A Uniform Vector Estimation Method Based on Historical Superposition and a Display Device

By obtaining the difference in image block motion vectors between the current video frame and the previous video frame, combining historical credibility and similarity, a method based on historical superposition is used to determine the uniform motion vector, which solves the problem of misjudgment in conventional motion estimation algorithms, and improves the recognition accuracy and video playback quality.

CN114051141BActive Publication Date: 2025-07-22SHANGHAI SJ ELECTRONIC TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111165565.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-09-30
Publication Date
2025-07-22
Estimated Expiration
2041-09-30

AI Technical Summary

Technical Problem

In the prior art, conventional motion estimation calculation methods cannot effectively ensure the characteristics of the uniform motion vector, resulting in frequent misjudgment phenomena, especially when identifying subtitles in video frames.

Method used

By obtaining the difference in image block motion vectors between the current video frame and the previous video frame, combining historical credibility and similarity, a method based on historical superposition is used to determine the uniform motion vector to reduce misjudgment.

Benefits of technology

It improves the accuracy of the identification of uniform motion vectors, reduces the probability of misjudgment, and ensures the smoothness of video playback and picture quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114051141B_ABST
    Figure CN114051141B_ABST
Patent Text Reader

Abstract

The present application provides a uniform motion vector estimation method and a display device based on historical superposition, which can reduce the misjudgment of the uniform motion vector to a certain extent, thereby improving the accuracy of identifying the uniform motion vector and ensuring the vector characteristics of the uniform motion vector.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of image processing technologies, and particularly to a uniform motion vector estimation method based on historical superposition and a display device using the same method. Background Art

[0002] Motion Estimation and Motion Compensation (MEMC) is a technology currently widely used in frame rate conversion. By estimating the motion trajectories of objects in consecutive moving images, and then combining the image data and the obtained motion vectors, intermediate images are interpolated, thereby improving the video frame rate and alleviating problems such as jitter and trailing during video playback.

[0003] Motion estimation is a very important part of frame rate conversion technology. Whether the prediction of the motion trajectory of an object is accurate directly determines the quality of the final interpolated image. Conventional motion estimation methods screen several candidate vectors and select the optimal vector as the final motion estimation result.

[0004] However, these candidate vectors cannot guarantee the characteristics of uniform motion vectors, and misjudgments of vectors will occur (random vectors are misjudged as uniform motion vectors or uniform motion vectors are misjudged as random vectors). For example, for subtitles in a video frame (including fixed subtitles, scrolling subtitles, flying subtitles, etc.), due to the inaccurate search for the uniform motion vector of the scrolling subtitles, there are many misjudged vectors, resulting in a flickering phenomenon. Summary of the Invention

[0005] In order to solve the problems existing in the prior art, the present application provides a uniform motion vector estimation method based on historical superposition and a display device using this method, which can reduce the misjudgment of uniform motion vectors to a certain extent, thereby improving the accuracy of identifying uniform motion vectors and ensuring the vector characteristics of uniform motion vectors.

[0006] In a first aspect, the present application provides a uniform motion vector estimation method based on historical superposition, including the following steps:

[0007] Obtain the motion vector of an image block in the current video frame, where the image block is any image block in the current video frame;

[0008] Determine the motion vector pointing to the image block in the previous video frame according to the motion vector of the image block in the current video frame;

[0009] Calculate the motion vector difference between the motion vector of the image block in the current video frame and the motion vector of the image block pointing to the previous video frame;

[0010] Determine the credibility of the image block in the current video frame according to the relationship between the motion vector difference and the motion vector difference threshold;

[0011] Determine whether the motion vector of the image block in the current video frame is a uniform motion vector according to the relationship between the credibility of the image block in the current video frame and the credibility threshold.

[0012] In a feasible manner, determining the credibility of the image block in the current video frame according to the relationship between the motion vector difference and the motion vector difference threshold specifically includes:

[0013] If the motion vector difference is less than the motion vector difference threshold, increase the target credibility on the historical credibility to obtain the credibility of the image block in the current video frame;

[0014] If the motion vector difference is not less than the motion vector difference threshold, reduce the target credibility on the historical credibility to obtain the credibility of the image block in the current video frame;

[0015] Wherein, the historical credibility is the credibility of the image block at the corresponding position of the image block in the current video frame in the previous video frame.

[0016] In a feasible manner, pre-store the corresponding relationship between the motion vector difference and the target credibility, and determine the target credibility corresponding to the motion vector difference according to the corresponding relationship.

[0017] In a feasible manner, the corresponding relationship includes a first corresponding relationship and a second corresponding relationship,

[0018] If the motion vector difference is less than the motion vector difference threshold, determine the target credibility corresponding to the motion vector difference according to the first corresponding relationship;

[0019] If the motion vector difference is not less than the motion vector difference threshold, determine the target credibility corresponding to the motion vector difference according to the second corresponding relationship.

[0020] In a feasible manner, determining whether the motion vector of the image block in the current video frame is a uniform motion vector according to the relationship between the credibility of the image block in the current video frame and the credibility threshold specifically includes:

[0021] If the credibility of the image block is greater than the credibility threshold, determine that the motion vector of the image block in the current video frame is a uniform motion vector;

[0022] If the credibility of the image block is not greater than the credibility threshold, determine that the motion vector of the image block in the current video frame is not a uniform motion vector.

[0023] In a feasible manner, the method further includes:

[0024] Calculating the similarity between the image block in the current video frame and the image block pointed to in the previous video frame;

[0025] Determining the credibility of the image block in the current video frame according to the relationship between the similarity and the similarity threshold and the relationship between the motion vector difference and the motion vector difference threshold.

[0026] In a feasible manner, determining the credibility of the image block in the current video frame according to the relationship between the similarity and the similarity threshold and the relationship between the motion vector difference and the motion vector difference threshold specifically includes:

[0027] If the motion vector difference is less than the motion vector difference threshold and the similarity is greater than the similarity threshold, determining the target credibility according to the first function relationship, and adding the target credibility to the historical credibility to obtain the credibility of the image block in the current video frame;

[0028] If the motion vector difference is less than the motion vector difference threshold and the similarity is not greater than the similarity threshold, determining the target credibility according to the second function relationship, and adding the target credibility to the historical credibility to obtain the credibility of the image block in the current video frame;

[0029] If the motion vector difference is not less than the motion vector difference threshold and the similarity is greater than the similarity threshold, determining the target credibility according to the third function relationship, and subtracting the target credibility from the historical credibility to obtain the credibility of the image block in the current video frame;

[0030] If the motion vector difference is not less than the motion vector difference threshold and the similarity is not greater than the similarity threshold, determining the target credibility according to the fourth function relationship, and subtracting the target credibility from the historical credibility to obtain the credibility of the image block in the current video frame;

[0031] Wherein, the function relationship is the function relationship between the motion vector difference and the target credibility, the slope of the first function relationship is greater than the slope of the second function relationship, the slope of the third function relationship is less than the slope of the fourth function relationship, and the historical credibility is the credibility of the image block at the corresponding position of the image block in the current video frame in the previous video frame.

[0032] The uniform motion vector estimation method based on historical superposition provided by the present application, after obtaining the motion vectors of each image block in the current video frame and the motion vectors of each image block in the previous video frame using a conventional motion estimation method, for any image block in the current video frame, determines whether its corresponding motion vector is a uniform motion vector through the method provided by the present application, which can reduce the misjudgment of the uniform motion vector to a certain extent, eliminate the interference of random vectors, and finally obtain a uniform motion vector with a relatively high accuracy rate.

[0033] In a second aspect, the present application provides an image processing device, including the following units:

[0034] An acquisition unit: configured to acquire the motion vector of an image block in the current video frame, where the image block is any image block in the current video frame;

[0035] A first determination unit: configured to determine the motion vector pointing to the image block in the previous video frame according to the motion vector of the image block in the current video frame;

[0036] A first calculation unit: configured to calculate the motion vector difference between the motion vector of the image block in the current video frame and the motion vector of the image block pointing to the previous video frame;

[0037] A second determination unit: configured to determine the credibility of the image block in the current video frame according to the relationship between the motion vector difference and the motion vector difference threshold;

[0038] A third determination unit: configured to determine whether the motion vector of the image block in the current video frame is a uniform motion vector according to the relationship between the credibility of the image block in the current video frame and the credibility threshold.

[0039] In a third aspect, the present application provides a display device, including:

[0040] A display for displaying video images;

[0041] A controller, coupled to the display, configured to implement the method steps described in any one of the first aspect when executed.

[0042] In a fourth aspect, the present application provides a computer-readable storage medium, in which a computer program is stored, and the computer program implements the method steps described in any one of the first aspect when executed by a processor.

[0043] In a fifth aspect, the present application further provides a computer program product, including a computer program, and the computer program implements the method steps described in any one of the first aspect when executed by a processor.

[0044] For the technical effects brought about by any one of the implementation manners from the second aspect to the fifth aspect provided in this application, reference may be made to the technical effects brought about by different implementation manners in the first aspect above, and details are not described herein again.

[0045] Other features and advantages of this application will be described in the following specification. Moreover, some of them will become apparent from the specification or be understood by implementing this application. The objectives and other advantages of this application can be achieved and obtained by the structures specifically pointed out in the written specification, claims, and drawings. Brief Description of the Drawings

[0046] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the accompanying drawings required for use in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other accompanying drawings can be obtained based on these drawings without creative efforts.

[0047] Figure 1 It is a schematic diagram of the application scenario of the display device provided in this application;

[0048] Figure 2 It is a hardware configuration block diagram of the control device 100 provided in this application;

[0049] Figure 3-1 It is a hardware configuration block diagram of the display device 200 provided in this application;

[0050] Figure 3-2 It is a hardware configuration block diagram of the video processor 260-1 provided in the application;

[0051] Figure 4 It is a functional configuration schematic diagram of the display device 200 provided in this application;

[0052] Figure 5 It is a schematic flowchart of a method for estimating a uniform motion vector based on historical superposition provided in this application;

[0053] Figure 6 It is a schematic diagram of an image block pointing to a previous video frame provided in this application;

[0054] Figure 7 It is a schematic diagram of a method for obtaining historical credibility provided in this application;

[0055] Figure 8 It is one of the schematic flowcharts of a method for estimating a uniform motion vector based on historical superposition provided in this application;

[0056] Figure 9The second flowchart diagram of a uniform motion vector estimation method based on historical superposition provided by this application;

[0057] Figure 10 The structural schematic diagram of an image processing device provided by this application. Detailed implementation manners

[0058] To make the objectives and implementation manners of this application clearer, the following will clearly and completely describe the exemplary implementation manners of this application with reference to the accompanying drawings in the exemplary embodiments of this application. Obviously, the described exemplary embodiments are only a part of the embodiments of this application, rather than all of the embodiments.

[0059] It should be noted that the brief descriptions of the terms in this application are only for facilitating the understanding of the subsequent described implementation manners, rather than intending to limit the implementation manners of this application. Unless otherwise specified, these terms should be understood in their ordinary and general meanings.

[0060] The terms "first", "second", "third", etc. in the description, claims and the above-mentioned drawings of this application are used to distinguish similar or the same kind of objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such terms can be interchanged under appropriate circumstances.

[0061] The terms "comprising" and "having" and any variations thereof are intended to cover but not exclusively include. For example, a product or device comprising a series of components does not necessarily have to be limited to all the clearly listed components, but may include other components not clearly listed or inherent to these products or devices.

[0062] The term "module" refers to any known or later-developed hardware, software, firmware, artificial intelligence, fuzzy logic or a combination of hardware or / and software code that can perform functions related to this element.

[0063] The frame rate of current mainstream movies is 24fps, the frame rate of TV programs is generally 25fps, and the refresh rate of mainstream display devices is 60Hz. Therefore, the MEMC function is generally available in current display devices to improve the frame rate of videos. MEMC can intelligently calculate the motion vectors of objects in continuous moving images based on the relationship between the front and back frames, and then interpolate intermediate images by combining the image data and the obtained motion vectors to make the picture actions smoother. It can be seen that the MEMC function can not only improve the frame rate of videos, but also improve the blurring or smearing in the pictures of sports events such as ball games or intense movements.

[0064] Motion estimation is a very crucial step in MEMC. The accuracy of predicting the motion trajectory of an object directly determines the quality of the final interpolated image. In the prior art, the conventional motion estimation method is to screen several candidate vectors and use the selected optimal vector as the final motion estimation result. However, these candidate vectors cannot guarantee the characteristics of a uniform motion vector, resulting in vector misjudgment and a low accuracy rate in identifying uniform motion vectors.

[0065] To solve the technical problems existing in the prior art, the embodiments of the present application provide a method for estimating a uniform motion vector based on historical superposition and a display device using this method. After obtaining the motion vectors of each image block in the current video frame and the motion vectors of each image block in the previous video frame by using the conventional motion estimation method, for any image block in the current video frame, the following method is used to determine whether its corresponding motion vector is a uniform motion vector: Obtain the motion vector of this image block in the current video frame, determine the motion vector of the image block pointed to in the previous video frame according to the motion vector of this image block in the current video frame, then calculate the motion vector difference between the motion vector of this image block in the current video frame and the motion vector of the image block pointed to in the previous video frame, determine the credibility of this image block in the current video frame according to the relationship between the motion vector difference and the motion vector difference threshold, and finally determine whether the motion vector of this image block in the current video frame is a uniform motion vector according to the relationship between the credibility of this image block and the credibility threshold. This method can reduce the misjudgment of uniform motion vectors to a certain extent, improve the accuracy of identifying uniform motion vectors, and ensure the vector characteristics of uniform motion vectors.

[0066] The method in the embodiments of the present application can be applied to display devices with video playback functions, such as smart TVs, smartphones, laptop computers, desktop computers, etc.

[0067] Figure 1 It is a schematic diagram of the application scenario of the display device provided by the embodiments of the present application. As Figure 1 shown, the user can operate the display device 200 through the mobile terminal 300 and the control device 100.

[0068] Among them, the control device 100 can be a remote control, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., to control the display device 200 wirelessly or by other wired methods. The user can input user instructions through buttons on the remote control, voice input, control panel input, etc. to control the display device 200. For example: The user can input corresponding control instructions through the volume increase / decrease keys, channel control keys, up / down / left / right movement keys, voice input key, menu key, power on / off key, etc. on the remote control to achieve the function of controlling the display device 200.

[0069] In some embodiments, a mobile terminal, a tablet computer, a computer, a laptop, and other smart devices may also be used to control the display device 200. For example, an application running on the smart device is used to control the display device 200. Through configuration, the application can provide various controls for the user in an intuitive user interface (UI) on the screen associated with the smart device.

[0070] Exemplarily, the mobile terminal 300 and the display device 200 may install software applications, and establish connection communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. For example, a control instruction protocol can be established between the mobile terminal 300 and the display device 200, and the remote control keyboard can be synchronized to the mobile terminal 300. By controlling the user interface on the mobile terminal 300, the function of controlling the display device 200 can be realized. Also, the audio and video content displayed on the mobile terminal 300 can be transmitted to the display device 200 to achieve the synchronous display function.

[0071] As Figure 1 As also shown in the figure, the display device 200 also performs data communication with the server 400 through various communication methods. The display device 200 is allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 can provide various contents and interactions to the display device 200. Exemplarily, the display device 200 receives software program updates or accesses a remotely stored digital media library by sending and receiving information, as well as through electronic program guide (EPG) interaction. The server 400 can be a group or multiple groups, and can be one type or multiple types of servers. Other network service contents such as video-on-demand and advertising services are provided through the server 400.

[0072] The display device 200 can be a smart TV, a smart phone, etc. The specific type of smart product, device model, etc. are not limited. Those skilled in the art can understand that the display device 200 can make some changes in performance and configuration according to needs.

[0073] In addition to providing the function of receiving broadcast television, the display device 200 can also additionally provide the function of a smart network TV that supports computer functions. Exemplarily, it includes network TV, smart TV, Internet Protocol TV (IPTV), etc.

[0074] Figure 2 This is the hardware configuration block diagram of the control device 100 provided by the embodiment of the present application. As Figure 2As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory 190, and a power supply 180. The control device 100 can receive the input operation instructions of the user and convert the operation instructions into instructions recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.

[0075] Figure 3-1 This is the hardware configuration block diagram of the display device 200 provided by the embodiment of the present application. As Figure 3-1 shown, the display device 200 includes a controller 210, a tuner demodulator 220, a communication interface 230, a detector 240, an input / output interface 250, a video processor 260-1, an audio processor 260-2, a display 280, an audio output 270, a memory 290, a power supply, and a user input interface.

[0076] The display 280 is a component for receiving the image signal input from the video processor 260-1 and displaying video content, images, and the menu control interface. The display 280 includes a display screen component for presenting the picture and a driving component for driving the image display. The displayed video content can come from broadcast television content, that is, various broadcast signals received through wired or wireless communication protocols. Or, it can display various image contents received from the network server through the network communication protocol.

[0077] At the same time, the display 280 also displays the user control UI interface generated in the display device 200 and used to control the display device 200.

[0078] In addition, depending on the type of the display 280, it also includes a driving component for driving the display. Or, if the display 280 is a projection display, it may further include a projection device and a projection screen.

[0079] The communication interface 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example: the communication interface 230 can be a Wifi module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233, or other network communication protocol modules or near-field communication protocol modules, as well as an infrared receiver (not shown in the figure).

[0080] The detector 240 is a signal for the display device 200 to collect the external environment or interact with the outside. The detector 240 includes a light receiver 242, a sensor for collecting the ambient light intensity, which can adaptively display parameter changes by collecting ambient light; or, the detector 240 includes an image collector 241, such as a camera, which can be used to collect the external environment scene, user attributes or user interaction gestures. Or, the detector 240 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0081] The input / output interface 250 controls data transmission between the display device 200 and other external devices under the control of the controller 210. Such as receiving data such as video signals, audio signals, or command instructions from external devices.

[0082] The tuner demodulator 220 receives radio and television signals through wired or wireless reception methods, and can perform modulation and demodulation processes such as amplification, mixing, and resonance, and demodulate the TV audio and video signals and EPG data signals carried in the user-selected TV channel frequency from multiple wireless or wired radio and television signals.

[0083] The tuner demodulator 220 can, according to user selection and under the control of the controller 210, respond to the TV signal frequency selected by the user and the TV signal carried by that frequency.

[0084] The video processor 260-1 is used to receive external video signals, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal, and can obtain signals that can be directly displayed or played on the display device 200.

[0085] Such as Figure 3-2 The hardware configuration block diagram of the video processor 260-1 shown, it can be seen from Figure 3-2 that the video processor 260-1 includes a demultiplexing module 260-11, a video decoding module 260-12, an image synthesis module 260-13, a MEMC module 260-14, a display formatting module 260-15, etc.

[0086] The audio processor 260-2 is used to receive external audio signals, and perform decompression, decoding, noise reduction, digital-to-analog conversion, and amplification processing, etc. according to the standard codec protocol of the input signal, to obtain sound signals that can be played in the speaker.

[0087] The audio output 270 receives the sound signal output by the audio processor 260-2 under the control of the controller 210, such as the speaker 272, and in addition to the speaker 272 carried by the display device 200 itself, the external audio output terminal 274 of the sound generating device that can be output to an external device, such as an external audio interface or a headphone interface, etc.

[0088] The power supply provides power supply support for the display device 200 by the power input from the external power supply under the control of the controller 210. The power supply can include a built-in power circuit installed inside the display device 200, or it can also be a power supply installed outside the display device 200, and a power interface for providing an external power supply in the display device 200.

[0089] The user input interface is used to receive the user's input signal, and then send the received user input signal to the controller 210. The user input signal can be a remote control signal received through an infrared receiver, and various user control signals can be received through the network communication module.

[0090] For example, the user inputs a user command through the remote control device 100 or the mobile terminal 300. The user input interface then, according to the user's input, the display device 200 responds to the user's input through the controller 210.

[0091] In some embodiments, the user can input a user command on the graphical user interface (GUI) displayed on the display 280, then the user input interface receives the user input command through the graphical user interface (GUI). Or, the user can input a user command by inputting a specific sound or gesture, then the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

[0092] The controller 210 controls the operation of the display device 200 and responds to the user's operations through various software control programs stored in the memory 290.

[0093] As Figure 3-1 shown, the controller 210 includes a RAM 213, a ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, such as the first interface 218-1 to the nth interface 218-n, and a communication bus. Among them, the RAM 213, the ROM 214, the graphics processor 216, the CPU processor 212, and the communication interface 218 are connected through the bus.

[0094] The ROM 214 is used to store instructions for various system startups. For example, when a power-on signal is received, the power supply of the display device 200 starts to boot up. The CPU processor 212 runs the system startup instructions in the ROM, copies the operating system stored in the memory 290 to the RAM 213, so as to start running the startup operating system. After the operating system startup is completed, the CPU processor 212 then copies various application programs in the memory 290 to the RAM 213, and then starts to run and start various application programs.

[0095] The graphics processor 216 is used to generate various graphic objects, such as icons, operation menus, and graphic displays of user input instructions, etc. It includes an arithmetic unit that performs operations by receiving various interactive instructions input by the user and displays various objects according to display attributes. And it includes a renderer that generates various objects obtained based on the arithmetic unit and displays the rendering results on the display 280.

[0096] The CPU processor 212 is used to execute the operating system and application program instructions stored in the memory 290. And according to various interactive instructions received from the outside, it executes various application programs, data, and content, so as to finally display and play various audio and video contents.

[0097] In some exemplary embodiments, the CPU processor 212 may include multiple processors. The multiple processors may include a main processor and multiple or one sub-processor. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode and / or display the operation of the screen in the normal mode. The multiple or one sub-processor is used to perform an operation in a standby mode or other states.

[0098] The controller 210 can control the overall operation of the display device 100. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 can perform operations related to the object selected by the user command.

[0099] Among them, the object can be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying a connection to a hyperlink page, document, image, etc., or performing an operation corresponding to the program of the icon. The user command for selecting the UI object can be an input command through various input devices (such as a mouse, keyboard, touchpad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.

[0100] The memory 290 includes various software modules stored for driving the display device 200. Such as: various software modules stored in the memory 290, including: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules, etc.

[0101] Among them, the basic module is a bottom-layer software module for signal communication between various hardware in the postpartum care display device 200 and for sending processing and control signals to the upper-layer module. The detection module is a management module for collecting various information from various sensors or user input interfaces, performing analog-to-digital conversion, and analyzing and managing.

[0102] For example: The voice recognition module includes a voice parsing module and a voice instruction database module. The display control module is a module for controlling the display 280 to display image content, and can be used to play multimedia image content, UI interface and other information. The communication module is a module for performing control and data communication with external devices. The browser module is a module for performing data communication between browsing servers. The service module is a module for providing various services and various application programs.

[0103] Meanwhile, the memory 290 is also used to store externally received data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects, etc.

[0104] Figure 4 It is a schematic diagram of the function configuration of the display device 200 provided by the embodiment of the present application. As Figure 4 shown, the memory 290 is used to store an operating system, application programs, content, user data, etc., and under the control of the controller 210, it executes the system operation of driving the display device 200 and responds to various operations of the user. The memory 290 may include volatile and / or non-volatile memory.

[0105] The memory 290 is specifically used to store the running program of the controller 210 in the display device 200, and to store various built-in application programs of the display device 200, various application programs downloaded by the user from external devices, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and various internal data supporting the applications. The memory 290 is used to store system software such as an OS kernel, middleware, and applications, and to store input video data, audio data, and other user data.

[0106] The memory 290 is specifically used to store driver programs and related data of the audio and video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuner demodulator 220, the input / output interfaces of the detector 240, etc.

[0107] In some embodiments, the memory 290 may store software and / or programs. Software programs representing an operating system (OS) include, for example, a kernel, middleware, an application programming interface (API), and / or application programs. Exemplarily, the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, API, or application programs), and the kernel may provide interfaces to allow the middleware and API, or applications to access the controller to implement the control or management of system resources.

[0108] Exemplarily, the memory 290 includes a broadcast reception module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external instruction recognition module 2907, a communication control module 2908, an optical reception module 2909, a power control module 2910, an operating system 2911, and other application programs 2912, a browser module, etc. The controller 210 executes various software programs in the memory 290 to perform functions such as: radio and television signal reception and demodulation function, television channel selection control function, volume selection control function, image control function, display control function, audio control function, external instruction recognition function, communication control function, optical signal reception function, power control function, a software control platform supporting various functions, and other applications such as a browser function.

[0109] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0110] Figure 5 The flowchart of a uniform motion vector estimation method based on historical superposition provided by the embodiments of the present application can be executed by the display device 200 shown in Figure 1 As shown in Figure 5 shown, the method includes the following steps:

[0111] Step S501: Obtain the motion vector of an image block in the current video frame, where the image block is any image block in the current video frame;

[0112] Step S502: Determine the motion vector pointing to the image block in the previous video frame according to the motion vector of the image block in the current video frame;

[0113] Step S503: Calculate the motion vector difference between the motion vector of the image block in the current video frame and the motion vector of the image block pointing to the previous video frame;

[0114] Step S504: Determine the credibility of the image block in the current video frame according to the relationship between the motion vector difference and the motion vector difference threshold;

[0115] Step S505: Determine whether the motion vector of the image block in the current video frame is a uniform motion vector according to the relationship between the credibility of the image block in the current video frame and the credibility threshold.

[0116] Before executing step S501, the display device needs to first determine the motion vectors of each image block in the previous video frame and the motion vectors of each image block in the current video frame according to a conventional motion estimation method. The conventional motion estimation method can be referred to the prior art, and specific limitations are not made herein.

[0117] The specific implementation of step S502 for determining the motion vector of the image block pointing to the image block in the previous video frame is illustrated by the following examples:

[0118] Figure 6 A schematic diagram of an image block pointing to the previous video frame provided by this application is as Figure 6 shown. Assume that it is necessary to determine the motion vector mv c ,y c ) of the image block (x c (vx c ,vy c ) in the current video frame pointing to the image block (x p ,y p ) in the previous video frame, and the specific method is as follows: p (vx p ,vy p ), specifically as follows:

[0119] x p = x c - vx c * ∆t (1)

[0120] y p = y c - vy c * ∆t (2)

[0121] Among them, ∆t is the time interval between two video frames. After calculating the position information x p and y p of the image block pointing to the previous video frame, the image block (x p ,y p ) pointing to the previous video frame and the motion vector mv p ,y p ) of the image block (x p (vx p ,vy p ) can be obtained.

[0122] One way to calculate the motion vector difference between the motion vector of the image block in the current video frame and the motion vector pointing to the image block in the previous video frame is as follows:

[0123] Motion vector mv p (vx p ,vy p ) and motion vector mv c (vx c ,vy c ) is calculated as follows:

[0124] Diff = | vx p - vx c | + | vy p - vy c | (3)

[0125] It should be noted that the above method for calculating the motion vector difference is only an example, and the present application does not limit the specific method for calculating the motion vector difference, which can be any method in the prior art.

[0126] Step S504 determines the credibility of the image block in the current video frame according to the relationship between the motion vector difference and the motion vector difference threshold, specifically including:

[0127] If the motion vector difference is less than the motion vector difference threshold, the credibility of the image block in the current video frame is obtained by adding the target credibility to the historical credibility;

[0128] If the motion vector difference is not less than the motion vector difference threshold, the credibility of the image block in the current video frame is obtained by subtracting the target credibility from the historical credibility;

[0129] Wherein, the historical credibility is the credibility of the image block corresponding to the position of the image block in the current video frame in the previous video frame.

[0130] Figure 7 is a schematic diagram of a method for obtaining historical credibility provided by the present application. As Figure 7 shown, the historical credibility of the image block A in the current video frame 11 is the credibility of the image block A in the previous video frame 11 .

[0131] In this application, the corresponding relationship between the motion vector difference and the target confidence can be pre-stored, and the target confidence corresponding to the motion vector difference is determined according to this corresponding relationship. This corresponding relationship can be represented in the form of a table or in the form of a function curve, which is not specifically limited in this article. At the same time, this corresponding relationship can be set according to actual experience, but it needs to satisfy the inverse relationship between the motion vector difference and the target confidence. For example, the larger the motion vector difference, the smaller the corresponding target confidence, indicating that the degree of considering the image block in the current video frame as a uniform motion vector is smaller.

[0132] In this application, according to the relationship between the motion vector difference and the motion vector difference threshold, the target confidence increased on the historical confidence and the target confidence decreased can be set to different values. For example, the corresponding relationship between the motion vector difference and the target confidence can be further divided into a first corresponding relationship and a second corresponding relationship.

[0133] If the motion vector difference is less than the motion vector difference threshold, the target confidence corresponding to the motion vector difference is determined according to the first corresponding relationship;

[0134] If the motion vector difference is not less than the motion vector difference threshold, the target confidence corresponding to the motion vector difference is determined according to the second corresponding relationship.

[0135] By setting different first and second corresponding relationships, the corresponding target confidence can be determined in different situations, making the method for obtaining the confidence of the image block in the current video frame in this application more flexible.

[0136] In addition, this application can further combine the similarity between image blocks to more precisely determine the target confidence of the image block in the current video frame, as follows:

[0137] Calculate the similarity between the image block in the current video frame and the image block pointing to the previous video frame;

[0138] According to the relationship between the similarity and the similarity threshold and the relationship between the motion vector difference and the motion vector difference threshold, determine the confidence of the image block in the current video frame, specifically including:

[0139] If the motion vector difference is less than the motion vector difference threshold and the similarity is greater than the similarity threshold, determine the target confidence according to the first function relationship, and increase the target confidence on the historical confidence to obtain the confidence of the image block in the current video frame;

[0140] If the difference of the motion vectors is less than the motion vector difference threshold, and the similarity is not greater than the similarity threshold, determine the target confidence according to the second functional relationship, and add the target confidence to the historical confidence to obtain the confidence of the image block in the current video frame;

[0141] If the difference of the motion vectors is not less than the motion vector difference threshold, and the similarity is greater than the similarity threshold, determine the target confidence according to the third functional relationship, and subtract the target confidence from the historical confidence to obtain the confidence of the image block in the current video frame;

[0142] If the difference of the motion vectors is not less than the motion vector difference threshold, and the similarity is not greater than the similarity threshold, determine the target confidence according to the fourth functional relationship, and subtract the target confidence from the historical confidence to obtain the confidence of the image block in the current video frame.

[0143] In this application, the slopes corresponding to the functional relationships need to satisfy: the slope k1 of the first functional relationship is greater than the slope k2 of the second functional relationship, and the slope k3 of the third functional relationship is less than the slope k4 of the fourth functional relationship, where the functional relationship represents the functional relationship between the difference of the motion vectors and the target confidence.

[0144] Step S505 determines whether the motion vector of the image block in the current video frame is a uniform motion vector according to the relationship between the confidence of the image block in the current video frame and the confidence threshold, which specifically includes:

[0145] If the confidence of the image block is greater than the confidence threshold, determine that the motion vector of the image block in the current video frame is a uniform motion vector;

[0146] If the confidence of the image block is not greater than the confidence threshold, determine that the motion vector of the image block in the current video frame is not a uniform motion vector.

[0147] After executing step S505, it can be determined whether the image block in the current video frame is a uniform motion vector.

[0148] It should be noted that the motion vector difference threshold, the confidence threshold, and the similarity threshold involved in the steps of this method are all set according to actual experience and are not specifically limited in this article.

[0149] Figure 8 One of the flow diagrams of a method for estimating a uniform motion vector based on historical superposition provided by an embodiment of this application includes the following steps:

[0150] Step S601: Divide the input video frame into M*N image blocks, and execute Step S602. For example, if the resolution of the input video frame is 1920*1080, it is divided into 240*135 image blocks.

[0151] Step S602: Obtain the motion vectors of each image block in the previous video frame and the motion vectors of each image block in the current video frame, and execute Step S603.

[0152] As described above, the motion vector of an image block can be obtained by any method in the prior art.

[0153] Step S603: Obtain the motion vector mv c ,y c ) of the image block (x c in the current video frame, where the image block (x c ,y c ) is any image block in the current video frame, and execute Step S604.

[0154] Step S604: Determine the motion vector mv c ,y c ) of the image block (x c in the current video frame, and determine the motion vector mv p ,y p ) in the previous video frame pointed to by it, and execute Step S605. p

[0155] Among them, for the determination of the position of the image block (x p ,y p ), reference can be made to the description above, and it will not be elaborated here.

[0156] Step S605: Calculate the motion vector difference between the motion vector mv p and the motion vector mv c , and execute Step S606.

[0157] Among them, for the determination of the motion vector difference, reference can be made to the description above, and it will not be elaborated here.

[0158] Step S606: Determine whether the motion vector difference is less than the motion vector difference threshold. If so, execute Step S607; if not, execute Step S608.

[0159] Among them, the motion vector difference threshold can be set according to actual experience.

[0160] Step S607: Increase the target credibility on the historical credibility to obtain the credibility of the image block (x c ,y c ) in the current video frame, and execute Step S609.​

[0161] Step S608: Reduce the target credibility from the historical credibility to obtain the credibility of the image block (x c , y c ) in the current video frame, and execute Step S609.

[0162] Regarding the specific value of the target credibility, this application provides multiple methods. For details, please refer to the previous description and will not be elaborated here.

[0163] Step S609: Determine whether the credibility of the image block (x c , y c ) in the current video frame is greater than the credibility threshold. If so, execute Step S610; if not, execute Step S611.

[0164] Among them, the credibility threshold is set according to actual experience.

[0165] Step S610: Determine that the motion vector mv c , y c ) of the image block (x c in the current video frame is a uniform motion vector. For example, the motion vector corresponding to the subtitle in the video frame is a uniform motion vector.

[0166] Step S611: Determine that the motion vector mv c , y c ) of the image block (x c in the current video frame is not a uniform motion vector.

[0167] Taking the image block (1, 1) in the video frame as an example below, assuming that the initial credibility value of the image block (1, 1) is 0, the motion vector difference threshold is 2, and the credibility threshold is 8, the specific details are as follows:

[0168] In the first frame, assuming that the motion vector difference of the image block (1, 1) is 0, at this time, comparing with the motion vector difference threshold, 0 < 2. Therefore, it is necessary to add the target credibility 4 to the historical credibility of the image block (1, 1), and the credibility of the image block (1, 1) in the first frame is 4 (0 + 4). By comparing with the credibility threshold, 4 < 8, it is determined that the motion vector of the image block (1, 1) is not a uniform motion vector.

[0169] In the second frame, assuming that the motion vector difference between the motion vector of the image block (1, 1) and the motion vector of the image block it points to in the first frame is 1, at this time, comparing with the motion vector difference threshold, 1 < 2. Therefore, it is necessary to add the target credibility 3 to the historical credibility of the image block (1, 1), and the credibility of the image block (1, 1) in the second frame is 7 (4 + 3). By comparing with the credibility threshold, 7 < 8, it is determined that the motion vector of the image block (1, 1) is not a uniform motion vector.

[0170] For the third frame, assume that the motion vector difference between the motion vector of image block (1, 1) and the motion vector of the image block it points to in the second frame is 1. At this time, comparing with the motion vector difference threshold, 1 < 2. Therefore, it is necessary to add the target credibility 3 to the historical credibility of image block (1, 1), and the credibility of image block (1, 1) in the third frame is obtained as 10 (7 + 3). By comparing with the credibility threshold, 10 > 8, it is determined that the motion vector of image block (1, 1) is a uniform motion vector.

[0171] For the fourth frame, assume that the motion vector difference between the motion vector of image block (1, 1) and the motion vector of the image block it points to in the third frame is 3. At this time, comparing with the motion vector difference threshold, 3 > 2. Therefore, it is necessary to subtract the target credibility 1 from the historical credibility of image block (1, 1), and the credibility of image block (1, 1) in the fourth frame is obtained as 9 (10 - 1). By comparing with the credibility threshold, 9 > 8, it is determined that the motion vector of image block (1, 1) is a uniform motion vector.

[0172] Overall, the target credibility satisfies the trend of decreasing as the motion vector difference increases. For the occasional occurrence of vector misjudgment (random vectors are misjudged as uniform motion vectors or uniform motion vectors are misjudged as random vectors), the method provided in this application will not immediately jump out of the historical basis, eliminates the interference of random vectors to a certain extent, effectively reduces the probability of vector misjudgment, and improves the accuracy of identifying uniform motion vectors.

[0173] Figure 9 This is the second flow chart of a method for estimating uniform motion vectors based on historical superposition provided by an embodiment of this application, which specifically includes the following steps:

[0174] Step S1101: Divide the input video frame into M * N image blocks, and execute step S1102.

[0175] Step S1102: Obtain the motion vectors of each image block in the previous video frame and the motion vectors of each image block in the current video frame, and execute step S1103.

[0176] Step S1103: Obtain the motion vector mv c , y c ) of the image block (x c , where the image block (x c , y c ) is any image block in the current video frame, and execute step S1104.

[0177] Step S1104: According to the motion vector mv of the image block (x c , y c ) in the current video framec , determine the motion vector mv p for the image block (x p , y p ) pointing to the previous video frame, and perform step S1105.

[0178] Step S1105: Calculate the motion vector difference between the motion vector mv p and the motion vector mv c , and perform step S1106.

[0179] Step S1106: Calculate the similarity between the image block (x c , y c ) in the current video frame and the image block (x p , y p ) pointing to the previous video frame, and perform step S1107.

[0180] Among them, the calculation method of the similarity can refer to the prior art and will not be specifically limited in this article.

[0181] Step S1107: Determine whether the motion vector difference is less than the motion vector difference threshold. If so, perform step S1108; if not, perform step S1114.

[0182] Step S1108: Determine whether the similarity is greater than the similarity threshold. If so, perform step S1109; if not, perform step S1110.

[0183] Among them, the similarity threshold is set according to actual experience.

[0184] Step S1109: Determine the target credibility according to the first functional relationship, and add this target credibility to the historical credibility to obtain the credibility of the image block (x c , y c ) in the current video frame, and perform step S1111.

[0185] Among them, the functional relationship is used to represent the relationship between the motion vector difference and the target credibility, and k1 is used to represent the slope of the first functional relationship.

[0186] Step S1110: Determine the target credibility according to the second functional relationship, and add this target credibility to the historical credibility to obtain the credibility of the image block (x c , y c ) in the current video frame, and perform step S1111.

[0187] Among them, k2 is used to represent the slope of the second functional relationship. Compared with the slope k1 of the first function in step S1109, k1 > k2.

[0188] Step S1111: Determine whether the credibility of the image block (x c , y c ) in the current video frame is greater than the credibility threshold. If so, execute Step S1112; if not, execute Step S1113.

[0189] Step S1112: Determine that the motion vector mv c , y c ) of the image block (x c in the current video frame is a uniform motion vector.

[0190] Step S1113: Determine that the motion vector mv c , y c ) of the image block (x c in the current video frame is not a uniform motion vector.

[0191] Step S1114: Determine whether the similarity is greater than the similarity threshold. If so, execute Step S1115; if not, execute Step S1116.

[0192] Step S1115: Determine the target credibility according to the third functional relationship, and reduce the target credibility from the historical credibility to obtain the credibility of the image block (x c , y c ) in the current video frame, and execute Step S1111.

[0193] Among them, k3 is used to represent the slope of the third functional relationship.

[0194] Step S1116: Determine the target credibility according to the fourth functional relationship, and reduce the target credibility from the historical credibility to obtain the credibility of the image block (x c , y c ) in the current video frame, and execute Step S1111.

[0195] Among them, k4 is used to represent the slope of the fourth functional relationship. Compared with the slope k3 corresponding to the third function in Step S1115, k4 > k3.

[0196] Taking the image block (1, 1) in the video frame as an example, assume that the initial value of the credibility of the image block (1, 1) is 0, the motion vector difference threshold is 2, the credibility threshold is 8, and the similarity threshold is 50. Specifically as follows:

[0197] For the first frame, assume that the motion vector difference of the image block (1,1) is 1 and the similarity is 80. At this time, comparing with the motion vector difference threshold, 1 < 2, and then comparing with the similarity threshold, 80 > 50. Then, according to the first functional relationship, it is determined that the image block (1,1) needs to add a target credibility of 4 to the historical credibility, and the credibility of the image block (1,1) in the first frame is obtained as 4 (0 + 4). By comparing with the credibility threshold, 4 < 8, it is determined that the motion vector of the image block (1,1) is not a uniform motion vector.

[0198] For the second frame, assume that the motion vector difference of the image block (1,1) is 1 and the similarity is 30. At this time, comparing with the motion vector difference threshold, 1 < 2, and then comparing with the similarity threshold, 30 < 50. Then, according to the second functional relationship, it is determined that the image block (1,1) needs to add a target credibility of 2 to the historical credibility, and the credibility of the image block (1,1) in the second frame is obtained as 6 (4 + 2). By comparing with the credibility threshold, 6 < 8, it is determined that the motion vector of the image block (1,1) is not a uniform motion vector.

[0199] At this time, it should be understood that the slope k1 corresponding to the first functional relationship is greater than the slope k2 corresponding to the second functional relationship. Therefore, for the first frame and the second frame, when the motion vector differences of both are 1 and both are less than the motion vector difference threshold, the corresponding target credibilities are different. The target credibility corresponding to the slope k1 is 4, and the target credibility corresponding to the slope k2 is 2. It can be seen that 4 > 2, that is, k1 > k2.

[0200] For the third frame, assume that the motion vector difference of the image block (1,1) is 5 and the similarity is 80. At this time, comparing with the motion vector difference threshold, 5 > 2, and then comparing with the similarity threshold, 80 > 50. Then, according to the third functional relationship, it is determined that the image block (1,1) needs to reduce the target credibility by 0.5 on the historical credibility, and the credibility of the image block (1,1) in the third frame is obtained as 5.5 (6 - 0.5). By comparing with the credibility threshold, 5.5 < 8, it is determined that the motion vector of the image block (1,1) is not a uniform motion vector.

[0201] For the fourth frame, assume that the motion vector difference of the image block (1,1) is 5 and the similarity is 30. At this time, comparing with the motion vector difference threshold, 5 > 2, and then comparing with the similarity threshold, 30 < 50. Then, according to the fourth functional relationship, it is determined that the image block (1,1) needs to reduce the target credibility by 1 on the historical credibility, and the credibility of the image block (1,1) in the fourth frame is obtained as 4.5 (5.5 - 1). By comparing with the credibility threshold, 4.5 < 8, it is determined that the motion vector of the image block (1,1) is not a uniform motion vector.

[0202] It should be understood at this time that the slope k3 corresponding to the third functional relationship is less than the slope k4 corresponding to the fourth functional relationship. Therefore, for the third frame and the fourth frame, when the motion vector difference between the two is 5, which is greater than the motion vector difference threshold, the corresponding target credibility of the two is different. The target credibility corresponding to the slope k3 is 0.5, and the target credibility corresponding to the slope k4 is 1. It can be seen that 0.5 < 1, that is, k3 < k4.

[0203] In addition, overall, the target credibility satisfies the trend of decreasing as the motion vector difference increases.

[0204] A uniform motion vector estimation method based on historical superposition and a display device using the method provided by the present application. After obtaining the motion vectors of each image block in the current frame and the motion vectors of each image block in the previous frame according to the motion estimation algorithm in the prior art, calculate the motion vector difference between the motion vector of the image block in the current frame and the motion vector of the image block pointed to in the previous video frame, determine the credibility of the image block in the current frame, and then determine whether the motion vector of the image block in the current frame is a uniform motion vector according to the relationship between the credibility and the credibility threshold. For the accidental occurrence of vector misjudgment (random vectors are misjudged as uniform motion vectors or uniform motion vectors are misjudged as random vectors), it will not immediately jump out of the historical basis, to a certain extent excluding the interference of random vectors, effectively reducing the probability of vector misjudgment, improving the accuracy of identifying uniform motion vectors, ensuring the vector characteristics of uniform motion vectors, and enabling the display device to have a better display effect.

[0205] Based on the same inventive concept, an image processing device is also provided in an embodiment of the present application, as Figure 10 shown. The device 1200 includes:

[0206] An acquisition unit 1201: configured to acquire the motion vector of an image block in the current video frame, where the image block is any image block in the current video frame;

[0207] A first determination unit 1202: configured to determine the motion vector of the image block pointed to in the previous video frame according to the motion vector of the image block in the current video frame;

[0208] A first calculation unit 1203: configured to calculate the motion vector difference between the motion vector of the image block in the current video frame and the motion vector of the image block pointed to in the previous video frame;

[0209] A second determination unit 1204: configured to determine the credibility of the image block in the current video frame according to the relationship between the motion vector difference and the motion vector difference threshold;

[0210] The third determination unit 1205: configured to determine whether the motion vector of the image block in the current video frame is a uniform motion vector according to the relationship between the credibility of the image block in the current video frame and the credibility threshold.

[0211] Among them, the second determination unit 1204 specifically includes:

[0212] If the motion vector difference is less than the motion vector difference threshold, increase the target credibility on the historical credibility to obtain the credibility of the image block in the current video frame;

[0213] If the motion vector difference is not less than the motion vector difference threshold, reduce the target credibility on the historical credibility to obtain the credibility of the image block in the current video frame;

[0214] Among them, the historical credibility is the credibility of the image block corresponding to the position of the image block in the current video frame in the previous video frame.

[0215] Furthermore, the corresponding relationship between the motion vector difference and the target credibility is pre-stored, and the target credibility corresponding to the motion vector difference is determined according to the corresponding relationship.

[0216] Furthermore, the corresponding relationship includes a first corresponding relationship and a second corresponding relationship.

[0217] If the motion vector difference is less than the motion vector difference threshold, determine the target credibility corresponding to the motion vector difference according to the first corresponding relationship;

[0218] If the motion vector difference is not less than the motion vector difference threshold, determine the target credibility corresponding to the motion vector difference according to the second corresponding relationship.

[0219] Among them, the third determination unit 1205 specifically includes:

[0220] If the credibility of the image block is greater than the credibility threshold, determine that the motion vector of the image block in the current video frame is a uniform motion vector;

[0221] If the credibility of the image block is not greater than the credibility threshold, determine that the motion vector of the image block in the current video frame is not a uniform motion vector.

[0222] In addition, the apparatus 1200 further includes a second calculation unit 1206 and a fourth determination unit 1207.

[0223] The second calculation unit 1206: configured to calculate the similarity between the image block in the current video frame and the image block pointed to in the previous video frame.

[0224] Fourth determination unit 1207: configured to determine the credibility of the image block in the current video frame according to the relationship between the similarity and the similarity threshold and the relationship between the motion vector difference and the motion vector difference threshold.

[0225] Wherein, the fourth determination unit 1207 specifically includes:

[0226] If the motion vector difference is less than the motion vector difference threshold and the similarity is greater than the similarity threshold, determine the target credibility according to the first function relationship, and add the target credibility to the historical credibility to obtain the credibility of the image block in the current video frame;

[0227] If the motion vector difference is less than the motion vector difference threshold and the similarity is not greater than the similarity threshold, determine the target credibility according to the second function relationship, and add the target credibility to the historical credibility to obtain the credibility of the image block in the current video frame;

[0228] If the motion vector difference is not less than the motion vector difference threshold and the similarity is greater than the similarity threshold, determine the target credibility according to the third function relationship, and subtract the target credibility from the historical credibility to obtain the credibility of the image block in the current video frame;

[0229] If the motion vector difference is not less than the motion vector difference threshold and the similarity is not greater than the similarity threshold, determine the target credibility according to the fourth function relationship, and subtract the target credibility from the historical credibility to obtain the credibility of the image block in the current video frame;

[0230] Wherein, the function relationship is the function relationship between the motion vector difference and the target credibility, the slope of the first function relationship is greater than the slope of the second function relationship, the slope of the third function relationship is less than the slope of the fourth function relationship, and the historical credibility is the credibility of the image block corresponding to the position of the image block in the previous video frame in the current video frame.

[0231] Based on the same inventive concept, an embodiment of the present application further provides a computer-readable non-volatile storage medium, including program codes, when the program codes run on a display device, the program codes are used to cause the display device to execute the steps of any one of the above-mentioned uniform vector estimation methods based on historical superposition.

[0232] Based on the same inventive concept, the present application further provides a computer program product, including a computer program, when the computer program is executed by a processor, the steps of any one of the above-mentioned uniform vector estimation methods based on historical superposition are implemented.

[0233] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0234] The present application is described with reference to the flowcharts and / or block diagrams of methods, apparatuses (systems), and computer program products according to the present application. It should be understood that each flow and / or block in the flowchart and / or block diagram, and the combination of flows and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing devices generate means for implementing the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0235] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory generate a manufactured article including instruction means that implement the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0236] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0237] Obviously, those skilled in the art can make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these modifications and variations.

Claims

1. A method for estimating a uniform motion vector based on historical superposition, characterized in that The method includes: Obtaining a motion vector of an image block in a current video frame, where the image block is any image block in the current video frame; Determining, according to the motion vector of the image block in the current video frame, a motion vector of the image block in a previous video frame pointed to by the motion vector of the image block in the current video frame; Calculating a motion vector difference between the motion vector of the image block in the current video frame and the motion vector of the image block in the previous video frame pointed to by the motion vector of the image block in the current video frame; If the motion vector difference is less than a motion vector difference threshold, increasing a target credibility on a historical credibility to obtain the credibility of the image block in the current video frame; if the motion vector difference is not less than the motion vector difference threshold, reducing the target credibility on the historical credibility to obtain the credibility of the image block in the current video frame; where the historical credibility is the credibility of the image block at a corresponding position of the image block in the current video frame in the previous video frame; Determining whether the motion vector of the image block in the current video frame is a uniform motion vector according to a relationship between the credibility of the image block in the current video frame and a credibility threshold; 2. The method according to claim 1, wherein Pre-storing a corresponding relationship between the motion vector difference and the target credibility, and determining the target credibility corresponding to the motion vector difference according to the corresponding relationship; 3. The method according to claim 2, wherein The corresponding relationship includes a first corresponding relationship and a second corresponding relationship. If the motion vector difference is less than the motion vector difference threshold, determining the target credibility corresponding to the motion vector difference according to the first corresponding relationship; If the motion vector difference is not less than the motion vector difference threshold, determining the target credibility corresponding to the motion vector difference according to the second corresponding relationship; 4. The method according to claim 1, wherein Determining whether the motion vector of the image block in the current video frame is a uniform motion vector according to a relationship between the credibility of the image block in the current video frame and a credibility threshold specifically includes: If the credibility of the image block is greater than the credibility threshold, determining that the motion vector of the image block in the current video frame is a uniform motion vector; If the credibility of the image block is not greater than the credibility threshold, determining that the motion vector of the image block in the current video frame is not a uniform motion vector; 5. A method for estimating a uniform motion vector based on historical superposition, characterized in that, The method further includes: Obtaining a motion vector of an image block in a current video frame, where the image block is any image block in the current video frame; Determining, according to the motion vector of the image block in the current video frame, a motion vector of the image block in a previous video frame pointed to by the motion vector of the image block in the current video frame; Calculating a motion vector difference between the motion vector of the image block in the current video frame and the motion vector of the image block in the previous video frame pointed to by the motion vector of the image block in the current video frame; Calculating a similarity between the image block in the current video frame and the image block in the previous video frame pointed to by the motion vector of the image block in the current video frame; Determine the credibility of the image block in the current video frame according to the relationship between the similarity and the similarity threshold and the relationship between the motion vector difference and the motion vector difference threshold; Determine the credibility of the image block in the current video frame according to the relationship between the similarity and the similarity threshold and the relationship between the motion vector difference and the motion vector difference threshold, specifically including: If the motion vector difference is less than the motion vector difference threshold and the similarity is greater than the similarity threshold, determine the target credibility according to the first function relationship, and increase the target credibility on the historical credibility to obtain the credibility of the image block in the current video frame; If the motion vector difference is less than the motion vector difference threshold and the similarity is not greater than the similarity threshold, determine the target credibility according to the second function relationship, and increase the target credibility on the historical credibility to obtain the credibility of the image block in the current video frame; If the motion vector difference is not less than the motion vector difference threshold and the similarity is greater than the similarity threshold, determine the target credibility according to the third function relationship, and decrease the target credibility on the historical credibility to obtain the credibility of the image block in the current video frame; If the motion vector difference is not less than the motion vector difference threshold and the similarity is not greater than the similarity threshold, determine the target credibility according to the fourth function relationship, and decrease the target credibility on the historical credibility to obtain the credibility of the image block in the current video frame; Wherein, the function relationship is the function relationship between the motion vector difference and the target credibility, and the historical credibility is the credibility of the image block corresponding to the position of the image block in the previous video frame in the current video frame; Determine whether the motion vector of the image block in the current video frame is a uniform motion vector according to the relationship between the credibility of the image block in the current video frame and the credibility threshold.

6. An image processing apparatus, characterized in that, Including: An acquisition unit: used to acquire the motion vector of the image block in the current video frame, where the image block is any image block in the current video frame; A first determination unit: used to determine the motion vector of the image block in the previous video frame pointed to by the motion vector of the image block in the current video frame according to the motion vector of the image block in the current video frame; A first calculation unit: used to calculate the motion vector difference between the motion vector of the image block in the current video frame and the motion vector of the image block in the previous video frame pointed to by the motion vector of the image block in the current video frame; A second determination unit: used to increase the target credibility on the historical credibility to obtain the credibility of the image block in the current video frame when the motion vector difference is less than the motion vector difference threshold; used to decrease the target credibility on the historical credibility to obtain the credibility of the image block in the current video frame when the motion vector difference is not less than the motion vector difference threshold; wherein, the historical credibility is the credibility of the image block corresponding to the position of the image block in the previous video frame in the current video frame; A third determination unit: configured to determine whether the motion vector of the image block in the current video frame is a uniform motion vector according to the relationship between the credibility of the image block in the current video frame and a credibility threshold.

7. A display device, characterized in that, Comprising: A display for displaying video images; A controller coupled to the display and configured to implement the method steps recited in any one of claims 1-5 when executed.

8. A computer-readable storage medium, characterized in that, A computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method steps recited in any one of claims 1-5 are implemented.

Citation Information

Patent Citations

  • Method and system for carrying out reliability classification on motion vector in video

    CN101833768A

  • Interpolation frame generating method applied to up-conversion of video frame rate

    CN103702128A