Display device and image processing method

Abstract

Embodiments provided by the present application belong to the display technology, and provide a display device, an image processing method and apparatus. The display device includes a display, a camera for capturing an image, and a processor connected to the display. The processor is configured to determine whether to correct the base color ratio of the image output by the camera when the distance between the shooting target and the camera is less than a first threshold. If so, according to the base color ratio, determine the correction weights corresponding to each base color, and control the display to output an image according to the correction weights. The present application can greatly improve the quality of the output image, thereby ensuring that the image color is not distorted.

Description

Technical Field

[0001] This application relates to image processing technology. More specifically, it relates to a display device, an image processing method, and an apparatus. Background Art

[0002] With the continuous progress of science and technology, display devices are integrating more and more functions and developing towards the direction of intelligence. Functions such as large-screen video calls, face recognition, motion-sensing games, and artificial intelligence (AI) fitness are gradually applied in display devices, and the realization of these functions is inseparable from cameras, which assist in realizing the intelligence of display devices through the image acquisition function of the cameras.

[0003] When the shooting target is relatively close to the camera of the display device, the display device will irradiate light on the shooting target, and the light reflected by the shooting target will cause obvious interference to the imaging of the camera. For a display device with a large screen such as a television, when the light intensity of the light emitted by the display device is strong, when the display device displays the image obtained by the camera, there is a situation of image color distortion (such as being reddish). Summary of the Invention

[0004] Exemplary embodiments of this application provide a display device, an image processing method, and an apparatus, which can greatly improve the quality of the output image and thus ensure that the image color is not distorted.

[0005] In a first aspect, an embodiment of this application provides a display device, including:

[0006] A display;

[0007] A camera for taking images;

[0008] A processor connected to the display, and the processor is configured to:

[0009] When the distance between the shooting target and the camera is less than a first threshold, determine whether to correct the base color ratio of the image output by the camera;

[0010] If so, determine the correction weight corresponding to each base color according to the base color ratio;

[0011] Control the display to output an image according to the correction weight.

[0012] In some possible implementations, when the processor is used to determine whether to correct the base color ratio of the image output by the camera, it is specifically used to: compare the base color ratio of the image output by the camera with the base color ratio of a reference image, where the reference image is an image with a standard base color ratio in the same color temperature environment as the image output by the camera; if the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is greater than a second threshold, determine to correct the base color ratio of the image output by the camera; if the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is less than or equal to the second threshold, determine not to correct the base color ratio of the image output by the camera.

[0013] In some possible implementations, when the processor is used to determine the correction weight corresponding to each base color according to the base color ratio, it is specifically used to: determine the correction weight corresponding to each base color according to the difference between the base color ratio and the base color ratio of the reference image, where the reference image is an image with a standard base color ratio in the same color temperature environment as the image output by the camera.

[0014] In some possible implementations, when the processor is used to control the display to output an image according to the correction weight, it is specifically used to: send the correction weight to the camera so that the camera performs dynamic color matrix correction on the output image; control the display to output the image from the camera after dynamic color matrix correction.

[0015] In some possible implementations, when the processor is used to control the display to output an image according to the correction weight, it is specifically used to: correct the image parameters of the filter according to the correction weight; control the display to output the corrected image.

[0016] In some possible implementations, the processor is further configured to: determine the distance according to at least one frame of image output by the camera, where the image includes a shooting target.

[0017] In some possible implementations, when the processor is used to determine the distance according to at least one frame of image output by the camera, it is specifically used to: respectively extract the feature maps of the shooting target in each frame of image; determine the proportion of the feature map of the shooting target in the corresponding image; determine the distance according to the proportion.

[0018] In some possible implementations, when the processor is used to determine the distance according to at least one frame of image output by the camera, it is specifically used to: determine the distance through a distance sensor.

[0019] In a second aspect, an embodiment of the present application provides an image processing method applied to a display device, and the image processing method includes:

[0020] When the distance between the shooting target and the camera is less than a first threshold, determine whether to correct the base color ratio of the image output by the camera;

[0021] If so, determine the correction weight corresponding to each primary color according to the primary color ratio.

[0022] Control the display to output an image according to the correction weight.

[0023] In some possible implementation manners, determining whether to correct the primary color ratio of the image output by the camera includes: comparing the primary color ratio of the image output by the camera with the primary color ratio of a reference image, where the reference image is an image with a standard primary color ratio in the same color temperature environment as the image output by the camera; if the difference between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is greater than a second threshold, determine to correct the primary color ratio of the image output by the camera; if the difference between the primary color ratio of the image output by the camera and the primary color ratio of the reference image is less than or equal to the second threshold, determine not to correct the primary color ratio of the image output by the camera.

[0024] In some possible implementation manners, determining the correction weight corresponding to each primary color according to the primary color ratio includes: determining the correction weight corresponding to each primary color according to the difference between the primary color ratio and the primary color ratio of the reference image, where the reference image is an image with a standard primary color ratio in the same color temperature environment as the image output by the camera.

[0025] In some possible implementation manners, controlling the display to output an image according to the correction weight includes: sending the correction weight to the camera so that the camera performs dynamic color matrix correction on the output image; controlling the display to output the image from the camera after dynamic color matrix correction.

[0026] In some possible implementation manners, controlling the display to output an image according to the correction weight includes: correcting the image parameters of the filter according to the correction weight; controlling the display to output the corrected image.

[0027] In some possible implementation manners, the image processing method further includes: determining a distance according to at least one frame of image output by the camera, where the image includes a shooting target.

[0028] In some possible implementation manners, determining a distance according to at least one frame of image output by the camera includes: respectively extracting the feature maps of the shooting target in each frame of image; determining the proportion of the feature map of the shooting target in the corresponding image; determining the distance according to the proportion.

[0029] In some possible implementation manners, determining a distance according to at least one frame of image output by the camera includes: determining the distance through a distance sensor.

[0030] In a third aspect, an embodiment of the present application provides an image processing apparatus, which is applied to a display device. The image processing apparatus includes:

[0031] A first determination module, configured to determine whether to correct the base color ratio of the image output by the camera when the distance between the shooting target and the camera is less than a first threshold;

[0032] A processing module, configured to, if so, determine the correction weights corresponding to the respective base colors according to the base color ratio;

[0033] A control module, configured to control the display to output an image according to the correction weights.

[0034] In some possible implementation manners, the first determination module is specifically configured to: compare the base color ratio of the image output by the camera with the base color ratio of a reference image, where the reference image is an image with a standard base color ratio in the same color temperature environment as the image output by the camera; if the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is greater than a second threshold, determine to correct the base color ratio of the image output by the camera; if the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is less than or equal to the second threshold, determine not to correct the base color ratio of the image output by the camera.

[0035] In some possible implementation manners, the processing module is specifically configured to: determine the correction weights corresponding to the respective base colors according to the difference between the base color ratio and the base color ratio of the reference image, where the reference image is an image with a standard base color ratio in the same color temperature environment as the image output by the camera.

[0036] In some possible implementation manners, the control module is specifically configured to: send the correction weights to the camera so that the camera performs dynamic color matrix correction on the output image; control the display to output the image of the camera after dynamic color matrix correction.

[0037] In some possible implementation manners, the control module is specifically configured to: correct the image parameters of the filter according to the correction weights; control the display to output the corrected image.

[0038] In some possible implementation manners, the image processing apparatus further includes a second determination module, configured to determine the distance according to at least one frame of image output by the camera, where the image includes a shooting target.

[0039] In some possible implementation manners, the second determination module is specifically configured to: respectively extract the feature maps of the shooting target in each frame of image; determine the proportion of the feature map of the shooting target in the corresponding image; and determine the distance according to the proportion.

[0040] In some possible implementation manners, the second determination module is specifically configured to: determine the distance through a distance sensor.

[0041] Fourthly, an embodiment of the present application provides a computer-readable storage medium, in which computer program instructions are stored. When the computer program instructions are executed, any image processing method described in the second aspect of the present application is implemented.

[0042] Fifthly, an embodiment of the present application provides a computer program product, including a computer program, which when executed by a processor implements any image processing method described in the second aspect of the present application.

[0043] For the display device, image processing method and device provided by the present application, when the distance between the shooting target and the camera is less than the first threshold, it is determined whether to correct the base color ratio of the image output by the camera. If so, according to the base color ratio, the correction weights corresponding to each base color are determined, and according to the correction weights, the display is controlled to output an image. Since the present application can correct the base color ratio of the image output by the camera according to the correction weights corresponding to each base color and output the corrected image, the quality of the output image can be greatly improved, and thus the image color can be ensured not to be distorted.

[0044] These and other aspects of the present application will become more apparent and understandable in the following description of the (multiple) embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the embodiments of the present application or the implementation manners in the related art, the following will briefly introduce the drawings required to be used in the description of the embodiments or the related art. Obviously, the following drawings are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings.

[0046] Figure 1 It is a schematic diagram of the interaction scenario between the display device and the camera provided by an embodiment of the present application;

[0047] Figure 2 It is a hardware configuration block diagram of the display device provided by an embodiment of the present application;

[0048] Figure 3 It is a schematic diagram of the software system of the display device provided by an embodiment of the present application;

[0049] Figure 4 It is a flowchart of the image processing method provided by an embodiment of the present application;

[0050] Figure 5 It is a flowchart of the image processing method provided by another embodiment of the present application;

[0051] Figure 6 It is a schematic structural diagram of the image processing device provided by an embodiment of the present application;

[0052] Figure 7 The structural schematic diagram of the image processing device provided by another embodiment of the present application. Detailed implementation manners

[0053] To make the objectives, implementation manners, and advantages of the present application clearer, the following will clearly and completely describe the exemplary implementation manners of the present application with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only a part of the embodiments of the present application, rather than all the embodiments.

[0054] Based on the exemplary embodiments described in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope protected by the appended claims of the present application. In addition, although the disclosed content in the present application is introduced according to one or several exemplary instances, it should be understood that each aspect of these disclosed contents can also constitute a complete implementation manner alone.

[0055] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the subsequent described implementation manners, rather than intending to limit the implementation manners of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.

[0056] The terms "first", "second", "third", etc. in the specification, claims, and the above-mentioned drawings of the present application are used to distinguish similar or like objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise indicated (Unless otherwise indicated). It should be understood that such terms can be interchanged under appropriate circumstances, for example, can be implemented in an order other than those given in the illustration or description of the embodiments of the present application.

[0057] In addition, the terms "comprising" and "having" and any variations thereof are intended to cover but not exclude inclusion. For example, a product or device including a series of components does not necessarily have to be limited to those clearly listed components, but may include other components not clearly listed or inherent to these products or devices.

[0058] The term "module" used in the present application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or a combination of hardware or / and software codes that can perform functions related to the element.

[0059] As used in this application, the term "remote control" refers to a component of an electronic device (such as the display device disclosed in this application), which can generally wirelessly control the electronic device within a relatively short distance range. It is generally connected to the electronic device using infrared and / or radio frequency (RF) signals and / or Bluetooth, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example: a handheld touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface on a touch screen.

[0060] As used in this application, the term "gesture" refers to a user behavior in which a user expresses an intended idea, action, purpose, and / or result through a change in hand shape or a hand movement, etc.

[0061] Figure 1 FIG. is a schematic diagram of an interaction scenario between a display device and a camera provided in an embodiment of this application. As Figure 1 shown, the display device 200 displays a user image obtained by the camera 100.

[0062] As Figure 1 also shown, the display device 200 also communicates with the server 400 through various communication methods for data communication. The display device 200 is allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 can provide various contents and interactions to the display device 200. By way of example, the display device 200 receives software program updates or accesses a remotely stored digital media library by sending and receiving information, as well as electronic program guide (EPG) interactions. The server 400 can be a cluster or multiple clusters, and can include one or more types of servers. Other network service contents such as video-on-demand and advertising services are provided through the server 400.

[0063] The display device 200 can be a liquid crystal display, an OLED display, or a projection display device. The specific type, size, and resolution of the display device are not limited. Those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as needed.

[0064] In addition to providing the function of receiving broadcast television, the display device 200 can also additionally provide the function of an intelligent network television that supports computer functions, including but not limited to, network television, smart television, Internet protocol television (IPTV), etc.

[0065] Figure 2 FIG. is a block diagram of the hardware configuration of a display device provided in an embodiment of this application. As Figure 2As shown, in some embodiments, the display device 200 includes at least one of a controller 250, a tuner-demodulator 210, a communicator 220, a detector 230, an input / output interface 255, a display 275, an audio output interface 285, a memory 260, a power supply 290, a user interface 265, and an external device interface 240.

[0066] In some embodiments, the display 275 is a component for receiving an image signal output from a first processor and displaying video content, images, and a menu control interface.

[0067] In some embodiments, the display 275 includes a display screen component for presenting a picture and a driving component for driving image display.

[0068] In some embodiments, the displayed video content can come from broadcast television content, that is, various broadcast signals that can be received through wired or wireless communication protocols. Or, various image contents sent from a network server side received through a network communication protocol can be displayed.

[0069] In some embodiments, the display 275 is used to present a user control UI interface generated in the display device 200 and used to control the display device 200.

[0070] In some embodiments, according to the type of the display 275, a driving component for driving the display is further included.

[0071] In some embodiments, the display 275 is a projection display, and may further include a projection device and a projection screen.

[0072] In some embodiments, the communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communicator may include at least one of a Wifi chip, a Bluetooth communication protocol chip, a wired Ethernet communication protocol chip and other network communication protocol chips or a near field communication protocol chip, and an infrared receiver.

[0073] In some embodiments, the display device 200 can establish sending and receiving of control signals and data signals with an external control device or a content providing device through the communicator 220.

[0074] In some embodiments, the user interface 265 can be used to receive an infrared control signal of a control device (such as an infrared remote controller, etc.).

[0075] In some embodiments, the detector 230 is for the display device 200 to collect signals of the external environment or for external interaction.

[0076] In some embodiments, the detector 230 includes a light receiver, a sensor for collecting the ambient light intensity, and can adaptively display parameter changes by collecting ambient light.

[0077] In some embodiments, the detector 230 may further include an image collector, such as a camera, a webcam, etc., which can be used to collect the external environmental scene, as well as to collect the user's attributes or interaction gestures with the user, can adaptively change the display parameters, and can also recognize the user's gestures to implement the function of interacting with the user.

[0078] In some embodiments, the detector 230 may further include a temperature sensor, etc., such as by sensing the ambient temperature.

[0079] In some embodiments, the display device 200 can adaptively adjust the display color temperature of the image. For example, in an environment with a relatively high temperature, the display device 200 can be adjusted to display an image with a cooler color temperature, or in an environment with a relatively low temperature, the display device 200 can be adjusted to display an image with a warmer color temperature.

[0080] In some embodiments, the detector 230 may also include a sound collector, such as a microphone, which can be used to receive the user's voice. Exemplarily, it includes the voice signal of the control instruction for the user to control the display device 200, or collects the ambient sound for identifying the type of the ambient scene, so that the display device 200 can adapt to the ambient noise.

[0081] In some embodiments, such as Figure 2 As shown, the input / output interface 255 is configured to enable data transmission between the controller 250 and other external devices or other controllers 250. Such as receiving the video signal data, audio signal data, or command instruction data of the external device.

[0082] In some embodiments, the external device interface 240 may include, but is not limited to: any one or more of the high-definition multimedia interface HDMI interface, analog or data high-definition component input interface, composite video input interface, USB input interface, Red Green Blue (RGB) port, etc. It can also be a composite input / output interface formed by the above multiple interfaces.

[0083] In some embodiments, such as Figure 2 As shown, the tuner demodulator 210 is configured to receive the broadcast television signal through wired or wireless reception, and can perform modulation and demodulation processes such as amplification, mixing, and resonance, and demodulate the audio and video signals from multiple wireless or wired broadcast television signals. The audio and video signals may include the television audio and video signals carried in the television channel frequency selected by the user, as well as the EPG data signal.

[0084] In some embodiments, the frequency points demodulated by the tuner-demodulator 210 are controlled by the controller 250, and the controller 250 can issue control signals according to user selections, so that the modem responds to the TV signal frequency selected by the user and modulates and demodulates the TV signal carried by the frequency.

[0085] In some embodiments, broadcast TV signals can be classified into terrestrial broadcast signals, cable broadcast signals, satellite broadcast signals, or Internet broadcast signals, etc. according to different TV signal broadcast standards. Or they can be classified into digital modulation signals, analog modulation signals, etc. according to different modulation types. Or they can be classified into digital signals, analog signals, etc. according to different signal types.

[0086] In some embodiments, the controller 250 and the tuner-demodulator 210 can be located in different separate devices, that is, the tuner-demodulator 210 can also be in an external device of the main device where the controller 250 is located, such as an external set-top box. In this way, the set-top box outputs the TV audio-video signal obtained by modulating and demodulating the received broadcast TV signal to the main device, and the main device receives the audio-video signal through the first input / output interface.

[0087] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 can control the overall operation of the display device 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 275, the controller 250 can perform operations related to the object selected by the user command.

[0088] In some embodiments, the object can be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: operations for displaying a page, document, image, etc. connected to the hyperlink, or operations for executing a program corresponding to the icon. The user command for selecting a UI object can be a command input through various input devices (such as a mouse, keyboard, touchpad, etc.) connected to the display device 200 or a voice command corresponding to the user's spoken voice.

[0089] Such as Figure 2As shown, the controller 250 includes at least one of a random access memory 251 (RAM), a read-only memory 252 (ROM), a video processor 270, an audio processor 280, other processors 253 (such as a graphics processing unit (GPU)), a processor 254 (Central Processing Unit, CPU), a communication interface, and a communication bus 256. Among them, the communication bus connects each component.

[0090] In some embodiments, the RAM 251 is used to store the operating system or temporary data of other running programs.

[0091] In some embodiments, the ROM 252 is used to store instructions for various system startups.

[0092] In some embodiments, the ROM 252 is used to store a basic input / output system, called the Basic Input Output System (BIOS). It is used to complete the power-on self-test of the system, the initialization of each functional module in the system, the driver for the basic input / output of the system, and the boot of the operating system.

[0093] In some embodiments, when a power-on signal is received, the power of the display device 200 starts to boot. The CPU runs the system startup instructions in the ROM 252 and copies the temporary data of the operating system stored in the memory to the RAM 251 to facilitate the startup or running of the operating system. After the operating system starts up, the CPU then copies the temporary data of various application programs in the memory to the RAM 251, and then, to facilitate the startup or running of various application programs.

[0094] In some embodiments, the CPU processor 254 is used to execute the instructions of the operating system and application programs stored in the memory, and to execute various application programs, data, and content according to various interaction instructions received from the outside, so as to finally display and play various audio and video contents.

[0095] In some exemplary embodiments, the CPU processor 254 may include multiple processors. The multiple processors may include a main processor and one or more sub-processors. The main processor is used to execute some operations of the display device 200 in the pre-power-on mode and / or the operation of displaying the screen in the normal mode. One or more sub-processors are used to perform an operation in a standby mode or other states.

[0096] In some embodiments, the graphics processor 253 is configured to generate various graphic objects, such as icons, operation menus, and graphic displays of user input instructions. It includes an arithmetic unit that performs operations by receiving various interactive instructions input by the user and displays various objects according to display attributes. It also includes a renderer that renders various objects obtained from the arithmetic unit, and the rendered objects are used for display on the display.

[0097] In some embodiments, the video processor 270 is configured to receive an external video signal and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal, and a signal that can be directly displayed or played on the display device 200 can be obtained.

[0098] In some embodiments, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc.

[0099] Among them, the demultiplexing module is used to perform demultiplexing processing on the input audio-visual data stream. For example, if the input is MPEG-2, the demultiplexing module demultiplexes it into a video signal and an audio signal, etc.

[0100] The video decoding module is used to process the demultiplexed video signal, including decoding and scaling processing, etc.

[0101] The image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator according to user input or self-generation with the video image after scaling processing to generate an image signal for display.

[0102] The frame rate conversion module is used to convert the input video frame rate, such as converting a 60Hz frame rate to a 120Hz frame rate or a 240Hz frame rate, and the common format is implemented by means of frame interpolation.

[0103] The display formatting module is used to receive the video output signal after frame rate conversion and change the signal to conform to the display format signal, such as outputting an RGB data signal.

[0104] In some embodiments, the graphics processor 253 and the video processor can be integrated or separately provided. When integrated, it can perform processing on the graphic signal output to the display. When separately provided, they can perform different functions respectively, such as the GPU + FRC (Frame Rate Conversion) architecture.

[0105] In some embodiments, the audio processor 280 is configured to receive an external audio signal, decompress and decode it according to the standard codec protocol of the input signal, and perform processing such as noise reduction, digital-to-analog conversion, and amplification to obtain a sound signal that can be played on the speaker.

[0106] In some embodiments, the video processor 270 may be composed of one or more chips. The audio processor may also be composed of one or more chips.

[0107] In some embodiments, the video processor 270 and the audio processor 280 may be separate chips or integrated with the controller in one or more chips.

[0108] In some embodiments, the audio output receives the sound signal output by the audio processor 280 under the control of the controller 250, such as the speaker 286, and in addition to the speaker carried by the display device 200 itself, it can be output to the external audio output terminal of the generating device of the external device, such as the external audio interface or the headphone interface, etc. It may also include a short-range communication module in the communication interface, for example, a Bluetooth module for Bluetooth speaker sound output.

[0109] The power supply 290, under the control of the controller 250, provides power supply support for the display device 200 with the power input from the external power supply. The power supply 290 may include a built-in power circuit installed inside the display device 200 or an external power supply installed outside the display device 200, and a power interface for providing an external power supply in the display device 200.

[0110] The user interface 265 is used to receive the user's input signal and then send the received user input signal to the controller 250. The user input signal may be a remote control signal received through an infrared receiver or various user control signals received through the network communication module.

[0111] In some embodiments, the user inputs a user command through a control device or a mobile terminal, and the user input interface then, and the display device 200 responds to the user input through the controller 250.

[0112] In some embodiments, the user can input a user command in the graphical user interface (GUI) displayed on the display 275, and then the user input interface receives the user input command through the graphical user interface (GUI). Or, the user can input a user command by inputting a specific sound or gesture, and then the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

[0113] In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or an operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The common manifestation form of a user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an interface element such as an icon, a window, a control, etc. displayed on the display screen of an electronic device, where the control can include visible interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc.

[0114] The memory 260 includes various software modules stored for driving the display device 200. For example, various software modules stored in the first memory include at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules, etc.

[0115] The basic module is a bottom - layer software module for signal communication between various hardware in the display device 200 and for sending processing and control signals to upper - layer modules. The detection module is a management module for collecting various information from various sensors or user input interfaces, and performing analog - to - digital conversion and analysis management.

[0116] For example, the voice recognition module includes a voice parsing module and a voice instruction database module. The display control module is a module for controlling the display to display image content, and can be used to play multimedia image content, UI interface and other information. The communication module is a module for controlling and data communication with external devices. The browser module is a module for performing data communication between browsing servers. The service module is a module for providing various services and various application programs. At the same time, the memory 260 is also used to store externally received data, user data, images of various items in various user interfaces, and visual effect diagrams of focus objects, etc.

[0117] Figure 3 This is a schematic diagram of the software system of the display device provided by an embodiment of the present application. Refer to Figure 3 In some embodiments, the system is divided into four layers, from top to bottom are the application layer (abbreviation "application layer"), the application framework layer (abbreviation "framework layer"), the Android runtime and the system library layer (abbreviation "system runtime library layer"), and the kernel layer.

[0118] In some embodiments, at least one application runs in the application layer. These applications can be window programs, system setting programs, clock programs, camera applications, etc. that come with the operating system; they can also be applications developed by third-party developers, such as HiSee programs, KTV programs, magic mirror programs, etc. In specific implementations, the application packages in the application layer are not limited to the above examples. Actually, other application packages can also be included, and the embodiments of this application do not limit this.

[0119] The framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center, which decides to let the applications in the application layer perform actions. Through the API interface, an application can access the resources in the system and obtain the services of the system during execution.

[0120] As Figure 3 shown, in the embodiments of this application, the application framework layer includes Managers, Content Provider, etc. Among them, the Managers include at least one of the following modules: The ActivityManager is used to interact with all the activities running in the system; the Location Manager is used to provide access to the system location service for system services or applications; the Package Manager is used to retrieve various information related to the application packages currently installed on the device; the NotificationManager is used to control the display and clearing of notification messages; the Window Manager is used to manage the icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0121] In some embodiments, the ActivityManager is used to: manage the life cycles of various applications and the usual navigation back functions, such as controlling the exit of an application (including switching the user interface currently displayed in the display window to the system desktop), opening, and backing (including switching the user interface currently displayed in the display window to the previous-level user interface of the currently displayed user interface), etc.

[0122] In some embodiments, the Window Manager is used to manage all window programs, such as obtaining the size of the display screen, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the changes in the display window (such as shrinking the display window, jittering the display, distorting the display, etc.).

[0123] In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries included in the system runtime layer to implement the functions to be achieved by the framework layer.

[0124] In some embodiments, the kernel layer is the layer between hardware and software. As Figure 3 shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, touch sensor, pressure sensor, etc.).

[0125] In some embodiments, the kernel layer also includes a power driver module for power management.

[0126] In some embodiments, Figure 3 the software programs and / or modules corresponding to the software architecture in Figure 2 are stored in the first memory or the second memory as shown.

[0127] In some embodiments, taking the magic mirror application (camera application) as an example, when the remote control receiving device receives a remote control input operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the input operation into a raw input event (including information such as the value of the input operation and the timestamp of the input operation). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer, identifies the control corresponding to the input event according to the current position of the focus, and determines that the input operation is a confirmation operation. The control corresponding to the confirmation operation is the control of the magic mirror application icon. The magic mirror application calls the interface of the application framework layer to start the magic mirror application, and then starts the camera driver by calling the kernel layer to capture a static image or video through the camera.

[0128] In some embodiments, for a display device with touch function, taking the split-screen operation as an example, the display device receives an input operation (such as split-screen operation) applied by the user on the display screen. The kernel layer can generate a corresponding input event according to the input operation and report the event to the application framework layer. The activity manager of the application framework layer sets the window mode (such as multi-window mode) corresponding to the input operation, as well as the window position and size, etc. The window management of the application framework layer draws the window according to the settings of the activity manager, and then sends the drawn window data to the display driver of the kernel layer, and the display driver displays the corresponding application interface in different display areas of the display screen.

[0129] The display device assists in achieving intelligence through the image acquisition function of the camera. When the shooting target is relatively close to the camera of the display device, the display device will emit light onto the shooting target, and the light reflected by the shooting target will cause obvious interference to the imaging of the camera. When the light intensity of the light emitted by the display device is relatively strong, when the display device displays the image obtained through the camera, there is a situation of image color distortion (such as being reddish). Exemplarily, for display devices with large screens such as televisions, since the screen of the television is much larger than that of a mobile phone screen and the display brightness of the television is also relatively high, referring to Figure 1 , when a person is relatively close to the camera of the television, the screen of the television will emit relatively strong light onto the person, significantly affecting the imaging effect of the camera. Especially when the light intensity of the light emitted by the television screen is relatively strong, the shooting target such as a human face will be significantly reddish. This phenomenon will be particularly obvious in products applying the camera of a laser television, because the monochromaticity of the laser is very strong, and with an anti-light gain screen, the light reflected onto the human face will significantly affect the imaging of the camera, resulting in an unnatural reddish human face. Although the camera of the television has undergone objective color calibration, since the color calibration is carried out under a standard ambient light source, the spectrum of this ambient light is close to natural light, and the color calibration is also based on the sensor adjustment of this natural mixed spectrum to simulate and achieve the human eye's perception of the color spectrum. However, for the "light source" with a specific spectrum emitted by the television screen shining on a person, the camera will be unable to make correct processing, resulting in an unnatural reddish human face, that is, there is a situation of image color distortion.

[0130] Based on the above problems, the present application provides a display device, an image processing method and apparatus, which solve the situation of image color distortion (such as being reddish) when the display device displays the image obtained through the camera by performing post-processing intervention on the image output by the camera, and improve the quality of the output image.

[0131] The following uses detailed embodiments to illustrate how the present application performs image processing.

[0132] Figure 4 It is a flowchart of the image processing method provided by an embodiment of the present application. As Figure 4 shown, the processor 254 in the display device 200 is configured to perform the following steps:

[0133] In S401, when the distance between the shooting target and the camera is less than the first threshold, it is determined whether to correct the base color ratio of the image output by the camera.

[0134] In the embodiments of the present application, the shooting target is, for example, a human face. Exemplarily, a first threshold can be set according to the size of the display of the display device 200. Exemplarily, the primary colors of the image output by the camera include red (R), green (G), and blue (B), and the primary color ratio of the image output by the camera is the RGB ratio, including the red ratio, the green ratio, and the blue ratio. The distance between the shooting target and the camera can be determined with reference to the related art or the subsequent embodiments. When the distance between the shooting target and the camera is less than the first threshold, since there may be a situation of image color distortion, it is necessary to determine whether to correct the primary color ratio of the image output by the camera. For how to determine whether to correct the primary color ratio of the image output by the camera, reference can be made to the related art or the subsequent embodiments, which will not be elaborated here.

[0135] In S402, if so, determine the correction weight corresponding to each primary color according to the primary color ratio.

[0136] In this step, the correction weight is used to adjust the primary color ratio of the image output by the camera. After determining to correct the primary color ratio of the image output by the camera, the correction weight corresponding to each primary color of the image output by the camera can be determined according to the primary color ratio of the image output by the camera. For how to determine the correction weight corresponding to each primary color according to the primary color ratio, reference can be made to the related art or the subsequent embodiments, which will not be elaborated here.

[0137] In S403, control the display to output an image according to the correction weight.

[0138] After determining the correction weight corresponding to each primary color of the image output by the camera, correct the primary color ratio of the image output by the camera according to the correction weight, and then control the display to output an image. For how to control the display to output an image according to the correction weight, reference can be made to the related art or the subsequent embodiments, which will not be elaborated here.

[0139] The image processing method provided by the embodiments of the present application determines whether to correct the primary color ratio of the image output by the camera when the distance between the shooting target and the camera is less than the first threshold. If so, determine the correction weight corresponding to each primary color according to the primary color ratio, and control the display to output an image according to the correction weight. Since the embodiments of the present application can correct the primary color ratio of the image output by the camera according to the correction weight corresponding to each primary color and output the corrected image, the quality of the output image can be greatly improved, and thus the image color can be ensured not to be distorted.

[0140] Based on the above embodiments, the processor 254 is further configured to: determine the distance according to at least one frame of image output by the camera, and the image includes the shooting target.

[0141] Exemplarily, the shooting target is a human face, and the camera outputs 25 frames of images including the human face to the processor 254 per second. The processor 254 can determine the distance between the human face and the camera according to the 25 frames of images output by the camera.

[0142] Further, in a possible implementation manner, when the processor is used to determine the distance according to at least one frame of image output by the camera, it is specifically configured to: respectively extract the feature maps of the shooting target in each frame of image; determine the proportion of the feature map of the shooting target in the corresponding image; and determine the distance according to the proportion.

[0143] Exemplarily, for the 25 frames of images output by the camera per second, the processor 254 respectively extracts the feature maps of the human face in each frame of image, that is, completes the recognition and extraction of the human face features. Specifically, how to complete the recognition and extraction of the human face features can refer to the existing related technologies and will not be elaborated here. The processor 254 can determine the distance between the human face and the camera according to the average value of the proportion of the area of the feature map of the human face in the 25 frames of images in the total area of the corresponding images.

[0144] Further, in another possible implementation manner, when the processor is used to determine the distance according to at least one frame of image output by the camera, it is specifically configured to: determine the distance through a distance sensor.

[0145] Exemplarily, the distance sensor can be integrated in the camera, or is a separate sensor for assisting in measuring the distance between the person and the camera. The processor 254 can directly determine the distance between the shooting target such as the human face and the camera through this distance sensor.

[0146] Next, in combination with specific steps, the image processing method provided in the embodiments of the present application will be described in detail. In the following embodiments of the present application, the image processing of the shooting target being a human face is taken as an example for description.

[0147] Figure 5 This is a flowchart of the image processing method provided in another embodiment of the present application. As Figure 5 shown, the processor 254 in the display device 200 is configured to execute the following steps:

[0148] In the embodiments of the present application, Figure 4 step S401 in it can be further refined into the following three steps of S501 to S503:

[0149] In S501, when the distance between the shooting target and the camera is less than the first threshold, the base color ratio of the image output by the camera is compared with the base color ratio of the reference image.

[0150] Among them, the reference image is an image with a standard base color ratio in the same color temperature environment as the image output by the camera.

[0151] Exemplarily, the shooting target is a human face, and the reference image can be obtained through a machine deep learning model of an artificial neural network. Specifically, multiple (such as 200,000) standard human face skin color sample images in different color temperature environments can be acquired, and these human face skin color sample images are input into the machine deep learning model of the initial artificial neural network for iterative training until the value of the calculated loss function meets the preset evaluation conditions, obtaining the reference image and the corresponding feature value (i.e., RGB ratio) of the reference image. How the machine deep learning model of the artificial neural network obtains the reference image can refer to related technologies and will not be elaborated here. Exemplarily, the RGB ratio of the reference image can be stored in, for example, a database for query. When the processor 254 determines that the distance between the shooting target and the camera is less than the first threshold, it compares the RGB ratio of the image output by the camera with the RGB ratio of the reference image stored in the database.

[0152] In S502, if the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is greater than the second threshold, it is determined to correct the base color ratio of the image output by the camera.

[0153] In S503, if the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is less than or equal to the second threshold, it is determined not to correct the base color ratio of the image output by the camera.

[0154] The second threshold is used to determine whether it is necessary to correct the base color ratio of the image output by the camera. It can be understood that the smaller the second threshold, the closer the base color ratio of the image output by the camera is to the base color ratio of the reference image. Exemplarily, after the processor 254 compares the RGB ratio of the image output by the camera with the RGB ratio of the reference image stored in the database, it can determine the difference between the two RGB ratios, and compare this difference with the second threshold. If the difference is greater than the second threshold, it is determined to correct the base color ratio of the image output by the camera. If the difference is less than or equal to the second threshold, it is determined not to correct the base color ratio of the image output by the camera.

[0155] In the embodiments of the present application, Figure 4 Step S402 can be further refined into the following S504 step:

[0156] In S504, if it is determined to correct the base color ratio of the image output by the camera, the correction weight corresponding to each base color is determined according to the difference between the base color ratio and the base color ratio of the reference image.

[0157] Wherein, the reference image is an image with a standard base color ratio in the same color temperature environment as the image output by the camera.

[0158] In this step, after the processor 254 determines the base color ratio of the image output by the camera to be corrected, exemplarily, it can use the machine deep learning model of the artificial neural network based on the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image, with the goal of making the difference between the base color ratio of the corrected image output by the camera and the base color ratio of the reference image less than or equal to the second threshold, to determine the correction weights corresponding to each base color of the image output by the camera. For example, two correction weight values, namely R gain and B gain, are obtained. For how the machine deep learning model of the artificial neural network determines the correction weights corresponding to each base color of the image output by the camera, reference can be made to related technologies and will not be elaborated here. Optionally, the correction weights corresponding to each base color can be determined according to the average value of the correction weights corresponding to each base color of multiple images output by the camera.

[0159] In the embodiments of the present application, Figure 4 step S403 in can be further refined into the following two steps, S505 and S506:

[0160] In S505, the correction weights are sent to the camera so that the camera performs dynamic color matrix correction on the output image.

[0161] Exemplarily, the processor 254 sends the correction weights (such as R gain, B gain) to the camera through the communication protocol with the camera so that the camera performs dynamic color matrix correction on the output image. Correspondingly, after receiving the correction weights, the camera image signal processor (ISP) of the camera re-adjusts the register values to perform dynamic color matrix correction, which includes the correction of the white balance of the camera.

[0162] In S506, the display output is controlled to output the image of the camera after dynamic color matrix correction.

[0163] After the camera performs dynamic color matrix correction on the output image and outputs the image after dynamic color matrix correction to the processor 254, considering that it may be necessary to perform multiple corrections on the image output by the camera, therefore, after receiving the image from the camera after dynamic color matrix correction, the processor 254 executes the steps of S501 to S505 until it is determined that the base color ratio of the image output by the camera is not to be corrected, that is, step S503 is executed, and then the display output is controlled to output the image of the camera after dynamic color matrix correction.

[0164] The image processing method provided by the embodiment of the present application compares the base color ratio of the image output by the camera with the base color ratio of the reference image when the distance between the shooting target and the camera is less than the first threshold. If the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is greater than the second threshold, it is determined to correct the base color ratio of the image output by the camera. If the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is less than or equal to the second threshold, it is determined not to correct the base color ratio of the image output by the camera. If it is determined to correct the base color ratio of the image output by the camera, the correction weight corresponding to each base color is determined according to the difference between the base color ratio and the base color ratio of the reference image, and the correction weight is sent to the camera so that the camera performs dynamic color matrix correction on the output image and controls the display to output the image of the camera after dynamic color matrix correction. Since the embodiment of the present application can correct the base color ratio of the image output by the camera according to the correction weight corresponding to each base color and output the corrected image, the quality of the output image can be greatly improved, and thus the image color can be ensured not to be distorted.

[0165] In the above Figure 5 shown embodiment, it is a specific implementation manner that the processor 254 supports sending the correction weight to the camera. Considering the situation that the processor 254 does not support sending the correction weight to the camera, therefore, after determining the correction weight corresponding to each base color in S504, in another specific implementation manner (that is, a further refinement of the Figure 4 step S403), the processor 254 is configured to: correct the image parameters of the filter according to the correction weight and control the display to output the corrected image.

[0166] Exemplarily, the filters of the processor 254 can be used for post-processing of images. Specifically, the processor 254 corrects the image parameters of the filters according to the correction weights. Considering that it may be necessary to correct the image parameters of the filters multiple times, after the processor 254 corrects the image parameters of the filters according to the correction weights, it compares the base color ratio of the image after filter correction with the RGB ratio of the reference image stored in the database. If the difference between the base color ratio of the image after filter correction and the base color ratio of the reference image is greater than the second threshold, it is determined to continue correcting the base color ratio of the image after filter correction; if the difference between the base color ratio of the image after filter correction and the base color ratio of the reference image is less than or equal to the second threshold, it is determined not to correct the base color ratio of the image after filter correction anymore. If it is determined to continue correcting the base color ratio of the image after filter correction, the correction weights corresponding to each base color are re-determined according to the difference between the base color ratio of the image after filter correction and the base color ratio of the reference image, and the image parameters of the filters are corrected according to the re-determined correction weights, repeating the above steps after the processor 254 corrects the image parameters of the filters according to the correction weights until it is determined not to correct the base color ratio of the image after filter correction anymore, and then controls the display to output the corrected image.

[0167] The following is an embodiment of the device of the present application, which can be used to execute the method embodiment of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the method embodiment of the present application.

[0168] Figure 6 It is a schematic structural diagram of an image processing device provided by an embodiment of the present application. This image processing device is applied to a display device. As Figure 6 shown, the image processing device 600 provided by the embodiment of the present application includes: a first determination module 601, a processing module 602, and a control module 603.

[0169] The first determination module 601 is configured to determine whether to correct the base color ratio of the image output by the camera when the distance between the shooting target and the camera is less than the first threshold.

[0170] The processing module 602 is configured to, if so, determine the correction weights corresponding to each base color according to the base color ratio.

[0171] The control module 603 is configured to control the display to output an image according to the correction weights.

[0172] In some possible implementations, the first determination module 601 may specifically be configured to: compare the base color ratio of the image output by the camera with the base color ratio of a reference image, where the reference image is an image with a standard base color ratio in the same color temperature environment as the image output by the camera; if the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is greater than a second threshold, determine to correct the base color ratio of the image output by the camera; if the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is less than or equal to the second threshold, determine not to correct the base color ratio of the image output by the camera.

[0173] In some possible implementations, the processing module 602 may specifically be configured to: determine the correction weight corresponding to each base color according to the difference between the base color ratio and the base color ratio of the reference image, where the reference image is an image with a standard base color ratio in the same color temperature environment as the image output by the camera.

[0174] In some possible implementations, the control module 603 may specifically be configured to: send the correction weight to the camera so that the camera performs dynamic color matrix correction on the output image; control the display to output the image of the camera after the dynamic color matrix correction.

[0175] In some possible implementations, the control module 603 may specifically be configured to: correct the image parameters of the filter according to the correction weight; control the display to output the corrected image.

[0176] Figure 7 This is a schematic structural diagram of an image processing device provided in another embodiment of the present application. As Figure 7 shown, on the basis of the device structure shown in Figure 6 the present embodiment, the image processing device 700 of the present application may further include:

[0177] A second determination module 604, configured to determine a distance according to at least one frame of image output by the camera, where the image includes a shooting target.

[0178] In some possible implementations, the second determination module 604 may specifically be configured to: respectively extract the feature maps of the shooting target in each frame of image; determine the proportion of the feature map of the shooting target in the corresponding image; and determine the distance according to the proportion.

[0179] In some possible implementations, the second determination module 604 may specifically be configured to: determine the distance through a distance sensor.

[0180] It should be noted that the device provided in this embodiment can be used to execute the above-mentioned image processing method, and its implementation manners and technical effects are similar, which will not be elaborated here in this embodiment.

[0181] It should be noted that it should be understood that the division of each module of the above device is only a division of logical functions. In actual implementation, it can be fully or partially integrated into a physical entity, or physically separated. And these modules can all be implemented in the form of software called by processing elements; they can also all be implemented in the form of hardware; or some modules can be implemented in the form of software called by processing elements, and some modules can be implemented in the form of hardware. For example, the processing module can be a separately established processing element, or can be integrated in a certain chip of the above device. In addition, it can also be stored in the memory of the above device in the form of program code, and the function of the above processing module can be called and executed by a certain processing element of the above device. The implementation of other modules is similar. In addition, all or part of these modules can be integrated together or can be independently implemented. Here, the processing element can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each of the above modules can be completed by the integrated logic circuit in the processor element or the instruction in the form of software.

[0182] For example, the above modules can be one or more integrated circuits configured to implement the above method, such as: one or more ASICs (Application Specific Integrated Circuits), or one or more DSPs (Digital Signal Processors), or one or more FPGAs (Field Programmable Gate Arrays), etc. Again, when a certain module above is implemented in the form of a processing element scheduling program code, the processing element can be a general-purpose processor, such as a CPU or other processors that can call program code. Again, these modules can be integrated together and implemented in the form of an SOC (System-on-a-Chip).

[0183] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs. When the computer program instructions are loaded and executed on a computer, the processes or functions according to the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer program can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer program can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that the computer can access, or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk (SSD)), etc.

[0184] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the image processing method described in any of the above method embodiments is implemented.

[0185] An embodiment of the present application further provides a computer program product, which includes a computer program. The computer program is stored in a computer-readable storage medium, and at least one processor can read the computer program from the computer-readable storage medium. When the at least one processor executes the computer program, the image processing method described in any of the above method embodiments can be implemented.

[0186] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0187] For ease of explanation, the above description has been presented in connection with specific embodiments. However, the foregoing exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations are possible in light of the above teachings. The selection and description of the embodiments were made to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, Comprising: A display; A camera for capturing images, wherein the display screen of the display device and the shooting direction of the camera are the same; A processor connected to the display, the processor being configured to: When the distance between the shooting target and the camera is less than a first threshold, compare the base color ratio of the image output by the camera with the base color ratio of a reference image, and determine whether to correct the base color ratio of the image output by the camera, the reference image being an image with a standard base color ratio in the same color temperature environment as the image output by the camera; If so, determine the correction weight corresponding to each base color according to the difference between the base color ratio and the base color ratio of the reference image; Control the display to output an image according to the correction weight.

2. The display device according to claim 1, characterized in that, When the processor is used to compare the base color ratio of the image output by the camera with the base color ratio of the reference image to determine whether to correct the base color ratio of the image output by the camera, it is specifically used for: If the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is greater than a second threshold, determine to correct the base color ratio of the image output by the camera; If the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is less than or equal to the second threshold, determine not to correct the base color ratio of the image output by the camera.

3. The display device according to claim 2, characterized in that, When the processor is used to control the display to output an image according to the correction weight, it is specifically used for: Send the correction weight to the camera so that the camera performs dynamic color matrix correction on the output image; Control the display to output the image from the camera after dynamic color matrix correction.

4. The display device according to claim 1 or 2, characterized in that When the processor is used to control the display to output an image according to the correction weight, it is specifically used for: Correct the image parameters of the filter according to the correction weight; Control the display to output the corrected image.

5. The display device according to claim 1 or 2, characterized in that, The processor is further configured to: Determine the distance according to at least one frame of image output by the camera, the image including the shooting target.

6. The display device according to claim 4, characterized in that, When the processor is used to determine the distance according to at least one frame of image output by the camera, it is specifically used for: Extract the feature maps of the shooting target in each frame of the image respectively; Determine the proportion of the feature map of the shooting target in the corresponding image; Determine the distance according to the proportion.

7. The display device according to claim 4, characterized in that, When the processor is used to determine the distance according to at least one frame of image output by the camera, it is specifically used for: Determine the distance through a distance sensor.

8. An image processing method, characterized in that, Applied to the display device according to any one of claims 1-5, the image processing method includes: When the distance between the shooting target and the camera is less than a first threshold, determine whether to correct the base color ratio of the image output by the camera; If so, determine the correction weight corresponding to each base color according to the base color ratio; Control the display to output an image according to the correction weight.

9. The image processing method according to claim 8, characterized in that The determining whether to correct the base color ratio of the image output by the camera includes: Compare the base color ratio of the image output by the camera with the base color ratio of a reference image, where the reference image is an image with a standard base color ratio in the same color temperature environment as the image output by the camera; If the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is greater than a second threshold, determine to correct the base color ratio of the image output by the camera; If the difference between the base color ratio of the image output by the camera and the base color ratio of the reference image is less than or equal to the second threshold, determine not to correct the base color ratio of the image output by the camera.

Images