Display device and brightness adjustment method

Abstract

The present invention discloses a display device and a brightness adjustment method. Upon detecting that a user inputs a first adjustment mode instruction, a brightness adjustment process for a light source in a first adjustment mode can be performed. Combined with a target depth image captured by an image collector, the brightness of the adjusted light source is determined to be effective. If effective, the accuracy and stability of image acquisition can be improved. Furthermore, upon detecting that a user inputs a second adjustment mode instruction, a brightness adjustment process for a light source in a second adjustment mode can be performed. Combined with a target depth image captured by the image collector, the brightness of the adjusted light source is determined to be effective. If effective, the accuracy and stability of image acquisition can be improved.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and in particular to a display device and a brightness adjustment method. Background Art

[0002] Cameras are widely used in our daily lives. Users often install cameras on electronic devices such as TVs or computers to capture images. However, the light emitted by the TV or computer monitors can affect the accuracy of the images captured by the camera. Summary of the Invention

[0003] Embodiments of the present invention provide a display device and a brightness adjustment method to solve the problem in the prior art that light emitted by a light source may affect the accuracy of images captured by a camera.

[0004] In a first aspect, an embodiment of the present disclosure provides a display device, including:

[0005] a display having a light source;

[0006] A controller is connected to the display, and the controller is configured to:

[0007] When detecting that a user inputs a first adjustment mode instruction, controlling the display to display a first adjustment mode interface having a first adjustment mode button, and when detecting that the user inputs an instruction through the first adjustment mode button, controlling the image collector to capture a target depth image and adjust the brightness of the light source, and when determining that the adjusted brightness of the light source is valid based on the multiple target depth images captured, controlling the first adjustment mode interface to display content that the adjustment is completed;

[0008] When it is detected that the user inputs the second adjustment mode instruction, the image collector is controlled to collect the target depth image and adjust the brightness of the light source, and when it is determined that the adjusted brightness of the light source is valid based on the collected target depth image, the display is controlled to display the second adjustment mode interface of the content completed by the adjustment.

[0009] The beneficial effects of the embodiments of the present disclosure are as follows:

[0010] Based on the above embodiment, two different modes for adjusting the brightness of the light source can be implemented. When it is detected that the user inputs the first adjustment mode instruction, the brightness adjustment process of the light source in the first adjustment mode can be performed, and combined with the target depth image collected by the image collector, it is determined whether the brightness of the adjusted light source is valid. When it is valid, the accuracy and stability of the image acquisition can be improved. Also, when it is detected that the user inputs the second adjustment mode instruction, the brightness adjustment process of the light source in the second adjustment mode can be performed, and combined with the target depth image collected by the image collector, it is determined whether the brightness of the adjusted light source is valid. When it is valid, the accuracy and stability of the image acquisition can be improved.

[0011] In a second aspect, an embodiment of the present disclosure provides a brightness adjustment method, including:

[0012] When detecting that a user inputs a first adjustment mode instruction, controlling the display to display a first adjustment mode interface having a first adjustment mode button, and when detecting that the user inputs an instruction through the first adjustment mode button, controlling the image collector to capture a target depth image and adjust the brightness of the light source, and when determining that the adjusted brightness of the light source is valid based on the multiple target depth images captured, controlling the first adjustment mode interface to display content that the adjustment is completed;

[0013] When it is detected that the user inputs the second adjustment mode instruction, the image collector is controlled to collect the target depth image and adjust the brightness of the light source, and when it is determined that the adjusted brightness of the light source is valid based on the collected target depth image, the display is controlled to display the second adjustment mode interface of the content completed by the adjustment.

[0014] The beneficial effects of the embodiments of the present disclosure are as follows:

[0015] Based on the above embodiment, two different modes for adjusting the brightness of the light source can be implemented. When it is detected that the user inputs the first adjustment mode instruction, the brightness adjustment process of the light source in the first adjustment mode can be performed, and combined with the target depth image collected by the image collector, it is determined whether the brightness of the adjusted light source is valid. When it is valid, the accuracy and stability of the image acquisition can be improved. Also, when it is detected that the user inputs the second adjustment mode instruction, the brightness adjustment process of the light source in the second adjustment mode can be performed, and combined with the target depth image collected by the image collector, it is determined whether the brightness of the adjusted light source is valid. When it is valid, the accuracy and stability of the image acquisition can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 illustrates an operating scenario of a display device according to some embodiments;

[0017] Figure 2shows a hardware configuration block diagram of a control device according to some embodiments;

[0018] Figure 3 exemplarily shows a hardware configuration block diagram of the display device 200;

[0019] Figure 4 The schematic diagram of the structure of the display device is exemplarily shown;

[0020] Figure 5 The flowchart of some methods for determining reference pixels implemented by the controller is exemplified;

[0021] Figure 6a A schematic diagram of a first detected depth image is exemplarily shown;

[0022] Figure 6b A schematic diagram of a second detected depth image is exemplarily shown;

[0023] Figure 7 Flowcharts showing some brightness adjustment methods implemented by the controller;

[0024] Figure 8 Flowcharts showing exemplary brightness adjustment methods implemented by the controller;

[0025] Figure 9 Schematic diagrams showing some selection and adjustment interfaces;

[0026] Figure 10 Schematic diagrams showing some manual adjustment mode interfaces;

[0027] Figure 11 Flowcharts showing some further brightness adjustment methods implemented by the controller;

[0028] Figure 12 Schematic diagrams showing some automatic adjustment mode interfaces. DETAILED DESCRIPTION

[0029] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings of the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. And in the absence of conflict, the embodiments of the present invention and the features in the embodiments can be combined with each other. Based on the described embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0030] Unless otherwise defined, the technical or scientific terms used in the present invention shall have the usual meanings understood by persons of ordinary skill in the field to which the present invention belongs. The words "first", "second" and similar terms used in the present invention do not indicate any order, quantity or importance, but are only used to distinguish different components. Words such as "include" or "comprise" mean that the elements or objects preceding the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Words such as "connect" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect.

[0031] It should be noted that the sizes and shapes of the figures in the accompanying drawings do not reflect the actual scale and are only for the purpose of illustrating the present invention. The same or similar reference numerals throughout represent the same or similar elements or elements with the same or similar functions.

[0032] In order to make the purpose and implementation of this application clearer, the exemplary implementation of this application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of this application. Obviously, the described exemplary embodiments are only part of the embodiments of this application, not all of the embodiments.

[0033] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0034] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0035] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0036] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functionality associated with that element.

[0037] Figure 1 The schematic diagram exemplarily shows an operation scenario of a display device. Figure 1As shown, the user can operate the display device 200 through the smart device 300 or the control apparatus 100 .

[0038] Illustratively, the control device 100 can be configured to control the display device 200. It can receive user input and convert the input into commands that the display device 200 can recognize and respond to, acting as an intermediary for interaction between the user and the display device 200. For example, a user operates the channel increase or decrease keys on the control device 100, and the display device 200 responds to the channel increase or decrease operation. Illustratively, the control device 100 can be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, or other short-range communication methods, allowing wireless or wired control of the display device 200. The user can control the display device 200 by inputting user commands via buttons on the remote control, voice input, or control panel input. For example, the user can control the display device 200 by inputting corresponding control commands via the volume increase or decrease keys, channel control keys, up / down / left / right movement keys, voice input keys, menu keys, power on / off keys, etc. on the remote control. Alternatively, a smart device 300 (such as a mobile terminal (e.g., a mobile phone), tablet computer, computer, laptop computer, etc.) can be used to control the display device 200. Alternatively, the display device 200 and the server 400 are communicatively connected via a local area network (LAN), a wireless local area network (WLAN), or other networks.

[0039] For example, the display device 200 may have a network TV function with a broadcast receiving function and a computer support function. The display device may be implemented as a TV, for example, a smart TV, a digital TV, a network TV, an Internet Protocol TV (IPTV), etc.

[0040] Figure 2 FIG. 1 is an exemplary block diagram showing a configuration of the control device 100. Figure 2 As shown, the control device 100 may include a controller 110 , a memory 120 , a communicator 130 , a user input interface 140 , a user output interface 150 , and a power supply 160 .

[0041] The controller 110 includes a random access memory (RAM) 111, a read-only memory (ROM) 112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and coordination between internal components and external and internal data processing functions.

[0042] Under the control of the controller 110, the communicator 130 communicates control signals and data signals with the display device 200. For example, the communicator 130 may include at least one of an infrared signal module 131, a WIFI module 132, a Bluetooth communication protocol module 133, a wired Ethernet communication protocol module 134, and an NFC module.

[0043] The user input interface 140 may include at least one of a microphone 141 , a touchpad 142 , a sensor 143 , a button 144 , etc., so that the user can input user operation instructions for controlling the display device 200 to the control apparatus 100 through voice, touch, gesture, pressing, etc.

[0044] The user output interface 150 may output a user operation instruction received by the user input interface 140 to the display device 200, or output an image or voice signal received by the display device 200. Here, the user output interface 150 may include an LED interface 151, a vibration interface 152 for generating vibration, a sound output interface 153 for outputting sound, and a display 154 for outputting an image.

[0045] The power supply 160 is used to provide operating power support for various components of the control device 100 under the control of the controller 110. It can be in the form of a battery and related control circuits.

[0046] Figure 3 exemplarily shows a hardware configuration block diagram of the display device 200. Figure 3 As shown, the display device 200 may include at least one of a tuner 210 , a communicator 220 , a detector 230 , an external device interface 240 , a controller 250 , a memory 260 , a user interface 265 , a display 275 , an audio output interface 280 , and a power supply 290 .

[0047] Exemplarily, the tuner-demodulator 210 can receive broadcast television signals via wired or wireless means, and can perform modulation and demodulation processing such as amplification, mixing, and resonance, and is used to demodulate the audio and video signals carried in the frequency of the TV channel selected by the user, as well as additional information (such as EPG data) from multiple wireless or wired broadcast television signals.

[0048] Communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types. For example, communicator 220 may include at least one of a network communication protocol module or a near-field communication protocol module such as a WIFI module 221, a Bluetooth communication protocol module 222, or a wired Ethernet communication protocol module 223, and an infrared receiver.

[0049] Exemplarily, the detector 230 is a component of the display device 200 for collecting signals of the external environment or external interaction. Exemplarily, the detector 230 may include a sound collector 231, such as a microphone, which can be used to receive the user's voice, such as a voice signal of a control instruction of the user to control the display device 200.

[0050] Exemplarily, the external device interface 240 is a component that provides the controller 250 with control over data transmission between the display device 200 and an external device. For example, the external device interface 240 may include, but is not limited to, any one or more of the following: a High Definition Multimedia Interface (HDMI) 241, a Composite Video Broadcast Signal (CVBS) interface 242, an analog or digital component interface 243, a Universal Serial Bus (USB) interface 244, and the like.

[0051] Exemplarily, the controller 250 controls the operation of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored in the memory 260. Alternatively, in response to a received user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform operations related to the object selected by the control instruction. For example, the controller 250 may include at least one of a random access memory (RAM) 251, a read-only memory (ROM) 252, a graphics processing unit (GPU) 253, a processor 254 (e.g., a central processing unit (CPU)), a communication interface 255, a video processor 256, an audio processor 257, and a communication bus. The communication interface 255 may include first to nth interfaces. These interfaces may be network interfaces connected to external devices via a network.

[0052] Exemplarily, the memory 260 may be used to store various types of data, software programs, or applications that drive and control the operation of the display device 200. Exemplarily, the memory 260 may be used to store an operating program that drives the controller 250 in the display device 200; store various applications built into the display device 200 and downloaded by the user from an external device; and store data such as visual effect images used to configure various UIs provided by the display 275, various objects related to the UIs, and selectors for selecting UI objects.

[0053] Exemplarily, the user interface 265 can receive various user interactions, specifically, to send an operation instruction input by the user to the controller 250 , or to transmit a signal output from the controller 250 to the user.

[0054] For example, a user may input a user operation command through a user interface (UI) displayed on the display 275, and the user interface 265 may receive the user input command through the UI. For example, the user interface 265 may receive a user operation command for controlling the position of a selector in the UI to select different objects or items.

[0055] Exemplarily, the video processor is used to perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis on the received external video signal according to the standard codec protocol of the input signal to obtain a signal displayed or played on the display device 200.

[0056] Exemplarily, the audio processor 257 is used to receive external audio signals, perform decompression and decoding according to the standard codec protocol of the input signal, as well as noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal played in the speaker.

[0057] Exemplarily, the display 275 can be used to receive an image signal output from the video processor 256 in the controller 250, and to display video content, image content, and components of a menu control interface and a user control UI interface. The displayed video content can come from the video content in the broadcast signal received by the tuner demodulator 210, or from the video content input from the communicator 220 or the external device interface 240. The display 275 can simultaneously display the user control UI generated in the display device 200 and used to control the display device 200. Among them, the display 275 can be a liquid crystal display (Liquid Crystal Display, LCD), and the light source of the display can be the backlight source in the LCD. The display 275 can also be an organic light emitting diode (Organic Light Emitting Diode, OLED) display, and the light source of the display can be an OLED that emits light in an OLED display.

[0058] For example, the power supply 290 may be configured to provide power supply support for the display device 200 using power input from an external power source under the control of the controller 250 .

[0059] Figure 4 The structural diagram of the display device is shown as an example. Figure 4As shown, the image collector 232 can be set on the display 275, and the image collector 232 can be connected to the display 275 through a USB interface to exchange data. Of course, the image collector can also be embedded in the upper frame of the display 275.

[0060] In some examples, the image collector can capture depth images and grayscale images. For example, the image collector can be a 3D camera. The images captured by the 3D camera can include depth images and grayscale images. Exemplarily, the 3D camera can be a structured light camera based on structured light. Alternatively, the 3D camera can be a time of flight (TOF) camera.

[0061] In smart TV scenarios, the TV's light source (such as the backlight) affects the ambient light and temperature around the TV, impacting the accuracy and stability of 3D camera image acquisition. For example, in strong ambient light, the laser speckle pattern, the core technology of structured light cameras, can be overwhelmed, affecting the accuracy and stability of depth images captured by the camera. Time-of-flight (TOF) depth image sensors use time-of-flight technology to measure depth information in a scene. They continuously send light pulses to a target, and the sensor receives the returned light signals. The sensor calculates the time of flight of the light pulses to determine the distance to the target. These pulses are typically 850nm near-infrared light. However, TOF depth image sensors are extremely sensitive to ambient light (such as the display backlight). In reality, the infrared filter cannot completely filter out ambient light, and some ambient light is still refracted into the high-resistance epitaxial layer, generating photocurrent. This affects the dynamic range of the TOF depth image sensor, making it susceptible to saturation. Its ambient light resistance needs to be improved.

[0062] In view of this, the display device provided in the embodiment of the present invention adjusts the brightness of the light source to meet the requirements of accuracy and stability of the image acquisition by the image collector.

[0063] The following description takes the display as an LCD as an example, and the light source is a backlight.

[0064] 1. Determine the reference pixel point.

[0065] In some examples, the controller 250 pre-stores reference pixel points. The reference pixel points can be obtained through experiments before the display device is shipped and burned into the controller 250. Alternatively, the reference pixel points can be obtained by the user actively triggering the process of determining the reference pixel points when the camera is first turned on after shipping.

[0066] Figure 5 Schematic diagram of some methods for determining reference pixels implemented by the controller 250. Figure 5 As shown, the controller 250 may be configured to: determine the reference pixel point using the following steps;

[0067] S01: The display and image collector are started, and the light source is controlled to be turned off.

[0068] For example, when the display settings are not factory-set, the operator can manually press the power button on the control device 100 to input a power on / off signal to the display controller 250 via the power button on the control device 100, thereby controlling the display to start up. Because the display and image acquisition device are connected via USB, the image acquisition device will also start up when the display starts up.

[0069] Alternatively, the operator can also control the display to start up by using the power button set on the display. Since the display and the image collector are connected via USB, the image collector will also start up after the display starts up.

[0070] After the display is turned on, the backlight will also turn on. The operator can manually press the light off button on the control device 100 to input a light off signal to the display controller 250 via the light off button on the control device 100, thereby controlling the backlight to turn off. Alternatively, after the display is turned on, the controller 250 can automatically control the backlight to turn off.

[0071] S02: Control the image collector to collect a plurality of first detection depth images.

[0072] For example, the controller 250 controls the image collector to continuously collect N first detection depth images. The depth images collected by the image collector are images within its visible area.

[0073] Here, N can be set to 20, 30, 40 or more values, which is not limited here.

[0074] S03: Determine a first detected depth value corresponding to a same pixel point in a set area of ​​the first detected depth image.

[0075] For example, Figure 6a As shown, the set area CA1 of the first detection depth image X1 can be the central area of ​​the first detection depth image. For example, the central area can be a rectangular area extended based on the center point A1. The coordinates of the center point A1 are (x1, y1), and the coordinates of the four vertices of the central area are: the coordinates of the upper left vertex (x1-Δx, y1+Δy), the coordinates of the lower left vertex (x1-Δx, y1-Δy), the coordinates of the upper right vertex (x1+Δx, y1+Δy), and the coordinates of the lower right vertex (x1+Δx, y1-Δy). Among them, Δx=Δy can be made so that the central area covers Q Q is a pixel point. For example, Q=50 or other values. It should be noted that Δx and Δy can be determined according to actual needs and are not limited here.

[0076] Of course, the set area may also be an area at other positions in the first detected depth image, which is not limited here.

[0077] And, set the Q in the area 2 Pixel points are defined in sequence as: pixel point PX_1, pixel point PX_2, pixel point PX_3, ... pixel point PX_q (q is an integer, and 1≤q≤Q 2 ), ...pixel PX_Q 2 .

[0078] Exemplarily, the first detection depth value corresponding to the same pixel in a set area of ​​the first detection depth image is the average of the grayscale values ​​corresponding to the same pixel in the set area of ​​the N first detection depth images. That is, for each pixel in the set area, the average of the grayscale values ​​of the pixel in the N first detection depth images is determined. Exemplarily, the N first detection depth images continuously acquired by the image collector are defined, in sequence, as: the first first detection depth image X1_1, the second first detection depth image X1_2, the third first detection depth image X1_3, ... the nth first detection depth image X1_n (n is an integer, and 1≤n≤N), ... the Nth first detection depth image X1_N.

[0079] The first detection depth value CX1_q corresponding to the pixel point PX_q is determined by formulas (1) and (2):

[0080] (1).

[0081] (2).

[0082] Among them, cx1_qn is the grayscale value corresponding to the pixel point PX_q in the nth first detection depth image X1_n.

[0083] S04: Control the light source to turn on, and control the light source to turn off after the set time.

[0084] For example, the set time may be 1 hour, 2 hours, 5 hours, etc., which may be determined according to actual application requirements and is not limited here.

[0085] S05: Control the image collector to collect multiple second detection depth images.

[0086] For example, the controller 250 controls the image collector to continuously collect N second detection depth images. The depth images collected by the image collector are images within its visible area.

[0087] In order to keep the results more uniform, the number of the second detection depth images may be the same as the number of the first detection depth images.

[0088] S06: Determine a second detected depth value corresponding to the same pixel point in the set area of ​​the second detected depth image.

[0089] For example, Figure 6b As shown, the set area CA2 of the second detection depth image X2 can be the central area of ​​the second detection depth image. For example, the central area can be a rectangular area extended based on the center point A1. The coordinates of the center point A1 are (x1, y1), and the coordinates of the four vertices of the central area are: the coordinates of the upper left vertex (x1-Δx, y1+Δy), the coordinates of the lower left vertex (x1-Δx, y1-Δy), the coordinates of the upper right vertex (x1+Δx, y1+Δy), and the coordinates of the lower right vertex (x1+Δx, y1-Δy). Among them, Δx=Δy can be made so that the central area covers Q Q is a pixel point. For example, Q=50 or other values. It should be noted that Δx and Δy can be determined according to actual needs and are not limited here.

[0090] In order to keep the results more uniform, the position of the set area of ​​the second detection depth image is the same as the position of the set area of ​​the first detection depth image.

[0091] Exemplarily, the second detection depth value corresponding to each pixel in a set area of ​​each second detection depth image is the average of the grayscale values ​​corresponding to all pixels in the set area of ​​the second detection depth image. Exemplarily, the N second detection depth images continuously acquired by the image collector are defined, in sequence, as follows: the first second detection depth image X2_1, the second second detection depth image X2_2, the third second detection depth image X2_3, ... the nth second detection depth image X2_n (n is an integer, and 1≤n≤N), ... the Nth second detection depth image X2_N.

[0092] The second detection depth value CX2_q corresponding to the pixel point PX_q is determined by formulas (3) and (4):

[0093] (3).

[0094] (4).

[0095] Among them, cx2_qn is the grayscale value corresponding to the pixel point PX_q in the nth second detection depth image X2_n.

[0096] S07 . Determine a reference pixel from the pixels within the set area according to the first detected depth value and the second detected depth value of the same pixel.

[0097] For example, the detection difference between the first detection depth value and the second detection depth value of the same pixel can be determined, and the pixel corresponding to the detection difference that meets the set detection difference range is determined as the reference pixel. For example, the set detection difference range can be 0±ΔCX. ΔCX can be a value such as 0.1, 0.05, or 0.009, which can be determined according to the needs of the actual application and is not limited here.

[0098] Furthermore, the detection difference of pixel PX_q is: CX2_q - CX1_q. Taking Q = 50 as an example, if the detection difference CX2_3 - CX1_3 of pixel PX_3 is between 0 ± ΔCX, pixel PX_3 is determined as the reference pixel. If the detection difference CX2_20 - CX1_20 of pixel PX_20 is between 0 ± ΔCX, pixel PX_20 is determined as the reference pixel. If the detection difference CX2_100 - CX1_100 of pixel PX_100 is between 0 ± ΔCX, pixel PX_100 is determined as the reference pixel.

[0099] For example, after turning on the light source, the light source can be left on for a period of time and then turned off. Since the light source remains on for a period of time, the ambient temperature in front of the TV may change. After turning off the light source, a second depth detection image is captured, and a second depth detection value is determined for the pixel in the set area. Subsequently, based on the first and second depth detection values, a reference pixel that is least affected by the light source temperature change is obtained.

[0100] 2. Determine whether the brightness of the light source needs to be adjusted.

[0101] In some examples, during operation of the television, it may be determined whether the brightness of the light source needs to be adjusted based on the depth value corresponding to the reference pixel point.

[0102] a. Set the image type to include depth image and grayscale image.

[0103] Figure 7 Schematic diagram of some brightness adjustment methods implemented by the controller 250. Figure 7 As shown, the controller 250 can be configured to perform the following steps:

[0104] S11, detecting a user input start instruction, and controlling the display and the image collector to start.

[0105] For example, the user can manually press the power button on the control device 100 to input a power on / off signal to the display controller 250 via the power button on the control device 100, thereby controlling the display to start up. Since the display and the image collector are connected via USB, the image collector will also start up after the display starts up.

[0106] S12, controlling the light source of the display to set a low brightness.

[0107] Exemplarily, the low brightness setting can be a brightness value between 0 and 10. For example, the controller 250 can control the backlight of the TV to display a brightness value of 0, at which point the TV display image is the darkest. The controller 250 can also control the backlight of the TV to display a brightness value of 5, at which point the TV display image is slightly brighter, but relatively dark. The controller 250 can also control the backlight of the TV to display a brightness value of 10, at which point the TV display image is slightly brighter, but also relatively dark. Of course, in actual applications, the brightness value corresponding to the low brightness setting can be determined according to actual application requirements and is not limited here.

[0108] S13, control the image collector to collect the depth image and grayscale image corresponding to the set low brightness, and determine the reference depth value corresponding to the reference pixel point in the depth image corresponding to the set low brightness, and determine the reference grayscale value corresponding to the reference pixel point in the grayscale image corresponding to the set low brightness.

[0109] For example, when the TV backlight displays a brightness value of 0, the image collector can be controlled to collect a depth image and a grayscale image. Among them, for the depth image: the depth value BZ1_3 of the reference pixel point PX_3 in the depth image is used as the reference depth value corresponding to the reference pixel point PX_3 in the depth image. And, the depth value BZ1_20 of the reference pixel point PX_20 in the depth image is used as the reference depth value corresponding to the reference pixel point PX_20 in the depth image. And, the depth value BZ1_100 of the reference pixel point PX_100 in the depth image is used as the reference depth value corresponding to the reference pixel point PX_100 in the depth image. And the reference depth values ​​BZ1_3, BZ1_20 and BZ1_100 are stored.

[0110] Furthermore, for this grayscale image: the grayscale value IR1_3 of the reference pixel PX_3 in the grayscale image is used as the reference grayscale value corresponding to the reference pixel PX_3 in the grayscale image. Furthermore, the grayscale value IR1_20 of the reference pixel PX_20 in the grayscale image is used as the reference grayscale value corresponding to the reference pixel PX_20 in the grayscale image. Finally, the grayscale value IR1_100 of the reference pixel PX_100 in the grayscale image is used as the reference grayscale value corresponding to the reference pixel PX_100 in the grayscale image.

[0111] S14. Control the light source of the display to display a default brightness.

[0112] For example, the default brightness can be a brightness value between 70 and 80. For example, the controller 250 can control the TV backlight to display a brightness value of 70. Alternatively, the controller 250 can control the TV backlight to display a brightness value of 75. Alternatively, the controller 250 can control the TV backlight to display a brightness value of 80. Of course, in actual applications, the brightness value corresponding to the default brightness can be determined based on actual application requirements and is not limited here.

[0113] S15. Control the image collector to collect a depth image and a grayscale image corresponding to the default brightness, and determine the detection depth value corresponding to the reference pixel point in the depth image corresponding to the default brightness, and determine the detection grayscale value corresponding to the reference pixel point in the grayscale image corresponding to the default brightness.

[0114] For example, when the TV backlight displays a brightness value of 70, the image collector can be controlled to collect a depth image and a grayscale image. Among them, for the depth image: the depth value BZ2_3 of the reference pixel point PX_3 in the depth image is used as the detection depth value corresponding to the reference pixel point PX_3 in the depth image. In addition, the depth value BZ2_20 of the reference pixel point PX_20 in the depth image is used as the detection depth value corresponding to the reference pixel point PX_20 in the depth image. And, the depth value BZ2_100 of the reference pixel point PX_100 in the depth image is used as the detection depth value corresponding to the reference pixel point PX_100 in the depth image.

[0115] Furthermore, for the grayscale image: the grayscale value IR2_3 of the reference pixel PX_3 in the grayscale image is used as the detected grayscale value corresponding to the reference pixel PX_3 in the grayscale image. Furthermore, the grayscale value IR2_20 of the reference pixel PX_20 in the grayscale image is used as the detected grayscale value corresponding to the reference pixel PX_20 in the grayscale image. Finally, the grayscale value IR2_100 of the reference pixel PX_100 in the grayscale image is used as the detected grayscale value corresponding to the reference pixel PX_100 in the grayscale image.

[0116] S16. The detection difference range includes a depth difference range and a grayscale difference range. The depth difference range can be 0±ΔSD. The grayscale difference range can be 0±ΔIRD. ΔSD can be a value such as 0.1, 0.05, or 0.009, and ΔIRD can be a value such as 0.1, 0.05, or 0.009. In actual applications, ΔSD and ΔIRD can be determined based on actual application requirements and are not limited here.

[0117] Determine whether the detected depth difference between the reference depth value and the detected depth value corresponding to the same reference pixel satisfies the detected depth difference range. Also, determine whether the detected grayscale difference between the reference grayscale value and the detected grayscale value corresponding to the same reference pixel satisfies the detected grayscale difference range. If so, proceed to step S17. If not, proceed to step S18.

[0118] S17. Determine that the brightness of the light source does not need to be adjusted.

[0119] For example, the depth difference corresponding to reference pixel PX_3 is: BZ1_3 - BZ2_3. The depth difference corresponding to reference pixel PX_20 is: BZ1_20 - BZ2_20. The depth difference corresponding to reference pixel PX_100 is: BZ1_100 - BZ2_100. Furthermore, the grayscale difference corresponding to reference pixel PX_3 is: IR1_3 - IR2_3. The grayscale difference corresponding to reference pixel PX_20 is: IR1_20 - IR2_20. The grayscale difference corresponding to reference pixel PX_100 is: IR1_100 - IR2_100.

[0120] If the depth difference corresponding to reference pixel PX_3 is BZ1_3 - BZ2_3, the depth difference corresponding to reference pixel PX_20 is BZ1_20 - BZ2_20, and the depth difference corresponding to reference pixel PX_100 is BZ1_100 - BZ2_100, all of which meet the depth difference range. Furthermore, the grayscale difference corresponding to reference pixel PX_3 is IR1_3 - IR2_3. The grayscale difference corresponding to reference pixel PX_20 is IR1_20 - IR2_20. The grayscale difference corresponding to reference pixel PX_100 is IR1_100 - IR2_100, all of which meet the grayscale difference range, then the TV backlight brightness has little impact on the image acquisition device, and no additional backlight brightness adjustment is required.

[0121] S18. Determine whether the brightness of the light source needs to be adjusted.

[0122] For example, the depth difference corresponding to reference pixel PX_3 is: BZ1_3 - BZ2_3. The depth difference corresponding to reference pixel PX_20 is: BZ1_20 - BZ2_20. The depth difference corresponding to reference pixel PX_100 is: BZ1_100 - BZ2_100. Furthermore, the grayscale difference corresponding to reference pixel PX_3 is: IR1_3 - IR2_3. The grayscale difference corresponding to reference pixel PX_20 is: IR1_20 - IR2_20. The grayscale difference corresponding to reference pixel PX_100 is: IR1_100 - IR2_100.

[0123] If the depth difference corresponding to reference pixel PX_3 is BZ1_3 - BZ2_3, the depth difference corresponding to reference pixel PX_20 is BZ1_20 - BZ2_20, and the depth difference corresponding to reference pixel PX_100 is BZ1_100 - BZ2_100, all of these values ​​meet the depth difference range. Furthermore, the grayscale difference corresponding to reference pixel PX_3 is IR1_3 - IR2_3. The grayscale difference corresponding to reference pixel PX_20 is IR1_20 - IR2_20. The grayscale difference corresponding to reference pixel PX_100 is IR1_100 - IR2_100, which does not meet the grayscale difference range, indicates that the TV backlight brightness has a significant impact on the image acquisition device, and the backlight brightness needs to be adjusted.

[0124] Alternatively, if the depth difference corresponding to reference pixel PX_3 is BZ1_3 - BZ2_3, the depth difference corresponding to reference pixel PX_20 is BZ1_20 - BZ2_20, and the depth difference corresponding to reference pixel PX_100 is BZ1_100 - BZ2_100, these values ​​do not meet the depth difference range. Meanwhile, the grayscale difference corresponding to reference pixel PX_3 is IR1_3 - IR2_3. The grayscale difference corresponding to reference pixel PX_20 is IR1_20 - IR2_20. The grayscale difference corresponding to reference pixel PX_100 is IR1_100 - IR2_100, which also meet the grayscale difference range, indicates that the TV backlight brightness is significantly affecting the image acquisition device, and therefore the TV backlight brightness needs to be adjusted.

[0125] Alternatively, if the depth difference corresponding to reference pixel PX_3 is BZ1_3 - BZ2_3, the depth difference corresponding to reference pixel PX_20 is BZ1_20 - BZ2_20, and the depth difference corresponding to reference pixel PX_100 is BZ1_100 - BZ2_100, these values ​​do not meet the depth difference range. Furthermore, if the grayscale difference corresponding to reference pixel PX_3 is IR1_3 - IR2_3, the grayscale difference corresponding to reference pixel PX_20 is IR1_20 - IR2_20, and the grayscale difference corresponding to reference pixel PX_100 is IR1_100 - IR2_100, these values ​​also do not meet the grayscale difference range. This indicates that the brightness of the TV backlight is significantly affecting the image acquisition device, and therefore the backlight brightness needs to be adjusted.

[0126] b. Set the type of image to include a depth image.

[0127] In this embodiment, the controller 250 can be configured to execute steps: S11-S18, wherein steps S11, S12, and S14 are substantially the same as the above-mentioned steps S11, S12, and S14, and are not described in detail here. Only the differences are described below.

[0128] S13: Control the image collector to collect a depth image corresponding to the set low brightness, and determine a reference depth value corresponding to a reference pixel point in the depth image corresponding to the set low brightness.

[0129] For example, when the TV backlight displays a brightness value of 0, the image collector can be controlled to collect a depth image. For the depth image, the depth value BZ1_3 of the reference pixel point PX_3 in the depth image is used as the reference depth value corresponding to the reference pixel point PX_3 in the depth image. In addition, the depth value BZ1_20 of the reference pixel point PX_20 in the depth image is used as the reference depth value corresponding to the reference pixel point PX_20 in the depth image. And, the depth value BZ1_100 of the reference pixel point PX_100 in the depth image is used as the reference depth value corresponding to the reference pixel point PX_100 in the depth image.

[0130] S15 . Control the image collector to collect a depth image corresponding to a default brightness, and determine a detection depth value corresponding to a reference pixel point in the depth image corresponding to the default brightness.

[0131] For example, when the TV backlight displays a brightness value of 70, the image collector can be controlled to collect a depth image. For the depth image, the depth value BZ2_3 of the reference pixel point PX_3 in the depth image is used as the detection depth value corresponding to the reference pixel point PX_3 in the depth image. In addition, the depth value BZ2_20 of the reference pixel point PX_20 in the depth image is used as the detection depth value corresponding to the reference pixel point PX_20 in the depth image. And, the depth value BZ2_100 of the reference pixel point PX_100 in the depth image is used as the detection depth value corresponding to the reference pixel point PX_100 in the depth image.

[0132] S16. The detection difference range includes a detection depth difference range. The detection depth difference range may be 0±ΔSD. ΔSD may be a value such as 0.1, 0.05, or 0.009. In practical applications, ΔSD may be determined based on actual application requirements and is not limited here.

[0133] Determine whether the detected depth difference between the reference depth value and the detected depth value corresponding to the same reference pixel point meets the detected depth difference range. If so, execute step S17. If not, execute step S18.

[0134] S17. Determine that the brightness of the light source does not need to be adjusted.

[0135] For example, the depth difference corresponding to reference pixel PX_3 is BZ1_3-BZ2_3. The depth difference corresponding to reference pixel PX_20 is BZ1_20-BZ2_20. The depth difference corresponding to reference pixel PX_100 is BZ1_100-BZ2_100. If the depth difference corresponding to reference pixel PX_3 is BZ1_3-BZ2_3, the depth difference corresponding to reference pixel PX_20 is BZ1_20-BZ2_20, and the depth difference corresponding to reference pixel PX_100 is BZ1_100-BZ2_100, all of these satisfy the depth difference range. This indicates that the brightness of the TV backlight has little impact on the image acquisition device, and thus no additional adjustment of the TV backlight brightness is required.

[0136] S18. Determine whether the brightness of the light source needs to be adjusted.

[0137] For example, the depth difference corresponding to the reference pixel PX_3 is: BZ1_3 - BZ2_3. The depth difference corresponding to the reference pixel PX_20 is: BZ1_20 - BZ2_20. The depth difference corresponding to the reference pixel PX_100 is: BZ1_100 - BZ2_100.

[0138] If the detection depth difference corresponding to the reference pixel point PX_3 is: BZ1_3-BZ2_3, the detection depth difference corresponding to the reference pixel point PX_20 is: BZ1_20-BZ2_20, and the detection depth difference corresponding to the reference pixel point PX_100 is: BZ1_100-BZ2_100, and at least one of them does not meet the detection depth difference range, it means that the brightness of the TV backlight has a greater impact on the image collector, and the brightness of the TV backlight needs to be adjusted.

[0139] c. Set the image type to include grayscale image.

[0140] In this embodiment, the controller 250 can be configured to execute steps: S11-S18, wherein steps S11, S12, and S14 are substantially the same as the above-mentioned steps S11, S12, and S14, and are not described in detail here. Only the differences are described below.

[0141] S13 , controlling the image collector to collect a grayscale image corresponding to the set low brightness, and determining a reference grayscale value corresponding to a reference pixel point in the grayscale image corresponding to the set low brightness.

[0142] For example, when the TV backlight displays a brightness value of 0, the image collector can be controlled to capture a grayscale image. For this grayscale image, the grayscale value IR1_3 of the reference pixel PX_3 in the grayscale image is used as the reference grayscale value corresponding to the reference pixel PX_3 in the grayscale image. Furthermore, the grayscale value IR1_20 of the reference pixel PX_20 in the grayscale image is used as the reference grayscale value corresponding to the reference pixel PX_20 in the grayscale image. Furthermore, the grayscale value IR1_100 of the reference pixel PX_100 in the grayscale image is used as the reference grayscale value corresponding to the reference pixel PX_100 in the grayscale image.

[0143] S15 , controlling the image collector to collect a grayscale image corresponding to a default brightness, and determining a detection grayscale value corresponding to a reference pixel point in the grayscale image corresponding to the default brightness.

[0144] For example, when the TV backlight displays a brightness value of 70, the image collector can be controlled to capture a grayscale image. For this grayscale image, the grayscale value IR2_3 of the reference pixel PX_3 in the grayscale image is used as the detection grayscale value corresponding to the reference pixel PX_3 in the grayscale image. Furthermore, the grayscale value IR2_20 of the reference pixel PX_20 in the grayscale image is used as the detection grayscale value corresponding to the reference pixel PX_20 in the grayscale image. Furthermore, the grayscale value IR2_100 of the reference pixel PX_100 in the grayscale image is used as the detection grayscale value corresponding to the reference pixel PX_100 in the grayscale image.

[0145] S16. The detection difference range includes a detection grayscale difference range. The grayscale difference range may be 0±ΔIRD. ΔIRD may be a value such as 0.1, 0.05, or 0.009. In practical applications, ΔIRD may be determined based on actual application requirements and is not limited herein.

[0146] Determine whether the detection grayscale difference between the reference grayscale value and the detection grayscale value corresponding to the same reference pixel point meets the detection grayscale difference range. If so, execute step S17. If not, execute step S18.

[0147] S17. Determine that the brightness of the light source does not need to be adjusted.

[0148] For example, the grayscale difference corresponding to the reference pixel PX_3 is IR1_3 - IR2_3, the grayscale difference corresponding to the reference pixel PX_20 is IR1_20 - IR2_20, and the grayscale difference corresponding to the reference pixel PX_100 is IR1_100 - IR2_100.

[0149] If the grayscale difference corresponding to reference pixel PX_3 is IR1_3 - IR2_3, the grayscale difference corresponding to reference pixel PX_20 is IR1_20 - IR2_20, and the grayscale difference corresponding to reference pixel PX_100 is IR1_100 - IR2_100, and all meet the grayscale difference range, then the TV backlight brightness has little impact on the image acquisition device, and no additional adjustment of the TV backlight brightness is required.

[0150] S18. Determine whether the brightness of the light source needs to be adjusted.

[0151] For example, the grayscale difference corresponding to the reference pixel PX_3 is IR1_3 - IR2_3, the grayscale difference corresponding to the reference pixel PX_20 is IR1_20 - IR2_20, and the grayscale difference corresponding to the reference pixel PX_100 is IR1_100 - IR2_100.

[0152] If the grayscale difference corresponding to reference pixel PX_3 is IR1_3 - IR2_3, the grayscale difference corresponding to reference pixel PX_20 is IR1_20 - IR2_20, and the grayscale difference corresponding to reference pixel PX_100 is IR1_100 - IR2_100, and at least one of these grayscale differences does not meet the grayscale difference range, then the TV backlight brightness has a significant impact on the image acquisition device, and the TV backlight brightness needs to be adjusted.

[0153] 3. Determine whether the brightness of the light source needs to be adjusted.

[0154] For example, the first adjustment mode instruction may be a manual mode adjustment instruction, so that when the controller 250 detects that the user inputs the first adjustment mode instruction, the process of the manual adjustment mode may be entered.

[0155] For example, the second adjustment mode instruction may be an automatic mode adjustment instruction, so that when the controller 250 detects that the user inputs the second adjustment mode instruction, the process of the automatic adjustment mode may be entered.

[0156] Figure 8 Schematic diagram of some other brightness adjustment methods implemented by the controller 250. Figure 8 As shown, the controller 250 is further configured to perform the following steps:

[0157] S21. When it is determined that the brightness of the light source needs to be adjusted, the display is controlled to display a selection adjustment interface having a manual adjustment button and an automatic adjustment button. For example, Figure 9 FIG. 1 shows a selection and adjustment interface U1 displayed on a television. The selection and adjustment interface U1 can be displayed in an on-screen display (OSD) manner.

[0158] S22. Detecting that the user inputs a manual mode adjustment instruction via the manual adjustment selection button. For example, the user can manually press a button on the control device 100 to input an instruction to the display controller 250 via the button on the control device 100, thereby selecting the manual adjustment selection button to input the manual mode adjustment instruction into the controller 250, causing the controller 250 to activate the manual adjustment mode.

[0159] S23. Detecting that the user inputs an automatic mode adjustment instruction via the automatic adjustment selection button. For example, the user can manually press a button on the control device 100 to input an instruction to the display controller 250 via the button on the control device 100, thereby selecting the automatic adjustment selection button to input the automatic mode adjustment instruction to the controller 250, causing the controller 250 to activate the automatic adjustment mode.

[0160] 4. Manual adjustment mode.

[0161] Figure 10 Schematic diagrams of some manual adjustment mode interfaces are shown as examples. Figure 10As shown, in some examples, the controller 250 is configured to: when detecting that the user inputs a first adjustment mode instruction, control the display to display a first adjustment mode interface U2 having a first adjustment mode button, so that the brightness of the light source can be manually adjusted through the first adjustment mode button; and when manually adjusting the brightness of the light source, control the image collector to collect multiple target depth images and adjust the brightness of the light source, and when determining that the brightness of the light source after adjustment is valid based on the collected multiple target depth images, control the first adjustment mode interface to display the content of the completion of the first adjustment mode. Exemplarily, the first adjustment mode interface U2 can be displayed through an OSD. The user can manually press a button on the control device 100 to input an instruction to the controller 250 of the display through the button on the control device 100, so as to select the first adjustment mode button, so as to input an instruction to the controller 250 through the first adjustment mode button, so that the controller 250 starts the manual adjustment process.

[0162] Based on the above embodiment, when it is detected that the user inputs the first adjustment mode instruction, the brightness of the light source can be manually adjusted, and combined with the target depth image captured by the image collector, it can be determined whether the brightness of the adjusted light source is effective. If it is effective, the accuracy and stability of the image collector can be improved.

[0163] In some examples, the controller 250 is further configured to, when manually adjusting the brightness of the light source, perform the current brightness adjustment upon detecting a user input command via the first adjustment mode button. For example, the user selects the first adjustment mode button via a button on the control device 100. Each time the user presses the button on the control device 100, the first adjustment mode button flashes once, indicating that the current brightness adjustment has been initiated. In some examples, the first adjustment mode interface U2 may also display set step brightness values. For example, if the set step brightness value is 1, each flash of the first adjustment mode button decreases the brightness of the TV backlight by one brightness value. Alternatively, if the set step brightness value is 2, each flash of the first adjustment mode button decreases the brightness of the TV backlight by two brightness values. Alternatively, if the set step brightness value is 3, each flash of the first adjustment mode button decreases the brightness of the TV backlight by three brightness values. Of course, in actual applications, the set step brightness values ​​can be determined based on actual application needs and are not limited here.

[0164] Figure 11 Schematic diagram of some other brightness adjustment methods implemented by the controller. Figure 11 As shown, the controller 250 is further configured to perform the following steps:

[0165] S31 . During the current brightness adjustment, the brightness of the primary light source is reduced based on the set step brightness value.

[0166] For example, taking the set step brightness value as 1 and the brightness of the TV backlight as 70, the user selects the first adjustment mode button through the button on the control device 100. When the user presses the button on the control device 100 once, the first adjustment mode button flashes once accordingly, and the brightness of the TV backlight is reduced by 1 brightness value, that is, the brightness value of the TV backlight is 69 at this time.

[0167] S32: Control the image collector to collect multiple target depth images.

[0168] For example, the controller 250 controls the image collector to continuously collect R target depth images. The target depth images collected by the image collector are images within its visible area. R can be set to 20, 30, 40 or more values, which are not limited here.

[0169] S33: Determine the minimum variance of the depth values ​​corresponding to the reference pixel points in the multiple acquired target depth images.

[0170] Exemplarily, the R target depth images continuously captured by the image collector are defined in sequence as: the first target depth image MX_1, the second target depth image MX_2, the third target depth image MX_3, ... the rth target depth image MX_r (r is an integer, and 1≤r≤R), ... the Rth target depth image MX_R.

[0171] The depth value corresponding to the reference pixel point PX_3 in the rth target depth image MX_r is P3_r. And the variance SP_3 corresponding to the reference pixel point PX_3 is determined by formulas (5) and (6):

[0172] (5).

[0173] (6).

[0174] The depth value corresponding to the reference pixel point PX_20 in the rth target depth image MX_r is P20_r. And the variance SP_20 corresponding to the reference pixel point PX_20 is determined by formulas (7) and (8):

[0175] (7).

[0176] (8).

[0177] The depth value corresponding to the reference pixel point PX_100 in the rth target depth image MX_r is P100_r. And the variance SP_100 corresponding to the reference pixel point PX_100 is determined by formulas (9) and (10):

[0178] (9).

[0179] (10).

[0180] Thus, based on the variance SP_3, the minimum variance corresponding to the reference pixel point PX_3 is determined. Based on the variance SP_20, the minimum variance corresponding to the reference pixel point PX_20 is determined. And, based on the variance SP_100, the minimum variance corresponding to the reference pixel point PX_100 is determined.

[0181] S34: When it is determined that the minimum variance satisfies the minimum variance range, determine a real-time depth value.

[0182] For example, the minimum variance range can be determined based on the needs of the actual application and is not limited here. When it is determined that the minimum variances corresponding to all reference pixels meet the minimum variance range, the real-time depth value can be determined. The real-time depth value is the average of the depth values ​​corresponding to the reference pixels in the multiple target depth images.

[0183] For example, the depth value corresponding to the reference pixel point PX_3 in the rth target depth image MX_r is P3_r. Then the real-time depth value P3_0 corresponding to the reference pixel point PX_3 is determined by formula (11):

[0184] (11).

[0185] And, the depth value corresponding to the reference pixel point PX_20 in the rth target depth image MX_r is P20_r. Then the real-time depth value P20_0 corresponding to the reference pixel point PX_20 is: .

[0186] And, the depth value corresponding to the reference pixel point PX_100 in the rth target depth image MX_r is P100_r. Then the real-time depth value P100_0 corresponding to the reference pixel point PX_100 is determined by formula (12):

[0187] (12).

[0188] S35: Determine whether the depth difference between the real-time depth value of each reference pixel and the pre-stored reference depth value meets the set detection depth difference range. If so, execute step S36; if not, execute step S37.

[0189] For example, the detection depth difference range can be set to 0±ΔP. The detection grayscale difference range can be set to 0±ΔP. Here, ΔP can be a value such as 0.1, 0.05, or 0.009. In actual applications, ΔP can be determined according to the needs of the actual application and is not limited here.

[0190] The depth difference corresponding to the reference pixel PX_3 is: P3_0 - BZ1_3. The depth difference corresponding to the reference pixel PX_20 is: P20_0 - BZ1_20. The depth difference corresponding to the reference pixel PX_100 is: P100_0 - BZ1_100.

[0191] If the depth value differences are: P3_0- BZ1_3, P20_0- BZ1_20, and P100_0- BZ1_100, which all meet the set detection depth difference range, it means that the brightness of the TV backlight after adjustment is effective, and step S36 is executed.

[0192] If at least one of the depth value differences P3_0- BZ1_3, P20_0- BZ1_20, and P100_0- BZ1_100 does not meet the set detection depth difference range, it means that the brightness of the TV backlight after adjustment is invalid and the brightness of the TV backlight needs to be adjusted, thereby executing step S37.

[0193] S36: Determine whether the adjusted brightness of the light source is effective.

[0194] For example, after determining that the brightness of the light source after adjustment is effective, the user can be prompted that the brightness of the TV backlight after the current adjustment is in accordance with the application environment of the image collector. For example, the controller 250 can control the speaker to voice broadcast the content of the current effective adjustment, or the controller 250 can control the display to display the content of the current effective adjustment on the first adjustment mode interface, so as to be displayed on the first adjustment mode interface as the content of manual adjustment completion.

[0195] For example, after determining that the brightness of the light source after adjustment is effective, the controller 250 may further control the display to display the reference depth value and the real-time depth value in the first adjustment mode interface.

[0196] S37: Determine that the adjusted brightness of the light source is invalid, and proceed to the next adjustment of the light source. For example, the next adjustment process may repeat the above steps S31 to S37 until it is determined that the adjusted brightness of the light source is valid.

[0197] For example, when it is determined that the adjusted brightness of the light source is invalid, the controller 250 may further prompt the user to input a command again through the first adjustment mode button to adjust the brightness of the light source until it is determined that the adjusted brightness of the light source is valid. For example, the controller 250 may control the speaker to voice broadcast a message stating that the current adjustment is invalid and that the user should input a command through the first adjustment mode button to adjust the brightness of the light source, or the controller 250 may control the display to display a message stating that the current adjustment is invalid on the first adjustment mode interface.

[0198] 5. Automatic adjustment mode.

[0199] Figure 12 Schematic diagrams of some automatic adjustment mode interfaces are shown as examples. Figure 12 As shown, in some examples, the controller 250 is configured to: automatically adjust the brightness of the light source upon detecting that the user inputs a second adjustment mode instruction; and when the brightness of the light source in the second adjustment mode is adjusted, control the image collector to capture multiple target depth images and adjust the brightness of the light source; when it is determined based on the captured multiple target depth images that the adjusted brightness of the light source is valid, control the display to display a second adjustment mode interface U3 indicating that the second adjustment mode is completed. Exemplarily, the second adjustment mode interface U3 can be displayed via an OSD.

[0200] Based on the above embodiment, when it is detected that the user inputs the second adjustment mode instruction, the brightness of the light source can be automatically adjusted, and combined with the target depth image captured by the image collector, it can be judged whether the brightness of the adjusted light source is effective. If it is effective, the accuracy and stability of the image collector can be improved.

[0201] In some examples, the controller 250 is further configured to, when automatically adjusting the brightness of the light source, directly perform the current brightness adjustment upon detecting a user input of a second adjustment mode command. For example, when the user selects the second adjustment mode button on the control device 100, the automatic adjustment mode is activated, and the current brightness adjustment is initiated.

[0202] In this embodiment, the controller 250 may also be configured to execute steps: S31-S37, wherein steps S32~S35 are substantially the same as the above-mentioned steps S32~S35 and are not described in detail here. Only the differences are described below.

[0203] In some examples, the controller 250 is further configured to perform the following steps:

[0204] S31 . During the current brightness adjustment, the brightness of the primary light source is reduced based on the set step brightness value.

[0205] Exemplarily, the set step brightness value can be pre-stored. For example, if the set step brightness value is 1, then the brightness of the TV backlight is reduced by 1 brightness value when the automatic adjustment is performed once. Alternatively, if the set step brightness value is 2, then the brightness of the TV backlight is reduced by 2 brightness values ​​when the automatic adjustment is performed once. Alternatively, if the set step brightness value is 3, then the brightness of the TV backlight is reduced by 3 brightness values ​​when the automatic adjustment is performed once. Of course, in actual applications, the pre-stored set step brightness value can be determined according to the needs of the actual application and is not limited here.

[0206] For example, taking the setting of the step brightness value to 1 and the brightness of the TV backlight to 70 as an example, during the current automatic adjustment, the brightness of the TV backlight is reduced by 1 brightness value, that is, the brightness value of the TV backlight is 69 at this time.

[0207] S32~S35 are not described in detail here.

[0208] S36: Determine whether the adjusted brightness of the light source is effective.

[0209] For example, after determining that the brightness of the light source after adjustment is effective, the user can be prompted that the brightness of the TV backlight meets the application environment of the image collector after the current adjustment. For example, the controller 250 can control the speaker to voice broadcast the content of the current effective adjustment, or the controller 250 can control the display to display the content of the current effective adjustment on the second adjustment mode interface U3, so as to be displayed on the second adjustment mode interface U3 as the content of the automatic adjustment completion.

[0210] For example, after determining that the brightness of the light source after adjustment is effective, the controller 250 may further control the display to display the reference depth value and the real-time depth value in the second adjustment mode interface U3.

[0211] S37: Determine that the adjusted brightness of the light source is invalid, and proceed to the next adjustment of the light source. For example, the next adjustment process may repeat the above steps S31 to S37 until it is determined that the adjusted brightness of the light source is valid.

[0212] For example, when it is determined that the adjusted brightness of the light source is invalid, the controller 250 may control the process to directly enter the next adjustment of the light source until it is determined that the adjusted brightness of the light source is valid.

[0213] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if such changes and modifications fall within the scope of the claims and their equivalents, the present invention is intended to include such changes and modifications.

Claims

1. A display device, characterized in that: include: a display having a light source; A controller is connected to the display, and the controller is configured to: Detecting a user input start instruction and controlling the display and image collector to start; Controlling the light source of the display to display a low brightness setting; Controlling the image collector to collect a set type of image corresponding to the set low brightness, and determining a reference value corresponding to a reference pixel point in the set type of image corresponding to the set low brightness; Controlling the light source of the display to display a default brightness; Controlling the image collector to collect a set type of image corresponding to the default brightness, and determining a detection value corresponding to a reference pixel point in the set type of image corresponding to the default brightness; Determine whether a detection difference between the reference value and the detection value of the same type corresponding to the same reference pixel point meets a detection difference range; If not, determining that the brightness of the light source needs to be adjusted; When detecting that a user inputs a first adjustment mode instruction, controlling the display to display a first adjustment mode interface having a first adjustment mode button, and when detecting that the user inputs an instruction through the first adjustment mode button, controlling the image collector to capture a target depth image and adjust the brightness of the light source, and when determining that the adjusted brightness of the light source is valid based on the multiple target depth images captured, controlling the first adjustment mode interface to display content that the adjustment is completed; When it is detected that the user inputs the second adjustment mode instruction, the image collector is controlled to collect the target depth image and adjust the brightness of the light source, and when it is determined that the adjusted brightness of the light source is valid based on the collected target depth image, the display is controlled to display the second adjustment mode interface of the content completed by the adjustment.

2. The display device according to claim 1, wherein The first adjustment mode instruction is a manual mode adjustment instruction; The second adjustment mode instruction is an automatic mode adjustment instruction.

3. The display device according to claim 2, wherein The controller is further configured to: Controlling the light source of the display to display a low brightness setting; When the set type of image includes a depth image, the reference value includes a reference depth value; when the image collector is further configured to collect a grayscale image, the set type of image includes a grayscale image, and the reference value includes a reference grayscale value; Controlling the light source of the display to display a default brightness; When the set type of image includes a depth image, the detection value includes a detected depth value; when the set type of image includes a grayscale image, the detection value includes a detected grayscale value.

4. The display device according to claim 1, wherein The controller is further configured to: During the current brightness adjustment, the brightness of the light source is reduced once based on the set step brightness value; Controlling the image collector to collect a plurality of target depth images; Determining a minimum variance of depth values ​​corresponding to reference pixel points in the plurality of acquired target depth images; When it is determined that the minimum variance satisfies the minimum variance range, a real-time depth value is determined; wherein the real-time depth value is an average of depth values ​​corresponding to reference pixel points in the plurality of target depth images; Determine whether a depth difference between the real-time depth value of each reference pixel and a pre-stored reference depth value satisfies a set detection depth difference range; If so, determining that the adjusted brightness of the light source is effective; If not, it is determined that the brightness of the light source after adjustment is invalid, and the next adjustment of the light source is started.

5. The display device according to claim 4, wherein The controller is further configured to: When detecting that the user inputs an instruction through the first adjustment mode button, performing the current brightness adjustment; When it is determined that the adjusted brightness of the light source is invalid, the user is prompted to input an instruction again through the first adjustment mode button to adjust the brightness of the light source until it is determined that the adjusted brightness of the light source is valid.

6. The display device according to claim 5, wherein The controller is further configured to: When it is determined that the adjusted brightness of the light source is valid, the first adjustment mode interface is controlled to display the reference depth value and the real-time depth value.

7. The display device according to claim 4, wherein The controller is further configured to: When detecting that the user inputs a second adjustment mode instruction, directly performing the current brightness adjustment; When it is determined that the brightness of the light source after adjustment is invalid, directly enter the next adjustment of the light source until it is determined that the brightness of the light source after adjustment is valid.

8. The display device according to claim 7, wherein The controller is further configured to: When it is determined that the adjusted brightness of the light source is valid, the second adjustment mode interface is controlled to display the reference depth value and the real-time depth value.

9. The display device according to any one of claims 3 to 8, wherein: The controller is further configured to: determine the reference pixel point by adopting the following steps; Controlling the display and the image collector to start, and controlling the light source to turn off; Controlling the image collector to collect a plurality of first detection depth images; Determining a first detected depth value corresponding to a same pixel point in a set area of ​​the first detected depth image; Controlling the light source to turn on, and controlling the light source to turn off after a set time; Controlling the image collector to collect a plurality of second detection depth images; Determining a second detected depth value corresponding to a same pixel point in a set area of ​​the second detected depth image; A reference pixel is determined from the pixels within the set area according to the first detected depth value and the second detected depth value of the same pixel.

10. A brightness adjustment method, characterized in that: include: Detecting a user input start instruction and controlling the display and image collector to start; Controlling the light source of the display to display a low brightness setting; Controlling the image collector to collect a set type of image corresponding to the set low brightness, and determining a reference value corresponding to a reference pixel point in the set type of image corresponding to the set low brightness; Controlling the light source of the display to display a default brightness; Controlling the image collector to collect a set type of image corresponding to the default brightness, and determining a detection value corresponding to a reference pixel point in the set type of image corresponding to the default brightness; Determine whether a detection difference between the reference value and the detection value of the same type corresponding to the same reference pixel point meets a detection difference range; If not, determining that the brightness of the light source needs to be adjusted; When detecting that a user inputs a first adjustment mode instruction, controlling the display to display a first adjustment mode interface having a first adjustment mode button, and when detecting that the user inputs an instruction through the first adjustment mode button, controlling the image collector to capture a target depth image and adjust the brightness of the light source, and when determining that the adjusted brightness of the light source is valid based on the multiple target depth images captured, controlling the first adjustment mode interface to display content that the adjustment is completed; When it is detected that the user inputs the second adjustment mode instruction, the image collector is controlled to collect the target depth image and adjust the brightness of the light source, and when it is determined that the adjusted brightness of the light source is valid based on the collected target depth image, the display is controlled to display the second adjustment mode interface of the content completed by the adjustment.

Images