Display device and method for processing data of temperature sensor

Abstract

The invention discloses a display device and a processing method of data of a temperature sensor, the display device comprises a display device, a human body detection device and a control device, the human body detection device comprises a temperature sensor and a distance sensor, the control device is configured to determine whether a human body exists on the display side of the display device according to the object position data from the distance sensor and the temperature data from the temperature sensor; obtaining differential temperature data according to the temperature data and stored background data; and determining whether a human body exists on the display side of the display device according to the temperature value of each pixel position in the differential temperature data. The display device determines whether the human body exists or not according to the difference temperature data obtained through the difference value of the temperature data and the background data, so that the influence of a temperature high point possibly existing in the background data on an identification result is avoided, and the accuracy of identifying whether the human body exists or not is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of display devices, and more specifically, to a method for processing data of a display device and a temperature sensor. Background Art

[0002] With the continuous development of electronic technology, display devices have more and more functions, making display devices more intelligent. Some display devices are equipped with temperature sensors, which can be used to detect human bodies on the display side of the display device. When the temperature difference sensor detects human bodies and determines that the user has left the display device, the display device can stop displaying to achieve functions such as automatic shutdown, thereby saving energy. However, the accuracy of human body detection through temperature sensors in the prior art is low, which affects the user experience of the display device. Summary of the invention

[0003] The present application provides a display device and a method for processing temperature sensor data to solve the technical problem of low accuracy in human body detection through temperature sensors in the prior art, thereby improving the user experience of the display device.

[0004] In a first aspect, the present application provides a display device, comprising: a display device, configured to display a picture; a human body detection device, configured to obtain temperature data and object position data on a display side of the display device; a control device, connected to the display device and the human body detection device, respectively, configured to determine whether there is a human body on the display side of the display device according to the temperature data and the object position data, and control the display device to display the picture; the human body detection device comprises: a distance sensor, configured to detect object position data on the display side of the display device; a temperature sensor, configured to detect temperature data on the display side of the display device; the control device is connected to the distance sensor and the temperature sensor, respectively, and configured to determine whether there is a human body on the display side of the display device according to the object position data and the temperature data; the control device is specifically configured to: obtain differential temperature data according to the temperature data and stored background data; and determine whether there is a human body on the display side of the display device according to the temperature value of each pixel position in the differential temperature data.

[0005] The display device provided in this embodiment determines whether there is a human body by differential temperature data obtained by the difference between temperature data and background data. Compared with directly determining whether there is a human body by the peak value of the temperature value in the temperature data, this avoids the influence of possible high temperature points in the background data on the recognition results, thereby improving the accuracy of identifying whether there is a human body based on the temperature data of the temperature sensor, thereby ensuring the accuracy and effectiveness of subsequent processing performed by the display device based on the human body recognition result, and improving the user experience of the display device.

[0006] In some embodiments, when it is determined that there is no human body on the display side of the display device, the stored background data is updated according to the temperature data, thereby ensuring the real-time nature of the background data and improving the accuracy and real-time nature of identifying whether there is a human body through the background data.

[0007] In some embodiments, when it is determined that there is a human body on the display side of the display device and the background data has not been updated within a preset update time, the stored background data is updated according to the temperature data.

[0008] This embodiment determines whether a human body is present through the object position data of the distance sensor, thereby deciding whether to update the background data of the temperature sensor. This can effectively prevent the temperature data of the temperature sensor itself from affecting the update of the background data, thereby ensuring the accuracy of the update result, and further ensuring the accuracy of the control device in identifying the human body based on the temperature data.

[0009] In some embodiments, whether there is a human body on the display side of the display device is determined based on object position data from a distance sensor.

[0010] In some embodiments, when it is determined that there is a human body on the display device side and the background data has not been updated within a preset update time, multiple target parts in the stored background data are updated according to a plurality of continuous temperature data; wherein the multiple target parts are located within the entire area of ​​the temperature data, gradually approaching the position of the human body in the temperature data from the four sides of the temperature data. In one embodiment, the area where the human body is located is determined based on the position of the largest N pixels in the temperature value of each pixel position of the differential temperature data as the center, and the part of the background data other than the area where the human body is located is determined as the target part.

[0011] The control device of the display device provided in this embodiment completes the update of the background data by a successive update method even when the temperature data includes the human body. On the basis of ensuring the real-time and effectiveness of the background data, the timing and method of updating the background data are further improved. When there are cold sources and heat sources in the background data, these persistent temperature sources are eliminated in the background data, avoiding the influence of the external environment on the human body recognition results, thereby improving the accuracy of human body recognition. At the same time, the multiple update methods that gradually approach the human body area can also update the background data more comprehensively, prevent omissions when updating the background data, and avoid the situation where some areas are not updated due to inaccurate human body recognition in the temperature data at one time.

[0012] In some embodiments, the control device is specifically configured to: determine the mean square error, mean square value and maximum value of the temperature value at each pixel position in the differential temperature data; compare the mean square error, the mean square value and the maximum value with a first threshold, a second threshold and a third threshold, respectively, to obtain a first comparison result, a second comparison result and a third comparison result; after performing an OR logic calculation based on the first comparison result and the second comparison result, determine whether there is a human body on the display side of the display device based on the result of the AND logic calculation performed with the third comparison result.

[0013] The display device provided in this embodiment uses the mean square error, mean square value and maximum value of the differential temperature data to more comprehensively judge whether there is a human body in the differential temperature data. Since more parameters are used and the dimensions of the parameter sources are more comprehensive, this method can improve the accuracy of judging whether there is a human body based on the temperature data.

[0014] In some embodiments, the control device is specifically configured to: determine a threshold scaling factor based on the distance between the human body and the display side of the display device, wherein the scaling factor is inversely proportional to the distance; process the first threshold, the second threshold, and the third threshold according to the scaling factor; and compare the mean square error, the mean square value, and the maximum value with the processed first threshold, the second threshold, and the third threshold to obtain a first comparison result, a second comparison result, and a third comparison result, respectively.

[0015] The control device of the display device provided in this embodiment can use different scaling factors to process the threshold value according to the different distances between the human body and the display device in the temperature data, and compare the differential temperature data with the threshold value processed by the scaling factor to determine whether there is a human body on the display side of the display device. Taking into account the different intensities of the temperature data obtained by the temperature sensors at different distances, the threshold value is processed according to the scaling factor inversely proportional to the distance. When the temperature value is small, it can be ensured that the human body in the temperature data can be obtained by comparison to avoid the situation where the human body cannot be recognized. When the temperature value is large, it can avoid the erroneous recognition of all temperature values ​​as human bodies, thereby further improving the accuracy of human body recognition based on temperature data.

[0016] In some embodiments, the control device is specifically configured to: after the display device is turned on, when the background data is not stored, determine whether there is a human body on the display side of the display device; when it is determined that there is no human body on the display side of the display device, generate the background data according to the temperature data; when it is determined that there is a human body on the display side of the display device and it lasts for a preset judgment time, generate the background data according to the temperature data. This avoids more serious consequences such as subsequent failure to perform human body recognition due to failure to generate background data, and ensures the completeness of the entire processing flow of the display device.

[0017] A second aspect of the present application provides a method for processing data from a temperature sensor of a display device, which can be applied to a display device such as any one of the first aspect of the present application. For example, the processing method includes: acquiring temperature data from a temperature sensor; obtaining differential temperature data based on the temperature data and stored background data; and determining whether a human body exists on the display side of the display device based on the temperature value of each pixel position in the differential temperature data.

[0018] In the method for processing data from the temperature sensor of the display device provided in the present embodiment, differential temperature data obtained by the difference between the temperature data and the background data is used to determine whether a human body exists. Compared with directly determining whether a human body exists by the peak value of the temperature value in the temperature data, this method avoids the influence of possible high temperature points in the background data on the recognition result, thereby improving the accuracy of identifying whether a human body exists based on the temperature data of the temperature sensor, thereby ensuring the accuracy and effectiveness of subsequent processing performed by the display device based on the human body recognition result, and improving the user experience of the display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the implementation methods in the embodiments of the present application or the related technologies, the following is a brief introduction to the drawings required for use in the embodiments or the related technology descriptions. Obviously, the drawings described below are some embodiments of the present application, and a person skilled in the art can also obtain other drawings based on these drawings.

[0020] Figure 1 A specific implementation of a structure of a display device provided in this application;

[0021] Figure 2 A specific implementation of another structure of the display device provided by the present application;

[0022] Figure 3 A specific implementation of another structure of the display device provided in this application;

[0023] Figure 4 It is a structural schematic diagram of a display device in the related art;

[0024] Figure 5 A flow chart of a control method of a display device in the related art;

[0025] Fig. 6A A schematic diagram of the structure of an embodiment of a display device provided by the present application;

[0026] Figure 6B A schematic structural diagram of another embodiment of the display device provided by the present application;

[0027] Figure 7 A schematic diagram of the external structure of the human body detection device provided in this application;

[0028] Figure 8 A schematic diagram of the internal structure of the human body detection device provided in this application;

[0029] Fig. 9 A schematic diagram of a flow chart of an embodiment of a control method for a display device provided in the present application;

[0030] Fig.10 A schematic flow chart of another embodiment of a method for controlling a display device provided in the present application;

[0031] Fig.11 A schematic diagram of the identification area of ​​the radar provided in this application;

[0032] Fig.12 A schematic diagram of the position of an object within the radar's identification area provided for this application;

[0033] Fig.13 A schematic diagram of the position of an object within the recognition area of ​​a temperature sensor provided by the present application;

[0034] Fig.14 A control logic diagram of the control device provided for this application;

[0035] Fig.15 A schematic structural diagram of another embodiment of the display device provided by the present application;

[0036] Fig.16 A schematic diagram of processing data from a distance sensor provided by the present application;

[0037] Fig.17 A schematic diagram of an embodiment of a data processing method for a distance sensor of a display device provided by the present application;

[0038] Fig.18 A schematic diagram of another embodiment of a data processing method for a distance sensor of a display device provided by the present application;

[0039] Fig.19 A schematic flow chart of another embodiment of a method for processing data of a distance sensor of a display device provided by the present application;

[0040] Fig. 20 A schematic diagram of a recognition area of ​​a distance sensor provided in the present application;

[0041] Fig.21 A schematic flow chart of an embodiment of a data processing method for a temperature sensor of a display device provided by the present application;

[0042] Fig. 22 A schematic diagram of the identification area of ​​the radar and the identification area of ​​the temperature sensor provided in this application;

[0043] Fig.23 A schematic diagram of the correspondence between the identification area of ​​the radar provided in this application and the identification area of ​​the temperature sensor;

[0044] Fig.24 A schematic diagram of the target part provided for this application that is updated successively;

[0045] Fig.25 A schematic diagram of the update effect of successive updates provided by this application;

[0046] Fig.26 A schematic diagram of the threshold scaling factor and distance provided for this application;

[0047] Fig. 27 A schematic diagram of the structure of an electronic device provided in this application. DETAILED DESCRIPTION

[0048] In order to make the purpose, implementation mode and advantages of the present application clearer, the exemplary implementation mode of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0049] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0050] In addition, the terms "include" and "have" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to those components expressly listed but may include other components not expressly listed or inherent to such products or devices.

[0051] The display device provided in the embodiments of the present application may have various implementation forms, for example, it may be a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc.

[0052] For example, Figure 1 A specific implementation of a structure of a display device provided in this application, Figure 1 FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to an embodiment. Figure 1As shown, the user can operate the display device 200 through the smart device 300 or the control apparatus 100 .

[0053] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, and the display device 200 is controlled wirelessly or wired. The user may control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, etc.

[0054] In some embodiments, a smart device 300 (such as a mobile terminal, a tablet computer, a computer, a laptop computer, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on the smart device.

[0055] In some embodiments, the display device may not use the above-mentioned smart device or control device to receive instructions, but may receive user control through touch or gestures.

[0056] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.

[0057] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be one cluster or multiple clusters, and may include one or more types of servers.

[0058] Figure 2 1 is a specific implementation of another structure of the display device provided in the present application, and exemplarily shows a configuration block diagram of the control device 100 in an exemplary embodiment. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 120, a user input / output interface 130, a memory 140, and a power supply 150. The control device 100 can receive input operation instructions from the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200.

[0059] Figure 3 Another specific implementation of the structure of the display device provided in this application is as follows: Figure 3The display device 200 includes at least one of a tuner and demodulator 210 , a communicator 220 , a detector 230 , an external device interface 240 , a controller 250 , a display 260 , an audio output interface 270 , a memory 290 , a power supply 280 , and a user interface 300 .

[0060] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output.

[0061] The display 260 includes a display screen component for presenting images, and a driving component for driving image display, which is used to receive image signals output from the controller, and display video content, image content, and menu control interface components and user control UI interface.

[0062] The display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.

[0063] The communicator 220 is a component for communicating with an external device or server according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

[0064] The user interface can be used to receive control signals from the control device 100 (such as an infrared remote controller, etc.).

[0065] The detector 230 is used to collect signals from the external environment or the external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0066] The external device interface 240 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces.

[0067] The tuner-demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

[0068] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0069] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 can perform operations related to the object selected by the user command.

[0070] In some embodiments, the controller includes a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM Random Access Memory (RAM), ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.

[0071] The user may input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command through a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

[0072] "User interface" is the medium interface for interaction and information exchange between applications or operating systems and users. It realizes the conversion between the internal form of information and the form acceptable to users. The commonly used form of user interface is the Graphical User Interface (GUI), which refers to the user interface related to computer operation displayed in a graphical way. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, where the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.

[0073] Figure 4 is a schematic diagram of a structure of a display device in the related art, such as Figure 4The display device 1 shown includes: a display device 10, a control device 11 and a distance sensor 13. The control device 11 is used to control the display device 10 to display a picture. The distance sensor 13 can be a radar, and the distance sensor 13 can be used to detect the position data of an object on the display side of the display device 10 and send it to the control device 11. Specifically, refer to Figure 1 , the display side of the display device 10 is Figure 1 The side facing the user, and the non-display side of the display device 10 is Figure 1 The side of the display device 10 that is away from the user. When the user uses the display apparatus 1 , the user is generally at the display side of the display device 10 to watch the content displayed by the display device 10 .

[0074] Figure 5 FIG. 1 is a flow chart of a control method of a display device in the related art. Figure 5 The method shown can be applied to Figure 4 In the display device shown, it is executed by the control device 11. The control device 11 first obtains the object position data from the distance sensor 13 through S01, and then the control device 11 determines whether there is a human body on the display side of the display device according to the object position data through S02. Finally, the control device 11 controls the display device 10 according to whether there is a human body determined in S02. For example, when the control device 11 determines that there is a person on the display side of the display device, the display device 10 is controlled to continue to display the picture; when the control device 11 determines that there is no one on the display side of the display device, the display device 10 is controlled to stop displaying the picture, etc., thereby saving the overall energy consumption of the display device 1 and improving the user experience of the display device 1.

[0075] However, in the specific implementation process, the control device 11 of the display device 1 has a low accuracy rate in determining whether there is a human body based on the display object position data from the distance sensor 13. In particular, when the human body on the display side of the display device 10 does not move for a long time, if the control device 11 determines that there is no one on the display side of the display device based on the object position data and controls the display device 10 to stop displaying, the user's normal viewing will be interrupted, which greatly affects the user experience of the display device 1.

[0076] Based on this, the present application provides a display device and a control method thereof. By adding an infrared sensor to the display device, the processor not only relies on the object position data, but also combines the temperature data from the infrared sensor to jointly determine whether there is a human body on the display side of the display device, so as to improve the accuracy of human body detection by the display device, thereby improving the user experience of the display device. The technical solution of the present application is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0077] Fig. 6A The display device 1 shown in FIG6 is a schematic diagram of a structure of an embodiment of a display device provided in the present application, and includes:

[0078] The display device 10 is configured to display a picture. The display device 10 may be an LCD display, an LED display, a QLED display, an OLED display, a MiniLED display, or a laser display.

[0079] The control device 11 is connected to the display device 10 and the human body detection device 110 respectively, and the control device 11 is configured to control the display device 10, for example, the control device 11 controls the display device 10 to display a picture or stop displaying a picture, or the control device 11 controls the content displayed by the display device 10. The control device 11 can be a main control chip of the display device 1, such as a CPU, an MCU or a Soc.

[0080] The human body detection device 110 includes a distance sensor 13 and a temperature sensor 14. The distance sensor 13 is configured to detect the object position data on the display side of the display device 10 and send it to the control device 11, and the temperature sensor 14 is configured to detect the temperature data on the display side of the display device 10 and send it to the control device 11.

[0081] The control device 11 is specifically configured to determine whether there is a human body on the display side of the display device 10 based on the object position data and the temperature data.

[0082] In one embodiment, the temperature sensor 14 may be an infrared temperature sensor, a laser temperature sensor, a thermometer, a thermistor, a thermocouple, a digital temperature sensor, an analog temperature sensor, or the like.

[0083] In one embodiment, the distance sensor 13 may be a radar, a laser sensor, a millimeter wave radar sensor, etc. The radar may be a multi-transmitter multi-receiver radar, which has high detection precision and accuracy.

[0084] Figure 6B A schematic diagram of the structure of another embodiment of the display device provided by the present application is shown in FIG. Figure 6B The display device 1 shown also includes a processor 12, which can be used to receive object position data from the distance sensor 13 and temperature data from the temperature sensor 14 and send them to the control device 11 after performing relevant processing. The processor 12 can be a microprocessor such as an MCU, and the processor 12 can be integrated in the control device 11, or it can be a separate processing element. The processing steps related to the object position data and the temperature data provided in the embodiment of the present application can be executed by the control device 11 or by the processor 12, depending on the specific settings of the display device 1.

[0085] For example, the processor 12 can determine whether there is a human body on the display side of the display device according to the object position data and the temperature data, and when it is determined that there is a human body, send the first detection information to the control device 11; when it is determined that there is no human body, send the second detection information to the control device 11. For another example, the processor 12 can send the object position data and the temperature data to the control device 11, and the control device 11 determines whether there is a human body on the display side of the display device according to the object position data and the temperature data.

[0086] Figure 7 This is a schematic diagram of the external structure of the human body detection device provided in the present application, wherein the distance sensor 13 is a radar as an example, and the human body detection device 110 is provided with a temperature sensor 14 and a radar 13 at the same time, and the radar has an antenna A and an antenna B. The temperature sensor 14 and the radar 13 are both arranged toward the display side of the display device 10, and the antenna centerline of the radar 13 and the midpoint of the temperature sensor 14 are on a horizontal line, and the angle between the recognition angle of the radar 13 and the recognition angle of the temperature sensor 14 is set to be less than 3 degrees, so that the positions facing the radar 13 and the temperature sensor 14 are the same and the positions of the collected data sources are close. This is conducive to locating the collected objects by both at the same time, and is convenient for analyzing and judging the same object using two different data.

[0087] Figure 8 The internal structure diagram of the human body detection device provided by the present application is shown as follows Figure 6B The processor 12 in the illustrated embodiment specifically includes: a distance data processing unit 121, a temperature data processing unit 122 and a fusion processing unit 123, wherein the distance data processing unit 121 is connected to the distance sensor 13 via the first interface a, and is used to obtain and process the object position data from the distance sensor 13. The temperature data processing unit 122 is connected to the infrared sensor 14 via the second interface b, and is used to obtain and process the temperature data from the temperature sensor 14. The fusion processing unit 123 is connected to the distance data processing unit 121 and the temperature data processing unit 122 respectively, and is also connected to the control device 11 via the third interface c. The fusion processing unit 123 can be used to generate a detection signal according to the processing result of the distance data processing unit 121 on the object position data and the processing result of the temperature processing unit 122 on the temperature data, and send the detection signal to the control device 11 via the third interface c.

[0088] In one embodiment, the first interface a may be an SPI interface, the second interface b may be an I2C interface, and the third interface c may be a UART interface.

[0089] In summary, the processor in the display device provided in this embodiment processes the object position data from the distance sensor 13 and the temperature data from the temperature sensor 14 by different processing units, and each processing unit is connected through a universal and mature interface, which has the technical effects of simple structure, easy implementation and strong scalability, and is conducive to the application and promotion of the embodiment of the present application. Figure 6B The structure of the processor 12 shown can be based on different processing units, and the processor 12 can also process different data in parallel, thereby reducing the time required to process multiple data, thereby improving the computing efficiency of the processor 12.

[0090] Fig. 9 This is a flow chart of an embodiment of a control method for a display device provided in the present application, such as Fig. 9 The control method shown can be applied to Fig. 6A In the display device shown in FIG. 1 , and executed by the processor 12. Specifically, as Fig. 9 The control methods shown include:

[0091] S10 : The control device 11 obtains the object position data from the distance sensor 13 and the temperature data from the infrared sensor 14 .

[0092] In one embodiment, the distance sensor 13 can collect object position data once at a certain time interval and send it to the control device 11. At the same time, the infrared sensor 14 can also collect temperature data once at the same time interval and send it to the control device 11. Then, the control device 11 can receive the object position data from the distance sensor 13 and the temperature data from the infrared sensor 14 at a certain time interval. Alternatively, the control device 11 can also control the distance sensor 13 and the infrared sensor 14 to collect data respectively at a certain time interval, thereby receiving the object position data from the distance sensor 13 and the temperature data from the infrared sensor 14.

[0093] S20: The control device 11 determines whether there is a human body on the display side of the display device 10 based on the object position data and temperature data acquired in S10.

[0094] In one embodiment, the processor 12 determines whether the object position data satisfies a first preset condition and whether the temperature data satisfies a second preset condition, thereby ultimately determining whether there is a human body on the display side of the display device 10 based on the respective judgment results.

[0095] In one embodiment, when Figure 6BWhen the processor 12 shown determines that there is a human body on the display side of the display device 10, the processor 12 generates a first detection signal and sends it to the control device 11. When it is determined that there is no human body on the display side of the display device 10, the processor 12 generates a second detection signal and sends it to the control device 11. At this time, the control device 11 determines whether there is a human body on the display side of the display device 10 according to the received detection signal.

[0096] In summary, in the control method of the display device provided in this embodiment, the processor 12 can combine the object position data from the distance sensor 13 and the temperature data from the infrared sensor 14, and jointly determine whether there is a human body on the display side of the display device 10 through fusion processing, thereby avoiding errors in some cases when only relying on the data of the distance sensor 13 for human body detection, thereby increasing the accuracy of human body detection, and further improving the user experience of the display device 1.

[0097] It can be understood that, based on the embodiments of the present application, the display device 1 can also be provided with a greater number of sensors, or other sensors. The data of these sensors can be used in combination with the object position data of the distance sensor 13 to jointly determine whether there is a human body on the display side of the display device 10. The technical effect of improving the accuracy of human body detection can also be achieved. The implementation method and principle are the same and will not be repeated here.

[0098] In one embodiment, the infrared sensor 14 provided in the display device 1 as shown in FIG6 can also be replaced by other sensors, and the process of the above embodiment is executed according to the data of the other sensors, and the technical effect of improving the accuracy of human body detection can also be achieved through the fusion judgment method. Alternatively, in another embodiment, the infrared sensor 14 provided in the display device 1 as shown in FIG6 can also be replaced by another distance sensor, and the process of the above process is executed according to the data of the distance sensor, and the technical effect of improving the accuracy of human body detection can also be achieved by fusing the data of the two distance sensors.

[0099] Fig.10 A flow chart of another embodiment of the control method of the display device provided in the present application is shown as follows: Fig.10 The method described shows Fig. 9 A specific implementation of S20 shown in FIG. Fig.10 As shown, after the control device 11 acquires the object position data and the temperature data, the control device 11 determines whether the object position data satisfies a first preset condition through S201. Exemplarily, the first preset condition includes that the difference between the position coordinates of the object included in the object position data of the current object and the position of the object in the historical object position data stored in advance is less than a preset distance value.

[0100] When the control device 11 determines that the object position data meets the first preset condition, it can be determined in step S203 that there is a human body on the display side of the display device 10 .

[0101] When the control device 11 determines that the object position data does not meet the first preset condition, it does not directly determine that there is no human body on the display side of the display device 10, but continues to determine whether the temperature data meets the second preset condition through S202. Exemplarily, the second preset condition includes that at least one target temperature value included in the temperature data is greater than a preset temperature value.

[0102] When the control device 11 determines that the temperature data meets the second preset condition, it can be determined in step S203 that there is a human body on the display side of the display device 10 .

[0103] When the control device 11 determines that the temperature data does not satisfy the second preset condition, it can be determined in step S204 that there is no human body on the display side of the display device 10 .

[0104] It can be seen that only when the object position data does not meet the first preset condition and the temperature data does not meet the second preset condition, the control device 11 determines that there is no human body on the display side of the display device 10. Therefore, when the user of the display device 1 is stationary on the display side of the display device 10, even if the control device 11 determines that the first preset condition is not met based on the object position data, it will not directly determine that there is no human body on the display side of the display device 10, but will make another judgment based on the temperature data. Since the human body is stationary at this time and still has a certain temperature, the control device 11 can still determine that there is a human body on the display side of the display device 10 based on the temperature data.

[0105] In summary, in the control method of the display device provided in this embodiment, the processing logic of the control device 11 for jointly judging whether there is a human body based on the object position data and temperature data is further refined, so that the control method has a higher granularity and is easy to implement and use. Ultimately, the control device 11 can effectively avoid the problem of misidentification of object position data in some scenarios based on the two-level judgment of object position data and temperature data, thereby improving the accuracy of human body detection.

[0106] In the above embodiment of the present application, when the control device 11 determines that the object position data does not meet the first preset condition, it can continue to judge whether the temperature data meets the second preset condition. However, in some cases, taking the distance sensor 13 as a radar, since the area of ​​the identification area of ​​the temperature sensor 14 is smaller than the area of ​​the identification area of ​​the radar 13, in an embodiment of the present application, when the control device 11 determines that the object position data does not meet the first preset condition in S201, if the position information of the object in the current object position data corresponds to the area within the first target area in the identification area of ​​the radar 13, the control device 11 then executes S202 to determine whether the temperature data meets the second preset condition, and then determines whether there is a human body on the display side of the display device 10 according to the judgment result of S202. If the position information of the object in the current object position data corresponds to other areas other than the first target area in the identification area of ​​the radar 13, the control device 11 no longer executes S202, but directly determines that there is no human body on the display side of the display device 10 according to the recognition result of the object position data.

[0107] For example, Fig.11 A schematic diagram of the identification area of ​​the radar provided in the present application, wherein the identification area 130 of the radar can be divided into a first target area 131, and other areas 132 outside the first target area 131. Among them, the first target area 131 overlaps with the identification area of ​​the temperature sensor 14, or the accuracy of the temperature data of the objects in the first target area 131 is higher, so the objects in the first target area 131 can be subsequently judged based on the temperature data. In summary, in the control method of the display device provided in this embodiment, the control device 11 determines whether to continue to make subsequent judgments based on the temperature data according to the different target areas in the identification area of ​​the radar 13, thereby ensuring the accuracy of the identification in each identification area, preventing the introduction of new errors into the detection results due to the small identification range of the temperature sensor 14, and further improving the completeness of the entire method.

[0108] Fig.12 A schematic diagram of the position of an object within the radar identification area provided by this application, Fig.13 A schematic diagram of the position of an object within the recognition area of ​​a temperature sensor provided in this application, such as Fig.12 and Fig.13The figure shows the correspondence between the position in the identification area of ​​the radar 13 and the position in the identification area of ​​the temperature sensor 14 for the same object M. Specifically, the coordinates of the object M in the identification area of ​​the radar 13 are (X1, Y1), and the coordinates in the identification area of ​​the temperature sensor 14 are (X2, Y2). The angle of the object M in the identification area of ​​the radar 13 is calculated according to the formula α=arctan(X1 / Y1). According to the FOV=U degrees and the resolution K*K of the temperature sensor, the angle β=(2*U / K)*(K / 2-X2) of the object M in the identification area of ​​the temperature sensor 14 is calculated. Among them, when |(α-β)| is less than the threshold, the two correspond to the same object M, and when |(α-β)| is greater than the threshold, the two are not the same object. The threshold can be set between plus or minus 10 degrees.

[0109] In the above embodiment, a method is described in which the control device 11 determines whether there is a human body on the display side of the display device 10 based on the object position data and the temperature data, wherein when the control device 11 determines that there is no human body on the display side of the display device 10, the display device 10 can be controlled.

[0110] Specifically, Fig.14 A control logic diagram of the control device provided in the present application, wherein when the control device 11 determines through S204 that there is no human body on the display side of the display device 10, after the first time in S2041, the control device 11 controls the display device 10 in S2042 to display a prompt message that the display screen is about to stop being displayed, and the prompt message may be in the form of a pop-up window or the like. After the second time in S2043, the control device 11 controls the display device 1 in S2044 to reduce the sound and brightness. After the third time in S2045, the control device 11 controls the display device 10 in S2046 to stop displaying the screen, which may specifically be turning off the display device 10 or controlling the display device 1 to enter a standby state, etc. In one embodiment, the first time may be set to 5 minutes, the second time may be set to 10 minutes, and the third time may be set to 15 minutes.

[0111] In summary, in the control method of the display device provided in this embodiment, the control device 11 can perform different controls on the display device 10 after different times according to the received second detection signal, and finally realizes that when it is determined that there is no one on the display side of the display device 10, the display device 10 is promptly controlled to stop displaying the picture, thereby improving the intelligence of the display device 1 and reducing the ineffective energy consumption of the display device 1. In particular, by setting the first time and the second time, before the display is finally stopped, a prompt is given to the user who may not be detected, which prevents the direct control of the display device 11 to stop displaying from affecting the normal viewing of the user, and further improves the user experience of the display device 1.

[0112] In one embodiment, the control device 11 is further configured to, when the continuously received temperature data includes a temperature value greater than the warning threshold and the temperature value is increasing, determine that a fire may occur on the display side of the current display device 10, control the display device 11 to display fire warning information, or control the display device 1 to emit an alarm, etc. The display device provided in this embodiment is based on a temperature sensor, which can detect the temperature of the environment where the display device 1 is located to achieve a fire warning, which not only enriches the function of the display device 1, but also improves the safety guarantee capability of the user's life and property through the display device 1, and further improves the user experience of the display device 1.

[0113] Fig.15 A schematic diagram of the structure of another embodiment of the display device provided in the present application, Fig.15 In the illustrated embodiment, the display device 1 provided by the present application further includes an environmental sensor 15, wherein the environmental sensor 15 is connected to the control device 11. The environmental sensor 15 can be used to detect the air quality information of the environment in which the display device 1 is located, and send the air quality information to the control device 11, wherein the air quality information includes information of gases such as formaldehyde and PM2.5. The control device 11 can control the display device 10 to display air quality prompt information based on the received air quality information, for example, by displaying the air quality information in the boot interface or menu interface in the form of a pop-up window. The display device 1 provided in this embodiment actively displays the air quality information on the display device 10 based on the set environmental sensor 15. On the basis of enriching the functions of the display device 1, there is no need to specifically set an environmental sensor externally, which reduces the operations that the user needs to perform when he wants the display device 1 to display the air quality, and the equipment that needs to be purchased.

[0114] Furthermore, the present application also provides a method for the display device 1 to process data from the distance sensor 13, and the data from the distance sensor 13 may be the object position data described in the present application. The method for processing the data from the distance sensor 13 provided by the present application may be as follows: Fig. 6A The control device 11 shown in the figure is executed, or by Figure 6B The processor 12 shown is executed, or specifically by Figure 8 The distance data processing unit 121 in the processor 12 shown in the figure is executed, or the method can also be executed by any other electronic device that has the processing requirements and capabilities for the object position data. Fig. 6A The control device 11 shown is an execution body, and the method for processing the data of the distance sensor 13 is introduced instead of being limited thereto.

[0115] Specifically, the control device 11 provided in this embodiment stores and manages the object position data from the distance sensor 13 through a linked list, for example, Fig.16 A schematic diagram of processing data from a distance sensor provided in this application, in Fig.16 In the example shown, the control device 11 has stored 4 linked lists labeled a, b, c and d, each of which is used to store the object position data of a target object. For example, linked list a is used to store all object position data of target object A, linked list b is used to store all object position data of target object B, linked list c is used to store all object position data of target object C, linked list d is used to store all object position data of target object D, and so on. Linked list a stores 3 object position data, which are recorded as a1, a2 and a3, where a1 is the first node of the linked list, and a2 and a3 are the child nodes of the linked list. At the same time, the linked list is also sorted according to the order in which the child nodes are stored. For example, nodes a1, a2 and a3 correspond to the object position data added to the linked list in sequence, and child node a3 is the object position data added to the linked list the latest, recorded as the latest object position data.

[0116] Fig.17 The schematic diagram of an embodiment of the data processing method of the distance sensor of the display device provided in the present application shows the management steps of the object position data performed by the control device 11 each time after receiving the object position data. Specifically, the control device 11 is configured to, after receiving the object position data through S1, first query through S101 whether the linked list currently stored by the control device 11 is empty, if not empty, then compare the object position data with the latest object position data of each linked list in the multiple linked lists already stored through S102, if the object position data and the latest object position data in the first linked list meet the preset conditions, it means that the current object position data and the latest object position data in the first linked list meet the same target object, then add the object position data to the first linked list through S2.

[0117] When there is no first linked list that meets the preset condition in the multiple linked lists, the control device 11 creates a second linked list through S3 and stores the object position data as the first node of the second linked list.

[0118] Furthermore, when the linked list currently stored by the control device 11 is empty, the control device 11 creates a second linked list through S3 and stores the object position data as the first node of the second linked list.

[0119] Combination Fig.16, S1 process is the "check" operation performed by the control device 11 on the linked list, that is, the currently acquired object position data is compared with the latest object position data stored in multiple linked lists. For example, the object position data is compared with the latest object position data of node a3 in linked list a, the latest position data of node b4 in linked list b, the latest position data of node c3 in linked list c, and the latest position data of node d2 in linked list d. S2 process is the "change" operation performed by the control device 11 on the linked list, that is, if the object position data and the object position data in the first linked list a meet the preset conditions, the object position data is added to the first linked list a for storage, and its position is located at the a4 child node in the linked list. At this time, the newly added object position data replaces the object position data of the a3 child node, which is called the latest position data in linked list a. S3 process is the "add" operation performed by the control device 11 on the linked list, that is, if the multiple linked lists do not include the first linked list that meets the preset conditions, the control device 11 adds a second linked list e, and uses the object position data as the first node e1 of the second linked list e.

[0120] In summary, in the data processing method of the distance sensor of the display device provided in this embodiment, the object position data from the distance sensor 13 is stored and managed through a linked list, and in the processing process, the operations of "adding", "changing" and "checking" the object position data are realized through the linked list. Since the structure of the linked list is relatively simple and each linked list corresponds to a storage method of a target object, the linked list is suitable for separately storing and managing the object position data of each different object in the distance sensor data, thereby improving the management efficiency of the distance sensor data through the linked list and improving the confidence of human body detection based on the distance sensor data.

[0121] In one embodiment, the object position data includes the position coordinates (X, Y), motion state (S) and time information (T) of the object in the recognition area of ​​the distance sensor. The control device 11 can compare the object position data from multiple different dimensions according to the position coordinates, motion state and time information, thereby improving the accuracy and effectiveness of the comparison result.

[0122] In a specific implementation, the method for processing distance sensor data provided by the present application can be applied to Fig.10In step S201 of the method shown, when the control device 11 determines whether the object position data meets the first preset condition, the object position data can be compared with the latest object position data of the stored multiple linked lists, and when it is determined that the first linked list exists in the multiple linked lists, the control device 11 determines that the object position data meets the first preset condition, and then can also add the object position data to the first linked list. When it is determined that the first linked list does not exist in the multiple linked lists, the control device 11 determines that the object position data does not meet the first preset condition, and then can also add the object position data to the newly created second linked list.

[0123] In one embodiment, the control device 11 determines that the object position data meets the preset conditions including: the distance difference between the position coordinates of the object position data and the position coordinates of the latest object position data in the first linked list is less than a first distance preset value. At the same time, the time difference between the time information of the object position data and the time information of the latest object position in the first linked list is less than a first time preset value.

[0124] by Fig.16 Taking the linked list shown as an example, the distance difference between the position coordinates (X, Y) of the object position data and the position coordinates of the object position data a3 in the first linked list a is less than the first distance preset value, and the time difference of the time information T is less than the first time preset value, then it means that the distance and time of the currently processed object position data and the latest object position data a3 in the first linked list a are similar, and it can be considered that the two belong to the same target object a, so the current object position data can be stored in the child node a4 of the first linked list a.

[0125] In the data processing method of the distance sensor of the display device provided in the present embodiment, based on the linked list storage structure of the object position data of the distance sensor, the correlation between the current object position data to be processed and the linked list is jointly judged from the time dimension and the spatial distance dimension. Different target objects are distinguished based on the spatial and temporal continuity of the linked list itself, and the target object corresponding to the current object position data is determined more accurately and effectively, so as to continuously track the target object and manage the data of the distance sensor, thereby improving the efficiency of managing the target object based on the data of the distance sensor.

[0126] In one embodiment, when the control device 11 determines multiple linked lists that meet the preset conditions, the present application also provides a method for determining a first linked list based on the multiple linked lists. For example, Fig.18A schematic diagram of another embodiment of a data processing method for a distance sensor of a display device provided in the present application, wherein the control device 11 obtains a first linked list in which a plurality of distance differences are less than a first distance preset value and / or a time difference is less than a first time preset value based on a comparison of the distance difference and the time difference according to the currently acquired object position data in S1, and the plurality of first linked lists can be stored in a queue manner, for example, in S1001, the first linked list in which the distance difference is less than the first distance preset value is stored in the first queue, and in S1002, the first linked list in which the time difference is less than the first time preset value is stored in the second list.

[0127] Subsequently, the control device 11 determines in S1003 whether the number of first linked lists in the second list is 0. If the number of first linked lists in the second list is 0, then in S1004, it determines whether the number of first linked lists in the first queue is 0. If the number of first linked lists in the first queue is not 0, it means that multiple linked lists all include object position data whose distance difference with the current object position data is less than the first distance preset value. Then, in S1005, from the time dimension, the linked list with the smallest time difference between the latest object position data and the current object position data in all first linked lists in the first queue is the first linked list, so that the object position data is added to the determined first linked list.

[0128] When the control device 11 determines in S1007 that the number of first linked lists in the first queue is 0, it means that the first linked list is not included in the multiple linked lists currently stored, and the control device 11 subsequently needs to establish a new second linked list to store the current object position data.

[0129] If the control device 11 determines in S1003 that the number of first linked lists in the second queue is not 0, it means that multiple linked lists include object position data whose time difference with the current object position data is less than the first time preset value, then in S1006, from the spatial dimension, the linked list with the smallest distance difference between the latest object position data in all the first linked lists in the second queue and the current object position data is the first linked list, thereby adding the object position data to the determined first linked list.

[0130] In summary, the data processing method of the distance sensor of the display device provided in this embodiment can further perform secondary screening on the multiple first linked lists when there are multiple first linked lists that meet the preset conditions, so as to determine the first linked list closest to the current object position data, and then add the current object position data to the first linked list, thereby further improving the accuracy of processing the object position data and ensuring the effectiveness of managing the target object based on the distance sensor data.

[0131] In one embodiment, the present application also provides a processing method for the control device 11 to delete the stored linked list, thereby reducing the storage space occupied by invalid linked lists of useless target objects, and deleting the interference and impact of pseudo targets that may be misidentified on subsequent calculations.

[0132] Specifically, the control device 11 verifies the validity of the stored multiple linked lists at regular intervals to determine whether the target objects corresponding to the multiple linked lists are real objects. Assuming that the control device 11 determines that the target object corresponding to the third linked list among the multiple linked lists is not a real object, the stored third linked list and the object position data in the third linked list are deleted.

[0133] For example, Fig.19 A flow chart of another embodiment of the method for processing data of a distance sensor of a display device provided by the present application is shown in FIG. Fig.19 As shown, the control device 11 is specifically configured to execute one or more steps in S401-S405, determine whether the target object corresponding to the third linked list is a real object in S406, and delete the third linked list and stored object position data that are not real objects in S407.

[0134] S401: When no new object position data is added to the third linked list within the first detection time, it means that the target object corresponding to the third linked list has no subsequent movement update, and this target object is a pseudo target, so the control device 11 can determine that the target object corresponding to the third linked list is not a real object. In one embodiment, the first detection time can be set to 10 milliseconds.

[0135] S402: When the number of new object position data added to the third linked list within the second detection time is less than the first number value, it indicates that the target object is a temporary pseudo target, so the control device 11 can determine that the target object corresponding to the third linked list is not a real object. In one embodiment, the second detection time can be set to 1 second.

[0136] S403: When the motion states of the newly added object position data in the third linked list within the third detection time are all static, and the position coordinates of the newly added object position data are within the second target area in the identification area of ​​the distance sensor, it means that the target object is a static pseudo target and not a human body, then the control device 11 determines that the target object corresponding to the third linked list is not a real object. In one embodiment, the third detection time can be set to 600 seconds. For example, Fig. 20 This is a schematic diagram of a recognition area of ​​a distance sensor provided in the present application, wherein the entire recognition area 130 is divided into a first target area 131 in the middle, second target areas 133 on both sides, and a boundary area 134 .

[0137] S404: When the motion states of the newly added object position data in the third linked list within the fourth detection time are all static, and the position coordinates of the newly added object position data are within the boundary area of ​​the recognition area of ​​the distance sensor, it means that the target object has moved out of the recognition area of ​​the distance sensor, so the control device 11 determines that the target object corresponding to the third linked list is not a real object. In one embodiment, the fourth detection time can be set to 60 seconds.

[0138] S405: When the position coordinates of the object position data in the third linked list are within the first target area in the identification area of ​​the distance sensor, the control device 11 can determine whether the target object corresponding to the third linked list is a real object through the object position data and the temperature information from the temperature sensor 14.

[0139] Specifically, refer to Fig. 20 , when the position coordinates of the object position data in the third linked list are within the first target area 131, combined with Fig.11 The first target area 131 can determine whether the target object corresponding to the third linked list is a real object based on the temperature information provided by the temperature sensor.

[0140] In one embodiment, the control device 11 can specifically be configured as follows: Figure 12-13 The method shown first calculates a first angle α=arctan(X1 / Y1) based on the coordinates of the recognition area of ​​the distance sensor and the coordinate position (X1, Y1) of the object position data, and then calculates a second angle β=(2*U / K)*(K / 2-X2) based on the field of view FOV of the temperature sensor and the position of the object in the temperature information, and then determines that the target object corresponding to the third linked list is a real object when the absolute value of the difference between the first angle and the second angle |(α-β)| is less than a preset angle, and determines that the target object corresponding to the third linked list is not a real object if |(α-β)| is greater than the preset angle.

[0141] In summary, in the data processing method of the distance sensor of the display device provided in this embodiment, the object position data from the distance sensor 13 is stored and managed through a linked list, and in the processing process, the "deletion" operation of the object position data is implemented through the linked list, thereby avoiding the wrong recognition of the target object and the influence of the wrong target object on subsequent calculations, and also reducing the storage space occupied by the invalid linked list on the control device 11.

[0142] Furthermore, the present application also provides a method for the display device 1 to process data from the temperature sensor 14, and the data from the temperature sensor 14 may be the temperature data described in the present application. The method for processing the data from the temperature sensor provided in the present application may be as follows: Fig. 6AThe control device 11 shown in the figure is executed, or by Figure 6B The processor 12 shown is executed, or specifically by Figure 8 The method may be performed by the temperature data processing unit 122 in the processor 12 shown in the figure, or the method may be performed by any other electronic device that has the requirements and capabilities to process the data of the temperature sensor. Fig. 6A The control device 11 shown is an execution body, and the method for processing the data of the temperature sensor 14 is introduced instead of being limited thereto.

[0143] Specifically, Fig.21 A flow chart of an embodiment of a method for processing data of a temperature sensor of a display device provided by the present application is shown as follows: Fig.21 As shown, the control device 11 obtains differential temperature data D3 according to the difference between the received temperature data D1 and the stored background data D2. Subsequently, the control device 11 determines whether there is a human body on the display side of the display device 11 according to the differential temperature data D3.

[0144] In one embodiment, the resolution of the temperature sensor is K*K, and the temperature data includes temperature values ​​of K*K pixel positions distributed in K rows and K columns. Similarly, the background data also includes temperature values ​​of K*K pixel positions. The difference between the temperature data and the background data can also obtain the difference of the temperature values ​​of K*K pixel positions, and the difference of each pixel position is used to represent the temperature change between the current temperature data and the background data.

[0145] In summary, in the method for processing data from the temperature sensor of the display device provided in this embodiment, the differential temperature data obtained by the difference between the temperature data and the background data is used to determine whether a human body exists. Compared with directly determining whether a human body exists by the peak value of the temperature value in the temperature data, this avoids the influence of possible high temperature points in the background data on the recognition results, thereby improving the accuracy of identifying whether a human body exists based on the temperature data of the temperature sensor 14, thereby ensuring the accuracy and effectiveness of subsequent processing performed by the display device 1 based on the human body recognition result, and improving the user experience of the display device 1.

[0146] In a specific implementation, the method for processing temperature sensor data provided by the present application can be applied in the following aspects: Fig.10 In step S202 of the method shown, when the control device 11 determines whether the temperature data meets the second preset condition, the differential temperature data can be obtained according to the temperature data and the background data, and whether a human body exists can be determined according to the differential temperature data. When it is determined according to the differential temperature data that a human body exists, it means that the temperature data meets the second preset condition, and when it is determined according to the differential data that a human body does not exist, it means that the temperature data does not meet the second preset condition.

[0147] In one embodiment, the background data is preset.

[0148] In another embodiment, the background data may also be updated in real time, thereby ensuring the real-time nature of the background data and improving the accuracy and real-time nature of identifying the presence of a human body through the background data.

[0149] For example, when the control device 11 determines that there is no human body on the display side of the display device 10, the control device 11 updates the stored background data according to the currently acquired temperature data. The control device 11 can determine that there is no human body on the display side of the display device 10 according to the current temperature data, or the control device 11 can also determine that there is no human body on the display side of the display device according to data from other devices. Figure 8 In the display device 1 shown, the control device 11 can determine whether there is a human body on the display side of the display device 10 based on the object position data provided by the distance sensor 13. If it is determined that there is no human body on the display side of the display device 10 based on the object position data, the control device 11 can update the stored background data based on the currently acquired temperature data. In addition, the control device 11 can also determine whether there is a human body based on the data of other devices. The implementation method is the same and will not be repeated. In this embodiment, by determining whether there is a human body through the object position data of the distance sensor 13, it is decided whether to update the background data of the temperature sensor 14, which can effectively prevent the temperature data of the temperature sensor 14 itself from affecting the update of the background data, thereby ensuring the accuracy of the update result, and further ensuring the accuracy of the control device 11 in identifying the human body based on the temperature data.

[0150] In another embodiment, the control device 11 may determine to update the background data based on the currently acquired temperature data after a period of time. If the control device 11 is about to update the background data after a period of time, and there is a human body in the temperature data acquired within a continuous preset update time, the control device 11 may update the background data based on the current temperature data including the human body to ensure the real-time nature of the temperature data and avoid the impact of the background data not being updated for a long time on the human body recognition result.

[0151] In another embodiment, this embodiment can also be applied to when the display device 1 is turned on, and the control device 11 determines that no background data is currently stored, and determines whether there is a human body on the display side of the display device. When it is determined that there is no human body on the display side of the display device, the control device 11 generates background data based on the temperature data; and when it is determined that there is a human body on the display side of the display device, and the temperature data obtained by the control device 11 within a preset judgment time after turning on all contain a human body, the control device 11 can still generate background data based on the current temperature data including the human body, thereby avoiding more serious consequences such as subsequent inability to perform human body recognition due to the inability to generate background data, thereby ensuring the completeness of the entire processing flow of the display device 1.

[0152] In one embodiment of the present application, the control device 11 is also configured to, when it is determined that there is a human body on the display side of the display device 10 based on the object position data from the distance sensor 3, and the background data has not been updated within a preset update period, the control device 11 updates the background data multiple times based on the multiple temperature data currently acquired continuously, and each update only updates the target part that does not include the human body, and each updated target part gradually approaches the position of the human body in the temperature data from the four sides of the temperature data, and finally realizes the update of the entire temperature data.

[0153] In one embodiment, the control device 11 can determine the area where the human body is located based on the temperature value of a pixel position, or can also determine the area where the human body is located based on the temperature values ​​of multiple pixel positions. For example, the control device 11 specifically determines the position where the largest N pixels are located as the center based on the temperature value of each pixel position in the differential temperature data, and determines the area where the human body is located. At the same time, the part of the background data other than the area where the human body is located is determined as the target part. N can be a number such as 20.

[0154] In one embodiment, the target portion of the temperature data is determined based on the object position data from the distance sensor 13. For example, Fig. 22 The schematic diagram of the identification area of ​​the radar and the identification area of ​​the temperature sensor provided in the present application, wherein the distance sensor 13 is taken as an example of a radar, the xy coordinate system is the identification area SY of the radar 13, and the xz coordinate system is the identification area SX of the temperature sensor 14. Then, a position in the identification area SY of the radar 13 can correspond to a position in the identification area SX of the temperature sensor 14. For example, Fig.23 This is a schematic diagram of the correspondence between the identification area of ​​the radar and the identification area of ​​the temperature sensor provided in the present application, wherein a position Q in the identification area SY of the radar 13 may correspond to a position Q′ in the identification area SX of the temperature sensor 14 .

[0155] The control device 11 can obtain a square portion QX with a side length L based on a position Q' in the identification area SX of the determined temperature sensor 14 as the center, and the area within QX is the area corresponding to the position of the human body. Then, the part within the identification area SX of the temperature sensor 14 and outside the square portion QX is the target part that does not include the human body, and the control device 11 can update the background data that does not include the human body part based on the temperature data.

[0156] In one embodiment, the control device 11 is based on Figure 22-Figure 23 When the area QX including multiple human body locations is determined in the identification area SX of the temperature sensor 14 in the manner shown, multiple gradual approximations can be used to update the target area in the background data multiple times, and finally complete the update of the entire background data.

[0157] For example, Fig.24 A schematic diagram of the target part that is updated successively provided by the present application, wherein the control device 11 updates the background data in sequence according to the temperature data acquired at four consecutive moments T1-T4. First, the control device 11 determines that the white area in the temperature data at moment T1 is the location including the human body, and the shadow area outside the white area is the target area, and the processor updates the background data according to the temperature data of the target area at moment T1. Subsequently, the control device 11 determines the location including the human body in the temperature data at moments T2, T3, and T4 in the same manner, and updates the background data according to the temperature data of the target area that does not include the human body, respectively.

[0158] Fig.25 A schematic diagram of the update effect of the successive updates provided by this application, wherein, combined with Fig.24 The control device 11 updates the target area each time. Fig.25 The background data updated at time T1 is the shaded part. The background data updated at time T2 and time T3 have a larger shaded part and a smaller unupdated white part compared with the previous time. Finally, at time T4, the update of the entire background data is completed.

[0159] In summary, in the data processing method of the temperature sensor of the display device provided in this embodiment, even if the temperature data includes the human body, the control device 11 completes the update of the background data by a successive update method. On the basis of ensuring the real-time and effectiveness of the background data, the timing and method of updating the background data are further improved. In the case where cold sources and heat sources continue to exist in the background data, these persistent temperature sources are eliminated in the background data, avoiding the influence of the external environment on the human body recognition results, thereby improving the accuracy of human body recognition. At the same time, by adopting a multiple update method that successively approaches the human body area, the background data can be updated more comprehensively, preventing omissions when updating the background data, and avoiding the situation where some areas are not updated due to inaccurate human body recognition in the temperature data at a certain time.

[0160] In one embodiment, the control device 11 determines whether there is a human body on the display side of the display device based on the differential temperature data, specifically: the control device 11 calculates the mean square error, mean square value and maximum value of the temperature value at each pixel position in the differential temperature data. Subsequently, the control device 11 compares the mean square error, mean square value and maximum value with the first threshold, the second threshold and the third threshold, respectively, to obtain a first comparison result, a second comparison result and a third comparison result. Finally, the control device 11 jointly determines whether there is a human body on the display side of the display device based on the first comparison result, the second comparison result and the third comparison result.

[0161] Specifically, the mean square error δ1 is obtained by subtracting the mean square value of all temperature values ​​in the background data from the mean square value of all temperature values ​​in the temperature data. The mean square value δ2 is the mean square value of each pixel position in the differential temperature data. The maximum value δ3 is the difference between the two highest temperature values ​​in the background data. The result when the mean square error δ1 is greater than the first threshold is recorded as D1=1, and the result when the mean square value δ2 is greater than the second threshold is recorded as D2=1. The result when the maximum value δ3 is greater than the third threshold is recorded as D3=1. Then the processor performs an OR logic (||) calculation based on the first comparison result D1 and the second comparison result D3, and then performs an AND logic (&) calculation with the third comparison result D3, and finally determines whether there is a human body on the display side of the display device. That is, when (D1||D2)&D3=1, it is determined that there is a human body on the display side of the display device, and when (D1||D2)&D3 is not equal to 1, it is determined that there is no human body on the display side of the display device.

[0162] In summary, in the data processing method of the temperature sensor of the display device provided in this embodiment, the mean square error, mean square value and maximum value of the differential temperature data are used to more comprehensively judge whether there is a human body in the differential temperature data. Since more parameters are used and the dimensions of the parameter sources are more comprehensive, this method can improve the accuracy of judging whether there is a human body based on the temperature data.

[0163] In one embodiment, the control device 11 may also determine a threshold scaling factor according to the distance between the human body and the display side of the display device, and process the first threshold, the second threshold, and the third threshold according to the threshold scaling factor, and finally obtain the first comparison result, the second comparison result, and the third comparison result according to the processed first threshold, the second threshold, and the third threshold. The distance between the human body and the display side of the display device may be determined according to the object position data of the distance sensor 13.

[0164] Table 1

[0165]

[0166]

[0167] For example, Table 1 shows a correspondence between a distance and a threshold scaling factor, and it can be seen that the scaling factor is inversely proportional to the distance. Fig.26 A schematic diagram of the threshold scaling factor and distance provided for the present application, wherein the closer the distance between position Q1 and position P of the display device is, the smaller the scaling factor corresponding to position Q1 is; the farther the distance between position Q2 and position P of the display device is, the larger the scaling factor corresponding to position Q2 is. The reason for this setting is that when the human body is farther away from the display device, each temperature value caused by the human body in the differential temperature data is smaller. At this time, the threshold value needs to be reduced accordingly to ensure that the human body in the temperature data can be obtained by comparison to avoid the situation where the human body cannot be recognized; when the human body is closer to the display device, each temperature value caused by the human body in the differential temperature data is larger. At this time, the threshold value needs to be enlarged accordingly to avoid the situation where all temperature values ​​are recognized as human bodies.

[0168] In one embodiment, the correspondence between the distance and the scaling factor can also be calculated by a fixed function or a piecewise function. For example, the fixed function can be p(x)=p1x n +p2x n-1 +……+p n x+p n+1 The piecewise function can be the following formula:

[0169]

[0170] In summary, in the temperature data processing method of the display device provided in this embodiment, the control device 11 can use different scaling factors to process the threshold according to the different distances between the human body and the display device in the temperature data, and compare the differential temperature data with the threshold processed by the scaling factor to determine whether there is a human body on the display side of the display device. Since the intensity of the temperature data obtained by the temperature sensor at different distances is different, the threshold is processed according to the scaling factor inversely proportional to the distance. When the temperature value is small, it can be ensured that the human body in the temperature data can be obtained by comparison, thereby avoiding the situation where the human body cannot be recognized. When the temperature value is large, it can avoid the erroneous recognition of all temperature values ​​as human bodies, thereby further improving the accuracy of human body recognition based on temperature data.

[0171] In the aforementioned embodiments of the present application, the method for processing the object position data from the distance sensor and / or the temperature data from the temperature sensor provided in the embodiments of the present application is introduced. In order to realize the functions in the methods provided in the above embodiments of the present application, the control device 11 or the processor 12 as the execution subject may include a hardware structure and / or a software module, and realize the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

[0172] It should be noted that it should be understood that the division of the various modules of the above device is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And these modules can all be implemented in the form of software called by processing elements; they can also be all implemented in the form of hardware; some modules can also be implemented in the form of software called by processing elements, and some modules can be implemented in the form of hardware. For example, the processing module can be a separately established processing element, or it can be integrated in a chip of the above device. In addition, it can also be stored in the memory of the above device in the form of program code, and called and executed by a processing element of the above device. The function of the above-mentioned module is determined. The implementation of other modules is similar. In addition, these modules can be fully or partially integrated together, or they can be implemented independently. The processing element described here can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each module above can be completed by an integrated logic circuit of hardware in the processor element or instructions in the form of software.

[0173] For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as one or more application specific integrated circuits (ASIC), or one or more microprocessors (digital signal processors, DSP), or one or more field programmable gate arrays (FPGA), etc. For another example, when a module above is implemented in the form of a processing element scheduling program code, the processing element may be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0174] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

[0175] For example, Fig. 27 A schematic diagram of the structure of an electronic device provided in this application, such as Fig. 27 The device shown can be used to execute the method and / or steps thereof for processing object position data and / or temperature data provided in any embodiment of the present application. In one embodiment, Fig. 27The electronic device 2000 shown includes a processor 2001 and a memory 2002; wherein the memory 2002 is used to store computer executable instructions, and the processor 2001 can execute the computer executable instructions stored in the memory 2002. When the computer executable instructions are executed by the processor 2001, the processor 2001 implements the method and / or the steps thereof executed by any control device 11 or processor 12 in the aforementioned embodiments of the present application.

[0176] In one embodiment, if Fig. 27 The electronic device 2000 shown further includes a communication interface 2003 , wherein the processor 2001 can communicate with other devices via the communication interface 2003 , for example, the processor 2001 obtains object position data and temperature data via the communication interface 2003 .

[0177] The present application also provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are executed, they can be used to implement any method and / or steps therein performed by the control device 11 or the processor 12 in any of the aforementioned embodiments of the present application.

[0178] An embodiment of the present application also provides a chip for executing instructions, wherein the chip is used to execute any of the methods and / or steps therein executed by the control device 11 or the processor 12 as described above in the present application.

[0179] An embodiment of the present application also provides a computer program product, including a computer program, which, when executed, implements any of the methods and / or steps therein performed by the control device 11 or the processor 12 as described above in the present application.

[0180] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.

[0181] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A display device, characterized in that: include: A display device configured to display a picture; A human body detection device, configured to detect temperature data and object position data on a display side of the display device; A control device, connected to the display device and the human body detection device respectively, configured to determine whether there is a human body on the display side of the display device according to the temperature data and the object position data, and control the display device to display a picture; The human body detection device comprises: a distance sensor configured to detect position data of an object on a display side of the display device; A temperature sensor configured to detect temperature data of a display side of the display device; The control device is connected to the distance sensor and the temperature sensor respectively, and is configured as follows: Obtaining differential temperature data according to the temperature data and stored background data; It is determined whether there is a human body on the display side of the display device according to the temperature value of each pixel position in the differential temperature data.

2. The display device according to claim 1, characterized in that The control device is also configured to: When it is determined that there is no human body on the display side of the display device, the stored background data is updated according to the temperature data.

3. The display device according to claim 2, characterized in that The control device is also configured to: When it is determined that a human body exists on the display side of the display device and the background data is not updated within a preset update time, the stored background data is updated according to the temperature data.

4. The display device according to claim 2 or 3, characterized in that: The control device is specifically configured as follows: It is determined whether there is a human body on the display side of the display device according to the object position data from the distance sensor.

5. The display device according to claim 1, characterized in that The control device is also configured to: When it is determined that there is a human body on the display device side and the background data has not been updated within a preset update time, multiple target parts in the stored background data are updated according to a plurality of continuous temperature data; The multiple target parts are located within the entire area of ​​the temperature data, gradually approaching the position of the human body in the temperature data from the surroundings of the temperature data.

6. The display device according to claim 5, characterized in that The control device is specifically configured to: determine the area where the human body is located based on the positions of the largest N pixels in the temperature values ​​of each pixel position of the differential temperature data as the center, and determine the part of the background data other than the area where the human body is located as the target part.

7. The display device according to any one of claims 1 to 6, characterized in that: The control device is specifically configured as follows: Determine the mean square error, mean square value and maximum value of the temperature value at each pixel position in the differential temperature data; Respectively comparing the mean square error, the mean square value and the maximum value with a first threshold, a second threshold and a third threshold to obtain a first comparison result, a second comparison result and a third comparison result; After performing an OR logic calculation based on the first comparison result and the second comparison result, an AND logic calculation is performed with the third comparison result to determine whether there is a human body on the display side of the display device.

8. The display device according to claim 7, characterized in that The control device is also configured to: Determining a threshold scaling factor according to the distance between the human body and the display side of the display device, wherein the scaling factor is inversely proportional to the distance; Processing the first threshold, the second threshold, and the third threshold according to a scaling factor; The mean square error, the mean square value and the maximum value are respectively compared with the processed first threshold, the second threshold and the third threshold to obtain a first comparison result, a second comparison result and a third comparison result.

9. The display device according to any one of claims 1 to 8, characterized in that: The control device is also configured to: After the display device is turned on, when the background data is not stored, determining whether there is a human body on the display side of the display device; When it is determined that there is no human body on the display side of the display device, generating the background data according to the temperature data; When it is determined that a human body exists on the display side of the display device and lasts for a preset determination time, the background data is generated according to the temperature data.

10. A method for processing data of a temperature sensor of a display device, characterized in that: The display device comprises: a display device, a human body detection device and a control device, the display device is configured to display a picture, the human body detection device is configured to detect whether there is a human body on the display side of the display device and generate a detection signal, the control device is configured to receive temperature data and object position data on the display side of the display device, the human body detection device comprises: a distance sensor and a temperature sensor, the distance sensor is configured to detect object position data on the display side of the display device, the temperature sensor is configured to detect temperature data on the display side of the display device, the control device is configured to determine whether there is a human body on the display side of the display device according to the object position data and the temperature data, and the processing method comprises: Get temperature data from the temperature sensor; Obtaining differential temperature data according to the temperature data and stored background data; It is determined whether there is a human body on the display side of the display device according to the temperature value of each pixel position in the differential temperature data.

Images