Display device and control method therefor
By combining data fusion processing from distance and temperature sensors in the display device, the problem of low accuracy in human body detection of the display device is solved, improving detection accuracy and user experience, while also providing fire early warning function.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-07-16
- Publication Date
- 2026-04-02
AI Technical Summary
Existing display devices have low accuracy in detecting the presence of a human body on the display side, especially when the human body is stationary for a long time, which can easily lead to misjudgment as no one being there, affecting the user experience.
By combining data from distance and temperature sensors, a fusion processing method is used to jointly determine whether a human body is present on the display side of the display device, avoiding reliance solely on object position data for judgment.
It improves the accuracy of human body detection, enhances the user experience of display devices, and provides fire warning functions when necessary, thereby enhancing safety.
Smart Images

Figure CN2025108794_02042026_PF_FP_ABST
Abstract
Description
Display device and control method thereof
[0001] The present disclosure claims priority to Chinese Patent Application No. 202411391790.0, filed on September 30, 2024; Chinese Patent Application No. 202411390860.0, filed on September 30, 2024; Chinese Patent Application No. 202411391666.4, filed on September 30, 2024, the contents of which are incorporated herein by reference in their entirety. TECHNICAL FIELD
[0002] The present disclosure relates to the technical field of display devices, and in particular to a display device and a control method thereof. BACKGROUND
[0003] With the continuous development of electronic technology, display devices have more and more functions, and display devices are more intelligent. SUMMARY
[0004] In one aspect, a display device is provided, including a display device configured to display a picture; a human body detection device configured to detect temperature data and object position data on a display side of the display device; a control device connected to the display device and the human body detection device, respectively, and configured to determine whether a human body exists on the display side of the display device according to the temperature data and the object position data, and control the display device to display a picture; the human body detection device includes a temperature sensor configured to detect the temperature data on the display side of the display device; a distance sensor configured to detect the object position data on the display side of the display device; the control device is connected to the temperature sensor and the distance sensor, respectively, and configured to determine whether the object position data meets a first preset condition; when the object position data meets the first preset condition, it is determined that a human body exists on the display side of the display device; when the object position data does not meet the first preset condition, it is determined whether the temperature data meets a second preset condition; when the temperature data meets the second preset condition, it is determined that a human body exists on the display side of the display device; when the temperature data does not meet the second preset condition, it is determined that a human body does not exist on the display side of the display device.
[0005] In one aspect, a control method of a display device is provided, including: obtaining temperature information from a temperature sensor and object position information from a distance sensor; determining whether the object position data meets a first preset condition; when the object position data meets the first preset condition, determining that a human body exists on a display side of the display device and generating a first detection signal; when the object position data does not meet the first preset condition, determining whether the temperature data meets a second preset condition; when the temperature data meets the second preset condition, determining that a human body exists on the display side of the display device and generating the first detection signal; when the temperature data does not meet the second preset condition, determining that a human body does not exist on the display side of the display device and generating a second detection signal; and controlling the display device to display a picture according to the first detection signal or the second detection signal.
[0006] In one aspect, a display device is provided, including: a display device configured to display a picture; a human body detection device configured to detect temperature data and object position data on a display side of the display device; and a control device connected to the display device and the human body detection device, respectively, and configured to determine whether a human body exists on the display side of the display device according to the temperature data and the object position data, and to control the display device to display a picture. The human body detection device includes: a distance sensor configured to detect the object position data on the display side of the display device; and a temperature sensor configured to detect the temperature data on the display side of the display device. The control device is connected to the distance sensor and the temperature sensor, respectively, and is configured to: compare the object position data with latest object position data of each of a plurality of linked lists stored in a memory, wherein each of the linked lists is used to store object position data of a target object; when a comparison result of the object position data and latest object position data of a first linked list of the plurality of linked lists meets a preset condition, determine that the object position data corresponds to a target object of the first linked list, and add the object position data to the first linked list; and when the comparison result of the object position data and the latest object position data of the plurality of linked lists does not meet the preset condition, establish a second linked list and add the object position data to the second linked list.
[0007] In one aspect, a data processing method of a distance sensor of a display device is provided. The display device includes a display device configured to display a picture, a human body detection device configured to detect temperature data and object position data on a display side of the display device, and a control device configured to determine whether a human body exists on the display side of the display device according to the temperature data and the object position data, and control the display device to display a picture. The human body detection device includes a distance sensor configured to detect the object position data on the display side of the display device, and a temperature sensor configured to detect the temperature data on the display side of the display device. The control device is configured to determine whether a human body exists on the display side of the display device according to the object position data and the temperature data. The method includes comparing the object position data with stored latest object position data of each of a plurality of linked lists, respectively, wherein the linked list is used to store object position data of a target object; determining that the object position data corresponds to a target object of a first linked list when a comparison result of the object position data and the latest object position data of the first linked list meets a preset condition, and adding the object position data to the first linked list; and establishing a second linked list and adding the object position data to the second linked list when the comparison result of the object position data and the latest object position data of the plurality of linked lists does not meet the preset condition.
[0008] In one aspect, a display device is provided. The display device includes a display device configured to display a picture, a human body detection device configured to detect temperature data and object position data on a display side of the display device, and a control device connected to the display device and the human body detection device, respectively, and configured to determine whether a human body exists on the display side of the display device according to the temperature data and the object position data, and control the display device to display a picture. The human body detection device includes a distance sensor configured to detect the object position data on the display side of the display device, and a temperature sensor configured to detect the temperature data on the display side of the display device. The control device is connected to the distance sensor and the temperature sensor, respectively, and configured to obtain differential temperature data according to the temperature data and stored background data, and determine whether a human body exists on the display side of the display device according to a temperature value of each pixel position in the differential temperature data.
[0009] A processing method of data of a temperature sensor of a display device, the display device comprising a display device configured to display a picture, a human body detection device configured to detect whether a human body exists on a display side of the display device and generate a detection signal, and a control device configured to temperature data and object position data on the display side of the display device, the human body detection device comprising a distance sensor configured to detect the object position data on the display side of the display device, and a temperature sensor configured to detect the temperature data on the display side of the display device, the control device configured to determine whether the human body exists on the display side of the display device according to the object position data and the temperature data, the processing method comprising: obtaining the temperature data from the temperature sensor; obtaining difference temperature data according to the temperature data and stored background data; and determining whether the human body exists on the display side of the display device according to a temperature value of each pixel position in the difference temperature data. BRIEF DESCRIPTION OF DRAWINGS
[0010] FIG. 1 is a specific embodiment of a structure of a display device according to some embodiments;
[0011] FIG. 2 is another specific embodiment of a structure of a display device according to some embodiments;
[0012] FIG. 3 is yet another specific embodiment of a structure of a display device according to some embodiments;
[0013] FIG. 4 is a structure diagram of a display device in the related art according to some embodiments;
[0014] FIG. 5 is a flow diagram of a control method of a display device in the related art according to some embodiments;
[0015] FIG. 6A is a structure diagram of an embodiment of a display device according to some embodiments;
[0016] FIG. 6B is a structure diagram of another embodiment of a display device according to some embodiments;
[0017] FIG. 7 is an external structure diagram of a human body detection device according to some embodiments;
[0018] FIG. 8 is an internal structure diagram of a human body detection device according to some embodiments;
[0019] FIG. 9 is a flow diagram of an embodiment of a control method of a display device according to some embodiments;
[0020] FIG. 10 is a flow diagram of another embodiment of a control method of a display device according to some embodiments;
[0021] FIG. 11 is a schematic diagram of a recognition area of a radar according to some embodiments;
[0022] FIG. 12 is a schematic diagram of a position of an object in a recognition area of a radar according to some embodiments;
[0023] FIG. 13 is a schematic diagram of a position of an object in a recognition area of a temperature sensor according to some embodiments;
[0024] FIG. 14 is a schematic diagram of control logic of a control device according to some embodiments;
[0025] FIG. 15 is a schematic diagram of a structure of another embodiment of a display device according to some embodiments;
[0026] FIG. 16 is a schematic diagram of processing data of a distance sensor according to some embodiments;
[0027] FIG. 17 is a schematic diagram of an embodiment of a method of processing data of a distance sensor of a display device according to some embodiments;
[0028] FIG. 18 is a schematic diagram of another embodiment of a method of processing data of a distance sensor of a display device according to some embodiments;
[0029] FIG. 19 is a schematic diagram of a flow of yet another embodiment of a method of processing data of a distance sensor of a display device according to some embodiments;
[0030] FIG. 20 is a schematic diagram of a recognition area of a distance sensor according to some embodiments;
[0031] FIG. 21 is a schematic diagram of a flow of an embodiment of a method of processing data of a temperature sensor of a display device according to some embodiments;
[0032] FIG. 22 is a schematic diagram of a recognition area of a radar and a recognition area of a temperature sensor according to some embodiments;
[0033] FIG. 23 is a schematic diagram of a correspondence between a recognition area of a radar and a recognition area of a temperature sensor according to some embodiments;
[0034] FIG. 24 is a schematic diagram of a target portion updated in sequence according to some embodiments;
[0035] FIG. 25 is a schematic diagram of an update effect of a target portion updated in sequence according to some embodiments;
[0036] FIG. 26 is a schematic diagram of a threshold scaling factor and a distance according to some embodiments;
[0037] FIG. 27 is a schematic diagram of a structure of an electronic device according to some embodiments. DETAILED DESCRIPTION
[0038] Some embodiments of the present disclosure will be described in detail below with reference to the drawings, obviously, the described embodiments are only some embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments provided in the present disclosure, all other embodiments obtained by those skilled in the art belong to the scope of protection of the present disclosure. Unless otherwise required by the context, throughout the specification and claims, the term "comprise" and other forms such as third person singular form "comprises" and present participle form "comprising" are interpreted as open, inclusive meaning, that is, "include, but not limited to". In the description of the specification, the terms "one embodiment", "some embodiments", "exemplary embodiments", "example", "specific example" or "some examples" and the like are intended to mean that the specific features, structures, materials or characteristics related to the embodiment or example are included in at least one embodiment or example of the present disclosure. The illustrative representation of the above terms does not necessarily mean the same embodiment or example. In addition, the specific features, structures, materials or characteristics described can be included in any one or more embodiments or examples in any appropriate manner. Hereinafter, the terms "first", "second" are only used for description purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features limited by "first", "second" can be explicitly or implicitly included one or more features. In the description of the embodiments of the present disclosure, unless otherwise stated, the meaning of "multiple" is two or more. In the description of some embodiments, "coupling" and "connection" and their derivatives may be used. The term "connection" should be interpreted broadly, for example, "connection" can be fixed connection, or detachable connection, or integral; can be directly connected, or indirectly connected through intermediate medium. The term "coupling" indicates that two or more components have direct physical contact or electrical contact. The term "coupling" or "communicatively coupled" may also mean that two or more components do not have direct contact with each other, but still cooperate or interact with each other. The disclosed embodiments are not necessarily limited to the content herein. "At least one of A, B and C" has the same meaning as "at least one of A, B or C", which includes the following combinations of A, B and C: only A, only B, only C, combination of A and B, combination of A and C, combination of B and C, and combination of A, B and C. "A and / or B" includes the following three combinations: only A, only B, and combination of A and B.The use of "adapted to" or "configured to" herein means open and inclusive language that is not limited to devices adapted or configured to perform additional tasks or steps. As used herein, "about," "approximately," or "around" includes the recited value and the average value within an acceptable range of deviation from the recited value, as determined by one of ordinary skill in the art considering the measurement being discussed and the error associated with measuring the particular quantity (i.e., the limitations of the measurement system). As used herein, "parallel," "perpendicular," "equal" includes the recited condition and conditions that approximate the recited condition, the approximation being within an acceptable range of deviation, as determined by one of ordinary skill in the art considering the measurement being discussed and the error associated with measuring the particular quantity (i.e., the limitations of the measurement system). For example, "parallel" includes absolute parallel and near parallel, where the acceptable range of deviation for near parallel can be, for example, within 5°; "perpendicular" includes absolute perpendicular and near perpendicular, where the acceptable range of deviation for near perpendicular can also be, for example, within 5°. "Equal" includes absolute equality and near equality, where the acceptable range of deviation for near equality can be, for example, a difference between the two that is less than or equal to 5% of either.
[0039] The display device provided by the embodiments of the present disclosure can have various implementation forms, for example, can be a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. For example, referring to FIG. 1, which is a specific implementation of a structure of a display device according to some embodiments, and FIG. 1 is a schematic diagram of an operation scenario between the display device and a control device according to some embodiments. As shown in FIG. 1, a user can operate the display device 200 through a smart device 300 or a control device 100. In some embodiments, the control device 100 can be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication modes, to control the display device 200 in a wireless or wired manner. The user can input user instructions through buttons on the remote controller, voice input, control panel input, etc., to control the display device 200. In some embodiments, the smart device 300 (such as a mobile terminal, a tablet computer, a computer, a notebook computer, etc.) can also be used to control the display device 200. For example, an application running on the smart device is used to control the display device 200. In some embodiments, the display device can not receive instructions using the above-mentioned smart device or control device, but can receive user control through touch or gesture, etc. In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300, for example, can directly receive user voice instructions through a voice instruction acquisition module configured inside the display device 200, or can receive user voice instructions through a voice control device arranged outside the display device 200. In some embodiments, the display device 200 also communicates data with a server 400. The display device 200 can be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 can provide various content and interaction to the display device 200. The server 400 can be one cluster or multiple clusters, and can include one or more types of servers.
[0040] Referring to FIG. 2, which is a detailed implementation of another structure of a display device according to some embodiments, an exemplary configuration block diagram of the control device 100 according to exemplary embodiments is shown. As shown in FIG. 2, the control device 100 includes a controller 110, a communication interface 120, a user input / output interface 130, a memory 140, and a power supply 150. The control device 100 can receive input operation instructions from a user and convert the operation instructions into instructions that can be recognized and responded to by the display device 200, thereby acting as an intermediary in the interaction between the user and the display device 200. Referring to FIG. 3, which is a detailed implementation of yet another structure of a display device according to some embodiments, as shown in FIG. 3, the display device 200 includes at least one of a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory 290, a power supply 280, and a user interface 300. In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an n-th interface for input / output. The display 260 includes a display screen component for presenting a picture, a driving component for driving the image display, a component for receiving an image signal originating from the controller output, and a component for displaying video content, image content, and a menu control interface, and a user control UI interface. The display 260 can be a liquid crystal display, an OLED display, and a projection display, and can also be a projection device and a projection screen. The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator can include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220. The user interface can be used to receive control signals of the control device 100 (such as an infrared remote control, etc.). The detector 230 is used to collect signals of the external environment or interaction with the external environment. For example, the detector 230 includes a light receiver for collecting ambient light intensity, or the detector 230 includes an image collector such as a camera, which can be used to collect external environment scenes, user attributes, or user interaction gestures, or the detector 230 includes a sound collector such as a microphone, etc., for receiving external sounds. The external device interface 240 can include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or data high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It can also be a composite input / output interface formed by the above-mentioned multiple interfaces.The tuner and demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals. In some embodiments, the controller 250 and the tuner and demodulator 210 can be located in different separate devices, i.e., the tuner and demodulator 210 can also be located in an external device of the main device where the controller 250 is located, such as an external set-top box, etc. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object displayed on the display 260, the controller 250 can perform an operation related to the object selected by the user command. In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM (Random Access Memory), a ROM (Read-Only Memory), a first interface to an n-th interface for input / output, a communication bus, etc. The user can input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor. The "user interface" is a medium interface for interaction and information exchange between an application or an operating system and a user, and it implements conversion between an internal form of information and a form that a user can accept. A commonly used form of a user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation that is displayed in a graphical manner. It can be an icon, a window, a control, etc. displayed on a display screen of an electronic device, and the control can include a visible interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a widget, etc.
[0041] Referring to FIG. 4, FIG. 4 is a structural schematic diagram of a display device in the related art according to some embodiments. As shown in FIG. 4, the display device 1 includes a display apparatus 10, a control apparatus 11 and a distance sensor 13. The control apparatus 11 is configured to control the display apparatus 10 to display a picture. The distance sensor 13 can be a radar, and the distance sensor 13 is configured to detect object position data on the display side of the display apparatus 10 and send the object position data to the control apparatus 11. Specifically, referring to FIG. 1, the display side of the display apparatus 10 is the side of the display apparatus 10 facing the user in FIG. 1, and the non-display side of the display apparatus 10 is the side of the display apparatus 10 away from the user in FIG. 1. When the user uses the display device 1, the user is generally on the display side of the display apparatus 10 to watch the content displayed by the display apparatus 10. Referring to FIG. 5, FIG. 5 is a flowchart of a control method of a display device in the related art according to some embodiments. The method shown in FIG. 5 can be applied to the display device shown in FIG. 4 and is executed by the control apparatus 11. The control apparatus 11 first acquires the object position data from the distance sensor 13 through S01, and then determines whether there is a human body on the display side of the display apparatus according to the object position data through S02. Finally, the control apparatus 11 controls the display apparatus 10 according to whether there is a human body determined in S02, for example, when the control apparatus 11 determines that there is a human body on the display side of the display apparatus, the control apparatus 11 controls the display apparatus 10 to continuously display a picture; when the control apparatus 11 determines that there is no human body on the display side of the display apparatus, the control apparatus 11 controls the display apparatus 10 to stop displaying a picture, and so on, thereby saving the overall energy consumption of the display device 1 and improving the use experience of the display device 1.
[0042] However, in the specific implementation process, the accuracy of the control apparatus 11 of the display device 1 in determining whether there is a human body according to the display object position data from the distance sensor 13 is low. Especially for the case that the human body on the display side of the display apparatus 10 does not move for a long time, if the control apparatus 11 determines that there is no human body on the display side of the display apparatus according to the object position data at this time, and controls the display apparatus 10 to stop displaying, it will interrupt the normal watching of the user, which greatly affects the use experience of the display device 1. Based on this, the present disclosure provides a display device and a control method thereof. By adding an infrared sensor to the display device, the processor not only relies on the object position data, but also combines the temperature data from the infrared sensor to determine whether there is a human body on the display side of the display apparatus, so as to improve the accuracy of the display device in detecting the human body and improve the use experience of the display device. The embodiments of the present disclosure will be described in detail below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes can not be described in detail in some embodiments.
[0043] Referring to FIG. 6A, FIG. 6A is a structural schematic diagram of an embodiment of a display device according to some embodiments. As shown in FIG. 6A, the display device 1 includes a display apparatus 10 configured to display a picture. The display apparatus 10 can be specifically an LCD display screen, an LED display screen, a QLED display screen, an OLED display screen, a MiniLED display screen, or a laser display screen, etc. A control apparatus 11 connected to the display apparatus 10 and a human body detection apparatus 110 respectively, the control apparatus 11 is configured to control the display apparatus 10, for example, the control apparatus 11 controls the display apparatus 10 to display a picture or stop displaying a picture, or the control apparatus 11 controls the content displayed by the display apparatus 10. The control apparatus 11 can be a master control chip of the display device 1, such as a CPU, an MCU, or a Soc, etc. The human body detection apparatus 110 includes a distance sensor 13 and a temperature sensor 14. The distance sensor 13 is configured to detect object position data on the display side of the display apparatus 10 and send it to the control apparatus 11, and the temperature sensor 14 is configured to detect temperature data on the display side of the display apparatus 10 and send it to the control apparatus 11. The control apparatus 11 is specifically configured to determine whether there is a human body on the display side of the display apparatus 10 according to the object position data and the temperature data. In an embodiment, the temperature sensor 14 can be an infrared temperature sensor, a laser temperature sensor, a thermometer, a thermistor, a thermocouple, a digital temperature sensor, or an analog temperature sensor, etc. In an embodiment, the distance sensor 13 can be a radar, a laser sensor, a millimeter wave radar sensor, etc. The radar can be specifically a multi-transmit multi-receive radar, which has high detection accuracy and accuracy.
[0044] Referring to FIG. 6B, FIG. 6B is a structural schematic diagram of another embodiment of a display device according to some embodiments. As shown in FIG. 6B, the display device 1 further includes a processor 12, which can be used to receive object position data from the distance sensor 13 and temperature data from the temperature sensor 14 and send them to the control apparatus 11 after relevant processing. The processor 12 can be a microprocessor such as an MCU, which can be integrated in the control apparatus 11 or can be a separate processing element. The processing steps related to the object position data and the temperature data provided by the embodiments of the present disclosure can be performed by the control apparatus 11 or by the processor 12, depending on the specific configuration of the display device 1. For example, the processor 12 can determine whether there is a human body on the display side of the display apparatus according to the object position data and the temperature data, and send first detection information to the control apparatus 11 when it is determined that there is a human body; send second detection information to the control apparatus 11 when it is determined that there is no human body. For another example, the processor 12 can send the object position data and the temperature data to the control apparatus 11, and the control apparatus 11 determines whether there is a human body on the display side of the display apparatus according to the object position data and the temperature data.
[0045] Referring to FIG. 7, FIG. 7 is a schematic diagram of an external structure of a human body detection device according to some embodiments, wherein the distance sensor 13 is taken as an example of a radar, and the human body detection device 110 is provided with the temperature sensor 14 and the radar 13 at the same time, and the radar has an antenna A and an antenna B. The temperature sensor 14 and the radar 13 are both arranged towards the display side of the display device 10, and the midline of the antenna of the radar 13 and the midpoint of the temperature sensor 14 are on a horizontal line, and the included angle between the identification angle of the radar 13 and the identification angle of the temperature sensor 14 is set to be less than 3 degrees, so that the positions towards which the radar 13 and the temperature sensor 14 are arranged are the same, and the positions from which the data collected by the radar 13 and the temperature sensor 14 are collected are close. Thus, it is beneficial to position the objects collected by the two at the same time, and it is convenient to analyze and judge the same object by using two different data.
[0046] Referring to FIG. 8, FIG. 8 is a schematic diagram of an internal structure of a human body detection device according to some embodiments, wherein the processor 12 in the embodiment shown in FIG. 6B is specifically shown to include a distance data processing unit 121, a temperature data processing unit 122 and a fusion processing unit 123, wherein the distance data processing unit 121 is connected with the distance sensor 13 through a first interface a, for obtaining and processing the object position data from the distance sensor 13. The temperature data processing unit 122 is connected with the infrared sensor 14 through a second interface b, for obtaining and processing the temperature data from the temperature sensor 14. The fusion processing unit 123 is connected with the distance data processing unit 121 and the temperature data processing unit 122 respectively, and is also connected with the control device 11 through a third interface c. The fusion processing unit 123 can be used to generate a detection signal according to the processing result of the object position data by the distance data processing unit 121 and the processing result of the temperature data by the temperature data processing unit 122, and send the detection signal to the control device 11 through the third interface c. In an embodiment, the first interface a can be an SPI interface, the second interface b can be an I2C interface, and the third interface c can be a UART interface.
[0047] In summary, the processor in the display device provided by some embodiments of the present disclosure processes the object position data from the distance sensor 13 and the temperature data from the temperature sensor 14 by different processing units respectively, and each processing unit is connected through a general and mature interface, which has the technical effects of simple structure, easy implementation and strong expansibility, and is beneficial to the application and promotion of the embodiments of the present disclosure. At the same time, when the display device adopts the structure of the processor 12 shown in FIG. 6B, the processor 12 can also process different data in parallel based on different processing units, thereby reducing the time required for processing multiple data, and further improving the computing efficiency of the processor 12.
[0048] Referring to FIG. 9, FIG. 9 is a flowchart of an embodiment of a control method of a display device according to some embodiments. The control method shown in FIG. 9 can be applied to the display device shown in FIG. 6A and executed by the processor 12. Specifically, the control method shown in FIG. 9 includes: S10: the control device 11 acquires the object position data from the distance sensor 13 and the temperature data from the infrared sensor 14. In an embodiment, the distance sensor 13 can collect the object position data at an interval and send it to the control device 11, and at the same time, the infrared sensor 14 also collects the temperature data at the same interval and sends it to the control device 11, so that the control device 11 can receive the object position data from the distance sensor 13 and the temperature data from the infrared sensor 14 at an interval. Alternatively, the control device 11 can also control the distance sensor 13 and the infrared sensor 14 to collect data at an interval, respectively, so as to receive the object position data from the distance sensor 13 and the temperature data from the infrared sensor 14. S20: The control device 11 determines whether there is a human body on the display side of the display device 10 according to the object position data and the temperature data acquired in S10. In an embodiment, the processor 12 judges whether the object position data satisfies a first preset condition and judges whether the temperature data satisfies a second preset condition, so as to finally determine whether there is a human body on the display side of the display device 10 according to the respective judgment results. In an embodiment, when the processor 12 determines that there is a human body on the display side of the display device 10 as shown in FIG. 6B, the processor 12 generates a first detection signal and sends it to the control device 11. When it is determined that there is no human body on the display side of the display device 10, the processor 12 generates a second detection signal and sends it to the control device 11. At this time, the control device 11 determines whether there is a human body on the display side of the display device 10 according to the received detection signal.
[0049] In summary, the control method of the display device provided by some embodiments of the present disclosure can combine the object position data from the distance sensor 13 and the temperature data from the infrared sensor 14 to determine whether there is a human body on the display side of the display device 10 through fusion processing, thereby avoiding errors in some cases when human body detection is only dependent on the data of the distance sensor 13, thereby increasing the accuracy of human body detection and improving the use experience of the display device 1. It can be understood that on the basis of the embodiments of the present disclosure, the display device 1 can also be provided with a larger number of sensors or other sensors, and the data of the sensors can be used in combination with the object position data of the distance sensor 13 to determine whether there is a human body on the display side of the display device 10. The technical effect of improving the accuracy of human body detection can also be achieved, and the implementation and principles are the same, which will not be described in detail.
[0050] In an embodiment, the infrared sensor 14 provided in the display device 1 as shown in FIG. 6 can also be replaced by other sensors, and the above-mentioned embodiment processes are executed according to the data of the other sensors, and the technical effect of improving the human body detection accuracy can also be achieved through the fusion judgment mode. Alternatively, in another embodiment, the infrared sensor 14 provided in the display device 1 as shown in FIG. 6 can also be replaced by another distance sensor, and the above-mentioned processes are executed according to the data of the distance sensor, and the technical effect of improving the human body detection accuracy can also be achieved through the fusion of the data of the two distance sensors. Referring to FIG. 10, FIG. 10 is a flowchart of another embodiment of a control method of a display device according to some embodiments. The method as shown in FIG. 10 shows a specific implementation of S20 shown in FIG. 9. As shown in FIG. 10, after obtaining the object position data and the temperature data, the control device 11 determines whether the object position data satisfies a first preset condition through S201. Exemplarily, the first preset condition includes that the difference between the position coordinates of the object included in the current object position data and the position of the object in the historical object position data stored in advance is less than a preset distance value. Then, when the control device 11 determines that the object position data satisfies the first preset condition, it can be determined in S203 that there is a human body on the display side of the display device 10. When the control device 11 determines that the object position data does not satisfy the first preset condition, it does not directly determine that there is no human body on the display side of the display device 10, but continues to determine whether the temperature data satisfies a second preset condition through S202. Exemplarily, the second preset condition includes that at least one target temperature value included in the temperature data is greater than a preset temperature value, etc. Then, when the control device 11 determines that the temperature data satisfies the second preset condition, it can be determined in S203 that there is a human body on the display side of the display device 10. When the control device 11 determines that the temperature data does not satisfy the second preset condition, it can be determined in S204 that there is no human body on the display side of the display device 10. It can be seen that only when the object position data does not satisfy the first preset condition and the temperature data does not satisfy the second preset condition, the control device 11 determines that there is no human body on the display side of the display device 10, so when the user of the display device 1 is stationary on the display side of the display device 10, even if the control device 11 determines that the first preset condition is not satisfied according to the object position data, it will not directly determine that there is no human body on the display side of the display device 10, but will also make a second determination through the temperature data. Since the human body is in a stationary state and still has a certain temperature, the control device 11 can still determine that there is a human body on the display side of the display device 10 according to the temperature data.
[0051] In summary, the display device control method provided by some embodiments of the present disclosure further refines the processing logic of the control device 11 for jointly determining whether a human body exists according to the object position data and the temperature data, so that the control method has a higher granularity, is easy to implement and use, and ultimately enables the control device 11 to effectively avoid the problem of incorrect identification of the object position data in some scenarios on the basis of the two levels of determination of the object position data and the temperature data, thereby improving the accuracy of human body detection.
[0052] In the above embodiments of the present disclosure, when the control device 11 determines that the object position data does not meet the first preset condition, it can continue to determine whether the temperature data meets the second preset condition. However, in some cases, taking the radar as an example, since the recognition area of the temperature sensor 14 is smaller than the recognition area of the radar 13, in an embodiment of the present disclosure, when the control device 11 determines in S201 that the object position data does not meet the first preset condition, if the position information of the object in the current object position data corresponds to a region within the first target region in the recognition area of the radar 13, the control device 11 further performs S202 to determine whether the temperature data meets the second preset condition, and then determines whether a human body exists on the display side of the display device 10 according to the determination result of S202. If the position information of the object in the current object position data corresponds to a region other than the first target region in the recognition area of the radar 13, the control device 11 does not perform S202, but directly determines that no human body exists on the display side of the display device 10 according to the recognition result of the object position data. For example, referring to FIG. 11, which is a schematic diagram of a recognition area of a radar according to some embodiments, the recognition area 130 of the radar can be divided into a first target region 131 and other regions 132 outside the first target region 131. The first target region 131 overlaps with the recognition area of the temperature sensor 14, or the accuracy of the temperature data of the object within the first target region 131 is higher, so that the subsequent determination can be based on the temperature data for the object within the first target region 131. In summary, the display device control method provided by some embodiments of the present disclosure determines whether to continue the subsequent determination based on the temperature data according to different target regions within the recognition area of the radar 13, thereby ensuring the accuracy of the recognition within each recognition area, preventing new errors from being introduced into the detection result due to the small recognition range of the temperature sensor 14, and further improving the completeness of the entire method.
[0053] Referring to FIG. 12, which is a schematic diagram of the position of an object in the identification area of a radar according to some embodiments, and referring to FIG. 13, which is a schematic diagram of the position of an object in the identification area of a temperature sensor according to some embodiments, FIGS. 12-13 show the correspondence between the position in the identification area of the radar 13 and the position in the identification area of the temperature sensor 14 for the same object M. Specifically, the coordinates of the object M in the identification area of the radar 13 are (X1, Y1), and the coordinates of the object M in the identification area of the temperature sensor 14 are (X2, Y2). The angle of the object M in the identification area of the radar 13 is calculated according to the formula a = arctan(X1 / Y1). The angle of the object M in the identification area of the temperature sensor 14 is calculated according to the FOV = U degrees and the resolution K*K of the temperature sensor, b = (2*U / K)*(K / 2-X2). Wherein, when |(a-b)| is less than a threshold value, they correspond to the same object M, and when |(a-b)| is greater than the threshold value, they are not the same object. The threshold value can be set to between plus and minus 10 degrees. In the above embodiments, the method for the control device 11 to determine whether there is a human body on the display side of the display device 10 according to the object position data and the temperature data is described, wherein when the control device 11 determines that there is no human body on the display side of the display device 10, the display device 10 can be controlled.
[0054] Specifically, referring to FIG. 14, which is a schematic diagram of the control logic of a control device according to some embodiments, when the control device 11 determines through S204 that there is no human body on the display side of the display device 10, after a first time of S2041, the control device 11 controls the display device 10 to display prompt information that the display screen will be stopped in S2042. The prompt information can be in the form of a pop-up window, etc. After a second time of S2043, the control device 11 controls the display device 1 to reduce the sound and brightness in S2044. After a third time of S2045, the control device 11 controls the display device 10 to stop displaying the screen in S2046, which can specifically be turning off the display device 10 or controlling the display device 1 to enter a standby state, etc. In an embodiment, the first time can be set to 5 minutes, the second time can be set to 10 minutes, and the third time can be set to 15 minutes.
[0055] In conclusion, the control method of the display device provided by some embodiments of the present disclosure can control the display device 10 at different times according to the received second detection signal, so as to control the display device 10 to stop displaying the picture in time when it is determined that no one is on the display side of the display device 10, thereby improving the intelligent degree of the display device 1 and reducing the invalid energy consumption of the display device 1. In particular, through the setting of the first time and the second time, the user who may not be detected is prompted before the display is finally stopped, preventing the normal viewing of the user from being affected by directly controlling the display device 11 to stop displaying, and further improving the use experience of the display device 1.
[0056] In an embodiment, the control device 11 is further configured to determine that a fire may occur on the display side of the display device 10 when the temperature value greater than the warning threshold is included in the continuously received temperature data and the temperature value is continuously increasing, and control the display device 11 to display fire warning information or control the display device 1 to emit an alarm sound. The display device provided by some embodiments of the present disclosure can detect the temperature of the environment where the display device 1 is located based on the temperature sensor, thereby realizing fire warning, which not only enriches the functions of the display device 1, but also improves the safety guarantee capability of the user's person and property through the display device 1, and further improves the use experience of the display device 1.
[0057] Referring to FIG. 15, FIG. 15 is a structural schematic diagram of another embodiment of a display device according to some embodiments. In the embodiment shown in FIG. 15, the display device 1 provided by the present disclosure further comprises an environment sensor 15, wherein the environment sensor 15 is connected with the control device 11. The environment sensor 15 can be used to detect the air quality information of the environment where the display device 1 is located, and send the air quality information to the control device 11, wherein the air quality information comprises information of formaldehyde, PM2.5 and other gases. The control device 11 can control the display device 10 to display air quality prompt information according to the received air quality information, for example, by displaying the air quality information in the form of a pop-up window on the boot interface or the menu interface. The display device 1 provided by some embodiments of the present disclosure actively displays the air quality information on the display device 10 based on the set environment sensor 15, which not only enriches the functions of the display device 1, but also does not need to specially set an environment sensor outside, thereby reducing the operation and the equipment that the user needs to purchase when the user wants the display device 1 to display the air quality. Further, the present disclosure further provides a method for processing data from the distance sensor 13 by the display device 1, wherein the data from the distance sensor 13 can be the object position data described in the present disclosure. The processing method of the data from the distance sensor 13 provided by the present disclosure can be executed by the control device 11 as shown in FIG. 6A, or by the processor 12 as shown in FIG. 6B, or specifically by the distance data processing unit 121 in the processor 12 as shown in FIG. 8, or the method can also be executed by any other electronic device with processing demand and capability for object position data. In the embodiments of the present disclosure, the control device 11 as shown in FIG. 6A is taken as the execution subject to introduce the processing method of the data from the distance sensor 13, but not to limit it. Specifically, the control device 11 provided by some embodiments of the present disclosure stores and manages the object position data from the distance sensor 13 by using a linked list, for example, referring to FIG. 16, FIG. 16 is a schematic diagram of processing data from a distance sensor according to some embodiments. In the example shown in FIG. 16, the control device 11 has stored four linked lists labeled a, b, c and d, and each linked list is used to store the object position data of one target object. For example, the linked list a is used to store all the object position data of the target object A, the linked list b is used to store all the object position data of the target object B, the linked list c is used to store all the object position data of the target object C, and the linked list d is used to store all the object position data of the target object D, and so on. The linked list a stores three object position data, which are labeled a1, a2 and a3, wherein a1 is the first node of the linked list, and a2 and a3 are the child nodes of the linked list. At the same time, the linked list is also sorted according to the order in which the child nodes are stored, for example, the nodes a1, a2 and a3 correspond to the object position data which are sequentially added to the linked list, and the child node a3 is the latest added object position data in the linked list, which is labeled as the latest object position data.Referring to FIG. 17, which is a schematic diagram of an embodiment of a data processing method of a distance sensor of a display device according to some embodiments, showing the management steps of the control device 11 on the object position data after receiving each time. Specifically, the control device 11 is configured to, after receiving the object position data, first query whether the current control device 11 has stored a linked list through S1, if not empty, compare the object position data with the latest object position data of each of the plurality of linked lists already stored through S102, if the object position data is found to meet the preset condition with the latest object position data in the first linked list, it means that the current object position data and the latest object position data in the first linked list belong to the same target object, and then the object position data is added to the first linked list through S2. And when there is no first linked list that meets the preset condition in the plurality of linked lists, the control device 11 creates a second linked list through S3, and stores the object position data as the first node of the second linked list. And when the current control device 11 has stored a linked list, the control device 11 creates a second linked list through S3, and stores the object position data as the first node of the second linked list. In combination with FIG. 16, the S1 process is the "check" operation of the control device 11 on the linked list, that is, comparing the current acquired object position data with the latest object position data stored in the plurality of linked lists. For example, the object position data is compared with the latest object position data of the a3 node in the linked list a, the latest position data of the b4 node in the linked list b, the latest position data of the c3 node in the linked list c, and the latest position data of the d2 node in the linked list d. The S2 process is the "change" operation of the control device 11 on the linked list, that is, the object position data meets the preset condition with the object position data in the first linked list a, then the object position data is added to the first linked list a for storage, and its position is located in the a4 subnode in the linked list, at this time, the newly added object position data replaces the object position data of the a3 node, which is called the latest position data in the linked list a. The S3 process is the "increase" operation of the control device 11 on the linked list, that is, none of the plurality of linked lists includes a first linked list that meets the preset condition, then the control device 11 adds a second linked list e, and the object position data is the first node e1 of the second linked list e.
[0058] In summary, the data processing method of the distance sensor of the display device provided by some embodiments of the present disclosure stores and manages the object position data from the distance sensor 13 through a linked list, and in the processing process, the "add", "modify", and "query" operations of the object position data are implemented through the linked list. Since the structure of the linked list is relatively simple, and each linked list corresponds to the storage mode of a target object, the linked list is suitable for separately storing and managing the object position data of each different object in the distance sensor data, thereby improving the management efficiency of the distance sensor data through the linked list and improving the confidence of human body detection based on the distance sensor data.
[0059] In an embodiment, the object position data includes position coordinates (X, Y) of the object within the identification area of the distance sensor, a motion state (S), and time information (T). Then, the control device 11 can compare the object position data from multiple different dimensions according to the position coordinates, the motion state, and the time information therein, so as to improve the accuracy and effectiveness of the comparison result. In a specific implementation, the method for processing the distance sensor data provided by the present disclosure can be applied in the S201 step in the method shown in FIG. 10. When the control device 11 determines whether the object position data meets the first preset condition, the control device 11 can compare the object position data with the latest object position data of the plurality of stored linked lists, and determine that there is a first linked list in the plurality of linked lists. When the control device 11 determines that the object position data meets the first preset condition, the control device 11 can further add the object position data to the first linked list. When it is determined that there is no first linked list in the plurality of linked lists, the control device 11 determines that the object position data does not meet the first preset condition, and further adds the object position data to a newly created second linked list. In an embodiment, the control device 11 determines that the object position data meets the preset condition, including: the distance difference between the position coordinates of the object position data and the position coordinates of the latest object position data in the first linked list is less than a first distance preset value. At the same time, the time difference between the time information of the object position data and the time information of the latest object position in the first linked list is less than a first time preset value. Taking the linked list shown in FIG. 16 as an example, the distance difference between the position coordinates (X, Y) of the object position data and the position coordinates of the object position data a3 in the first linked list a is less than the first distance preset value, and the time difference of the time information T is less than the first time preset value. It is indicated that the object position data currently processed and the latest object position data a3 in the first linked list a are close in distance and close in time, and can be considered as belonging to the same target object a. Therefore, the current object position data can be stored in the child node a4 of the first linked list a. In the data processing method of the distance sensor of the display device provided by some embodiments of the present disclosure, the linked list storage structure of the object position data based on the distance sensor is used to determine the relevance of the object position data currently to be processed and the linked list from the time dimension and the spatial distance dimension, and the different target objects are distinguished based on the continuity of the linked list in space and time. The target object corresponding to the current object position data is more accurately and effectively determined, so as to continuously track the target object and manage the data of the distance sensor, and the efficiency of managing the target object based on the data of the distance sensor is improved.
[0060] In an embodiment, when the control device 11 determines a plurality of chains meeting the preset condition, the present disclosure further provides a method for determining a first chain from the plurality of chains. For example, referring to FIG. 18, which is a schematic diagram of another embodiment of a data processing method of a distance sensor of a display device according to some embodiments, after the control device 11 compares the distance difference and the time difference based on the currently acquired object position data at S1, a plurality of first chains having a distance difference less than a first distance preset value and / or a time difference less than a first time preset value are obtained. The plurality of first chains can be stored in a queue manner, for example, the first chains having a distance difference less than the first distance preset value are stored in a first queue at S1001, and the first chains having a time difference less than the first time preset value are stored in a second list at S1002. Subsequently, the control device 11 determines whether the number of first chains in the second list is 0 at S1003. If the number of first chains in the second list is 0, the control device 11 determines whether the number of first chains in the first queue is 0 at S1004. If the number of first chains in the first queue is not 0, it means that a plurality of chains include object position data having a distance difference less than the first distance preset value from the current object position data. Then, the control device 11 further determines a first chain from the first chains in the first queue by comparing the time difference between the latest object position data in the first chains and the current object position data at S1005, and adds the object position data to the determined first chain. When the control device 11 determines that the number of first chains in the first queue is 0 at S1007, it means that the plurality of chains currently stored do not include a first chain, and the control device 11 needs to establish a new second list to store the current object position data subsequently. If the control device 11 determines that the number of first chains in the second queue is not 0 at S1003, it means that a plurality of chains include object position data having a time difference less than the first time preset value from the current object position data. Then, the control device 11 further determines a first chain from the first chains in the second queue by comparing the distance difference between the latest object position data in the first chains and the current object position data at S1006, and adds the object position data to the determined first chain.
[0061] In summary, the data processing method of a distance sensor of a display device provided by some embodiments of the present disclosure can further screen a plurality of first chains when the number of first chains meeting the preset condition is more than one, so as to determine a first chain closest to the current object position data, and add the current object position data to the first chain, thereby further improving the accuracy of processing the object position data and ensuring the effectiveness of managing the target object based on the data of the distance sensor.
[0062] In an embodiment, the present disclosure also provides a method for the control device 11 to delete the stored linked lists, thereby reducing the storage space occupied by the invalid linked lists of useless target objects, and deleting the interference and influence of the pseudo-targets possibly identified by mistake on the subsequent calculation. Specifically, the control device 11 verifies the validity of the stored linked lists every certain time interval, and determines whether the target objects corresponding to the linked lists are real objects. Assuming that the control device 11 determines that the target object corresponding to a third linked list in the linked lists is not a real object, the control device 11 deletes the stored third linked list and the object position data in the third linked list. For example, referring to FIG. 19, which is a flowchart of another embodiment of a data processing method of a distance sensor of a display device according to some embodiments, as shown in FIG. 19, the control device 11 is specifically configured to perform one or more steps in S401-S405, determine whether the target object corresponding to the third linked list is a real object in S406, and delete the third linked list and the stored object position data which are not real objects in S407. S401: When the third linked list does not add new object position data within a first detection time, it is indicated that the target object corresponding to the third linked list is not updated subsequently, and the target object is a pseudo-target. Therefore, the control device 11 can determine that the target object corresponding to the third linked list is not a real object. In an embodiment, the first detection time can be set to 10 milliseconds. S402: When the number of new object position data added by the third linked list within a second detection time is less than a first number value, it is indicated that the target object is a pseudo-target temporarily appearing. Therefore, the control device 11 can determine that the target object corresponding to the third linked list is not a real object. In an embodiment, the second detection time can be set to 1 second. S403: When the motion states of the new object position data newly added by the third linked list within a third detection time are all in a stationary state, and the position coordinates of the new object position data are in a second target region in the recognition region of the distance sensor, it is indicated that the target object is a stationary pseudo-target and is not a human body. Therefore, the control device 11 determines that the target object corresponding to the third linked list is not a real object. In an embodiment, the third detection time can be set to 600 seconds. For example, referring to FIG. 20, which is a schematic diagram of a recognition region of a distance sensor according to some embodiments, the entire recognition region 130 is divided into a first target region 131 at a middle position, second target regions 133 at both sides, and a boundary region 134. S404: When the motion states of the new object position data newly added by the third linked list within a fourth detection time are all in a stationary state, and the position coordinates of the new object position data are in the boundary region in the recognition region of the distance sensor, it is indicated that the target object has moved out of the recognition region of the distance sensor. Therefore, the control device 11 determines that the target object corresponding to the third linked list is not a real object. In an embodiment, the fourth detection time can be set to 60 seconds.S405: When the position coordinate of the object position data in the third chain table is in the first target region in the recognition region of the distance sensor, the control device 11 can jointly determine whether the target object corresponding to the third chain table is a real object through the object position data and the temperature information from the temperature sensor 14. Specifically, referring to FIG. 20, when the position coordinate of the object position data in the third chain table is in the first target region 131, in combination with FIG. 11, the first target region 131 can jointly determine whether the target object corresponding to the third chain table is a real object according to the temperature information provided by the temperature sensor. In an embodiment, the control device 11 can specifically determine whether the target object corresponding to the third chain table is a real object according to the method shown in FIGS. 12-13, first calculate a first angle a = arctan (X1 / Y1) according to the coordinate of the recognition region of the distance sensor and the coordinate position (X1, Y1) of the object position data, then calculate a second angle β = (2*U / K)*(K / 2-X2) according to the field of view angle FOV of the temperature sensor and the position of the object in the temperature information, and then determine that the target object corresponding to the third chain table is a real object when the absolute value of the difference between the first angle and the second angle |(a-β)| is less than a preset angle, and determine that the target object corresponding to the third chain table is not a real object when the absolute value of the difference between the first angle and the second angle |(a-β)| is greater than the preset angle. In summary, in the data processing method of the distance sensor of the display device provided by some embodiments of the present disclosure, the object position data from the distance sensor 13 is stored and managed through the chain table, and in the processing process, the "deletion" operation of the object position data is realized through the chain table, thereby avoiding the false recognition of the target object, avoiding the influence of the false target object on the subsequent calculation, and reducing the occupation of the storage space of the control device 11 by the invalid chain table.
[0063] The display device 1 provided by the present disclosure also provides a method for processing data from the temperature sensor 14, which can be the temperature data described in the present disclosure. The method for processing data from the temperature sensor provided by the present disclosure can be executed by the control device 11 as shown in FIG. 6A, or by the processor 12 as shown in FIG. 6B, or specifically by the temperature data processing unit 122 in the processor 12 as shown in FIG. 8, or by any other electronic device with the processing requirement and capability of data from the temperature sensor. In the embodiments of the present disclosure, the control device 11 as shown in FIG. 6A is taken as the main body for executing the method for processing data from the temperature sensor 14, which is not intended to be limited. Specifically, referring to FIG. 21, which is a flowchart of an embodiment of the method for processing data from the temperature sensor of the display device according to some embodiments, as shown in FIG. 21, the control device 11 obtains the differential temperature data D3 according to the difference between the received temperature data D1 and the stored background data D2. Then, the control device 11 determines whether there is a human body on the display side of the display device 11 according to the differential temperature data D3. In an embodiment, the resolution of the temperature sensor is K*K, and the temperature data includes temperature values of K*K pixel positions distributed in K rows and K columns. Similarly, the background data also includes temperature values of K*K pixel positions. The difference between the temperature data and the background data can also obtain the difference values of the temperature values of K*K pixel positions, and each difference value of the pixel position is used to represent the temperature change of the current temperature data compared with the background data. In summary, in the method for processing data from the temperature sensor of the display device provided by some embodiments of the present disclosure, the differential temperature data obtained by the difference between the temperature data and the background data is used to determine whether there is a human body, which avoids the influence of the possible high temperature point in the background data on the recognition result compared with directly determining whether there is a human body by the peak value of the temperature value in the temperature data, thereby improving the accuracy of recognizing whether there is a human body according to the temperature data of the temperature sensor 14, and further ensuring the accuracy and effectiveness of the subsequent processing of the display device 1 according to the human body recognition result, and improving the user experience of the display device 1.
[0064] In a specific implementation, the method for processing temperature sensor data provided by the present disclosure can be applied in S202 of the method shown in FIG. 10. When the control device 11 determines whether the temperature data meets the second preset condition, the difference temperature data can be obtained according to the temperature data and the background data, and it is determined whether there is a human body according to the difference temperature data. When it is determined that there is a human body according to the difference temperature data, it means that the temperature data meets the second preset condition. When it is determined that there is no human body according to the difference data, it means that the temperature data does not meet the second preset condition. In an embodiment, the background data is preset. In another embodiment, the background data can also be updated in real time, so as to ensure the real-time of the background data and improve the accuracy and real-time of the identification of whether there is a human body through the background data. For example, when the control device 11 determines that there is no human body on the display side of the display device 10, the stored background data is updated according to the currently obtained temperature data. The control device 11 can determine that there is no human body on the display side of the display device 10 according to the current temperature data, or the control device 11 can also determine that there is no human body on the display side of the display device 10 according to the data of other devices. For example, in combination with the display device 1 shown in FIG. 6 or FIG. 8, the control device 11 can determine whether there is a human body on the display side of the display device 10 according to the object position data provided by the distance sensor 13. If it is determined that there is no human body on the display side of the display device 10 according to the object position data, the control device 11 can update the stored background data according to the currently obtained temperature data. In addition, the control device 11 can also determine whether there is a human body according to the data of other devices, and the implementation is the same, which will not be described herein. In this embodiment, whether there is a human body is determined through the object position data of the distance sensor 13, so as to determine whether the background data of the temperature sensor 14 is updated, which can effectively prevent the influence of the temperature data of the temperature sensor 14 itself on the background data, so as to ensure the accuracy of the update result, and further ensure the accuracy of the human body identification of the control device 11 according to the temperature data. In another embodiment, the control device 11 can update the background data according to the currently obtained temperature data every interval. If the control device 11 is about to update the background data after a period of time, and there is a human body in the temperature data obtained within the continuous preset update time, the control device 11 can update the background data according to the temperature data including the human body, so as to ensure the real-time of the temperature data and avoid the influence of the long-time non-update of the background data on the human body identification result.In another embodiment, the embodiment can also be applied when the display device 1 is powered on, the control device 11 determines that there is no background data stored currently, judges whether there is a human body on the display side of the display device, when it is determined that there is no human body on the display side of the display device, the control device 11 generates the background data according to the temperature data, and when it is determined that there is a human body on the display side of the display device and the temperature data obtained by the control device 11 within a preset judgment time length after the display device is powered on all include the human body, the control device 11 can still generate the background data according to the temperature data including the human body currently, thereby avoiding more serious consequences such as subsequent human body recognition failure caused by the failure to generate the background data, and ensuring the completeness of the entire processing flow of the display device 1.
[0065] In an embodiment of the present disclosure, the control device 11 is further configured to, when it is determined according to the object position data from the distance sensor 3 that there is a human body on the display side of the display device 10 and the background data is not updated within a preset update time length, update the background data according to a plurality of temperature data obtained continuously, update only a target part not including the human body each time, and gradually approach the position of the human body in the temperature data from the four corners of the temperature data each time, so as to finally update the entire temperature data. In an embodiment, the control device 11 can take the temperature value of one pixel position as the region where the human body is located, or can also determine the region where the human body is located according to the temperature values of a plurality of pixel positions, for example, the control device 11 specifically determines the position of the maximum N pixel points as the center according to the temperature value of each pixel position in the differential temperature data, and determines the region where the human body is located. At the same time, the part of the background data except the region where the human body is located is determined as the target part. N can be 20 or the like.
[0066] In an embodiment, the target part in the temperature data is determined according to the object position data from the distance sensor 13. For example, referring to FIG. 22, which is a schematic diagram of the identification area of a radar and the identification area of a temperature sensor according to some embodiments, where the distance sensor 13 is taken as an example of the radar, the identification area SY of the radar 13 in the x-y coordinate system and the identification area SX of the temperature sensor 14 in the x-z coordinate system are shown. For a position in the identification area SY of the radar 13, there can be a corresponding position in the identification area SX of the temperature sensor 14. Referring to FIG. 23, which is a schematic diagram of the correspondence between the identification area of a radar and the identification area of a temperature sensor according to some embodiments, for a position Q in the identification area SY of the radar 13, there can be a corresponding position Q' in the identification area SX of the temperature sensor 14. The control device 11 can determine a square part QX with a side length L centered at the position Q' in the identification area SX of the temperature sensor 14, and the part in the identification area SX of the temperature sensor 14 outside the square part QX is the target part not including the human body. The control device 11 can update the background data not including the human body according to the temperature data. In an embodiment, when the control device 11 determines the area QX in the identification area SX of the temperature sensor 14 including the positions of multiple human bodies as shown in FIGS. 22-23, the control device 11 can use a multiple gradual approximation method to update the background data multiple times, and finally complete the update of the entire background data. For example, referring to FIG. 24, which is a schematic diagram of a target part updated gradually according to some embodiments, the control device 11 updates the background data according to the temperature data obtained at four consecutive time points T1-T4. First, the control device 11 determines the white area in the temperature data at T1 as the position including the human body, and the shaded area outside the white area as the target area. The processor updates the background data according to the temperature data of the target area at T1. Then, the control device 11 determines the positions including the human body in the temperature data at T2, T3 and T4 in the same way, and updates the background data according to the temperature data of the target area not including the human body. Referring to FIG. 25, which is a schematic diagram of the update effect of the gradual update according to some embodiments, the background data updated at T1 in FIG. 25 is the shaded part, and the background data updated at T2 and T3 has a larger shaded part and a smaller white part compared with the previous time. Finally, at T4, the update of the entire background data is completed.To sum up, in the data processing method of the temperature sensor of the display device provided by some embodiments of the present disclosure, the control device 11 completes the update of the background data in a successive update manner even in the case that the temperature data includes a human body, on the basis of ensuring the real-time and effectiveness of the background data, further improves the timing and method of updating the background data, and realizes the elimination of the continuously existing temperature source in the background data in the case that the continuously existing cold source and heat source exist in the background data, avoids the influence of the external environment on the human body recognition result, and thus improves the accuracy of human body recognition. At the same time, the multiple update manner of successively approximating the human body region can also comprehensively update the background data, prevent the omission of the background data update, and avoid the occurrence of the situation that some regions are not updated due to the inaccurate human body recognition in the temperature data in one time.
[0067] In an embodiment, the control device 11 determines whether a human body exists on the display side of the display device according to the differential temperature data, specifically, the control device 11 calculates the mean square error, the mean square value and the maximum value of the temperature values of each pixel position in the differential temperature data. Then, the control device 11 compares the mean square error, the mean square value and the maximum value with the first threshold value, the second threshold value and the third threshold value respectively to obtain the first comparison result, the second comparison result and the third comparison result. Finally, the control device 11 determines whether a human body exists on the display side of the display device according to the first comparison result, the second comparison result and the third comparison result. Specifically, the mean square error δ1 is obtained by subtracting the mean square value of all temperature values in the background data from the mean square value of all temperature values in the temperature data. The mean square value δ2 is the mean square value of each pixel position in the differential temperature data. The maximum value δ3 is the difference between the two highest temperature values in the background data. The result that the mean square error δ1 is greater than the first threshold value is recorded as D1=1, and the result that the mean square value δ2 is greater than the second threshold value is recorded as D2=1. The result that the maximum value δ3 is greater than the third threshold value is recorded as D3=1. Then, the processor performs an or logic (||) calculation according to the first comparison result D1 and the second comparison result D3, and then performs an and logic (&) calculation with the third comparison result D3 to finally determine whether a human body exists on the display side of the display device. That is, when (D1||D2)&D3=1, it is determined that a human body exists on the display side of the display device, and when (D1||D2)&D3 is not equal to 1, it is determined that a human body does not exist on the display side of the display device. In summary, in the data processing method of the temperature sensor of the display device provided by some embodiments of the present disclosure, the mean square error, the mean square value and the maximum value of the differential temperature data are used to more comprehensively determine whether a human body exists in the differential temperature data. Since more parameters are used and the dimensions of the parameter sources are more comprehensive, the accuracy of determining whether a human body exists according to the temperature data can be improved by using the above method. In an embodiment, the control device 11 can also determine a threshold scaling coefficient according to the distance between the human body and the display side of the display device, and process the first threshold value, the second threshold value and the third threshold value according to the threshold scaling coefficient to finally obtain the first comparison result, the second comparison result and the third comparison result according to the processed first threshold value, the second threshold value and the third threshold value. The distance between the human body and the display side of the display device can be determined according to the object position data of the distance sensor 13.
[0068] Table 1
[0069] For example, Table 1 shows a correspondence between a distance and a threshold scaling coefficient, which can be seen that the scaling coefficient is inversely proportional to the distance. Referring to FIG. 26, which is a schematic diagram of a threshold scaling coefficient and a distance according to some embodiments, where the position Q1 is closer to the position P of the display device, and thus the scaling coefficient corresponding to the position Q1 is smaller, and the position Q2 is farther from the position P of the display device, and thus the scaling coefficient corresponding to the position Q2 is larger. The reason for such a setting is that when the human body is farther from the display device, each temperature value caused by the human body in the differential temperature data is smaller, at this time, the threshold value also needs to be correspondingly smaller, so as to ensure that the human body in the temperature data can be obtained by comparison, and the situation that the human body cannot be recognized is avoided; when the human body is closer to the display device, each temperature value caused by the human body in the differential temperature data is larger, at this time, the threshold value also needs to be correspondingly enlarged, so as to avoid the misrecognition situation that all temperature values are recognized as the human body. In an embodiment, the correspondence between the distance and the scaling coefficient can also be calculated by a fixed function or a segmented function, for example, the fixed function can be p(x) = p1xn + p2xn-1 + … + pnx + pn+1. The segmented function can be as follows:
[0070] In summary, in the temperature data processing method of the display device provided by some embodiments of the present disclosure, the control device 11 can process the threshold value by using different scaling coefficients according to different distances between the human body and the display device in the temperature data, and compare the differential temperature data with the threshold value processed by the scaling coefficient to determine whether there is a human body on the display side of the display device. Since the intensity of the temperature data obtained by the temperature sensor is considered to be different at different distances, the threshold value is processed according to the scaling coefficient which is inversely proportional to the distance, so that when the temperature value is small, it can be ensured that the human body in the temperature data can be obtained by comparison, and the situation that the human body cannot be recognized is avoided, and when the temperature value is large, the misrecognition situation that all temperature values are recognized as the human body is avoided, thereby further improving the accuracy of human body recognition according to the temperature data.
[0071] In the foregoing embodiments of the present disclosure, the processing method of the object position data from the distance sensor and / or the temperature data from the temperature sensor provided by the embodiments of the present disclosure is introduced, and in order to realize each function in the above-mentioned method provided by the embodiments of the present disclosure, the control device 11 or the processor 12 as an execution subject can include a hardware structure and / or a software module to realize each function in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a certain function in the above-mentioned functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the implementation.
[0072] It should be noted that the division of the various modules of the above apparatus is only a logical functional division, and all or part of them can be integrated into a physical entity or physically separated when actually implemented. The above modules can all be implemented in the form of software invoked by a processing element; all can be implemented in the form of hardware; or some modules are implemented in the form of software invoked by a processing element, and some modules are implemented in the form of hardware. For example, the processing module can be a separately established processing element, or can be integrated in a chip of the above apparatus, in addition, it can also be stored in the form of program code in the memory of the above apparatus, and the function of the above determination module is called and executed by a processing element of the above apparatus. The implementation of other modules is similar. In addition, all or part of the above modules can be integrated together or independently implemented. The processing element can be an integrated circuit with signal processing capability. In the implementation process, each step of the above method or each module can be completed by the integrated logic circuit of hardware or the instruction of software in the processing element. For example, the above modules can be one or more integrated circuits configured to implement the above method, such as one or more application specific integrated circuits (ASIC), or one or more digital signal processors (DSP), or one or more field programmable gate arrays (FPGA), etc. For another example, when a certain module is implemented in the form of program code invoked by a processing element, the processing element can be a general purpose processor, such as a central processing unit (CPU) or other processor that can invoke program code. For another example, the above modules can be integrated together to implement in the form of system on a chip (SOC). In the above embodiments, all or part can be realized by software, hardware, firmware or any combination thereof. When realized by software, all or part can be realized in the form of computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, all or part of the processes or functions described in the embodiments of the present disclosure are generated. The computer can be a general purpose computer, a special purpose computer, a computer network or other programmable device.The computer instructions can be stored in or transferred from one computer-readable medium to another computer-readable medium, such as from one website, computer, server, or data center to another website, computer, server, or data center, through a wired (such as coaxial cable, fiber optics, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means. The computer-readable medium can be any available medium or data storage that can be accessed by a computer, or a data storage device such as a server, data center, etc. that includes one or more of the available media integrated therein. The available medium can be a magnetic medium (e.g., a floppy diskette, a hard disk drive, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.
[0073] Referring to FIG. 27, which is a structural schematic diagram of an electronic device according to some embodiments, the device shown in FIG. 27 can be used to perform the method of processing object position data and / or temperature data and / or steps therein according to any embodiment of the present disclosure. In an embodiment, the electronic device 2000 shown in FIG. 27 includes a processor 2001 and a memory 2002; the memory 2002 is configured to store computer executable instructions, and the processor 2001 can execute the computer executable instructions stored in the memory 2002. When the computer executable instructions are executed by the processor 2001, the processor 2001 implements the method performed by the control device 11 or the processor 12 in any of the preceding embodiments of the present disclosure and / or steps therein. In an embodiment, the electronic device 2000 shown in FIG. 27 further includes a communication interface 2003, wherein the processor 2001 can communicate with other devices through the communication interface 2003, for example, the processor 2001 obtains object position data and temperature data through the communication interface 2003. The present disclosure also provides a computer readable storage medium storing computer executable instructions, which when executed can be used to implement the method performed by the control device 11 or the processor 12 in any of the preceding embodiments of the present disclosure and / or steps therein. The embodiments of the present disclosure also provide a chip for executing instructions, which is used to execute the method performed by the control device 11 or the processor 12 in any of the preceding embodiments of the present disclosure and / or steps therein. The embodiments of the present disclosure also provide a computer program product including a computer program, which when executed implements the method performed by the control device 11 or the processor 12 in any of the preceding embodiments of the present disclosure and / or steps therein. Those skilled in the art can understand that all or part of the steps of the above-mentioned method embodiments can be completed by a program instruction relevant hardware. The foregoing program can be stored in a computer readable storage medium. The program is executed to perform the steps of the above-mentioned method embodiments; and the foregoing storage medium includes: ROM, RAM, magnetic disk or optical disk and various media that can store program codes. Finally, it should be noted that the above embodiments are only used to illustrate the implementation of the present disclosure, rather than limit it; although the present disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can modify the implementation described in the foregoing embodiments, or equivalently replace some or all of the technical features; and the above modifications or replacements do not cause the essence of the corresponding implementation to deviate from the scope of the embodiments of the present disclosure. Those skilled in the art will understand that the disclosure range of the present disclosure is not limited to the above-mentioned specific embodiments, and some elements of the embodiments can be modified and replaced without departing from the spirit of the present disclosure. The scope of the present disclosure is limited by the appended claims.
Claims
1. A display device, wherein, The application relates to a display device, a human body detection device and a control device. The display device is configured to display a picture. The human body detection device is configured to detect temperature data and object position data on the display side of the display device. The control device is connected to the display device and the human body detection device respectively and is configured to determine whether a human body exists on the display side of the display device according to the temperature data and the object position data and control the display device to display a picture. The human body detection device comprises a temperature sensor configured to detect the temperature data on the display side of the display device and a distance sensor configured to detect the object position data on the display side of the display device. The control device is connected to the temperature sensor and the distance sensor respectively and is configured to determine whether the object position data meets a first preset condition, determine that a human body exists on the display side of the display device when the object position data meets the first preset condition, determine whether the temperature data meets a second preset condition when the object position data does not meet the first preset condition, determine that a human body exists on the display side of the display device when the temperature data meets the second preset condition and determine that a human body does not exist on the display side of the display device when the temperature data does not meet the second preset condition.
2. The display device of claim 1, wherein, The control device is connected to the distance sensor through a first interface, connected to the temperature sensor through a second interface and connected to the control device through a third interface.
3. The display device according to claim 1 or 2, wherein, The temperature sensor and the distance sensor are arranged on the display side of the display device, the middle line of the antenna of the distance sensor and the middle point of the lens of the temperature sensor are on a horizontal line and the included angle between the recognition angle of the distance sensor and the recognition angle of the temperature sensor is less than 3 degrees.
4. The display device according to any one of claims 1-3, wherein, The control device is specifically configured to determine whether the temperature data meets the second preset condition when the object position data does not meet the first preset condition and the position information in the object position data is in a first target region in the recognition region of the distance sensor.
5. The display device of claim 4, wherein, The control device is further configured to determine that a human body does not exist on the display side of the display device when the object position data does not meet the first preset condition and the position information in the object position data corresponds to a region outside the first target region in the recognition region of the distance sensor.
6. The display device according to any one of claims 1-5, wherein, The control device is specifically configured to determine that a human body does not exist on the display side of the display device when the display device displays a picture, control the display device to display prompt information that the picture will stop being displayed after a first time, control the display device to reduce the sound and brightness after a second time and control the display device to stop displaying a picture after a third time.
7. The display device according to any one of claims 1-6, wherein, The control device is further configured to control the display device to issue fire warning information when the temperature data comprises a temperature value greater than a warning threshold and the temperature value continuously increases.
8. The display device of any of claims 1-7, wherein, The first preset condition comprises that a distance difference between a position coordinate of the object in the object position data and a position coordinate of the object in the stored historical object position data is less than a preset distance value; and the second preset condition comprises that at least one target temperature value included in the temperature data is greater than a preset temperature value.
9. The display device according to any one of claims 1-8, wherein, Further comprising: An environmental sensor connected to the control device and configured to detect air quality information of an environment where the display device is located and send the air quality information to the control device; The control device is further configured to control the display device to display air quality prompt information according to the air quality information.
10. A control method of a display device, wherein, The method is applied to a display device, and the display device comprises a display device, a temperature sensor and a distance sensor. The method comprises: obtaining temperature information from the temperature sensor and object position information from the distance sensor; determining whether the object position data meets a first preset condition; when the object position data meets the first preset condition, determining that a human body exists on a display side of the display device; when the object position data does not meet the first preset condition, determining whether the temperature data meets a second preset condition; when the temperature data meets the second preset condition, determining that a human body exists on the display side of the display device; when the temperature data does not meet the second preset condition, determining that a human body does not exist on the display side of the display device; and controlling the display device to display a picture according to whether a human body exists on the display side of the display device.
11. A display device, wherein, Comprise: A display device configured to display a picture; A human body detection device configured to detect temperature data and object position data on a display side of the display device; A control device connected to the display device and the human body detection device respectively and configured to determine whether a human body exists on the display side of the display device according to the temperature data and the object position data and control the display device to display a picture; The human body detection device comprises a distance sensor configured to detect object position data on the display side of the display device and a temperature sensor configured to detect temperature data on the display side of the display device; and the control device is connected to the distance sensor and the temperature sensor respectively and configured to: compare the object position data with latest object position data of each chain table in a plurality of chain tables stored respectively, wherein the chain table is used to store object position data of a target object; when a comparison result of the object position data and latest object position data of a first chain table in the plurality of chain tables meets a preset condition, determine that the object position data corresponds to a target object of the first chain table and add the object position data to the first chain table; and when the comparison result of the object position data and the latest object position data of the plurality of chain tables does not meet the preset condition, establish a second chain table and add the object position data to the second chain table.
12. The display device of claim 11, wherein, The object position data comprises a position coordinate, a motion state and time information of the object.
13. The display device of claim 11 or 12, wherein, The preset condition comprises: a distance difference between the position coordinate of the object position data and the position coordinate of the latest object position data in the first chain table is less than a first distance preset value; and a time difference between the time information of the object position data and the time information of the latest object position data in the first chain table is less than a first time preset value.
14. The display device of claim 13, wherein, The control device is specifically configured to: when the distance difference between the position coordinate of the object position data and the position coordinate of the latest object position data in a plurality of first chain tables is less than the first distance preset value, determine that the object position data corresponds to a first chain table with the minimum time difference in time information in the plurality of first chain tables; when the time difference between the time information of the object position data and the time information of the latest object position data in a plurality of first chain tables is less than the first time preset value, determine that the object position data corresponds to a first chain table with the minimum distance difference in position coordinate in the plurality of first chain tables.
15. The display device of any of claims 11-14, wherein, The control device is further configured to: determine whether the target object corresponding to the plurality of chain tables is a real object; and when the target object corresponding to a third chain table in the plurality of chain tables is not a real object, delete the third chain table and the object position data in the third chain table.
16. The display device of claim 15, wherein, The control device is specifically configured to perform one or more of the following steps to determine whether the target object corresponding to the third chain table is a real object: when the third chain table does not add new object position data within a first detection time, determine that the target object corresponding to the third chain table is not a real object; when the number of new object position data added by the third chain table within a second detection time is less than a first number value, determine that the target object corresponding to the third chain table is not a real object.
17. The display device of claim 15 or 16, wherein, The control device is specifically configured to perform one or more of the following steps to determine whether the target object corresponding to the third chain table is a real object: when the motion state of the newly added object position data in the third chain table within a third detection time is all in a stationary state, and the position coordinate of the newly added object position data is in a second target region in the recognition region of the distance sensor, determine that the target object corresponding to the third chain table is not a real object; when the motion state of the newly added object position data in the third chain table within a fourth detection time is all in a stationary state, and the position coordinate of the newly added object position data is in a boundary region in the recognition region of the distance sensor, determine that the target object corresponding to the third chain table is not a real object; when the position coordinate of the object position data in the third chain table is in a first target region in the recognition region of the distance sensor, determine whether the target object corresponding to the third chain table is a real object by the object position data and temperature information from a temperature sensor.
18. The display device of claim 17, wherein, The control device is specifically configured to: calculate a first angle according to the coordinates of the identification area of the distance sensor and the coordinate position of the object position data; calculate a second angle according to the field of view angle FOV of the temperature sensor and the position of the object in the temperature information; and determine that the target object corresponding to the third chain table is a real object when the difference between the first angle and the second angle is less than a preset angle.
19. The display device of any of claims 11-18, wherein, The distance sensor is a multi-transmitting and multi-receiving radar.
20. A data processing method of a distance sensor of a display device, wherein, The display device includes a display device configured to display a picture, a human body detection device configured to detect temperature data and object position data on the display side of the display device, and a control device configured to determine whether a human body exists on the display side of the display device according to the temperature data and the object position data, and control the display device to display a picture. The human body detection device includes a distance sensor configured to detect object position data on the display side of the display device, and a temperature sensor configured to detect temperature data on the display side of the display device. The control device is configured to determine whether a human body exists on the display side of the display device according to the object position data and the temperature data. The method includes: comparing the object position data with the latest object position data of each chain table in a plurality of stored chain tables respectively, wherein the chain table is used to store object position data of a target object; when the comparison result of the object position data and the latest object position data of a first chain table in the plurality of chain tables meets a preset condition, determining that the object position data corresponds to the target object of the first chain table, and adding the object position data to the first chain table; and when the comparison result of the object position data and the latest object position data of the plurality of chain tables does not meet the preset condition, establishing a second chain table and adding the object position data to the second chain table.
21. A display device, wherein, It includes: a display device configured to display a picture; a human body detection device configured to detect temperature data and object position data on the display side of the display device; a control device connected to the display device and the human body detection device respectively, configured to determine whether a human body exists on the display side of the display device according to the temperature data and the object position data, and control the display device to display a picture; the human body detection device includes a distance sensor configured to detect object position data on the display side of the display device; a temperature sensor configured to detect temperature data on the display side of the display device; and the control device is connected to the distance sensor and the temperature sensor respectively, and is configured to obtain differential temperature data according to the temperature data and stored background data, and determine whether a human body exists on the display side of the display device according to the temperature value of each pixel position in the differential temperature data.
22. The display device of claim 21, wherein, The control device is further configured to update the stored background data according to the temperature data when it is determined that no human body exists on the display side of the display device.
23. The display device of claim 22, wherein, The control device is further configured to update the stored background data according to the temperature data when it is determined that a human body exists on the display side of the display device and the background data has not been updated for a preset update duration.
24. The display device of claim 22 or 23, wherein, The control device is specifically configured to determine whether a human body exists on the display side of the display device according to object position data from a distance sensor.
25. The display device of claim 21, wherein, The control device is further configured to update a plurality of target portions in the stored background data according to a plurality of continuous temperature data when it is determined that a human body exists on the display side of the display device and the background data has not been updated for a preset update duration; wherein the plurality of target portions gradually approach a position of the human body in the temperature data from a periphery of the temperature data.
26. The display device of claim 25, wherein, The control device is specifically configured to determine a region where the human body exists according to a position of N largest pixel points in temperature values of each pixel position of the differential temperature data as a center, and determine a portion other than the region where the human body exists in the background data as the target portion.
27. The display device of any of claims 21-26, wherein, The control device is specifically configured to determine a mean square error, a mean square value and a maximum value of the temperature value of each pixel position in the differential temperature data; and compare the mean square error, the mean square value and the maximum value with a first threshold value, a second threshold value and a third threshold value respectively to obtain a first comparison result, a second comparison result and a third comparison result. The control device is specifically configured to determine whether a human body exists on the display side of the display device according to a calculation result of performing an AND logical calculation on the first comparison result, the second comparison result and a calculation result of performing an AND logical calculation on the third comparison result after performing an OR logical calculation on the first comparison result and the second comparison result.
28. The display device of claim 27, wherein, The control device is further configured to determine a threshold scaling coefficient according to a distance between the human body and the display side of the display device, wherein the scaling coefficient is inversely proportional to the distance; process the first threshold value, the second threshold value and the third threshold value according to the scaling coefficient; and compare the mean square error, the mean square value and the maximum value with the processed first threshold value, the processed second threshold value and the processed third threshold value respectively to obtain a first comparison result, a second comparison result and a third comparison result.
29. The display device of any of claims 21-28, wherein, The control device is further configured to determine whether a human body exists on the display side of the display device when the background data is not stored after the display device is powered on; generate the background data according to the temperature data when it is determined that a human body does not exist on the display side of the display device; and generate the background data according to the temperature data when it is determined that a human body exists on the display side of the display device and lasts for a preset determination time.
30. A processing method of data of a temperature sensor of a display device, wherein, The display device comprises a display device configured to display a picture, a human body detection device configured to detect whether a human body exists on the display device display side and generate a detection signal, and a control device configured to display side temperature data and object position data of the display device, wherein the human body detection device comprises a distance sensor configured to detect object position data on the display device display side, and a temperature sensor configured to detect temperature data on the display device display side, and the control device is configured to determine whether a human body exists on the display device display side according to the object position data and the temperature data, and the processing method comprises: obtaining temperature data from the temperature sensor; obtaining differential temperature data according to the temperature data and stored background data; and determining whether a human body exists on the display device display side according to the temperature value of each pixel position in the differential temperature data.
Citation Information
Patent Citations
Display equipment control method and system
CN105786149A
Human body temperature detection method and device, medium and electronic equipment
CN114061764A
Display device and display device control method
CN116132738A
Control method and device of augmented reality equipment, electronic equipment and related equipment
CN118349102A
Display apparatus and control method thereof
CN119396265A