A display device and intelligent touch control method thereof

Abstract

The present disclosure discloses a display device and a smart touch method thereof, which are used to reduce the steps of switching touch control by calling a small window through a menu, and improve the efficiency of human-computer interaction. The device includes a display screen, a touch control component, and a controller, wherein: the display screen is used to display content; the touch control component is used to receive a touch signal input by a user; the controller is configured to execute: according to the detected user position, trigger the display of a control window on the display screen of the display device, and control the control window to be in a first state, wherein the first state represents a transition state of judging whether to switch to a second state according to the received touch signal input by the user; according to the detected touch position of the touch signal input by the user and the position relationship of the control window, control the control window to switch from the first state to the second state; determine that the control window is in the second state, and control the display screen through the control window.

Description

Technical Field

[0001] The present disclosure relates to the field of human-computer interaction technology, and in particular to a display device and an intelligent touch control method thereof. Background Art

[0002] As the most important interface for human-computer interaction, display screens are increasingly used in all aspects of life. With the development of technology, display screens have added many interactive functions. For example, users can interact with the display screen through voice control and touch control, including infrared, capacitance and other methods. As the functions of display screens become more comprehensive and the application scenarios become more varied, the sizes of display screens that can be selected in different scenarios are also more diverse.

[0003] As for the current large-size display screens, such as conference whiteboards over 86 inches, it is not convenient for users to perform full-screen touch operations due to the large size of the display screen. The currently provided touch methods are: one is to open a small window through the operation menu on the display screen, and the user performs touch operations in the small window and synchronizes them to the display screen. However, in this method, multiple selections need to be made through the operation menu before switching to the small window. Small-screen operations are performed in a fixed small window, and the human-computer interaction efficiency is low; the other method is to perform online touch through other devices and display devices to achieve synchronous operation of the two, but this method requires other devices, is not convenient for direct human-computer interaction, and the operation is cumbersome and the experience is poor. Summary of the invention

[0004] The present disclosure provides a display device and an intelligent touch method thereof, which are used to reduce the steps of calling a small window through a menu for touch switching, provide a more intelligent and portable human-computer interaction, and improve the efficiency of the human-computer interaction.

[0005] In a first aspect, an embodiment of the present disclosure provides a display device, including a display screen, a touch control component, and a controller, wherein:

[0006] The display screen is used to display content;

[0007] The touch control component is used to receive a touch control signal input by a user;

[0008] The controller is configured to perform:

[0009] triggering display of a control window on a display screen of the display device according to the detected user position, and controlling the control window to be in a first state, wherein the first state represents a transition state of determining whether to switch to a second state according to a received touch signal input by the user;

[0010] Controlling the control window to switch from a first state to a second state according to a detected relationship between a touch position of a touch signal input by a user and a position of the control window;

[0011] It is determined that the control window is in a second state, and the display screen is controlled through the control window.

[0012] The display device provided in this embodiment can predict the user's next behavior based on the user's behavior, and gradually determine whether the user has the need to use the control window based on the user's position and the touch position of the touch signal, thereby providing a seamless way to open the control window and improving the user's interaction efficiency.

[0013] As an optional implementation, the processor is specifically configured to execute:

[0014] Determining the distance between the user and the display device according to the detected user position;

[0015] If the distance is less than the distance threshold, display of a control window is triggered on a display screen of the display device.

[0016] As an optional implementation, the processor is specifically configured to execute:

[0017] Determining the horizontal coordinate of the center of the control window according to the horizontal coordinate of the user position;

[0018] The position of the control window displayed on the display screen is determined according to the horizontal coordinate of the center of the control window.

[0019] As an optional implementation, the processor is specifically configured to execute:

[0020] If the touch position is located in the area where the control window is located, the control window is controlled to be in the second state.

[0021] As an optional implementation, the processor is specifically configured to execute:

[0022] The control window is controlled to be in a second state according to the detected positional relationship between the touch position of the user operation and the control window, and the touch content generated within a first range centered on the touch position.

[0023] As an optional implementation, the processor is further configured to execute:

[0024] If the touch position is located in the area where the control window is located, determining a display position on the display screen corresponding to the touch position, and if the touch content matches display content displayed on the display screen within a second range centered on the display position, controlling the control window to be in a second state; or,

[0025] If the touch position is located in the area where the control window is located, the display content displayed on the display screen within a third range centered on the touch position is obtained; if the touch content generated within the range centered on the touch position matches the display content, the control window is closed and the content displayed at the display position corresponding to the touch position is deleted.

[0026] As an optional implementation manner, the processor is specifically configured to determine whether the touch content matches the display content in the following manner:

[0027] Determining that the touch content matches the display content according to at least one of the size and data type of the touch content and the display content; or,

[0028] As an optional implementation manner, it is determined that the touch content matches the display content according to at least one of the size and data type of the touch content and the display content.

[0029] The processor is specifically configured to execute:

[0030] After enlarging the touch content according to a preset rule or reducing the display content according to a preset rule, determining that the touch content matches the display content according to the sizes of the touch content and the display content; or,

[0031] After the touch content is enlarged according to a preset rule or the display content is reduced according to a preset rule, it is determined that the touch content matches the display content according to the sizes of the touch content and the display content.

[0032] As an optional implementation manner, the triggering of display of a control window on a display screen of the display device according to the detected user position, the processor is further configured to execute:

[0033] At least part of the content on the display screen is scaled and mapped to the control window for display.

[0034] As an optional implementation, the processor is further configured to execute:

[0035] During the process of the control window being converted from the first state to the second state, the transparency of the content mapped in the control window is controlled to decrease step by step.

[0036] As an optional implementation, the processor is specifically configured to execute:

[0037] If at least part of the content on the display screen is scaled and mapped to the control window for display according to the detected user position, the mapped content is displayed at a first level of transparency; or,

[0038] If the touch position is within the area where the control window is located, displaying the mapped content according to a second level of transparency, wherein the second level of transparency is lower than the first level of transparency; or,

[0039] If the touch position is located within the area where the control window is located, and the touch content matches the display content, the mapped content is displayed in a non-transparent manner.

[0040] As an optional implementation manner, after triggering display of the control window on the display screen of the display device, the processor is further configured to execute:

[0041] If no touch signal is detected for more than a preset period of time, closing the control window; or,

[0042] If the difference between the detection time of the touch signal and the detection time of the user position is greater than a time threshold, the control window is closed.

[0043] As an optional implementation, the processor is specifically configured to determine the user location in the following manner:

[0044] Determine the user position according to the depth information in the depth image of the user captured by the display device; or,

[0045] The digital radar array of the display device is used to perform scanning, and the user position is determined according to the scanning result.

[0046] As an optional implementation manner, the processor is further configured to:

[0047] If the control window is in the first state, the content is displayed through the control window, and the touch signal is received through the display screen;

[0048] If the control window is in the second state, the touch signal is received through the control window, and the content is displayed through the area outside the control window.

[0049] In a second aspect, an embodiment of the present disclosure provides a smart touch method, including:

[0050] triggering display of a control window on a display screen of the display device according to the detected user position, and controlling the control window to be in a first state, wherein the first state represents a transition state of determining whether to switch to a second state according to a received touch signal input by the user;

[0051] Controlling the control window to switch from a first state to a second state according to a detected relationship between a touch position of a touch signal input by a user and a position of the control window;

[0052] It is determined that the control window is in a second state, and the display screen is controlled through the control window.

[0053] As an optional implementation manner, triggering a display control window on a display screen of a display device according to the detected user position includes:

[0054] Determining the distance between the user and the display device according to the detected user position;

[0055] If the distance is less than the distance threshold, display of a control window is triggered on a display screen of the display device.

[0056] As an optional implementation manner, triggering a display control window on a display screen of the display device includes:

[0057] Determining the horizontal coordinate of the center of the control window according to the horizontal coordinate of the user position;

[0058] The position of the control window displayed on the display screen is determined according to the horizontal coordinate of the center of the control window.

[0059] As an optional implementation manner, controlling the control window to be in the second state according to the detected relationship between the touch position of the touch signal input by the user and the position of the control window includes:

[0060] If the touch position is located in the area where the control window is located, the control window is controlled to be in the second state.

[0061] As an optional implementation manner, controlling the control window to be in the second state according to the detected position relationship between the touch position of the touch signal input by the user and the position of the control window includes:

[0062] The control window is controlled to be in a second state according to a detected positional relationship between a touch position of a user operation and the control window, and touch contents generated within a first range centered on the touch position.

[0063] As an optional implementation manner, controlling the control window to be in the second state according to the detected positional relationship between the touch position of the user operation and the control window, and the touch content generated within a first range centered on the touch position, includes:

[0064] If the touch position is located in the area where the control window is located, determining a display position on the display screen corresponding to the touch position, and if the touch content matches display content displayed on the display screen within a second range centered on the display position, controlling the control window to be in a second state; or,

[0065] If the touch position is located in the area where the control window is located, the display content displayed on the display screen within a third range centered on the touch position is obtained; if the touch content generated within the range centered on the touch position matches the display content, the control window is closed and the content displayed at the display position corresponding to the touch position is deleted.

[0066] As an optional implementation, content matching is determined in the following manner:

[0067] Determining that the touch content matches the display content according to at least one of the size and data type of the touch content and the display content; or,

[0068] According to at least one of the size and the data type of the touch content and the display content, it is determined that the touch content matches the display content.

[0069] As an optional implementation, content matching is determined in the following manner:

[0070] After enlarging the touch content according to a preset rule or reducing the display content according to a preset rule, determining that the touch content matches the display content according to the sizes of the touch content and the display content; or,

[0071] After the touch content is enlarged according to a preset rule or the display content is reduced according to a preset rule, it is determined that the touch content matches the display content according to the sizes of the touch content and the display content.

[0072] As an optional implementation manner, triggering display of a control window on a display screen of the display device according to the detected user position further includes:

[0073] At least part of the content on the display screen is scaled and mapped to the control window for display.

[0074] As an optional implementation manner, scaling at least part of the content on the display screen and mapping it to the control window for display further includes:

[0075] During the process of the control window being converted from the first state to the second state, the transparency of the content mapped in the control window is controlled to decrease step by step.

[0076] As an optional implementation manner, controlling the transparency of the content mapped in the control window to decrease step by step includes:

[0077] If at least part of the content on the display screen is scaled and mapped to the control window for display according to the detected user position, the mapped content is displayed at a first level of transparency; or,

[0078] If the touch position is within the area where the control window is located, displaying the mapped content according to a second level of transparency, wherein the second level of transparency is lower than the first level of transparency; or,

[0079] If the touch position is located within the area where the control window is located, and the touch content matches the display content, the mapped content is displayed in a non-transparent manner.

[0080] As an optional implementation manner, after triggering the display of the control window on the display screen of the display device, the method further includes:

[0081] If no touch signal is detected for more than a preset period of time, closing the control window; or,

[0082] If the difference between the detection time of the touch signal and the detection time of the user position is greater than a time threshold, the control window is closed.

[0083] As an optional implementation manner, the user location is determined in the following manner:

[0084] Determine the user position according to the depth information in the depth image of the user captured by the display device; or,

[0085] The digital radar array of the display device is used to perform scanning, and the user position is determined according to the scanning result.

[0086] As an optional implementation, it also includes:

[0087] If the control window is in the first state, the content is displayed through the control window, and the touch signal is received through the display screen;

[0088] If the control window is in the second state, the touch signal is received through the control window, and the content is displayed through the area outside the control window.

[0089] In a third aspect, the present disclosure also provides a smart touch device, including:

[0090] a display unit, configured to trigger display of a control window on a display screen of the display device according to a detected user position, and control the control window to be in a first state, wherein the first state represents a transition state of determining whether to switch to a second state according to a received touch signal input by the user;

[0091] a conversion unit, configured to control the control window to convert from a first state to a second state according to a detected relationship between a touch position of a touch signal input by a user and a position of the control window;

[0092] The control unit is used to determine that the control window is in the second state, and control the display screen through the control window.

[0093] As an optional implementation manner, the display unit is specifically used for:

[0094] Determining the distance between the user and the display device according to the detected user position;

[0095] If the distance is less than the distance threshold, display of a control window is triggered on a display screen of the display device.

[0096] As an optional implementation manner, the display unit is specifically used for:

[0097] Determining the horizontal coordinate of the center of the control window according to the horizontal coordinate of the user position;

[0098] The position of the control window displayed on the display screen is determined according to the horizontal coordinate of the center of the control window.

[0099] As an optional implementation manner, the conversion unit is specifically used for:

[0100] If the touch position is located in the area where the control window is located, the control window is controlled to be in the second state.

[0101] As an optional implementation manner, the conversion unit is specifically used for:

[0102] The control window is controlled to be in a second state according to a detected positional relationship between a touch position of a user operation and the control window, and touch contents generated within a first range centered on the touch position.

[0103] As an optional implementation manner, the conversion unit is specifically used for:

[0104] If the touch position is located in the area where the control window is located, determining a display position on the display screen corresponding to the touch position, and if the touch content matches display content displayed on the display screen within a second range centered on the display position, controlling the control window to be in a second state; or,

[0105] If the touch position is located in the area where the control window is located, the display content displayed on the display screen within a third range centered on the touch position is obtained; if the touch content generated within the range centered on the touch position matches the display content, the control window is closed and the content displayed at the display position corresponding to the touch position is deleted.

[0106] As an optional implementation manner, the conversion unit is specifically used for:

[0107] Determining that the touch content matches the display content according to at least one of the size and data type of the touch content and the display content; or,

[0108] According to at least one of the size and the data type of the touch content and the display content, it is determined that the touch content matches the display content.

[0109] As an optional implementation manner, the conversion unit is specifically used for:

[0110] After enlarging the touch content according to a preset rule or reducing the display content according to a preset rule, determining that the touch content matches the display content according to the sizes of the touch content and the display content; or,

[0111] After the touch content is enlarged according to a preset rule or the display content is reduced according to a preset rule, it is determined that the touch content matches the display content according to the sizes of the touch content and the display content.

[0112] As an optional implementation manner, the display unit is further used for:

[0113] At least part of the content on the display screen is scaled and mapped to the control window for display.

[0114] As an optional implementation manner, the display unit is further used for:

[0115] During the process of the control window being converted from the first state to the second state, the transparency of the content mapped in the control window is controlled to decrease step by step.

[0116] As an optional implementation manner, the display unit is further used for:

[0117] If at least part of the content on the display screen is scaled and mapped to the control window for display according to the detected user position, the mapped content is displayed at a first level of transparency; or,

[0118] If the touch position is within the area where the control window is located, displaying the mapped content according to a second level of transparency, wherein the second level of transparency is lower than the first level of transparency; or,

[0119] If the touch position is located within the area where the control window is located, and the touch content matches the display content, the mapped content is displayed in a non-transparent manner.

[0120] As an optional implementation manner, after the display of the control window is triggered on the display screen of the display device, a closing unit is further included to:

[0121] If no touch signal is detected for more than a preset period of time, closing the control window; or,

[0122] If the difference between the detection time of the touch signal and the detection time of the user position is greater than a time threshold, the control window is closed.

[0123] As an optional implementation manner, the display unit is specifically configured to determine the user location in the following manner:

[0124] Determine the user position according to the depth information in the depth image of the user captured by the display device; or,

[0125] The digital radar array of the display device is used to perform scanning, and the user position is determined according to the scanning result.

[0126] As an optional implementation manner, the judgment unit is further included to:

[0127] If the control window is in the first state, the content is displayed through the control window, and the touch signal is received through the display screen;

[0128] If the control window is in the second state, the touch signal is received through the control window, and the content is displayed through the area outside the control window.

[0129] In a fourth aspect, an embodiment of the present disclosure further provides a computer storage medium on which a computer program is stored, and when the program is executed by a processor, it is used to implement the steps of the method described in the first aspect above.

[0130] These and other aspects of the present disclosure will become more apparent from the following description of the embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0131] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0132] Figure 1 A schematic diagram of an existing touch control method provided by an embodiment of the present disclosure;

[0133] Figure 2 A schematic diagram of a display device provided in an embodiment of the present disclosure;

[0134] Figure 3A A schematic diagram of a first control window display provided in an embodiment of the present disclosure;

[0135] Figure 3B A schematic diagram of a second control window display provided in an embodiment of the present disclosure;

[0136] Figure 4A A schematic diagram of detecting a user's location provided in an embodiment of the present disclosure;

[0137] Figure 4B A schematic diagram of detecting a user's location provided in an embodiment of the present disclosure;

[0138] Figure 5 A schematic diagram of controlling a window display position provided by an embodiment of the present disclosure;

[0139] Fig. 6A A schematic diagram of a first control window display provided by an embodiment of the present disclosure;

[0140] Figure 6B A schematic diagram of a second control window display provided by an embodiment of the present disclosure;

[0141] Figure 6C A schematic diagram of a third control window display provided by an embodiment of the present disclosure;

[0142] Fig. 7A A schematic diagram of a first touch content matching method provided in an embodiment of the present disclosure;

[0143] Figure 7B A schematic diagram of a second touch content matching method provided by an embodiment of the present disclosure;

[0144] Figure 7C A schematic diagram of a third touch content matching method provided by an embodiment of the present disclosure;

[0145] Fig.7D A schematic diagram of a fourth touch content matching method provided by an embodiment of the present disclosure;

[0146] Fig. 8A A schematic diagram of a fifth touch content matching method provided by an embodiment of the present disclosure;

[0147] Figure 8B A schematic diagram of a sixth touch content matching method provided by an embodiment of the present disclosure;

[0148] Figure 8C A schematic diagram of a seventh touch content matching method provided by an embodiment of the present disclosure;

[0149] Fig.8D A schematic diagram of an eighth touch content matching method provided by an embodiment of the present disclosure;

[0150] Fig. 9 A detailed intelligent touch method implementation flow chart provided in the embodiment of the present disclosure;

[0151] Fig.10 A flowchart of a smart touch method implementation provided by an embodiment of the present disclosure;

[0152] Fig.11 A schematic diagram of a smart touch device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0153] In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0154] In the embodiments of the present disclosure, the term "and / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent three situations: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0155] The application scenarios described in the embodiments of the present disclosure are intended to more clearly illustrate the technical solutions of the embodiments of the present disclosure, and do not constitute a limitation on the technical solutions provided by the embodiments of the present disclosure. It is known to those skilled in the art that with the emergence of new application scenarios, the technical solutions provided by the embodiments of the present disclosure are also applicable to similar technical problems. In the description of the present disclosure, unless otherwise specified, the meaning of "multiple" is two or more.

[0156] As the most important interface for human-computer interaction, display screens are increasingly used in all aspects of life. With the development of technology, display screens have added many interactive functions. For example, users can interact with the display screen through voice control, touch control, and other methods. Touch control methods include infrared, capacitance, and other methods. As the functions of display screens become more comprehensive and the application scenarios become more varied, the sizes of display screens that can be selected in different scenarios are also more diverse. However, for current large-size display screens, such as conference whiteboards over 86 inches, due to the large size of the display screen, it is not convenient for users to perform full-screen touch operations. The currently provided touch methods, such as Figure 1 As shown, one is to open the small window 101 through the operation menu 100 on the display device, and the user performs touch operation in the small window 101 and synchronizes it to the display device. However, in this method, multiple selections need to be made through the operation menu 100 before switching to the small window 101, and the position of the small window 101 is fixed. Touch operation is performed in the fixed small window 101, and the human-computer interaction efficiency is low; the other is to perform online touch control through other devices 102 and the display device to achieve synchronous operation of the two, but this method requires other devices, such as terminals, tablets, etc., which is not convenient for direct human-computer interaction, and the operation is cumbersome and the experience is poor. In order to reduce the number of steps for users to frequently open small windows through the operation menu during the operation of the display device, this embodiment provides a method and a display device for automatically determining whether it is necessary to use a small window to receive touch signals and control the display screen to perform corresponding operations for large-size display devices.

[0157] The display device provided in this embodiment includes, but is not limited to, a large-size display screen, a large-size smart tablet, a large-size electronic whiteboard and other display devices. The display device in this embodiment may also be configured with a camera component for photographing the user, or may be configured with a digital array radar for scanning the user and confirming the user's location. Among them, the camera component and / or the digital array radar may be integrated on the display device, or may be used as a separate component to communicate with the display device, and this embodiment does not make too many restrictions on this.

[0158] The core idea of ​​the intelligent touch method provided in this embodiment is to use the detection of the user to determine whether the user is about to perform a touch operation, and to specifically determine the user's behavior based on the received touch signal, for example, whether the touch operation input by the user at this time is a touch operation on the control window to control the display screen to display accordingly, or a touch operation on the display screen, accurately distinguish whether the user needs to use the control window to control the display screen, so that the display device automatically confirms the user's behavior without the user actively operating the menu to open the control window, and when it is determined that the user uses the control window to interact with the display device, a control window with a touch function is provided to the user for controlling the display screen using the control window. Among them, the control window in this embodiment and the small window in the above content are the same concept in this embodiment, both of which refer to the function of receiving touch signals and realizing the control of the display screen.

[0159] It should be noted that, in the initial state after the display device in this embodiment is powered on, the default control mode is set to receive touch signals through the display screen of the display device and display them. At this time, the display screen can receive touch signals and can also display corresponding to the touch signals. If the control mode is switched to the control window control mode, although the current display screen can also receive touch signals, it mainly receives touch signals through the control window and displays them synchronously on the control window and the display screen. Among them, the control window is located at a position corresponding to the user on the display screen, and the size of the control window is smaller than the size of the display screen, and can be set to a size that is convenient for the user to control the full screen without moving.

[0160] like Figure 2 As shown, a display device provided in this embodiment includes a display screen 200, a touch control component 201, and a controller 202, wherein:

[0161] The display screen 200 is used to display content;

[0162] The touch control component 201 is used to receive a touch control signal input by a user;

[0163] The controller 202 is configured to perform:

[0164] According to the detected user position, the display of the control window is triggered on the display screen 200 of the display device, and the control window is controlled to be in a first state, wherein the first state represents a transition state of determining whether to switch to the second state according to a touch signal received from the user input; it should be noted that the first state of the control window is used to indicate that the control window has a display function but does not yet have a control function.

[0165] Among them, the area of ​​the control window in this embodiment is as follows Figure 3A, Figure 3B This embodiment does not impose too many restrictions on the shape, size, and lines of the area of ​​the control window.

[0166] Controlling the control window to switch from a first state to a second state according to a detected relationship between a touch position of a touch signal input by a user and a position of the control window;

[0167] Determine that the control window is in the second state, and control the display screen 200 through the control window. It should be noted that the second state in this embodiment is used to indicate that the control window has control and display functions, and is used to realize full-screen control display.

[0168] In some embodiments, if the control window is in the first state, the content is displayed through the control window, and the touch signal is received through the display screen; at this time, it is still in the full-screen touch state, the touch signal is received through the full screen, and the control window only has the display function. If the control window is in the second state, the touch signal is received through the control window, and the content is displayed through the area outside the control window. At this time, the control window has the control function, can receive the touch signal, and synchronously display the content in the control window and the area outside the control window.

[0169] If the control window is in the first state, the content is displayed through the control window; in this state, the control window is only used to display content, including the content mapped after full-screen scaling and the content written by the user in the control window; the display is controlled by receiving a control signal through the display screen.

[0170] If the control window is in the second state, the content is displayed through the control window and a touch signal is received. In this state, the control window can not only display the content, but also receive a touch signal input by the user and control the display screen to display in full screen.

[0171] In implementation, the display device in this embodiment can detect the user's position, and judge the actual distance between the user and the display screen through the user's position, so as to estimate the user's behavior and judge whether the user is about to perform a touch operation on the display screen. When it is determined that the user is about to perform a touch operation on the display screen according to the user's position, a control window is displayed on the display screen, and the content on the display screen is scaled and displayed in the control window. At this time, the control window is displayed on the display screen, and the content mapped in the full screen is displayed in the control window. In the actual application process, when the user approaches the display screen and before performing a touch operation, the control window is pre-displayed on the display screen, so as to judge whether the user needs to control the full screen through the control window according to the actual behavior of the user performing the touch operation. The specific judgment method is based on the positional relationship between the touch position of the touch signal input by the user and the control window.

[0172] In some examples, if the touch position is within the area where the control window is located, it is determined that the control window is in the second state, a touch function is configured for the control window, a touch signal is received through the control window, and the display screen is controlled using the touch signal. It is easy to understand that if the user needs to use the control window, the touch position of the touch signal input by the user must be within the control window, otherwise it is considered that the user does not need to use the control window.

[0173] In some examples, in order to accurately determine the user's behavior, that is, whether the user is about to use the display device to perform a touch operation, this embodiment determines the distance between the user and the display device by the user's position, and finally determines whether the user has the behavior of about to perform a touch operation. In implementation, the distance between the user and the display device is determined according to the detected user position; if the distance is less than the distance threshold, the display of the control window is triggered on the display screen of the display device.

[0174] In some examples, the display device in this embodiment may detect the user's position through a camera assembly and / or a digital radar array, and specifically determine the user's position through any one or more of the following methods:

[0175] Method 1: determining the user position according to the depth information in the depth image of the user captured by the display device;

[0176] In implementation, the camera assembly includes but is not limited to a binocular camera, which is installed on the display device and uses the depth information in the depth image of the user to determine the user's position and the distance between the user and the display device (binocular camera), providing an accurate basis for judging the user's behavior.

[0177] Method 2: Use the digital radar array of the display device to scan and determine the user's position based on the scanning result.

[0178] During implementation, based on the fluctuation information between the transmitting beam and the receiving beam of the digital radar array, it is determined whether the user is scanned and the user's position is determined, and further the distance between the user and the display device is determined.

[0179] like Figure 4A As shown, a digital radar array 400 is installed on the display device for scanning the user; Figure 4B As shown, L2 represents the position of the digital radar array 400 relative to the user. The display device determines the position of the user through the fluctuation information between the transmitting beam and the receiving beam, and then determines that the distance between the user and the display device is X. If the distance is less than the distance threshold L1, it means that the user is about to perform a touch operation on the display device, triggering a display control window on the display screen of the display device. If the distance X is less than the distance threshold L1, it means that the user is not about to perform a touch operation, and the display screen still defaults to display screen touch.

[0180] Method 3: determine the first position of the user according to the depth information in the depth image of the user taken by the display device, scan using the digital radar array of the display device, determine the second position of the user according to the scanning result, and perform weighted summation of the first position of the user and the second position of the user according to the weights corresponding to the first position of the user and the second position of the user, so as to determine the final position of the user.

[0181] In this manner, the display device determines the user position according to the camera assembly and the digital radar array respectively, and finally performs weighted summation of the user positions respectively determined by the camera assembly and the digital radar array according to the corresponding weights, thereby determining the final user position.

[0182] In some examples, in order to improve the accuracy of judging user behavior, this embodiment not only judges whether the user is about to perform a touch operation based on the positional relationship between the user position, touch position and control window, but also combines the time of receiving the touch signal.

[0183] In some examples, if no operation on the control window is detected for more than a preset period of time, the control window is closed; or, if the difference between the detection time of the touch signal and the detection time of the user position is greater than a time threshold, the control window is closed.

[0184] In implementation, after receiving the user's touch signal, before determining the positional relationship between the touch position of the touch signal input by the user and the control window, the detection time of the touch signal is first determined, and the difference between the detection time of the user position is less than the time threshold. In implementation, the detection time is recorded by the clock in the display device, and the time threshold is customized. In this embodiment, the detection time is introduced as a judgment basis, so as to more accurately judge the user's operation behavior, provide more basis for the configuration and closing of the touch function of the control window, and improve the user's senseless experience.

[0185] In some examples, if the time interval between two consecutive user input touch signals is greater than a preset time, the control window and the touch function configured for the control window are closed. This can prevent the control window from being displayed after the user has not operated for a long time, resulting in the control window being unable to be automatically closed after the user has not operated. By setting the time threshold, it can be determined that after the user has not used the control window for touch operation for a long time, the control window is automatically closed and the display screen control state is returned.

[0186] In some examples, such as Figure 5 As shown, the position of the control window in this embodiment is not fixed. In order to improve the user experience and reduce movement when the user performs touch operations on a large-size display screen, the position of the control window set in this embodiment is determined based on the user's position. When the user's position moves, the position of the control window also moves accordingly.

[0187] In some embodiments, the horizontal coordinate of the center of the control window is determined based on the horizontal coordinate of the user's position; and the position of the control window displayed on the display screen is determined based on the horizontal coordinate of the center of the control window.

[0188] In implementation, the position of the control window displayed on the display screen is determined by the following steps:

[0189] Step 1) determining the horizontal coordinate of the center of the control window according to the horizontal coordinate of the user position;

[0190] Step 2) determining the ordinate of the center of the control window according to a preset ordinate;

[0191] Step 3) Determine the position of the control window displayed on the display screen according to the horizontal coordinate and the vertical coordinate.

[0192] Among them, the central horizontal coordinate X of the center position of the control window is aligned with the horizontal coordinate of the user position, and the central vertical coordinate Y of the center position of the control window can be a vertical coordinate preset according to the average height of the user, or a vertical coordinate preset according to the user's needs, without too much limitation here.

[0193] It is easy to understand that the position of the control window in this embodiment can move with the movement of the user. In order to facilitate the user to reduce the number of movements, the control window is always set to be located in front of the user for easy operation.

[0194] In some embodiments, in order to prompt the user whether to perform a touch operation on the control window, after determining the user's location information, if the distance between the user and the display screen is less than a distance threshold, at least part of the content on the display screen is scaled and mapped to the control window for display. Optionally, at least part of the content on the display screen is scaled proportionally and mapped to the control window for display.

[0195] In some embodiments, during the process of the control window being converted from the first state to the second state, the transparency of the content mapped in the control window is gradually reduced.

[0196] In some embodiments, the control window may change transparency step by step based on the following method:

[0197] If at least part of the content on the display screen is scaled and mapped to the control window for display according to the detected user position, the mapped content is displayed at a first level of transparency; or,

[0198] If the touch position is within the area where the control window is located, displaying the mapped content according to a second level of transparency, wherein the second level of transparency is lower than the first level of transparency; or,

[0199] If the touch position is located within the area where the control window is located, and the touch content matches the display content, the mapped content is displayed in a non-transparent manner.

[0200] In a specific implementation, since it is estimated that the user is about to perform a touch operation on the display screen only by the user's position, the content mapped in the control window can be displayed in a transparent display manner, so that the user can be reminded that the control window can be used for touch display without being completely blocked by the content of the display screen itself. Optionally, the control window itself can also be displayed in a step-by-step transparent display manner. It should be noted that the control window displayed at this time is in the first state, which only has a display function and does not have the function of receiving touch signals. If the user needs to use the control window, the user will inevitably perform a touch operation in the transparently displayed control window. If the user performs a touch operation outside the control window, it is considered that the user does not need to use the control window, and the transparently displayed control window is closed.

[0201] Furthermore, if Fig. 6A As shown, if it is detected that the distance L between the user position and the display device is less than the distance threshold, the content of the control window is displayed according to the first level of transparency, such as Figure 6B As shown, if it is detected that the user moves further toward the display device and detects that the input touch signal is located in the area where the control window is located, the content of the control window is displayed according to the second level of transparency, wherein the second level of transparency is lower than the first level of transparency. It is easy to understand that when the user behavior satisfies more judgment conditions, it means that the judgment result is more accurate at this time, and the transparency of the display of the content of the control window is adjusted to be lower, so as to determine that the user finally uses the control window. Figure 6C As shown, the control window is fully displayed without transparency.

[0202] In some embodiments, if it is detected that the distance between the user position and the display device is less than a distance threshold, the content of the control window is displayed according to the first level of transparency. If the user continues to move forward and inputs a touch signal, and the difference between the detection time of the touch signal and the detection time of the user position is less than the time threshold, and the touch position of the touch signal is located in the area where the control window is located, the mapped content is displayed according to the set second level of transparency. After determining that the display screen is controlled through the control window, the mapped content is displayed in the control window in a non-transparent manner. Through display methods with different transparencies, the user is reminded and the content of the control window is strengthened, thereby improving the user experience.

[0203] In some examples, this embodiment further controls the control window to be in the second state and determines to configure the touch function for the control window based on the positional relationship between the detected touch position of the user operation and the control window, and the touch content generated within the first range centered on the touch position. When it is determined that the touch position of the user's touch signal is located in the area where the control window is located, in order to avoid misjudgment, this embodiment further determines whether the user uses the control window for touch operation based on the specific touch content input by the user, thereby improving the accuracy of the judgment.

[0204] In some examples, by matching the touch content generated by the touch position with the content displayed on the display screen, it is determined that the touch signal is received through the control window at this time, and the content displayed by the touch signal is synchronously displayed on the display screen. Specifically, the judgment is made by combining the touch position and the touch content through the following steps:

[0205] Step 2-1) if the touch position is within the area where the control window is located, determining a display position on the display screen corresponding to the touch position;

[0206] Step 2-2) If the touch content matches the display content displayed on the display screen within a second range centered on the display position, the control window is controlled to be in a second state.

[0207] It should be noted that the touch content corresponding to the touch position in this embodiment includes: the touch content input by the user within a first range centered on the touch position; the display content corresponding to the display position includes: the display content on the display screen within a second range centered on the display position.

[0208] In implementation, when it is not yet determined whether the user uses the control window, when touch content input by the user is received within the control window, the touch content will still be synchronized and displayed on the display screen. And further, according to whether the touch content corresponding to the touch position matches the display content, it is determined whether to configure the touch function for the control window. For the accuracy of the determination, in implementation, the touch content corresponding to the touch position includes all the touch content input by the user within a preset area, that is, the display content corresponding to the touch content displayed within the preset area. The touch content specifically refers to the content input by the user in the control window, and the display content specifically refers to the content displayed on the display screen. The displayed content includes the content displayed on the display screen after being enlarged according to the content input by the user in the touch window. For example, as Fig. 7A shown, if the user inputs "ma" at the touch position and "ma" is displayed at the display position, further, it is determined that the touch content "Hello ma" corresponding to the touch position does not match the display content "ma" corresponding to the display position, then as Figure 7B shown, it is determined that the user does not need to use the control window at this time, and the user is actually performing a touch operation on the display screen, closing the control window and the "ma" displayed at the display position; as Figure 7C shown, if the user inputs "ma" at the touch position and "ma" is displayed at the display position, further, it is determined that the touch content "Hello ma" corresponding to the touch position matches the display content "Hello ma" corresponding to the display position, then as Fig.7D shown, it is determined that the user needs to use the control window at this time, configure the touch function for the control window, and the control window can also be displayed non-transparently.

[0209] It should be noted that if there is no touch content input by the user on the display screen before detecting the touch signal input by the user, then directly according to the positional relationship between the touch position of the detected touch signal input by the user and the position of the control window, it is determined to configure the touch function for the control window. At this time, there is no need to match the touch content generated by the touch position with the display content corresponding to the display position, and only need to determine whether the touch position of the touch signal input by the user is within the area where the control window is located.

[0210] In some embodiments, the matching between the touch content and the display content is determined in the following manner:

[0211] Determine that the touched content matches the displayed content according to at least one of the size and data type of the touched content and the displayed content. It should be noted that since the content in the control window in this embodiment is obtained by scaling the content of the display screen proportionally, when performing content matching, a more accurate matching basis can be provided, and proportional matching of sizes can be performed. For example, if the ratio of the display screen content to the content in the control window is 5:1, then after magnifying the size of the touched content by 5 times, it is determined whether it is equal to the size of the displayed content.

[0212] Optionally, the data types in this embodiment include, but are not limited to, at least one of text, graphics, and tables.

[0213] In some embodiments, after magnifying the touched content according to a preset rule or reducing the displayed content according to a preset rule, determine that the touched content matches the displayed content according to the sizes of the touched content and the displayed content.

[0214] In some embodiments, in addition to providing the matching of the touched content and the displayed content in this embodiment, in order to more accurately judge the user's touch behavior, it is also further determined the touch behavior according to whether the touched content matches the displayed content on the display screen around the touch position. The specific implementation is as follows:

[0215] Step 3-1) If the touch position is within the area where the control window is located, obtain the displayed content on the display screen within the third range centered on the touch position;

[0216] It should be noted that the touched content generated within the first range of the touch position in this embodiment includes: the touched content input by the user within the first range centered on the touch position; the displayed content includes: the displayed content on the display screen within the third range centered on the touch position. The displayed content represents the original displayed content on the display screen, that is, the displayed content includes the content originally displayed on the display screen and exactly this displayed content is within the control window, that is to say, the displayed content is the displayed content on the display screen that is not blocked behind the control window.

[0217] Step 3-2) If the touched content matches the displayed content, close the control window and the touch function configured for the control window, and delete the displayed content at the display position corresponding to the touch position.

[0218] During implementation, as Fig. 8A shown, if the user inputs "ma" at the touch position and "ma" is displayed at the display position, further, it is determined that the touched content "Hello ma" corresponding to the touch position matches the displayed content "Hello ma", then as Figure 8BAs shown, it is determined that the user does not need to use the control window at this time. The user is actually performing a touch operation on the display screen. Close the control window and the "ma" displayed at the display position; as Figure 8C As shown, if the user enters "ma" at the touch position and "ma" is displayed at the display position, further, it is determined that the touch content "Hello, how are you" corresponding to the touch position does not match the display content corresponding to the display position. At this time, the display content is the content displayed by the display screen within the control window, and in fact, there is no content but only the background of the display screen. Then, as Fig.8D As shown, it is determined that the user needs to use the control window at this time. Configure a touch function for the control window, and the control window can also be displayed in a non-transparent manner, including displaying the content and / or background of the control window in a non-transparent manner.

[0219] In some embodiments, after magnifying the touch content according to a preset rule or reducing the displayed content according to a preset rule, according to the sizes of the touch content and the displayed content, it is determined that the touch content matches the displayed content.

[0220] In this embodiment, the touch content input by the user in the control window is matched with the content in different regions (including the display region and the display area). If the touch content input by the user in the control window matches the display content in the display region, it indicates that the user needs to use the control window for touch display at this time, and a touch function is configured for the control window; if the touch content input by the user in the control window matches the displayed content, it indicates that the user is only performing a touch operation on the display screen, and the touch operation happens to be within the control window. Therefore, the display content at the display position corresponding to the touch position is deleted, and the control window is closed. By adding a judgment basis, misjudgment is further avoided, the accuracy of judgment is improved, and an accurate and seamless interaction experience is provided.

[0221] The present embodiment also provides a detailed intelligent touch method, the core idea of ​​which is to use the detected user position to determine the distance between the user and the display device. When it is determined that the distance is less than a distance threshold, a control window is displayed at a position corresponding to the user position on the display screen according to a first-level transparency, and the content on the display screen is proportionally scaled and mapped to the control window for display. If a touch signal input by the user is further detected, and the difference between the detection time of the touch signal and the detection time of the user position is less than a time threshold, the positional relationship between the touch position of the touch signal and the control window is determined. If the touch position is located in the area where the control window is located, the matching relationship between the touch content corresponding to the touch position and the display content and the display content is further determined. If the touch content matches the display content, it means that the user needs to use the control window at this time, and the touch function is configured for the control window and non-transparent display is performed. If the touch content matches the display content, it means that the user is using the display screen for touch operation at this time, and the control window and the touch function configured for the control window are closed, and the display content of the display position corresponding to the touch position is deleted. It should be noted that if there is no touch content input by the user on the display screen before receiving the touch signal input by the user, it is only necessary to determine the position relationship between the touch position of the touch signal input by the user and the control window to determine whether to configure the touch function for the control window and perform non-transparent display, and there is no need to match the touch content. Through the above process, for the user's operation of the display screen, the control window can be opened and closed without feeling. In the process of the user operating the display screen, there is no need for extra steps to open and close the control window. The control window can be opened, displayed, configured with touch function, closed, etc. according to the user's behavior, touch position, and touch content. Provide users with an efficient and convenient user experience.

[0222] like Fig. 9 As shown, the implementation process of the above method is specifically as follows:

[0223] Step 900: After the device is turned on, the default setting is that the display screen receives touch signals and controls the display;

[0224] Step 901: Detecting the user location;

[0225] Step 902: determine whether the distance between the detected user position and the display device is less than a distance threshold, if so, execute step 903, otherwise execute step 911;

[0226] Step 903: triggering a display control window on the display screen, and scaling the content on the display screen in proportion according to the first level of transparency to display it in the control window.

[0227] Step 904: detecting a touch signal input by a user;

[0228] Step 905, determining whether the difference between the detection time of the touch signal and the detection time of the user position is less than a time threshold, if so, executing step 906, otherwise executing step 911;

[0229] Step 906, determining whether the touch position of the touch signal is within the area where the control window is located, if so, executing step 907, otherwise executing step 911;

[0230] Step 907: Display the content in the control window according to the set secondary transparency, wherein the secondary transparency is lower than the primary transparency.

[0231] Step 908 , determining whether the touch content corresponding to the touch position on the display screen matches the display content corresponding to the display position or matches the display content; if it matches the display content, executing step 909 , otherwise executing step 911 .

[0232] The display content includes: display content on the display screen within a second range centered on the display position.

[0233] The display content includes: the display content on the display screen within a third range centered on the touch position.

[0234] Step 909: Determine to configure a touch function for the control window, and not to transparently display the content in the control window;

[0235] Step 910 , determining whether the time interval between two adjacent detections of the user input touch signal is greater than a preset time, if so, executing step 911 , otherwise executing step 906 .

[0236] Step 911: close the control window and delete the display content at the display position corresponding to the touch position, return to the display screen to receive the touch signal and control the display.

[0237] Based on the same inventive concept, the embodiment of the present disclosure also provides a method of smart touch. Since the method is the method corresponding to the device in the embodiment of the present disclosure, and the principle of solving the problem by the method is similar to that of the device, the implementation of the method can refer to the implementation of the device, and the repeated parts will not be repeated.

[0238] like Fig.10 As shown, the implementation process of a smart touch method provided by this embodiment is as follows:

[0239] Step 1000: triggering display of a control window on the display screen of the display device according to the detected user position, and controlling the control window to be in a first state, wherein the first state represents a transition state of determining whether to switch to a second state according to a received touch signal input by the user;

[0240] Step 1001: Control the control window to switch from a first state to a second state according to the detected relationship between the touch position of the touch signal input by the user and the position of the control window;

[0241] Step 1002: Determine whether the control window is in the second state, and control the display screen through the control window.

[0242] As an optional implementation manner, triggering a display control window on a display screen of a display device according to the detected user position includes:

[0243] Determining the distance between the user and the display device according to the detected user position;

[0244] If the distance is less than the distance threshold, display of a control window is triggered on a display screen of the display device.

[0245] As an optional implementation manner, triggering a display control window on a display screen of the display device includes:

[0246] Determining the horizontal coordinate of the center of the control window according to the horizontal coordinate of the user position;

[0247] The position of the control window displayed on the display screen is determined according to the horizontal coordinate of the center of the control window.

[0248] As an optional implementation manner, controlling the control window to be in the second state according to the detected relationship between the touch position of the touch signal input by the user and the position of the control window includes:

[0249] If the touch position is located in the area where the control window is located, the control window is controlled to be in the second state.

[0250] As an optional implementation manner, controlling the control window to be in the second state according to the detected position relationship between the touch position of the touch signal input by the user and the position of the control window includes:

[0251] The control window is controlled to be in a second state according to the detected positional relationship between the touch position of the user operation and the control window, and the touch content generated within a first range centered on the touch position.

[0252] As an optional implementation manner, controlling the control window to be in the second state according to the detected positional relationship between the touch position of the user operation and the control window, and the touch content generated within a first range centered on the touch position, includes:

[0253] If the touch position is located in the area where the control window is located, determining a display position on the display screen corresponding to the touch position, and if the touch content matches display content displayed on the display screen within a second range centered on the display position, controlling the control window to be in a second state; or,

[0254] If the touch position is located in the area where the control window is located, the display content displayed on the display screen within a third range centered on the touch position is obtained; if the touch content generated within the range centered on the touch position matches the display content, the control window is closed and the content displayed at the display position corresponding to the touch position is deleted.

[0255] As an optional implementation, content matching is determined in the following manner:

[0256] Determining that the touch content matches the display content according to at least one of the size and data type of the touch content and the display content; or,

[0257] According to at least one of the size and the data type of the touch content and the display content, it is determined that the touch content matches the display content.

[0258] As an optional implementation, content matching is determined in the following manner:

[0259] After enlarging the touch content according to a preset rule or reducing the display content according to a preset rule, determining that the touch content matches the display content according to the sizes of the touch content and the display content; or,

[0260] After the touch content is enlarged according to a preset rule or the display content is reduced according to a preset rule, it is determined that the touch content matches the display content according to the sizes of the touch content and the display content.

[0261] As an optional implementation manner, triggering display of a control window on a display screen of the display device according to the detected user position further includes:

[0262] At least part of the content on the display screen is scaled and mapped to the control window for display.

[0263] As an optional implementation manner, scaling at least part of the content on the display screen and mapping it to the control window for display further includes:

[0264] During the process of the control window being converted from the first state to the second state, the transparency of the content mapped in the control window is controlled to decrease step by step.

[0265] As an optional implementation manner, controlling the transparency of the content mapped in the control window to decrease step by step includes:

[0266] If at least part of the content on the display screen is scaled and mapped to the control window for display according to the detected user position, the mapped content is displayed at a first level of transparency; or,

[0267] If the touch position is within the area where the control window is located, displaying the mapped content according to a second level of transparency, wherein the second level of transparency is lower than the first level of transparency; or,

[0268] If the touch position is located within the area where the control window is located, and the touch content matches the display content, the mapped content is displayed in a non-transparent manner.

[0269] As an optional implementation manner, after triggering the display of the control window on the display screen of the display device, the method further includes:

[0270] If no touch signal is detected for more than a preset period of time, closing the control window; or,

[0271] If the difference between the detection time of the touch signal and the detection time of the user position is greater than a time threshold, the control window is closed.

[0272] As an optional implementation manner, the user location is determined in the following manner:

[0273] Determine the user position according to the depth information in the depth image of the user captured by the display device; or,

[0274] The digital radar array of the display device is used to perform scanning, and the user position is determined according to the scanning result.

[0275] As an optional implementation, it also includes:

[0276] If the control window is in the first state, the content is displayed through the control window, and the touch signal is received through the display screen;

[0277] If the control window is in the second state, the touch signal is received through the control window, and the content is displayed through the area outside the control window.

[0278] Based on the same inventive concept, the embodiment of the present disclosure also provides a smart touch device. Since the device is the device in the method in the embodiment of the present disclosure, and the principle of solving the problem by the device is similar to that of the method, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0279] like Fig.11 As shown, the device comprises:

[0280] The display unit 1100 is used to trigger the display of a control window on the display screen of the display device according to the detected user position, and control the control window to be in a first state, wherein the first state represents a transition state of determining whether to switch to a second state according to a received touch signal input by the user;

[0281] A conversion unit 1101, configured to control the control window to convert from a first state to a second state according to a detected relationship between a touch position of a touch signal input by a user and a position of the control window;

[0282] The control unit 1102 is configured to determine that the control window is in the second state, and control the display screen through the control window.

[0283] As an optional implementation manner, the display unit 1100 is specifically used for:

[0284] Determining the distance between the user and the display device according to the detected user position;

[0285] If the distance is less than the distance threshold, display of a control window is triggered on a display screen of the display device.

[0286] As an optional implementation manner, the display unit 1100 is specifically used for:

[0287] Determining the horizontal coordinate of the center of the control window according to the horizontal coordinate of the user position;

[0288] The position of the control window displayed on the display screen is determined according to the horizontal coordinate of the center of the control window.

[0289] As an optional implementation manner, the conversion unit 1101 is specifically configured to:

[0290] If the touch position is located in the area where the control window is located, the control window is controlled to be in the second state.

[0291] As an optional implementation manner, the conversion unit 1101 is specifically configured to:

[0292] The control window is controlled to be in a second state according to the detected positional relationship between the touch position of the user operation and the control window, and the touch content generated within a first range centered on the touch position.

[0293] As an optional implementation manner, the conversion unit 1101 is specifically configured to:

[0294] If the touch position is located in the area where the control window is located, determining a display position on the display screen corresponding to the touch position, and if the touch content matches display content displayed on the display screen within a second range centered on the display position, controlling the control window to be in a second state; or,

[0295] If the touch position is located in the area where the control window is located, the display content displayed on the display screen within a third range centered on the touch position is obtained; if the touch content generated within the range centered on the touch position matches the display content, the control window is closed and the content displayed at the display position corresponding to the touch position is deleted.

[0296] As an optional implementation manner, the conversion unit 1101 is specifically configured to:

[0297] Determining that the touch content matches the display content according to at least one of the size and data type of the touch content and the display content; or,

[0298] According to at least one of the size and the data type of the touch content and the display content, it is determined that the touch content matches the display content.

[0299] As an optional implementation manner, the conversion unit 1101 is specifically configured to:

[0300] After enlarging the touch content according to a preset rule or reducing the display content according to a preset rule, determining that the touch content matches the display content according to the sizes of the touch content and the display content; or,

[0301] After the touch content is enlarged according to a preset rule or the display content is reduced according to a preset rule, it is determined that the touch content matches the display content according to the sizes of the touch content and the display content.

[0302] As an optional implementation manner, the display unit is further used for:

[0303] At least part of the content on the display screen is scaled and mapped to the control window for display.

[0304] As an optional implementation manner, the display unit 1100 is further configured to:

[0305] During the process of the control window being converted from the first state to the second state, the transparency of the content mapped in the control window is controlled to decrease step by step.

[0306] As an optional implementation manner, the display unit 1100 is further configured to:

[0307] If at least part of the content on the display screen is scaled and mapped to the control window for display according to the detected user position, the mapped content is displayed at a first level of transparency; or,

[0308] If the touch position is within the area where the control window is located, displaying the mapped content according to a second level of transparency, wherein the second level of transparency is lower than the first level of transparency; or,

[0309] If the touch position is located within the area where the control window is located, and the touch content matches the display content, the mapped content is displayed in a non-transparent manner.

[0310] As an optional implementation manner, after the display of the control window is triggered on the display screen of the display device, a closing unit is further included to:

[0311] If no touch signal is detected for more than a preset period of time, closing the control window; or,

[0312] If the difference between the detection time of the touch signal and the detection time of the user position is greater than a time threshold, the control window is closed.

[0313] As an optional implementation manner, the display unit 1100 is specifically configured to determine the user location in the following manner:

[0314] Determine the user position according to the depth information in the depth image of the user captured by the display device; or,

[0315] The digital radar array of the display device is used to perform scanning, and the user position is determined according to the scanning result.

[0316] As an optional implementation manner, the judgment unit is further included to:

[0317] If the control window is in the first state, the content is displayed through the control window, and the touch signal is received through the display screen;

[0318] If the control window is in the second state, the touch signal is received through the control window, and the content is displayed through the area outside the control window.

[0319] Based on the same inventive concept, the embodiment of the present disclosure further provides a computer storage medium, on which a computer program is stored, and when the program is executed by a processor, the following steps are implemented:

[0320] triggering display of a control window on a display screen of the display device according to the detected user position, and controlling the control window to be in a first state, wherein the first state represents a transition state of determining whether to switch to a second state according to a received touch signal input by the user;

[0321] Controlling the control window to switch from a first state to a second state according to a detected relationship between a touch position of a touch signal input by a user and a position of the control window;

[0322] It is determined that the control window is in a second state, and the display screen is controlled through the control window.

[0323] Those skilled in the art will appreciate that the embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present disclosure may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program code.

[0324] The present disclosure is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present disclosure. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that has the functions specified in one or more boxes.

[0325] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0326] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0327] Obviously, those skilled in the art can make various changes and modifications to the present disclosure without departing from the spirit and scope of the present disclosure. Thus, if these modifications and variations of the present disclosure fall within the scope of the claims of the present disclosure and their equivalents, the present disclosure is also intended to include these modifications and variations.

Claims

1. A display device, wherein: It includes a display screen, a touch control component, and a controller, wherein: The display screen is used to display content; The touch control component is used to receive a touch control signal input by a user; The controller is configured to perform: triggering display of a control window on a display screen of the display device according to the detected user position, and controlling the control window to be in a first state, wherein the first state represents a transition state of determining whether to switch to a second state according to a received touch signal input by the user; the first state of the control window is used to indicate that the control window has a display function but does not yet have a control function; Controlling the control window to switch from a first state to a second state according to a detected relationship between a touch position of a touch signal input by a user and a position of the control window; It is determined that the control window is in a second state, and the display screen is controlled through the control window. The second state is used to represent that the control window has a control function and a display function.

2. The display device according to claim 1, wherein: The controller is specifically configured to execute: Determining the distance between the user and the display device according to the detected user position; If the distance is less than the distance threshold, display of a control window is triggered on a display screen of the display device.

3. The display device according to claim 1, wherein: The controller is specifically configured to execute: Determining the horizontal coordinate of the center of the control window according to the horizontal coordinate of the user position; The position of the control window displayed on the display screen is determined according to the horizontal coordinate of the center of the control window.

4. The display device according to claim 1, wherein: The controller is specifically configured to execute: If the touch position is located in the area where the control window is located, the control window is controlled to be in the second state.

5. The display device according to claim 1, wherein: The controller is specifically configured to execute: The control window is controlled to be in a second state according to the detected positional relationship between the touch position of the user operation and the control window, and the touch content generated within a first range centered on the touch position.

6. The display device according to claim 5, wherein: The controller is specifically configured to execute: If the touch position is located in the area where the control window is located, determining a display position on the display screen corresponding to the touch position, and if the touch content matches display content displayed on the display screen within a second range centered on the display position, controlling the control window to be in a second state; or, If the touch position is located in the area where the control window is located, the display content displayed on the display screen within a third range centered on the touch position is obtained; if the touch content generated within the range centered on the touch position matches the display content, the control window is closed and the content displayed at the display position corresponding to the touch position is deleted.

7. The display device according to claim 6, wherein: The controller is specifically configured as follows: Determining that the touch content matches the display content according to at least one of the size and data type of the touch content and the display content; or, According to at least one of the size and the data type of the touch content and the display content, it is determined that the touch content matches the display content.

8. The display device according to claim 6, wherein: The controller is specifically configured to execute: After enlarging the touch content according to a preset rule or reducing the display content according to a preset rule, determining that the touch content matches the display content according to the sizes of the touch content and the display content; or, After the touch content is enlarged according to a preset rule or the display content is reduced according to a preset rule, it is determined that the touch content matches the display content according to the sizes of the touch content and the display content.

9. The display device according to any one of claims 1 to 8, wherein: The controller is further configured to trigger display of a control window on a display screen of the display device according to the detected user position, and to execute: At least part of the content on the display screen is scaled and mapped to the control window for display.

10. The display device according to claim 9, wherein: The controller is further configured to perform: During the process of the control window being converted from the first state to the second state, the transparency of the content mapped in the control window is controlled to decrease step by step.

11. The display device according to claim 10, wherein: The controller is specifically configured to execute: If at least part of the content on the display screen is scaled and mapped to the control window for display according to the detected user position, the mapped content is displayed at a first level of transparency; or, If the touch position is within the area where the control window is located, displaying the mapped content according to a second level of transparency, wherein the second level of transparency is lower than the first level of transparency; or, If the touch position is located within the area where the control window is located, and the touch content matches the display content, the mapped content is displayed in a non-transparent manner.

12. The display device according to any one of claims 1 to 8, 10 to 11, wherein: After triggering the display of the control window on the display screen of the display device, the controller is further configured to execute: If no touch signal is detected for more than a preset period of time, closing the control window; or, If the difference between the detection time of the touch signal and the detection time of the user position is greater than a time threshold, the control window is closed.

13. The display device according to any one of claims 1 to 8, 10 to 11, wherein: The controller is specifically configured to determine the user position in the following manner: Determine the user position according to the depth information in the depth image of the user captured by the display device; or, The digital radar array of the display device is used to perform scanning, and the user position is determined according to the scanning result.

14. The display device according to any one of claims 1 to 8, 10 to 11, wherein: The controller is further configured to: If the control window is in the first state, the content is displayed through the control window, and the touch signal is received through the display screen; If the control window is in the second state, the touch signal is received through the control window, and the content is displayed through the area outside the control window.

15. A smart touch method, wherein: The method includes: triggering display of a control window on a display screen of a display device according to the detected user position, and controlling the control window to be in a first state, wherein the first state represents a transition state of determining whether to switch to a second state according to a received touch signal input by the user; the first state of the control window is used to indicate that the control window has a display function but does not yet have a control function; Controlling the control window to switch from a first state to a second state according to a detected relationship between a touch position of a touch signal input by a user and a position of the control window; It is determined that the control window is in a second state, and the display screen is controlled through the control window. The second state is used to represent that the control window has a control function and a display function.

16. The method according to claim 15, wherein: The triggering of display of a control window on a display screen of the display device according to the detected user position includes: Determining the distance between the user and the display device according to the detected user position; If the distance is less than the distance threshold, display of a control window is triggered on a display screen of the display device.

17. The method according to claim 15, wherein: The position of the control window is determined by: Determining the horizontal coordinate of the center of the control window according to the horizontal coordinate of the user position; The position of the control window displayed on the display screen is determined according to the horizontal coordinate of the center of the control window.

18. The method according to claim 15, wherein: The controlling the control window to be in the second state according to the detected relationship between the touch position of the touch signal input by the user and the position of the control window comprises: If the touch position is located in the area where the control window is located, the control window is controlled to be in the second state.

19. The method according to claim 15, wherein: The controlling the control window to be in the second state according to the detected relationship between the touch position of the touch signal input by the user and the position of the control window comprises: The control window is controlled to be in a second state according to the detected positional relationship between the touch position of the user operation and the control window, and the touch content generated within a first range centered on the touch position.

20. The method according to any one of claims 15 to 19, wherein: The method of triggering display of a control window on a display screen of the display device according to the detected user position further includes: At least part of the content on the display screen is scaled and mapped to the control window for display.

21. The method according to claim 20, wherein: The scaling of at least part of the content on the display screen and mapping the scaling to the control window for display further includes: During the process of the control window being converted from the first state to the second state, the transparency of the content mapped in the control window is controlled to decrease step by step.

22. A computer storage medium having a computer program stored thereon, wherein: When the program is executed by a processor, the steps of the method according to any one of claims 15 to 21 are implemented.

Images