Intelligent interactive display device and multi-finger interaction detection method

Abstract

The present invention discloses an intelligent interactive display device and a multi-finger interaction detection method, which are used to achieve the effect of solving screen accidental touches through software algorithm processing without relying on hardware devices. It includes a display screen and a control circuit, wherein: the display screen is used to receive a user's touch operation; the control circuit includes a processor and a memory, the memory is used to store a program executable by the processor, and the processor is used to read the program in the memory and perform the following steps: obtaining at least one detected candidate touch point, wherein each candidate touch point is generated by a user performing a touch operation on the display screen; in the process of the candidate touch point moving, according to the moving distance of the candidate touch point, determining a valid touch point from the detected candidate touch points; according to the number of valid touch points, executing a response corresponding to the movement of the valid touch point.

Description

Technical Field

[0001] The present invention relates to the field of intelligent software technology, and in particular to an intelligent interactive display device and a multi-finger interaction detection method. Background Art

[0002] Currently, large or extra-large touch display devices based on Android systems are becoming more and more popular. The mainstream display screen types are capacitive, resistive, and infrared screens, such as electronic whiteboards equipped with high-precision positioning technologies such as infrared, electromagnetic and capacitive touch.

[0003] Existing large touch display devices are not very responsive to touch events, and there may be many misoperations, especially when performing multi-finger operations on electronic whiteboards. For example, when a user performs a two-finger zoom operation, the electronic whiteboard mistakenly recognizes it as a three-finger operation, or when a user performs a three-finger operation, the electronic whiteboard mistakenly recognizes it as a two-finger operation. Therefore, how to solve the multi-finger interaction anomaly caused by the user's accidental touch on the screen is a technical problem that needs to be solved urgently. Summary of the invention

[0004] The present invention provides an intelligent interactive display device and a multi-finger interaction detection method, which are used to achieve the effect of solving the problem of accidental touches on the screen through software algorithm processing without relying on hardware devices.

[0005] In a first aspect, an embodiment of the present invention provides an intelligent interactive display device, including a display screen and a control circuit, wherein:

[0006] The display screen is used to receive a touch operation from a user;

[0007] The control circuit includes a processor and a memory, wherein the memory is used to store a program executable by the processor, and the processor is used to read the program in the memory and perform the following steps:

[0008] Acquire at least one detected candidate touch point, wherein each candidate touch point is generated by a user performing a touch operation on the display screen;

[0009] During the movement of the candidate touch point, determining a valid touch point from the detected candidate touch points according to the movement distance of the candidate touch point;

[0010] According to the number of effective contacts, a response corresponding to the movement of the effective contacts is performed.

[0011] The present embodiment provides an intelligent interactive display device and a multi-finger interaction detection method, which obtains the number of fingers used by the user when performing a touch operation, that is, the number of candidate touch points, and then uses the moving distance of the candidate touch points during the movement process to detect the valid touch points, thereby determining whether the final user touch instruction is a single-finger or multi-finger touch instruction based on the number of valid touch points. The user's touch behavior is judged using a software algorithm without relying on hardware devices, thereby achieving the technical effect of solving the problem of accidental touches on the screen.

[0012] As an optional implementation, the processor is specifically configured to execute:

[0013] According to the total number of candidate touch points detected before any candidate touch point moves, the number of valid touch points is controlled to be lower than or equal to the total number of candidate touch points.

[0014] As an optional implementation, the processor is specifically configured to execute:

[0015] From the detected candidate touch points, a candidate touch point whose moving distance is greater than a distance threshold is determined as a valid touch point.

[0016] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the processor is further configured to execute:

[0017] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to the movement distance of the effective touch point.

[0018] As an optional implementation, the processor is specifically configured to execute:

[0019] When the moving distance of the effective touch point is less than or equal to a distance threshold, it is determined to add the new candidate touch point to the effective touch points.

[0020] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the processor is further configured to execute:

[0021] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to the movement distance of the new candidate touch point.

[0022] As an optional implementation, the processor is specifically configured to execute:

[0023] When the moving distance of the new candidate touch point is greater than the distance threshold, it is determined to add the new candidate touch point to the valid touch points.

[0024] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the processor is further configured to execute:

[0025] During the movement of the effective touch point, a new candidate touch point is detected, and according to the touch duration of the new candidate touch point, it is determined whether to add the new candidate touch point to the effective touch points; wherein the touch duration is used to indicate the duration that the finger generating the candidate touch point touches the display screen.

[0026] As an optional implementation, the processor is specifically configured to execute:

[0027] When the touch duration of the new candidate contact point is greater than the time threshold, it is determined to add the new candidate contact point to the valid contact points.

[0028] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the processor is further configured to execute:

[0029] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to a time interval between executing a response corresponding to the movement of the effective touch point and detecting the new candidate touch point.

[0030] As an optional implementation, the processor is specifically configured to execute:

[0031] When the time interval is less than or equal to the interval threshold, it is determined to add the new candidate touch point to the valid touch points.

[0032] As an optional implementation manner, after determining to add the new candidate touch point to the valid touch point, the processor is further configured to execute:

[0033] According to the number of valid contacts after addition, a response corresponding to the movement of the valid contacts after addition is executed.

[0034] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the processor is further configured to execute:

[0035] A lost effective contact is detected during the movement of the effective contact, and it is determined whether to remove the lost effective contact from the effective contacts according to the movement distance of the remaining effective contacts.

[0036] As an optional implementation, the processor is specifically configured to execute:

[0037] When the moving distance of the remaining valid touch points is greater than a distance threshold, determining to remove the lost valid touch points from the valid touch points; or,

[0038] When the moving distance of the remaining valid contacts is less than or equal to the distance threshold, and a new valid contact is detected after the lost valid contact is detected, it is determined not to remove the lost valid contact from the valid contacts, wherein the number of the detected lost valid contacts and the new valid contacts is the same.

[0039] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the processor is further configured to execute:

[0040] A lost valid contact is detected during the movement of the valid contact, and whether to remove the lost valid contact from the valid contacts is determined based on the removal duration of the lost valid contact; wherein the removal duration represents the duration during which the finger that generated the valid contact is lifted and does not touch the display screen.

[0041] As an optional implementation, the processor is specifically configured to execute:

[0042] When the removal time is greater than the time threshold, it is determined that the lost valid contact is removed from the valid contacts; or,

[0043] When a new valid contact is detected after the loss of the valid contact is detected, and the time interval between the loss of the valid contact and the detection of the new valid contact is less than or equal to the time threshold, it is determined not to remove the lost valid contact from the valid contacts.

[0044] As an optional implementation manner, after determining to remove the lost valid contacts from the valid contacts, the processor is further configured to execute:

[0045] According to the number of effective contacts after removal, a response corresponding to the movement of effective contacts after removal is performed.

[0046] As an optional implementation manner, in determining a valid touch point from the detected candidate touch points, the processor is specifically further configured to execute:

[0047] According to the touch pressure value corresponding to the candidate touch point, a valid touch point is determined from the detected candidate touch points.

[0048] As an optional implementation manner, in determining a valid touch point from the detected candidate touch points, the processor is specifically further configured to execute:

[0049] Determine a valid touch point from the detected candidate touch points according to the contact area corresponding to the candidate touch point.

[0050] In a second aspect, an embodiment of the present invention provides a multi-finger interaction detection method, including:

[0051] Acquire at least one detected candidate touch point, wherein each candidate touch point is generated by a user performing a touch operation on the display screen;

[0052] During the movement of the candidate touch point, determining a valid touch point from the detected candidate touch points according to the movement distance of the candidate touch point;

[0053] According to the number of effective contacts, a response corresponding to the movement of the effective contacts is performed.

[0054] As an optional implementation manner, the acquiring at least one detected candidate touch point includes:

[0055] According to the total number of candidate touch points detected before any candidate touch point moves, the number of valid touch points is controlled to be lower than or equal to the total number of candidate touch points.

[0056] As an optional implementation manner, determining a valid touch point from the detected candidate touch points according to the moving distance of the candidate touch point includes:

[0057] From the detected candidate touch points, a candidate touch point whose moving distance is greater than a distance threshold is determined as a valid touch point.

[0058] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes:

[0059] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to the movement distance of the effective touch point.

[0060] As an optional implementation manner, determining whether to add the new candidate touch point to the valid touch point according to the moving distance of the valid touch point includes:

[0061] When the moving distance of the effective touch point is less than or equal to a distance threshold, it is determined to add the new candidate touch point to the effective touch points.

[0062] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes:

[0063] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to the movement distance of the new candidate touch point.

[0064] As an optional implementation manner, determining whether to add the new candidate touch point to the valid touch points according to the moving distance of the new candidate touch point includes:

[0065] When the moving distance of the new candidate touch point is greater than the distance threshold, it is determined to add the new candidate touch point to the valid touch points.

[0066] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes:

[0067] During the movement of the effective touch point, a new candidate touch point is detected, and according to the touch duration of the new candidate touch point, it is determined whether to add the new candidate touch point to the effective touch points; wherein the touch duration is used to indicate the duration that the finger generating the candidate touch point touches the display screen.

[0068] As an optional implementation manner, determining whether to add the new candidate touch point to the valid touch points according to the touch duration of the new candidate touch point includes:

[0069] When the touch duration of the new candidate contact point is greater than the time threshold, it is determined to add the new candidate contact point to the valid contact points.

[0070] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes:

[0071] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to a time interval between executing a response corresponding to the movement of the effective touch point and detecting the new candidate touch point.

[0072] As an optional implementation manner, determining whether to add the new candidate touch point to the effective touch point according to a time interval between executing a response corresponding to the movement of the effective touch point and detecting a new candidate touch point includes:

[0073] When the time interval is less than or equal to the interval threshold, it is determined to add the new candidate touch point to the valid touch points.

[0074] As an optional implementation manner, after determining to add the new candidate touch point to the valid touch point, the method further includes:

[0075] According to the number of valid contacts after addition, a response corresponding to the movement of the valid contacts after addition is executed.

[0076] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes:

[0077] A lost effective contact is detected during the movement of the effective contact, and it is determined whether to remove the lost effective contact from the effective contacts according to the movement distance of the remaining effective contacts.

[0078] As an optional implementation manner, determining whether to remove the lost valid contact from the valid contacts according to the moving distance of the remaining valid contacts includes:

[0079] When the moving distance of the remaining valid touch points is greater than a distance threshold, determining to remove the lost valid touch points from the valid touch points; or,

[0080] When the moving distance of the remaining valid contacts is less than or equal to the distance threshold, and a new valid contact is detected after the lost valid contact is detected, it is determined not to remove the lost valid contact from the valid contacts, wherein the number of the detected lost valid contacts and the new valid contacts is the same.

[0081] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes:

[0082] A lost valid contact is detected during the movement of the valid contact, and whether to remove the lost valid contact from the valid contacts is determined based on the removal duration of the lost valid contact; wherein the removal duration represents the duration during which the finger that generated the valid contact is lifted and does not touch the display screen.

[0083] As an optional implementation manner, determining whether to remove the lost valid contact from the valid contacts according to the removal duration of the lost valid contact includes:

[0084] When the removal time is greater than the time threshold, it is determined that the lost valid contact is removed from the valid contacts; or,

[0085] When a new valid contact is detected after the loss of the valid contact is detected, and the time interval between the loss of the valid contact and the detection of the new valid contact is less than or equal to the time threshold, it is determined not to remove the lost valid contact from the valid contacts.

[0086] As an optional implementation manner, after determining to remove the lost valid contacts from the valid contacts, the method further includes:

[0087] According to the number of effective contacts after removal, a response corresponding to the movement of effective contacts after removal is performed.

[0088] As an optional implementation manner, the determining of a valid touch point from the detected candidate touch points further includes:

[0089] According to the touch pressure value corresponding to the candidate touch point, a valid touch point is determined from the detected candidate touch points.

[0090] As an optional implementation manner, the determining of a valid touch point from the detected candidate touch points further includes:

[0091] Determine a valid touch point from the detected candidate touch points according to the contact area corresponding to the candidate touch point.

[0092] In a third aspect, an embodiment of the present invention further provides a multi-finger interaction detection device, comprising:

[0093] A touch point acquisition unit, used to acquire at least one detected candidate touch point, wherein each candidate touch point is generated by a user performing a touch operation on the display screen;

[0094] a touch point determination unit, used for determining a valid touch point from the detected candidate touch points according to the moving distance of the candidate touch point during the movement of the candidate touch point;

[0095] The response execution unit is used to execute a response corresponding to the movement of the effective contact points according to the number of the effective contact points.

[0096] As an optional implementation manner, the contact point acquisition unit is specifically used for:

[0097] According to the total number of candidate touch points detected before any candidate touch point moves, the number of valid touch points is controlled to be lower than or equal to the total number of candidate touch points.

[0098] As an optional implementation manner, the judgment contact unit is specifically used for:

[0099] From the detected candidate touch points, a candidate touch point whose moving distance is greater than a distance threshold is determined as a valid touch point.

[0100] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes a first judgment unit specifically configured to:

[0101] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to the movement distance of the effective touch point.

[0102] As an optional implementation manner, the first judgment unit is specifically configured to:

[0103] When the moving distance of the effective touch point is less than or equal to a distance threshold, it is determined to add the new candidate touch point to the effective touch points.

[0104] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes a second judgment unit specifically configured to:

[0105] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to the movement distance of the new candidate touch point.

[0106] As an optional implementation manner, the second judgment unit is specifically configured to:

[0107] When the moving distance of the new candidate touch point is greater than the distance threshold, it is determined to add the new candidate touch point to the valid touch points.

[0108] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes a third judgment unit specifically configured to:

[0109] During the movement of the effective touch point, a new candidate touch point is detected, and according to the touch duration of the new candidate touch point, it is determined whether to add the new candidate touch point to the effective touch points; wherein the touch duration is used to indicate the duration that the finger generating the candidate touch point touches the display screen.

[0110] As an optional implementation manner, the third judgment unit is specifically configured to:

[0111] When the touch duration of the new candidate contact point is greater than the time threshold, it is determined to add the new candidate contact point to the valid contact points.

[0112] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes a fourth judgment unit specifically configured to:

[0113] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to a time interval between executing a response corresponding to the movement of the effective touch point and detecting the new candidate touch point.

[0114] As an optional implementation manner, the fourth determination unit is specifically configured to:

[0115] When the time interval is less than or equal to the interval threshold, it is determined to add the new candidate touch point to the valid touch points.

[0116] As an optional implementation manner, after determining to add the new candidate touch point to the valid touch point, the method further includes a first execution response unit specifically configured to:

[0117] According to the number of valid contacts after addition, a response corresponding to the movement of the valid contacts after addition is executed.

[0118] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes a fifth judgment unit specifically configured to:

[0119] A lost effective contact is detected during the movement of the effective contact, and it is determined whether to remove the lost effective contact from the effective contacts according to the movement distance of the remaining effective contacts.

[0120] As an optional implementation manner, the fifth judgment unit is specifically configured to:

[0121] When the moving distance of the remaining valid touch points is greater than a distance threshold, determining to remove the lost valid touch points from the valid touch points; or,

[0122] When the moving distance of the remaining valid contacts is less than or equal to the distance threshold, and a new valid contact is detected after the lost valid contact is detected, it is determined not to remove the lost valid contact from the valid contacts, wherein the number of the detected lost valid contacts and the new valid contacts is the same.

[0123] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes a sixth judgment unit specifically configured to:

[0124] A lost valid contact is detected during the movement of the valid contact, and whether to remove the lost valid contact from the valid contacts is determined based on the removal duration of the lost valid contact; wherein the removal duration represents the duration during which the finger that generated the valid contact is lifted and does not touch the display screen.

[0125] As an optional implementation manner, the sixth judgment unit is specifically configured to:

[0126] When the removal time is greater than the time threshold, it is determined that the lost valid contact is removed from the valid contacts; or,

[0127] When a new valid contact is detected after the loss of the valid contact is detected, and the time interval between the loss of the valid contact and the detection of the new valid contact is less than or equal to the time threshold, it is determined not to remove the lost valid contact from the valid contacts.

[0128] As an optional implementation manner, after determining to remove the lost valid contacts from the valid contacts, a second execution response unit is further included to:

[0129] According to the number of effective contacts after removal, a response corresponding to the movement of effective contacts after removal is performed.

[0130] As an optional implementation manner, the determining of the valid touch point from the detected candidate touch points further includes a pressure determination unit specifically configured to:

[0131] According to the touch pressure value corresponding to the candidate touch point, a valid touch point is determined from the detected candidate touch points.

[0132] As an optional implementation manner, the determining of the valid touch point from the detected candidate touch points further includes an area determination unit specifically configured to:

[0133] Determine a valid touch point from the detected candidate touch points according to the contact area corresponding to the candidate touch point.

[0134] In a fourth aspect, an embodiment of the present invention further provides a computer storage medium on which a computer program is stored, and when the program is executed by a processor, it is used to implement the steps of the method described in the first aspect above.

[0135] These and other aspects of the present application will be more clearly understood in the description of the following embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0136] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0137] Figure 1 A schematic diagram of an intelligent interactive display device provided by an embodiment of the present invention;

[0138] Figure 2 A logic judgment flow chart for determining the maximum finger index of a user when touching is provided in an embodiment of the present invention;

[0139] Figure 3 A flow chart of determining effective touch points in a finger-adding scenario provided by an embodiment of the present invention;

[0140] Figure 4 A flow chart of valid contact point determination in a finger removal scenario provided by an embodiment of the present invention;

[0141] Figure 5 A detailed multi-finger interaction detection flow chart provided by an embodiment of the present invention;

[0142] Figure 6 A flowchart of a multi-finger interaction detection method provided by an embodiment of the present invention;

[0143] Figure 7A schematic diagram of a multi-finger interaction detection device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0144] In order to make the purpose, technical scheme and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0145] In the embodiments of the present invention, the term "and / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may represent three situations: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0146] The application scenarios described in the embodiments of the present invention are intended to more clearly illustrate the technical solutions of the embodiments of the present invention, and do not constitute a limitation on the technical solutions provided by the embodiments of the present invention. It is known to those skilled in the art that with the emergence of new application scenarios, the technical solutions provided by the embodiments of the present invention are also applicable to similar technical problems. In the description of the present invention, unless otherwise specified, "multiple" means two or more.

[0147] Embodiment 1. Currently, large or super-large touch display devices based on Android systems are becoming more and more popular. The mainstream display screen types are capacitive, resistive, and infrared screens, such as electronic whiteboards equipped with high-precision positioning technologies such as infrared, electromagnetic and capacitive touch. Existing large touch display devices are not sensitive to touch events, and there may be many misoperations, especially when performing multi-finger operations on the electronic whiteboard, which are often prone to misoperations. For example, when a user performs a two-finger zoom operation, the electronic whiteboard mistakenly recognizes it as a three-finger operation, or when the user performs a three-finger operation, the electronic whiteboard mistakenly recognizes it as a two-finger operation. Therefore, how to solve the multi-finger interaction anomaly caused by the user's accidental touch of the screen is a technical problem that urgently needs to be solved.

[0148] This embodiment proposes an intelligent interactive display device, which applies a multi-finger interaction detection method. The core idea is to use software algorithms to judge the user's touch behavior without relying on hardware devices, so as to achieve the technical effect of solving the screen accidental touch. This embodiment first obtains the number of fingers used by the user when performing the touch operation, that is, the number of candidate touch points, and then uses the moving distance of the candidate touch points during the movement process to detect the valid touch points, so as to determine whether the final user's touch instruction is a single-finger or multi-finger touch instruction based on the number of valid touch points. The problem of multi-finger interaction anomalies caused by screen accidental touches is effectively solved through a logical judgment algorithm.

[0149] It should be noted that the intelligent interactive display device in this embodiment refers to a large-size (generally over 50 inches) display device with touch and handwriting functions; on the intelligent interactive display device, writing programs such as electronic whiteboards can be installed, and users can use fingers, active pens or passive pens to write on the display device. The intelligent interactive display device can include display modules such as liquid crystal displays (LCD), organic electroluminescence displays (OLED), and electronic ink, which can display writing in real time.

[0150] like Figure 1 As shown, the present embodiment provides an intelligent interactive display device, including a display screen 100 and a control circuit 101, wherein:

[0151] The display screen 100 is used to receive a touch operation from a user;

[0152] The control circuit 101 includes a processor and a memory, wherein the memory is used to store a program executable by the processor, and the processor is used to read the program in the memory and execute the following steps:

[0153] Acquire at least one detected candidate touch point, wherein each candidate touch point is generated by a user performing a touch operation on the display screen;

[0154] During the movement of the candidate touch point, determining a valid touch point from the detected candidate touch points according to the movement distance of the candidate touch point;

[0155] According to the number of effective contacts, a response corresponding to the movement of the effective contacts is performed.

[0156] The touch points in this embodiment are generated by the user performing a touch operation on the display screen. If the user performs a multi-finger operation, multiple candidate touch points are detected. The multiple candidate touch points are generated by the user performing a multi-finger touch operation on the display screen. The number of detected candidate touch points is not greater than the number of fingers used by the user for the touch operation, and they should usually be the same. If the user performs a single-finger operation, one candidate touch point is detected, which is generated by the user performing a single-finger touch operation on the display screen. The valid touch points in this embodiment represent the fingers used by the user for the actual touch operation, and the number of valid touch points represents the number of fingers used by the user for the actual touch operation. If the user performs a multi-finger touch operation, then before the fingers move, the touch points generated by the fingers contacting the screen are obtained, and the number of fingers used by the user in the actual operation can be obtained.

[0157] During implementation, the detected touch point is first judged before the candidate touch point moves. Since different fingers do not touch at the same time when the user uses multi-finger operation, a judgment condition before the candidate touch point moves is added during the judgment, so that the number of fingers used by the user to touch the display screen can be detected.

[0158] In some embodiments, the number of fingers actually operated by the user is determined in the following manner:

[0159] When a new candidate contact is detected again before an already detected candidate contact moves, if it is determined that the new candidate contact has not moved, the number of already detected candidate contacts is increased according to the new candidate contact, thereby determining the maximum number of fingers used for the user's touch operation according to the final number of detected candidate contacts.

[0160] In some embodiments, the number of valid touch points is controlled to be lower than or equal to the total number of candidate touch points according to the total number of candidate touch points detected before any candidate touch point moves. In implementation, the number of valid touch points can be controlled not to be higher than the maximum finger index according to the maximum finger index.

[0161] In some embodiments, the user's touch operation includes but is not limited to pressing, moving and lifting. When the user presses the finger, a candidate touch point is generated. The candidate touch points generated during the finger movement also move accordingly. When the user lifts the finger, the generated candidate touch points disappear (are lost). Based on the above touch process of the user, this embodiment provides a logical judgment process for determining the maximum finger index of the user when touching, such as Figure 2 The specific implementation steps of this process are as follows:

[0162] Step 200: Detect user pressing and generate candidate touch point a;

[0163] Step 201, determine whether it is the first time that the user presses the button, if so, execute step 202, otherwise execute step 203;

[0164] Step 202, set the maximum finger index to 1;

[0165] Step 203, determine whether the generated candidate contact a has been moved, if yes, execute step 204, otherwise execute step 205;

[0166] Step 204, maintaining the maximum finger index unchanged;

[0167] Step 205, adding 1 to the maximum finger index;

[0168] Step 206 : Detect that the user lifts up the touch screen, and the candidate touch point a disappears, and then execute step 204 .

[0169] This embodiment can use the number of candidate touch points generated by the number of fingers touching the display screen before the finger moves as the maximum number of fingers of the user's touch operation, that is, the number of fingers actually used for the user's touch operation. When the finger has begun to move, the finger detected in the middle will not affect the response result of the user's touch operation. For example, when the user uses two fingers to perform a sliding operation for zooming, the third finger accidentally touches the screen in the middle, but because there is already a two-finger sliding operation when the third finger touches the screen, the two-finger touch process will not be changed to a three-finger touch, and the zooming is still maintained, avoiding the situation where the user accidentally touches and causes abnormal finger interaction.

[0170] In some embodiments, during the movement of the candidate contact point, the present embodiment determines a valid contact point from the detected candidate contact points according to the moving distance of the candidate contact point. Optionally, from the detected candidate contact points, the candidate contact point whose moving distance is greater than the distance threshold is determined as a valid contact point. In implementation, for each detected candidate contact point, each candidate contact point whose moving distance is greater than the distance threshold is determined as a valid contact point, and the remaining candidate contact points do not undergo subsequent calculation processes. The present embodiment can determine whether the candidate contact point is a contact point generated by a finger that touches by mistake according to the length of the moving distance of the candidate contact point, and is also used to determine whether it is a valid contact point.

[0171] In some embodiments, after determining a valid touch point from the detected candidate touch points, this embodiment may also determine whether the detected new candidate touch point is a valid touch point in the following manner:

[0172] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to the movement distance of the effective touch point.

[0173] During implementation, when the user's finger has moved during the touch process, and a new finger touches the display screen, that is, a new candidate touch point is detected during the movement of the effective touch point, then based on the moving distance of the effective touch point that has already moved, it is determined whether to add the new candidate touch point to the effective touch points. During implementation, the moving distance of the finger that has already moved is used to determine whether to use the new finger as the actual operating finger.

[0174] In some embodiments, whether to add the new candidate touch point to the valid touch points is determined by:

[0175] When the moving distance of the effective touch point is less than or equal to the distance threshold, it is determined that the new candidate touch point is added to the effective touch points. Otherwise, the new candidate touch point is ignored, that is, the new candidate touch point is determined to be a touch point generated by the user's accidental touch during the sliding operation.

[0176] In some embodiments, after determining a valid touch point from the detected candidate touch points, this embodiment may also determine whether the detected new candidate touch point is a valid touch point in the following manner:

[0177] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to the movement distance of the new candidate touch point.

[0178] In implementation, when a user's finger has moved during the touch process, and a new finger touches the display screen, that is, a new candidate touch point is detected during the movement of the valid touch point, then it is determined whether to add the new candidate touch point to the valid touch point according to the movement distance of the detected new candidate touch point. In implementation, when a user has already slid with a finger, and a new finger slid with a finger, then it is determined whether the new candidate touch point is a valid touch point according to the movement distance of the new candidate touch point.

[0179] In some embodiments, when the moving distance of the new candidate contact point is greater than the distance threshold, the new candidate contact point is determined to be added to the valid contact points. Otherwise, the new candidate contact point is ignored, that is, the new candidate contact point is determined to be a contact point generated by the user's accidental touch during the sliding operation.

[0180] In some embodiments, after determining a valid touch point from the detected candidate touch points, this embodiment further provides a method for determining whether a new candidate touch point should be added to the valid touch points according to the touch duration. The specific implementation process is as follows:

[0181] A new candidate contact point is detected during the movement of the effective contact point, and according to the touch duration of the new candidate contact point, it is determined whether to add the new candidate contact point to the effective contact point;

[0182] The touch duration is used to indicate the duration that the finger generating the candidate touch point touches the display screen.

[0183] During implementation, when the user's finger has moved during the touching process and a new finger touches the display screen, that is, a new candidate touch point is detected during the movement of the effective touch point, then it is determined whether to add the new candidate touch point to the effective touch point based on the touch duration of the detected new candidate touch point.

[0184] In some embodiments, when the touch duration of the new candidate contact point is greater than a time threshold, it is determined to add the new candidate contact point to the valid contacts.

[0185] In some embodiments, after determining a valid touch point from the detected candidate touch points, this embodiment further provides a method for determining whether a new candidate touch point should be added to the valid touch points according to the touch interval. The specific implementation process is as follows:

[0186] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to a time interval between executing a response corresponding to the movement of the effective touch point and detecting the new candidate touch point.

[0187] During implementation, when a user's finger has moved during the touch process and a new finger touches the display screen, that is, a new candidate touch point is detected during the movement of the valid touch point, the validity of the detected new candidate touch point is determined based on the time interval between the time of executing the response of the valid touch point and the detection time of the new candidate touch point.

[0188] In implementation, when the user adds a third finger to touch during a two-finger touch, the validity of the third finger, that is, whether it is an accidental touch operation, is determined based on the time interval between responding to the two-finger touch and detecting the three-finger touch.

[0189] In some embodiments, when the time interval is less than or equal to an interval threshold, it is determined to add the new candidate contact to the valid contacts.

[0190] The above embodiment can solve the problem of accidental screen touches caused by another finger accidentally touching the screen while the user is already using the finger to perform a sliding operation, thereby effectively shielding invalid finger touch events.

[0191] In some embodiments, when it is determined to add the new candidate contact to the valid contacts, a response corresponding to the movement of the added valid contacts is performed according to the number of the added valid contacts.

[0192] In implementation, if a new candidate contact point is added to a valid contact point, regardless of whether the response corresponding to the movement of the valid contact point has been executed at this time, the response corresponding to the movement of the added valid contact point is executed at this time. For example, when the user adds a third finger during a two-finger operation, and the new candidate contact point generated by the third finger touch operation is determined to be a valid contact point, the response of the two-finger operation is not executed at this time, but the response of the three-finger operation is executed.

[0193] like Figure 3 As shown, this embodiment provides a method for determining effective touch points in a finger-adding scenario, and the specific implementation process of the method is as follows:

[0194] Step 300: Detecting a new candidate touch point during the movement of the valid touch point;

[0195] Step 301, determine whether the moving distance of the effective touch point is less than or equal to the distance threshold, if so, execute step 302, otherwise execute step 306;

[0196] Step 302, determine whether the moving distance of the new candidate touch point is greater than the distance threshold, if so, execute step 303, otherwise execute step 306;

[0197] Step 303, determine whether the touch duration of the new candidate touch point is greater than the time threshold, if so, execute step 304, otherwise execute step 306;

[0198] Step 304, determine whether the time interval between executing the response of the valid touch point and detecting the new candidate touch point is less than or equal to the interval threshold, if so, execute step 305, otherwise execute step 306;

[0199] Step 305: Add the new candidate touch point to the valid touch points, and execute a response corresponding to the movement of the added valid touch points according to the number of the added valid touch points.

[0200] Step 306: Determine that the response fails.

[0201] In some embodiments, after determining valid touch points from detected candidate touch points, this embodiment further provides a method for determining whether to remove the lost valid touch points from the valid touch points. The specific implementation steps are as follows:

[0202] A lost effective contact is detected during the movement of the effective contact, and it is determined whether to remove the lost effective contact from the effective contacts according to the movement distance of the remaining effective contacts.

[0203] In implementation, when the user's finger has moved during the touch process, there is a situation where the finger is removed, resulting in the loss of the valid touch point, that is, the loss of the valid touch point is detected during the movement of the valid touch point, and the validity of the lost valid touch point is determined according to the movement distance of the remaining valid touch point. For example, during the two-finger touch sliding process, the user removes one finger (such as one finger moves out of the screen). In this case, the validity of the lost valid touch point is determined according to the movement distance of the remaining 1 finger.

[0204] In some embodiments, whether to remove the lost valid contacts from the valid contacts is determined by any of the following methods:

[0205] When the moving distance of the remaining valid touch points is greater than a distance threshold, determining to remove the lost valid touch points from the valid touch points; or,

[0206] When the moving distance of the remaining valid contacts is less than or equal to the distance threshold, and a new valid contact is detected after the lost valid contact is detected, it is determined not to remove the lost valid contact from the valid contacts, wherein the number of the detected lost valid contacts and the new valid contacts is the same.

[0207] In implementation, if the lost valid contacts are removed from the valid contacts, the number of valid contacts is reduced. For example, if the user removes one finger during a three-finger touch slide, two valid contacts remain, and a two-finger touch slide operation is responded to.

[0208] In some embodiments, after determining a valid touch point from the detected candidate touch points, this embodiment further provides the following method to determine whether the lost valid touch point is removed:

[0209] A lost valid contact is detected during the movement of the valid contact, and whether to remove the lost valid contact from the valid contacts is determined based on the removal duration of the lost valid contact; wherein the removal duration represents the duration during which the finger that generated the valid contact is lifted and does not touch the display screen.

[0210] In some embodiments, whether to remove the lost valid contacts from the valid contacts is determined by any of the following methods:

[0211] When the removal time is greater than the time threshold, it is determined that the lost valid contact is removed from the valid contacts; or,

[0212] When a new valid contact is detected after the loss of the valid contact is detected, and the time interval between the loss of the valid contact and the detection of the new valid contact is less than or equal to the time threshold, it is determined not to remove the lost valid contact from the valid contacts.

[0213] In some embodiments, after it is determined that the lost valid contacts are removed from the valid contacts, the present embodiment is further used to execute a response corresponding to the movement of the valid contacts after removal according to the number of the valid contacts after removal.

[0214] In some embodiments, Figure 4 As shown, this embodiment provides a method for determining effective contact points in a finger removal scenario, and the specific implementation process of the method is as follows:

[0215] Step 400: Detecting the loss of an effective contact during the movement of the effective contact;

[0216] Step 401, determine whether the moving distance of the remaining valid touch points is less than or equal to the distance threshold, and if a new valid touch point is detected after the loss of the valid touch point, execute step 402, otherwise execute step 404;

[0217] Step 402: determine whether a new valid contact is detected after the loss of the valid contact is detected, and the time interval between the loss of the valid contact and the detection of the new valid contact is less than or equal to the time threshold. If so, execute step 403; otherwise, execute step 404.

[0218] Step 403: determine not to remove the lost valid contact point, and continue to respond to the movement of the valid contact point;

[0219] Step 404: Determine to remove the lost valid contacts, and respond to the movement of the valid contacts after removal according to the number of the valid contacts after removal.

[0220] In some embodiments, the present embodiment may also determine a valid touch point from the detected candidate touch points in any of the following ways:

[0221] Method 1) Determine a valid touch point from the detected candidate touch points according to the touch pressure value corresponding to the candidate touch point.

[0222] In implementation, if the touch pressure value corresponding to the candidate touch point is greater than the pressure threshold, the candidate touch point is determined to be a valid touch point.

[0223] Method 2) Determine a valid touch point from the detected candidate touch points according to the contact area corresponding to the candidate touch point.

[0224] In implementation, if the contact area corresponding to the candidate contact point is greater than an area threshold, the candidate contact point is determined to be a valid contact point.

[0225] like Figure 5 As shown, this embodiment also provides a detailed multi-finger interaction detection process, as shown below:

[0226] Step 500: before the candidate touch point moves, obtaining at least one detected candidate touch point;

[0227] Step 501: determining a first touch point from the candidate touch points according to the touch pressure values ​​corresponding to the candidate touch points;

[0228] Step 502: determining a second contact point from the first contact points according to the contact area corresponding to the first contact point;

[0229] Step 503: determining a third touch point from the second touch points according to the moving distance of the second touch point;

[0230] Step 504: a new candidate touch point is detected during the movement of the third touch point, and a valid touch point is determined from the third touch points according to the touch duration of the new candidate touch point and the time interval between responding to the third touch point and detecting the new candidate touch point.

[0231] Step 505: A lost effective contact is detected during the movement of the effective contact, and whether to remove the lost effective contact from the effective contacts is determined according to the movement distance of the remaining effective contacts and the removal time of the lost effective contact.

[0232] Example 2. Based on the same inventive concept, the embodiment of the present invention also provides a multi-finger interaction detection method. Since this method is the method used by the intelligent interactive display device in the embodiment of the present invention, and the principle of solving the problem by this method is similar to that of the intelligent interactive display device, the implementation of this method can refer to the implementation of the intelligent interactive display device, and the repeated parts will not be repeated.

[0233] like Figure 6 As shown, the implementation process of a multi-finger interaction detection method provided in this embodiment is as follows:

[0234] Step 600: Acquire at least one detected candidate touch point, wherein each candidate touch point is generated by a user performing a touch operation on a display screen;

[0235] Step 601: during the movement of the candidate touch point, determining a valid touch point from the detected candidate touch points according to the movement distance of the candidate touch point;

[0236] Step 602: Execute a response corresponding to the movement of the valid contacts according to the number of the valid contacts.

[0237] As an optional implementation manner, the acquiring at least one detected candidate touch point includes:

[0238] According to the total number of candidate touch points detected before any candidate touch point moves, the number of valid touch points is controlled to be lower than or equal to the total number of candidate touch points.

[0239] As an optional implementation manner, determining a valid touch point from the detected candidate touch points according to the moving distance of the candidate touch point includes:

[0240] From the detected candidate touch points, a candidate touch point whose moving distance is greater than a distance threshold is determined as a valid touch point.

[0241] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes:

[0242] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to the movement distance of the effective touch point.

[0243] As an optional implementation manner, determining whether to add the new candidate touch point to the valid touch point according to the moving distance of the valid touch point includes:

[0244] When the moving distance of the effective touch point is less than or equal to a distance threshold, it is determined to add the new candidate touch point to the effective touch points.

[0245] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes:

[0246] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to the movement distance of the new candidate touch point.

[0247] As an optional implementation manner, determining whether to add the new candidate touch point to the valid touch points according to the moving distance of the new candidate touch point includes:

[0248] When the moving distance of the new candidate touch point is greater than the distance threshold, it is determined to add the new candidate touch point to the valid touch points.

[0249] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes:

[0250] During the movement of the effective touch point, a new candidate touch point is detected, and according to the touch duration of the new candidate touch point, it is determined whether to add the new candidate touch point to the effective touch points; wherein the touch duration is used to indicate the duration that the finger generating the candidate touch point touches the display screen.

[0251] As an optional implementation manner, determining whether to add the new candidate touch point to the valid touch points according to the touch duration of the new candidate touch point includes:

[0252] When the touch duration of the new candidate contact point is greater than the time threshold, it is determined to add the new candidate contact point to the valid contact points.

[0253] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes:

[0254] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to a time interval between executing a response corresponding to the movement of the effective touch point and detecting the new candidate touch point.

[0255] As an optional implementation manner, determining whether to add the new candidate touch point to the effective touch point according to a time interval between executing a response corresponding to the movement of the effective touch point and detecting a new candidate touch point includes:

[0256] When the time interval is less than or equal to the interval threshold, it is determined to add the new candidate touch point to the valid touch points.

[0257] As an optional implementation manner, after determining to add the new candidate touch point to the valid touch point, the method further includes:

[0258] According to the number of valid contacts after addition, a response corresponding to the movement of the valid contacts after addition is executed.

[0259] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes:

[0260] A lost effective contact is detected during the movement of the effective contact, and it is determined whether to remove the lost effective contact from the effective contacts according to the movement distance of the remaining effective contacts.

[0261] As an optional implementation manner, determining whether to remove the lost valid contact from the valid contacts according to the moving distance of the remaining valid contacts includes:

[0262] When the moving distance of the remaining valid touch points is greater than a distance threshold, determining to remove the lost valid touch points from the valid touch points; or,

[0263] When the moving distance of the remaining valid contacts is less than or equal to the distance threshold, and a new valid contact is detected after the lost valid contact is detected, it is determined not to remove the lost valid contact from the valid contacts, wherein the number of the detected lost valid contacts and the new valid contacts is the same.

[0264] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes:

[0265] A lost valid contact is detected during the movement of the valid contact, and whether to remove the lost valid contact from the valid contacts is determined based on the removal duration of the lost valid contact; wherein the removal duration represents the duration during which the finger that generated the valid contact is lifted and does not touch the display screen.

[0266] As an optional implementation manner, determining whether to remove the lost valid contact from the valid contacts according to the removal duration of the lost valid contact includes:

[0267] When the removal time is greater than the time threshold, it is determined that the lost valid contact is removed from the valid contacts; or,

[0268] When a new valid contact is detected after the loss of the valid contact is detected, and the time interval between the loss of the valid contact and the detection of the new valid contact is less than or equal to the time threshold, it is determined not to remove the lost valid contact from the valid contacts.

[0269] As an optional implementation manner, after determining to remove the lost valid contacts from the valid contacts, the method further includes:

[0270] According to the number of effective contacts after removal, a response corresponding to the movement of effective contacts after removal is performed.

[0271] As an optional implementation manner, the determining of a valid touch point from the detected candidate touch points further includes:

[0272] According to the touch pressure value corresponding to the candidate touch point, a valid touch point is determined from the detected candidate touch points.

[0273] As an optional implementation manner, the determining of a valid touch point from the detected candidate touch points further includes:

[0274] Determine a valid touch point from the detected candidate touch points according to the contact area corresponding to the candidate touch point.

[0275] Example 3: Based on the same inventive concept, the embodiment of the present invention also provides a multi-finger interaction detection device. The principle of solving the problem by the device is similar to that of the intelligent interactive display device. Therefore, the implementation of the device can refer to the implementation of the intelligent interactive display device, and the repeated parts will not be repeated.

[0276] like Figure 7 As shown, the device comprises:

[0277] A touch point acquisition unit 700 is used to acquire at least one detected candidate touch point, wherein each candidate touch point is generated by a user performing a touch operation on the display screen;

[0278] A touch point determination unit 701 is used to determine a valid touch point from detected candidate touch points according to a moving distance of the candidate touch point during the movement of the candidate touch point;

[0279] The response execution unit 702 is used to execute a response corresponding to the movement of the valid contacts according to the number of the valid contacts.

[0280] As an optional implementation manner, the contact point acquisition unit 700 is specifically used for:

[0281] According to the total number of candidate touch points detected before any candidate touch point moves, the number of valid touch points is controlled to be lower than or equal to the total number of candidate touch points.

[0282] As an optional implementation manner, the determination contact unit 701 is specifically used for:

[0283] From the detected candidate touch points, a candidate touch point whose moving distance is greater than a distance threshold is determined as a valid touch point.

[0284] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes a first judgment unit specifically configured to:

[0285] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to the movement distance of the effective touch point.

[0286] As an optional implementation manner, the first judgment unit is specifically configured to:

[0287] When the moving distance of the effective touch point is less than or equal to a distance threshold, it is determined to add the new candidate touch point to the effective touch points.

[0288] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes a second judgment unit specifically configured to:

[0289] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to the movement distance of the new candidate touch point.

[0290] As an optional implementation manner, the second judgment unit is specifically configured to:

[0291] When the moving distance of the new candidate touch point is greater than the distance threshold, it is determined to add the new candidate touch point to the valid touch points.

[0292] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes a third judgment unit specifically configured to:

[0293] During the movement of the effective touch point, a new candidate touch point is detected, and according to the touch duration of the new candidate touch point, it is determined whether to add the new candidate touch point to the effective touch points; wherein the touch duration is used to indicate the duration that the finger generating the candidate touch point touches the display screen.

[0294] As an optional implementation manner, the third judgment unit is specifically configured to:

[0295] When the touch duration of the new candidate contact point is greater than the time threshold, it is determined to add the new candidate contact point to the valid contact points.

[0296] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes a fourth judgment unit specifically configured to:

[0297] A new candidate touch point is detected during the movement of the effective touch point, and it is determined whether to add the new candidate touch point to the effective touch point according to a time interval between executing a response corresponding to the movement of the effective touch point and detecting the new candidate touch point.

[0298] As an optional implementation manner, the fourth determination unit is specifically configured to:

[0299] When the time interval is less than or equal to the interval threshold, it is determined to add the new candidate touch point to the valid touch points.

[0300] As an optional implementation manner, after determining to add the new candidate touch point to the valid touch point, the method further includes a first execution response unit specifically configured to:

[0301] According to the number of valid contacts after addition, a response corresponding to the movement of the valid contacts after addition is executed.

[0302] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes a fifth judgment unit specifically configured to:

[0303] A lost effective contact is detected during the movement of the effective contact, and it is determined whether to remove the lost effective contact from the effective contacts according to the movement distance of the remaining effective contacts.

[0304] As an optional implementation manner, the fifth judgment unit is specifically configured to:

[0305] When the moving distance of the remaining valid touch points is greater than a distance threshold, determining to remove the lost valid touch points from the valid touch points; or,

[0306] When the moving distance of the remaining valid contacts is less than or equal to the distance threshold, and a new valid contact is detected after the lost valid contact is detected, it is determined not to remove the lost valid contact from the valid contacts, wherein the number of the detected lost valid contacts and the new valid contacts is the same.

[0307] As an optional implementation manner, after determining the valid touch point from the detected candidate touch points, the method further includes a sixth judgment unit specifically configured to:

[0308] A lost valid contact is detected during the movement of the valid contact, and whether to remove the lost valid contact from the valid contacts is determined based on the removal duration of the lost valid contact; wherein the removal duration represents the duration during which the finger that generated the valid contact is lifted and does not touch the display screen.

[0309] As an optional implementation manner, the sixth judgment unit is specifically configured to:

[0310] When the removal time is greater than the time threshold, it is determined that the lost valid contact is removed from the valid contacts; or,

[0311] When a new valid contact is detected after the loss of the valid contact is detected, and the time interval between the loss of the valid contact and the detection of the new valid contact is less than or equal to the time threshold, it is determined not to remove the lost valid contact from the valid contacts.

[0312] As an optional implementation manner, after determining to remove the lost valid contacts from the valid contacts, a second execution response unit is further included to:

[0313] According to the number of effective contacts after removal, a response corresponding to the movement of effective contacts after removal is performed.

[0314] As an optional implementation manner, the determining of the valid touch point from the detected candidate touch points further includes a pressure determination unit specifically configured to:

[0315] According to the touch pressure value corresponding to the candidate touch point, a valid touch point is determined from the detected candidate touch points.

[0316] As an optional implementation manner, the determining of the valid touch point from the detected candidate touch points further includes an area determination unit specifically configured to:

[0317] Determine a valid touch point from the detected candidate touch points according to the contact area corresponding to the candidate touch point.

[0318] Based on the same inventive concept, an embodiment of the present invention further provides a computer storage medium on which a computer program is stored. When the program is executed by a processor, the following steps are implemented:

[0319] Acquire at least one detected candidate touch point, wherein each candidate touch point is generated by a user performing a touch operation on the display screen;

[0320] During the movement of the candidate touch point, determining a valid touch point from the detected candidate touch points according to the movement distance of the candidate touch point;

[0321] According to the number of effective contacts, a response corresponding to the movement of the effective contacts is performed.

[0322] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program code.

[0323] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that has the functions specified in one or more boxes.

[0324] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0325] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0326] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. An intelligent interactive display device, characterized in that: It includes a display screen and a control circuit, wherein: The display screen is used to receive a touch operation from a user; The control circuit includes a processor and a memory, wherein the memory is used to store a program executable by the processor, and the processor is used to read the program in the memory and execute the following steps: Acquire at least one detected candidate touch point, wherein each candidate touch point is generated by a user performing a touch operation on the display screen; During the movement of the candidate touch point, determining a valid touch point from the detected candidate touch points according to the movement distance of the candidate touch point; After determining a valid touch point from the detected candidate touch points, a new candidate touch point is detected during the movement of the valid touch point, and whether to add the new candidate touch point to the valid touch point is determined according to the movement distance of the valid touch point; or, After determining the valid touch point from the detected valid touch points, a new candidate touch point is detected during the movement of the valid touch point, and whether to add the new candidate touch point to the valid touch point is determined according to the movement distance of the new candidate touch point; or, After determining the valid touch point from the detected candidate touch points, a new candidate touch point is detected during the movement of the valid touch point, and whether to add the new candidate touch point to the valid touch points is determined according to the touch duration of the new candidate touch point; wherein the touch duration is used to indicate the duration of time that the finger generating the candidate touch point touches the display screen; or, After determining a valid touch point from the detected candidate touch points, a new candidate touch point is detected during the movement of the valid touch point, and determining whether to add the new candidate touch point to the valid touch point according to a time interval between performing a response corresponding to the movement of the valid touch point and detecting the new candidate touch point; According to the number of effective contacts, a response corresponding to the movement of the effective contacts is performed.

2. The display device according to claim 1, characterized in that The processor is further configured to execute: According to the total number of candidate touch points detected before any candidate touch point moves, the number of valid touch points is controlled to be lower than or equal to the total number of candidate touch points.

3. The display device according to claim 1, characterized in that The processor is specifically configured to execute: From the detected candidate touch points, a candidate touch point whose moving distance is greater than a distance threshold is determined as a valid touch point.

4. The display device according to claim 1, characterized in that The processor is specifically configured to execute: When the moving distance of the effective touch point is less than or equal to the distance threshold, it is determined to add the new candidate touch point to the effective touch points.

5. The display device according to claim 1, characterized in that The processor is specifically configured to execute: When the moving distance of the new candidate touch point is greater than the distance threshold, it is determined to add the new candidate touch point to the valid touch points.

6. The display device according to claim 1, characterized in that The processor is specifically configured to execute: When the touch duration of the new candidate contact point is greater than the time threshold, it is determined to add the new candidate contact point to the valid contact points.

7. The display device according to claim 1, characterized in that The processor is specifically configured to execute: When the time interval is less than or equal to the interval threshold, it is determined to add the new candidate touch point to the valid touch points.

8. The display device according to any one of claims 1 to 7, characterized in that: After determining to add the new candidate touch point to the valid touch point, the processor is further configured to execute: According to the number of added effective contacts, a response corresponding to the movement of the added effective contacts is executed.

9. The display device according to claim 1, characterized in that: After determining the valid touch point from the detected candidate touch points, the processor is further configured to execute: A lost effective contact is detected during the movement of the effective contact, and it is determined whether to remove the lost effective contact from the effective contacts according to the movement distance of the remaining effective contacts.

10. The display device according to claim 9, characterized in that The processor is specifically configured to execute: When the moving distance of the remaining valid touch points is greater than a distance threshold, determining to remove the lost valid touch points from the valid touch points; or, When the moving distance of the remaining valid contacts is less than or equal to the distance threshold, and a new valid contact is detected after the lost valid contact is detected, it is determined not to remove the lost valid contact from the valid contacts, wherein the number of the detected lost valid contacts and the new valid contacts is the same.

11. The display device according to claim 1, characterized in that After determining the valid touch point from the detected candidate touch points, the processor is further configured to execute: Detecting a lost effective contact during the movement of the effective contact, and determining whether to remove the lost effective contact from the effective contacts according to the removal time of the lost effective contact; The removal duration indicates the duration during which the finger generating the effective contact point is lifted up and does not touch the display screen.

12. The display device according to claim 11, characterized in that The processor is specifically configured to execute: When the removal time is greater than the time threshold, it is determined that the lost valid contact is removed from the valid contacts; or, When a new valid contact is detected after the loss of the valid contact is detected, and the time interval between the loss of the valid contact and the detection of the new valid contact is less than or equal to the time threshold, it is determined not to remove the lost valid contact from the valid contacts.

13. The display device according to any one of claims 9 to 12, characterized in that: When it is determined that the lost valid contacts are removed from the valid contacts, the processor is further configured to execute: According to the number of effective contacts after removal, a response corresponding to the movement of effective contacts after removal is performed.

14. The display device according to claim 1, characterized in that The determining of a valid touch point from the detected candidate touch points, the processor is further configured to execute: According to the touch pressure value corresponding to the candidate touch point, a valid touch point is determined from the detected candidate touch points.

15. The display device according to claim 1, characterized in that The determining of a valid touch point from the detected candidate touch points, the processor is further configured to execute: Determine a valid touch point from the detected candidate touch points according to the contact area corresponding to the candidate touch point.

16. A multi-finger interaction detection method, characterized in that: The method includes: Acquire at least one detected candidate touch point, wherein each candidate touch point is generated by a user performing a touch operation on the display screen; During the movement of the candidate touch point, determining a valid touch point from the detected candidate touch points according to the movement distance of the candidate touch point; After determining a valid touch point from the detected candidate touch points, a new candidate touch point is detected during the movement of the valid touch point, and whether to add the new candidate touch point to the valid touch point is determined according to the movement distance of the valid touch point; or, After determining the valid touch point from the detected valid touch points, a new candidate touch point is detected during the movement of the valid touch point, and whether to add the new candidate touch point to the valid touch point is determined according to the movement distance of the new candidate touch point; or, After determining the valid touch point from the detected candidate touch points, a new candidate touch point is detected during the movement of the valid touch point, and whether to add the new candidate touch point to the valid touch points is determined according to the touch duration of the new candidate touch point; wherein the touch duration is used to indicate the duration of time that the finger generating the candidate touch point touches the display screen; or, After determining a valid touch point from the detected candidate touch points, a new candidate touch point is detected during the movement of the valid touch point, and determining whether to add the new candidate touch point to the valid touch point according to a time interval between performing a response corresponding to the movement of the valid touch point and detecting the new candidate touch point; According to the number of effective contacts, a response corresponding to the movement of the effective contacts is performed.

17. The method according to claim 16, characterized in that Also includes: According to the total number of candidate touch points detected before any candidate touch point moves, the number of valid touch points is controlled to be lower than or equal to the total number of candidate touch points.

18. The method according to claim 16, characterized in that The determining of a valid touch point from the detected candidate touch points according to the moving distance of the candidate touch point comprises: From the detected candidate touch points, a candidate touch point whose moving distance is greater than a distance threshold is determined as a valid touch point.

19. The method according to claim 16, characterized in that The determining, according to the moving distance of the effective touch point, whether to add the new candidate touch point to the effective touch point comprises: When the moving distance of the effective touch point is less than or equal to the distance threshold, it is determined to add the new candidate touch point to the effective touch points.

20. The method according to claim 16, characterized in that The step of determining whether to add the new candidate touch point to the valid touch points according to the moving distance of the new candidate touch point comprises: When the moving distance of the new candidate touch point is greater than the distance threshold, it is determined to add the new candidate touch point to the valid touch points.

21. The method according to claim 16, characterized in that The determining, according to the touch duration of the new candidate contact point, whether to add the new candidate contact point to the valid contact points includes: When the touch duration of the new candidate contact point is greater than the time threshold, it is determined to add the new candidate contact point to the valid contact points.

22. The method according to claim 16, characterized in that The determining whether to add the new candidate touch point to the effective touch point according to the time interval between executing the response corresponding to the movement of the effective touch point and detecting the new candidate touch point comprises: When the time interval is less than or equal to the interval threshold, it is determined to add the new candidate touch point to the valid touch points.

23. The method according to any one of claims 16 to 22, characterized in that: After determining to add the new candidate touch point to the valid touch point, the method further includes: According to the number of added effective contacts, a response corresponding to the movement of the added effective contacts is executed.

24. The method according to claim 16, characterized in that After determining the valid touch point from the detected candidate touch points, the method further includes: A lost effective contact is detected during the movement of the effective contact, and it is determined whether to remove the lost effective contact from the effective contacts according to the movement distance of the remaining effective contacts.

25. The method according to claim 24, characterized in that The determining whether to remove the lost valid contacts from the valid contacts according to the moving distances of the remaining valid contacts comprises: When the moving distance of the remaining valid touch points is greater than a distance threshold, determining to remove the lost valid touch points from the valid touch points; or, When the moving distance of the remaining valid contacts is less than or equal to the distance threshold, and a new valid contact is detected after the lost valid contact is detected, it is determined not to remove the lost valid contact from the valid contacts, wherein the number of the detected lost valid contacts and the new valid contacts is the same.

26. The method according to claim 16, characterized in that After determining the valid touch point from the detected candidate touch points, the method further includes: A lost valid contact is detected during the movement of the valid contact, and whether to remove the lost valid contact from the valid contacts is determined based on the removal duration of the lost valid contact; wherein the removal duration represents the duration during which the finger that generated the valid contact is lifted and does not touch the display screen.

27. The method according to claim 26, characterized in that The determining whether to remove the lost valid contact from the valid contacts according to the removal duration of the lost valid contact includes: When the removal time is greater than the time threshold, it is determined that the lost valid contact is removed from the valid contacts; or, When a new valid contact is detected after the loss of the valid contact is detected, and the time interval between the loss of the valid contact and the detection of the new valid contact is less than or equal to the time threshold, it is determined not to remove the lost valid contact from the valid contacts.

28. The method according to any one of claims 24 to 27, characterized in that: After it is determined that the lost valid contacts are removed from the valid contacts, the method further includes: According to the number of effective contacts after removal, a response corresponding to the movement of effective contacts after removal is performed.

29. The method according to claim 16, characterized in that The determining of a valid touch point from the detected candidate touch points further includes: According to the touch pressure value corresponding to the candidate touch point, a valid touch point is determined from the detected candidate touch points.

30. The method according to claim 16, characterized in that The determining of a valid touch point from the detected candidate touch points further includes: Determine a valid touch point from the detected candidate touch points according to the contact area corresponding to the candidate touch point.

31. A computer storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 16 to 30 are implemented.

Images