Infrared multi-point touch screen system operating in multiple modes

Abstract

The invention discloses an infrared multi-point touch screen system running in multiple modes, relates to the technical field of touch screen systems, and solves the technical problems that reasonable analysis cannot be carried out based on a use mode of a user, errors exist in touch mode recognition of the user, and the use experience feeling is reduced. According to the method, the operation mode of the user is recognized, the touch area in the single-point touch mode is finely analyzed, touch information can be more accurately obtained through a series of operations, then more accurate calibration is carried out, in the multi-point mode, calibration is carried out by analyzing the coincidence degree of the multi-contact operation track and the standard track, and the accuracy of calibration is improved. By adopting calculation methods such as a vector sequence and included angle cosine similarity and combining with analysis and screening of touch point distances, the most matched standard track can be more accurately found for calibration, the recognition and response capability of a system to complex multi-contact operation is improved, the touch accuracy is improved, and misoperation is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of touch screen systems, in particular to a multi-mode infrared multi-point touch screen system. Background Art

[0002] With the continuous development of touch screen technology, infrared multi-point touch screen systems have been widely used in many fields, such as electronic equipment, commercial displays, industrial control, etc.

[0003] According to the publication number CN104423718B, a multi-mode infrared multi-point touch screen system is disclosed, which includes an infrared touch screen with a driver-free function; a touch screen management software is also running in the computer, and a special touch screen driver software is provided in the touch screen management software, and the special touch screen driver software matches the infrared touch screen; the touch screen management software is provided with a drive switch, and the drive function switch of the special touch screen driver software is controlled by the drive switch; when the drive function switch is turned on, the special touch screen driver software drives the infrared touch screen; when the drive function switch is turned off, the special touch screen driver software does not drive the infrared touch screen, thereby putting the infrared touch screen in the driver-free function mode.

[0004] However, some existing touch screen systems cannot perform reasonable analysis based on the user's usage mode when in use, and there are errors in identifying the user's touch mode, which causes a poor user experience. Summary of the invention

[0005] In view of the deficiencies in the prior art, the present invention provides an infrared multi-point touch screen system operating in multiple modes, which solves the problem that reasonable analysis cannot be performed based on the user's usage mode, errors exist in identifying the user's touch mode, and the user experience is reduced.

[0006] To achieve the above objectives, the present invention is implemented through the following technical solutions: a multi-mode infrared multi-point touch screen system, comprising:

[0007] An information acquisition unit, used to transmit the acquired basic information of the touch system to the touch pattern analysis unit, wherein the basic information includes the user's usage mode;

[0008] A touch pattern analysis unit, used to analyze the acquired basic information, generate different pattern results based on different usage modes, and transmit the single-point touch pattern results in the pattern results to the single-point pattern analysis unit, and transmit the multi-point touch pattern results in the pattern results to the multi-point pattern analysis unit;

[0009] A single-point mode analysis unit is used to analyze the acquired single-point touch mode results, and identify the touch area based on the occlusion position of the infrared matrix to obtain the intersection area and the non-intersection area, and at the same time perform calibration analysis on the intersection area to obtain calibration information;

[0010] A multi-point pattern analysis unit, used to analyze the acquired multi-touch pattern results, obtain recognition results by identifying and judging the touch tracks of the user's multi-touch operation, analyze the unrecognizable results in the recognition results, filter the standard information by analyzing the overlap of the touch tracks, generate calibration information, and transmit the calibration information to the calibration information output unit;

[0011] The calibration information output unit is used to display the calibration information to the corresponding operator.

[0012] As a further solution of the present invention: the specific method of generating the pattern result by the touch pattern analysis unit is:

[0013] The basic information is obtained, and at the same time, the user's usage mode in the basic information is obtained. If the user's usage mode is a single-point mode, a single-point touch mode result is generated. If the user's usage mode is a multi-point mode, a multi-point touch mode result is generated.

[0014] As a further solution of the present invention: the specific manner in which the single-point pattern analysis unit analyzes the single-point touch pattern result is:

[0015] Obtain the infrared matrix of the touch screen and the touch point of the user, and then identify the occlusion position of the infrared matrix according to the touch point to obtain the intersection area and the non-intersection area;

[0016] The intersection area is obtained and labeled as i, where i=1, 2, ..., j, where j represents the number of intersection areas. At the same time, the occlusion area corresponding to the intersection area i is obtained and recorded as Si, and is sorted from large to small according to the occlusion area Si. Then, the user's touch point information is obtained, and the intersection area is classified according to the touch point information to obtain the first touch information and the second touch information. The area corresponding to the first touch information and the second touch information is obtained, and then the area size of the first touch information and the second touch information is compared, and the touch information corresponding to the largest area is selected as the standard to generate standard information, and the standard information is calibrated and analyzed.

[0017] As a further solution of the present invention: the specific method of the single-point mode analysis unit to calibrate and analyze the standard information is:

[0018] Obtain the information input by the user, then calculate the correlation value between the standard information and the input information, and compare the calculated correlation value with the preset value. If the correlation value is less than the preset value, it means that there is a deviation in the standard information, and a calibration signal is generated. On the contrary, if the correlation value is greater than the preset value, it means that there is no deviation in the standard information, and calibration information is generated based on the standard information;

[0019] For the generated calibration signal, the correlation value between the remaining touch information and the input information is calculated, and the correlation value is compared with the preset value. If the correlation value is greater than the preset value, the calibration information is generated based on the remaining touch information. Conversely, if the correlation value is less than the preset value, the correlation value between the remaining touch information and the standard information is compared, and the touch information with the largest correlation value is selected as the standard to generate the calibration information.

[0020] As a further solution of the present invention: the specific manner in which the multi-point pattern analysis unit analyzes the multi-touch pattern result is:

[0021] The multi-touch operation corresponding to the multi-touch touch mode is obtained, and the running trajectory of the multi-touch operation is identified and obtained, and recorded as the touch trajectory. Then, the touch trajectory is identified and judged, and a recognition result and an unrecognizable result are generated. For the recognition result, a corresponding recognition instruction is generated, and for the unrecognizable result, a calibration analysis signal is generated, and the calibration analysis signal is processed at the same time.

[0022] As a further solution of the present invention: the specific manner in which the multi-point mode analysis unit processes the calibration analysis signal is:

[0023] Acquire the touch track, and use the touch track as a standard to filter the standard track of the system to obtain a pre-selected track, which is recorded as n, and n=1, 2, ..., m, where m represents the number of pre-selected tracks, and then calculate the cosine similarity of the angle between the touch track and the pre-selected track n;

[0024] The touch track is recorded as A, and any pre-selected track is recorded as B. At the same time, the track points corresponding to the touch track A and the pre-selected track B at the same time are recorded as (X A1 , Y A1 )、(X A2 , Y A2 )、(X A3 , Y A3 ) and (X B1 , Y B1 )、(X B2 , Y B2 )、(X B3 , Y B3 ), and construct the vector sequence corresponding to the touch track A and the pre-selected track B. Similarly, the vector sequence of touch track A and pre-selected track B is calculated. and Where O and P represent the track points of the touch track A and the pre-selected track B respectively;

[0025] Substitute the calculated vector sequence into the formula to calculate the angle cosine similarity Then the calculated angle cosine similarity is compared with the threshold to obtain the trajectory to be analyzed.

[0026] As a further solution of the present invention: the specific method of the multi-point mode analysis unit to obtain the trajectory to be analyzed is:

[0027] If the angle cosine similarity is greater than the threshold, it means that the touch track A and the pre-selected track B are partially similar. If the angle cosine similarity is less than the threshold, it means that the touch track A and the pre-selected track B are not similar.

[0028] By analogy, the pre-selected trajectories n are screened to obtain the trajectories to be analyzed and recorded as a, and a=1, 2, ..., b, where b represents the number of trajectories to be analyzed.

[0029] As a further solution of the present invention: the specific method of the multi-point mode analysis unit generating calibration information is:

[0030] The touch point distribution of the touch trajectory is obtained, and the distance between the touch trajectory and the touch point corresponding to the trajectory to be analyzed is calculated, and the average distance is calculated. Then, the average distance is compared with a preset distance value, and the specific value of the preset distance value is set by the operator. At the same time, the trajectory to be analyzed whose average distance is less than the preset distance value is screened and recorded as the screened trajectory, and then the screened trajectory corresponding to the maximum cosine value of the angle is selected as the standard trajectory, and calibration information is generated, and then the calibration information is transmitted to the calibration information output unit.

[0031] The present invention provides a multi-mode infrared multi-point touch screen system. Compared with the prior art, it has the following beneficial effects:

[0032] The present invention identifies the user's operation mode and conducts a detailed analysis of the touch area in the single-point touch mode. Through a series of operations, it is possible to more accurately obtain touch information and then perform more precise calibration. In the multi-point mode, calibration is performed by analyzing the overlap between the multi-touch operation trajectory and the standard trajectory. Calculation methods such as vector sequence and angle cosine similarity are used, combined with analysis and screening of touch point distances, to more accurately find the most matching standard trajectory for calibration, thereby improving the system's recognition and response capabilities for complex multi-touch operations, helping to improve touch accuracy and reduce misoperations. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 This is a block diagram of the system principle of the present invention;

[0034] Figure 2 This is a schematic diagram of infrared matrix segmentation of the present invention. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0036] For example, see Figure 1 and Figure 2 The present application provides a multi-mode infrared multi-point touch screen system, including an information acquisition unit, a touch mode analysis unit, a single-point mode analysis unit, a multi-point mode analysis unit and a calibration information output unit, and at the same time, in combination with the attached Figure 1 It can be known that the above functional units are electrically connected in a unidirectional manner.

[0037] The information acquisition unit is used to acquire basic information of the touch system and transmit the acquired basic information to the touch pattern analysis unit, wherein the basic information includes the user's usage mode.

[0038] A touch pattern analysis unit is used to analyze the acquired basic information and generate different pattern results based on different usage modes, wherein the pattern results include single-point touch pattern results and multi-point touch pattern results.

[0039] Obtain basic information and the user's usage mode in the basic information. If the user's usage mode is single-point mode, generate a single-point touch mode result and transmit the single-point touch mode result to the single-point mode analysis unit. If the user's usage mode is multi-point mode, generate a multi-point touch mode result and transmit the multi-point touch mode result to the multi-point mode analysis unit.

[0040] If the system finds that the user's operations over a period of time are mainly single-finger clicks, and only one touch point is generated each time, then the user's usage mode is determined to be single-point mode. At this time, the system generates single-point touch mode results according to the established process. This result may include information such as the frequency of single-point touches and the location distribution of clicks. If the system detects that the user often operates two or more touch points at the same time during the operation, such as pinch-to-zoom, multi-finger sliding, etc., the user's usage mode is determined to be multi-point mode. Subsequently, the system generates multi-point touch mode results, which may include information such as the type of multi-point touch gestures and the change in distance between touch points.

[0041] The single-point pattern analysis unit is used to analyze the acquired single-point touch pattern results, and to identify the touch area based on the occlusion position of the infrared matrix to obtain the intersection area and the non-intersection area, and to perform calibration analysis on the intersection area to obtain calibration information.

[0042] The obtained single-point touch mode results are analyzed, and the infrared matrix of the touch screen and the user's touch point are obtained at the same time. Then, the occlusion position of the infrared matrix is ​​identified according to the touch point to obtain the intersection area and the non-intersection area. The intersection area here means that the position of the touch point is located in multiple areas, and the non-intersection area means that the touch point exists in only one area, as shown in the attached figure. Figure 2 As shown, Figure 2 The left side represents the intersection area, and the right side represents the non-intersection area. The obtained intersection area is not processed, and the obtained non-intersection area is analyzed.

[0043] Obtain the intersection area and label the intersection area as i, and i=1, 2, ..., j, where j represents the number of the intersection area, and the intersection area is labeled clockwise from left to right, and at the same time, the occlusion area corresponding to the intersection area i is obtained and recorded as Si, and the occlusion area is directly obtained through image recognition and machine vision technology, and is sorted from large to small according to the occlusion area Si, then the user's touch point information is obtained, and the intersection area is classified according to the touch point information to obtain the first touch information and the second touch information, and the touch point information here is represented as the actual information corresponding to the infrared matrix, such as the corresponding letter or APP, and the area corresponding to the first touch information and the second touch information is obtained, and the area here may be a combination of one intersection area or multiple intersection areas, then compare the area sizes of the first touch information and the second touch information, and select the touch information corresponding to the largest area as the standard to generate standard information, and calibrate and analyze the standard information;

[0044] The information input by the user is obtained, and then the correlation value between the standard information and the input information is calculated, and the calculated correlation value is compared with a preset value, and the specific value of the preset value is set by the operator. If the correlation value is less than the preset value, it means that there is a deviation in the standard information, and a calibration signal is generated at the same time. Conversely, if the correlation value is greater than the preset value, it means that there is no deviation in the standard information, and the calibration information is generated based on the standard information; and the method of calculating the correlation value here is by calculating the cosine similarity between the standard information and the input information.

[0045] For the generated calibration signal, the correlation value between the remaining touch information and the input information is calculated, and the remaining touch information here represents the touch information remaining after removing the standard information. For example, in the above analysis process, the second touch information is recorded as the standard information, and the first touch information is the remaining touch information. At the same time, the correlation value is compared with the preset value. If the correlation value is greater than the preset value, the calibration information is generated based on the remaining touch information. Conversely, if the correlation value is less than the preset value, the correlation value of the remaining touch information and the standard information is compared, and the touch information with the largest correlation value is selected as the standard to generate the calibration information.

[0046] The generated calibration information is then transmitted to a calibration information output unit.

[0047] A calibration information output unit is used to display the calibration information to the corresponding operator.

[0048] Embodiment 2, as Embodiment 2 of the present invention, this embodiment is implemented on the basis of Embodiment 1, and the difference from Embodiment 1 is as follows:

[0049] A multi-point mode analysis unit is used to analyze the acquired multi-touch touch mode results, obtain the recognition results by identifying and judging the touch trajectory of the user's multi-touch operation, analyze the unrecognizable results in the recognition results, filter the standard information by analyzing the overlap between the running trajectory and the standard trajectory, generate calibration information, and transmit the calibration information to the calibration information output unit.

[0050] Acquire the multi-touch operation corresponding to the multi-touch touch mode, and identify and acquire the running track of the multi-touch operation, and record it as the touch track, then identify and judge the touch track, and the identification and judgment here specifically indicates whether the system can identify the touch track to obtain a specific instruction operation, generate an identification result and an unidentifiable result, generate a corresponding identification instruction for the identification result, and generate a calibration analysis signal for the unidentifiable result;

[0051] The generated calibration analysis signal is processed to obtain the touch trajectory. At the same time, the standard trajectory of the system is screened based on the touch trajectory to obtain the pre-selected trajectory. The standard trajectory in the system here is represented by the command trajectory stored in the system. The specific screening method is to match the system and select the standard trajectory with overlapping running trajectories. The overlap here is represented by all overlapping or partially overlapping trajectories, and is recorded as n, and n=1, 2, ..., m, where m represents the number of pre-selected trajectories. Then, the overlap between the touch trajectory and the pre-selected trajectory n is calculated, and the overlap here is represented by the angle cosine similarity. The specific calculation method is as follows:

[0052] The touch track is recorded as A, and any pre-selected track is recorded as B. At the same time, the track points corresponding to the touch track A and the pre-selected track B at the same time are recorded as (X A1 , Y A1 )、(X A2 , Y A2 )、(X A3 , Y A3 ) and (X B1 , Y B1 )、(X B2 , Y B2 )、(X B3 , Y B3 ), and construct the vector sequence corresponding to the touch track A and the pre-selected track B. Similarly, the vector sequence of touch track A and pre-selected track B is calculated. and Where O and P represent the track points of the touch track A and the pre-selected track B respectively;

[0053] Substitute the calculated vector sequence into the formula to calculate the angle cosine similarity Then, the calculated angle cosine similarity is compared with a threshold value, and the specific value of the threshold value is set by the operator. If the angle cosine similarity is greater than the threshold value, it means that the touch track A and the pre-selected track B are partially similar. If the angle cosine similarity is less than the threshold value, it means that the touch track A and the pre-selected track B are not similar.

[0054] Similarly, the pre-selected trajectories n are screened to obtain the trajectories to be analyzed and recorded as a, and a=1, 2, ..., b, where b represents the number of trajectories to be analyzed;

[0055] Then, the distribution of touch points of the touch trajectory is obtained, and the distance between the touch trajectory and the touch points corresponding to the trajectory to be analyzed is calculated. The calculation of the touch point distance here is expressed as performing separate distance calculations on the touch points on the touch trajectory in sequence with the touch points of the trajectory to be analyzed. For example, if the touch trajectory has three touch points, the distances of the three touch points and the corresponding three touch points on the trajectory to be analyzed are further calculated. Here, correspondence means that the order of the touch points is the same, and the average distance is calculated. Then, the average distance is compared with a preset distance value, and the specific value of the preset distance value is set by the operator. At the same time, the trajectory to be analyzed whose average distance is less than the preset distance value is screened and recorded as a screened trajectory. Then, the screened trajectory corresponding to the maximum cosine value of the angle is selected as the standard trajectory, and calibration information is generated. Then, the calibration information is transmitted to the calibration information output unit.

[0056] A calibration information output unit is used to display the acquired calibration information to the corresponding operator.

[0057] Embodiment 3, as the embodiment 3 of the present invention, focuses on combining the implementation processes of embodiment 1 and embodiment 2 for implementation.

[0058] Some of the data in the above formulas are numerically calculated by removing their dimensions. Meanwhile, the contents not described in detail in this specification belong to the prior art known to those skilled in the art.

[0059] The above embodiments are only used to illustrate the technical method of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical method of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical method of the present invention.

Claims

1. A multi-mode infrared multi-point touch screen system, characterized in that: include: An information acquisition unit, used to transmit the acquired basic information of the touch system to the touch pattern analysis unit, wherein the basic information includes the user's usage mode; A touch pattern analysis unit, used to analyze the acquired basic information, generate different pattern results based on different usage modes, and transmit the single-point touch pattern results in the pattern results to the single-point pattern analysis unit, and transmit the multi-point touch pattern results in the pattern results to the multi-point pattern analysis unit; A single-point mode analysis unit is used to analyze the acquired single-point touch mode results, and identify the touch area based on the occlusion position of the infrared matrix to obtain the intersection area and the non-intersection area, and at the same time perform calibration analysis on the intersection area to obtain calibration information; A multi-point pattern analysis unit, used to analyze the acquired multi-touch pattern results, obtain recognition results by identifying and judging the touch tracks of the user's multi-touch operation, analyze the unrecognizable results in the recognition results, filter the standard information by analyzing the overlap of the touch tracks, generate calibration information, and transmit the calibration information to the calibration information output unit; The calibration information output unit is used to display the calibration information to the corresponding operator.

2. The multi-mode infrared multi-point touch screen system according to claim 1, characterized in that: The specific method of generating the pattern result by the touch pattern analysis unit is as follows: The basic information is obtained, and at the same time, the user's usage mode in the basic information is obtained. If the user's usage mode is a single-point mode, a single-point touch mode result is generated. If the user's usage mode is a multi-point mode, a multi-point touch mode result is generated.

3. The multi-mode infrared multi-point touch screen system according to claim 1, characterized in that: The specific method of analyzing the single-point touch pattern result by the single-point pattern analysis unit is as follows: Obtain the infrared matrix of the touch screen and the touch point of the user, and then identify the occlusion position of the infrared matrix according to the touch point to obtain the intersection area and the non-intersection area; The intersection area is obtained and labeled as i, where i=1, 2, ..., j, where j represents the number of intersection areas. At the same time, the occlusion area corresponding to the intersection area i is obtained and recorded as Si, and is sorted from large to small according to the occlusion area Si. Then, the user's touch point information is obtained, and the intersection area is classified according to the touch point information to obtain the first touch information and the second touch information. The area corresponding to the first touch information and the second touch information is obtained, and then the area size of the first touch information and the second touch information is compared, and the touch information corresponding to the largest area is selected as the standard to generate standard information, and the standard information is calibrated and analyzed.

4. The multi-mode infrared multi-point touch screen system according to claim 3, characterized in that: The specific method of the single-point mode analysis unit to calibrate and analyze the standard information is as follows: Obtain the information input by the user, then calculate the correlation value between the standard information and the input information, and compare the calculated correlation value with the preset value. If the correlation value is less than the preset value, it means that there is a deviation in the standard information, and a calibration signal is generated. On the contrary, if the correlation value is greater than the preset value, it means that there is no deviation in the standard information, and calibration information is generated based on the standard information; For the generated calibration signal, the correlation value between the remaining touch information and the input information is calculated, and the correlation value is compared with the preset value. If the correlation value is greater than the preset value, the calibration information is generated based on the remaining touch information. Conversely, if the correlation value is less than the preset value, the correlation value between the remaining touch information and the standard information is compared, and the touch information with the largest correlation value is selected as the standard to generate the calibration information.

5. The multi-mode infrared multi-point touch screen system according to claim 1, characterized in that: The specific method in which the multi-point pattern analysis unit analyzes the multi-touch pattern result is: The multi-touch operation corresponding to the multi-touch touch mode is obtained, and the running trajectory of the multi-touch operation is identified and obtained, and recorded as the touch trajectory. Then, the touch trajectory is identified and judged, and a recognition result and an unrecognizable result are generated. For the recognition result, a corresponding recognition instruction is generated, and for the unrecognizable result, a calibration analysis signal is generated, and the calibration analysis signal is processed at the same time.

6. The multi-mode infrared multi-point touch screen system according to claim 5, characterized in that: The specific way in which the multi-point mode analysis unit processes the calibration analysis signal is as follows: Acquire the touch track, and use the touch track as a standard to filter the standard track of the system to obtain a pre-selected track, which is recorded as n, and n=1, 2, ..., m, where m represents the number of pre-selected tracks, and then calculate the cosine similarity of the angle between the touch track and the pre-selected track n; The touch track is recorded as A, and any pre-selected track is recorded as B. At the same time, the track points corresponding to the touch track A and the pre-selected track B at the same time are recorded as (X A1 , Y A1 )、(X A2 , Y A2 )、(X A3 , Y A3 ) and (X B1 , Y B1 )、(X B2 , Y B2 )、(X B3 , Y B3 ), and construct the vector sequence corresponding to the touch track A and the pre-selected track B. Similarly, the vector sequence of touch track A and pre-selected track B is calculated. and Where O and P represent the track points of the touch track A and the pre-selected track B respectively; Substitute the calculated vector sequence into the formula to calculate the angle cosine similarity Then the calculated angle cosine similarity is compared with the threshold to obtain the trajectory to be analyzed.

7. The multi-mode infrared multi-point touch screen system according to claim 6, characterized in that: The specific method for the multi-point mode analysis unit to obtain the trajectory to be analyzed is: If the angle cosine similarity is greater than the threshold, it means that the touch track A and the pre-selected track B are partially similar. If the angle cosine similarity is less than the threshold, it means that the touch track A and the pre-selected track B are not similar. By analogy, the pre-selected trajectories n are screened to obtain the trajectories to be analyzed and recorded as a, and a=1, 2, ..., b, where b represents the number of trajectories to be analyzed.

8. The multi-mode infrared multi-point touch screen system according to claim 1, characterized in that: The specific method of generating calibration information by the multi-point mode analysis unit is: The touch point distribution of the touch trajectory is obtained, and the distance between the touch trajectory and the touch point corresponding to the trajectory to be analyzed is calculated, and the average distance is calculated. Then, the average distance is compared with a preset distance value, and the specific value of the preset distance value is set by the operator. At the same time, the trajectory to be analyzed whose average distance is less than the preset distance value is screened and recorded as the screened trajectory, and then the screened trajectory corresponding to the maximum cosine value of the angle is selected as the standard trajectory, and calibration information is generated, and then the calibration information is transmitted to the calibration information output unit.

Images