Display device, touch display method, storage medium, and program product
Patent Information
- Application Number
- CN202410702825.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-31
- Publication Date
- 2026-09-29
- Estimated Expiration
- 2044-05-31
AI Technical Summary
[0005]本申请实施例提供一种显示设备、触摸显示方法、存储介质及程序产品,可用以解决相关技术中,用户在进行书写操作时,出现的书写连笔、落笔过快和抬笔迟钝等,导致用户书写体验较差的问题
[0019]本申请提供一种显示设备、触摸显示方法、存储介质及程序产品。该显示设备包括显示屏、触摸屏和处理器。其中,处理器可以基于触摸信息确定触摸区域,并根据触摸区域确定真实触摸点。获取历史触摸点,基于历史触摸点确定真实触摸点对应的书写过程,其中,书写包括落笔过程和抬笔过程。确定书写过程后,可基于书写过程确定真实触摸点是否为触摸到显示屏上产生的触摸点。若是,则标记真实触摸点所在轨迹输出,若否,则标记真实触摸点所在轨迹为不输出。由于本申请在落笔过程中,对未触摸到显示屏上产生的触摸点进行抑制不输出,因此有效避免了落笔过程由于未触摸到显示屏则显示对应笔迹的落笔过快问题。同理,本申请在抬笔过程中,也对未触摸到显示屏上而产生的触摸点进行抑制不输出,有效避免了抬笔过程中,触控笔或用户手指等离开显示屏仍显示笔迹的抬笔迟钝问题,同时,由于落笔和抬笔过程均不输出未触摸到显示屏产生的触摸点,也有效避免了书写连笔问题,从而有效提升了用户书写体验。
Smart Images

Figure CN121050598B_ABST
Abstract
Description
Technical Field
[0001] This application relates to touch technology. More specifically, it relates to a display device, a touch display method, a storage medium, and a program product. Background Technology
[0002] A touchscreen is an electronic system that detects the presence and location of touches within a display area, simplifying human-computer interaction. Among current touch technologies, infrared touch technology has advantages such as strong environmental adaptability, long lifespan, and the ability to recognize a greater number of touch points, leading to its widespread application. An infrared touchscreen consists of infrared emitting elements and infrared receiving elements, which together form an infrared detection light grid on the display surface. Fingers or styluses perform touch operations by blocking the infrared rays in the detection light grid.
[0003] In some related technologies, when displaying handwriting based on an infrared touchscreen, the touch area can be determined according to the changes in the touchscreen signal, and then the information of the touch point can be calculated based on the touch area to display the handwriting.
[0004] However, because the infrared detection light grid is at a certain height from the display screen surface, when the user is writing, if the finger or stylus does not completely fall into or completely leave the display screen surface, it will also block part of the infrared light, thus creating a corresponding touch point. This leads to problems such as continuous writing, writing too fast, and slow pen lifting, resulting in a poor writing experience for the user. Summary of the Invention
[0005] This application provides a display device, a touch display method, a storage medium, and a program product, which can be used to solve the problems in the related art, such as writing in a continuous manner, writing too fast, and lifting the pen too slowly, which lead to a poor writing experience for users.
[0006] In a first aspect, embodiments of this application provide a display device, the display device comprising:
[0007] A display screen is used to show the drawing strokes;
[0008] The touchscreen includes an infrared emitting element and an infrared receiving element, used to respond to touch operations, acquire touch information, and send the touch information to a processor;
[0009] A processor connected to the display screen and the touch screen is configured to:
[0010] The touch area is determined based on the touch information, and the actual touch point is determined based on the touch area;
[0011] Acquire historical touch points, and determine the writing process corresponding to the actual touch point based on the historical touch points. The writing process includes the pen-putting process and the pen-lifting process.
[0012] Based on the writing process, determine whether the actual touch point is a touch point generated by touching the display screen. If yes, mark the trajectory where the actual touch point is located and output it; if no, mark the trajectory where the actual touch point is located and do not output it.
[0013] Secondly, embodiments of this application provide a touch display method, the method comprising:
[0014] Receive touch information, determine the touch area based on the touch information, and determine the actual touch point based on the touch area;
[0015] Acquire historical touch points, and determine the writing process corresponding to the actual touch point based on the historical touch points. The writing process includes the pen-putting process and the pen-lifting process.
[0016] Determine whether the actual touch point is a touch point generated by touching the display screen. If yes, mark the trajectory of the actual touch point and output it; if no, mark the trajectory of the actual touch point and do not output it.
[0017] Thirdly, embodiments of this application provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the method described in the second aspect.
[0018] Fourthly, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the method described in the second aspect.
[0019] This application provides a display device, a touch display method, a storage medium, and a program product. The display device includes a display screen, a touch screen, and a processor. The processor can determine a touch area based on touch information and determine the actual touch point based on the touch area. Historical touch points are acquired, and the writing process corresponding to the actual touch point is determined based on the historical touch points. Writing includes a pen-starting process and a pen-removing process. After determining the writing process, it can be determined whether the actual touch point is a touch point generated by touching the display screen. If so, the trajectory of the actual touch point is marked and output; otherwise, the trajectory of the actual touch point is marked and not output. Because this application suppresses the output of touch points generated without touching the display screen during the pen-starting process, it effectively avoids the problem of displaying the corresponding handwriting too quickly when the pen-starting process does not touch the display screen. Similarly, this application also suppresses and does not output touch points generated when the pen is not touched on the display screen during the pen lifting process, effectively avoiding the problem of sluggish pen lifting when the stylus or user's finger leaves the display screen. At the same time, since no touch points generated when the pen is not touched on the display screen are output during the pen putting down and lifting process, the problem of continuous writing is also effectively avoided, thereby effectively improving the user's writing experience. Attached Figure Description
[0020] To more clearly illustrate the implementation methods in the embodiments of this application or related technologies, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings.
[0021] Figure 1 A schematic diagram of the external structure of an infrared touchscreen;
[0022] Figure 2 This is a schematic diagram illustrating the positional relationship between a display screen and an infrared touchscreen.
[0023] Figure 3 This is a schematic diagram of a scanning direction corresponding to the long side in a 1-to-2 scenario.
[0024] Figure 4 This is a schematic diagram of the other scanning direction corresponding to the longer side in a 1-to-2 scenario.
[0025] Figure 5 This is a schematic diagram of a scanning direction corresponding to the shorter side in a 1-to-2 scenario.
[0026] Figure 6 This is a schematic diagram of the other scanning direction corresponding to the shorter side in a 1-to-2 scenario.
[0027] Figure 7 This is a schematic diagram of the touch area under a specific scanning direction.
[0028] Figure 8 This is a schematic diagram of the structure of a display device provided in an embodiment of this application;
[0029] Figure 9 A flowchart illustrating a method for determining the writing process corresponding to a real touch point, provided in an embodiment of this application;
[0030] Figure 10 This application provides an embodiment of the pen-writing process, a schematic diagram of the writing process based on a stylus;
[0031] Figure 11 This application provides a schematic diagram illustrating the changes in the touch point during a pen-writing process.
[0032] Figure 12 This application provides an embodiment of a pen-lifting process, a schematic diagram of the writing process based on a stylus;
[0033] Figure 13 This application provides a schematic diagram illustrating the changes in the touch point during a pen-lifting process.
[0034] Figure 14 A flowchart illustrating a method for determining the writing process corresponding to a real touch point, provided in an embodiment of this application;
[0035] Figure 15 This is a schematic diagram illustrating the comparison of the size changes of the actual touch point and the output during the pen-writing process, based on existing technology, as provided in an embodiment of this application.
[0036] Figure 16 This is a schematic diagram illustrating the comparison of the size change of the actual touch point and the output during the pen lifting process, based on existing technology, as provided in an embodiment of this application.
[0037] Figure 17 A flowchart illustrating a touch display method provided in this application;
[0038] Figure 18 This is a schematic diagram of the structure of a touch display device provided in this application. Detailed Implementation
[0039] To make the objectives, implementation methods and advantages of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the described exemplary embodiments are only some embodiments of this application, and not all embodiments.
[0040] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.
[0041] Furthermore, the terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that includes a series of components is not necessarily limited to those that are explicitly listed, but may include other components that are not explicitly listed or that are inherent to such product or device.
[0042] Figure 1 This is a schematic diagram of the external structure of an infrared touchscreen, such as... Figure 1 As shown, the infrared touchscreen has a rectangular structure consisting of a long transmitting side, a long receiving side, a short transmitting side, and a short receiving side. There are several transmitting LEDs on the transmitting side, and corresponding receiving LEDs on the receiving side. A one-to-many scanning method is typically used, meaning that when one transmitting LED emits light, multiple receiving LEDs on the opposite side simultaneously receive it, thus forming an optical network. Touch behavior is determined based on the different shapes of the optical network under touch and non-touch conditions.
[0043] Currently, there are various infrared multi-point recognition schemes. Among them, a logical polygon overlay algorithm is provided. This algorithm can directly determine the touch area based on the changes in the touch screen signal, and then perform polygon overlay point positioning calculation based on the touch area to obtain the touch point information for display.
[0044] Figure 2 This is a schematic diagram illustrating the positional relationship between a display screen and an infrared touchscreen. (Reference) Figure 2 As shown, the infrared emitting and receiving elements are higher than the display screen, meaning the infrared detection light grid formed by the infrared emitting and receiving elements is higher than the display screen, which serves as the writing surface. When a finger or stylus writes on the display screen, during the writing process, when the finger or stylus lands completely in front of the display screen, i.e., between the display screen and the infrared detection light grid, it will also block some infrared light to generate a touch point for display, thus causing the problem of writing too quickly.
[0045] Similarly, during the pen lifting process, if the finger or stylus has left the display screen but is located between the display screen and the infrared detection grid, it will also block some infrared light to generate touch points for display, thus causing the pen lifting sluggishness problem.
[0046] Based on the aforementioned issues of writing too quickly and lifting the pen too slowly, when a user writes, if the pen is lifted too low after completing the previous stroke, leaving the finger or stylus still between the display screen and the infrared detection grid, and the writing continues, the two strokes will be connected. These issues, such as writing connected strokes, writing too quickly, and lifting the pen too slowly, result in a poor user experience.
[0047] Based on this, this application can consider the changing characteristics of touch points during the pen-writing and pen-lifting processes, thereby determining whether the actual touch point is a touch point generated by touching the display screen. Touch points generated by touching the display screen are output, while touch points not generated by touching the display screen, i.e., touch points generated by fingers or styluses located between the display screen and the infrared detection light grid, are suppressed and not output, in order to solve problems such as sluggish pen-writing, pen-lifting sluggishness, and continuous writing, thereby improving the user experience.
[0048] To facilitate a better understanding of the contents of this application by those skilled in the art, the following definitions are given for the concepts involved in the scheme of this application before describing the embodiments of this application.
[0049] Scanning Direction: In a 1-to-n (n≥1) scanning method, each optical path has a different angle for a specific lamp. For a specific emitting lamp, each angle of its corresponding n optical paths is called a scanning direction. Therefore, a 1-to-n scanning method will have n scanning directions, each scanning direction consisting of a set of parallel optical paths with the same slope. See [reference needed] for details. Figures 3 to 6 As shown, where, Figure 3 This is a schematic diagram showing a scanning direction corresponding to the longer side in a 1-to-2 scenario. Figure 4 This is a schematic diagram showing the other scanning direction corresponding to the longer side in a 1-to-2 scenario. Figure 5 This is a schematic diagram of a scanning direction corresponding to the shorter side in a 1-to-2 scenario. Figure 6 This is a schematic diagram of the other scanning direction corresponding to the shorter side in a 1-to-2 scenario.
[0050] Touch area: A specific scanning direction corresponds to a set of parallel scanning optical paths. When a touch occurs, each touch point blocks several consecutive lines of these parallel optical paths. These consecutively blocked optical paths are called a scanning area in this scanning direction. (See reference...) Figure 7 As shown. Figure 7 This is a schematic diagram of a touch area under a specific scanning direction. The dashed lines can represent the blocked light paths. Among the continuously blocked light paths, the first blocked light path can be defined as the starting boundary of this touch area, and the last blocked light path is the ending boundary. The order can be customized, and this application does not limit it.
[0051] The display device provided in this application can have various implementation forms, such as a television with touch function, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc.
[0052] The technical solution of this application will be described in detail below with reference to specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.
[0053] Figure 8 This is a schematic diagram of the structure of a display device provided in an embodiment of this application, with reference to... Figure 8 As shown, the display device includes:
[0054] Display screen 801 is used to display the drawing strokes;
[0055] The touch screen 802 includes an infrared emitting element and an infrared receiving element, used to respond to touch operations, acquire touch information, and send the touch information to the processor 803;
[0056] A processor 803 connected to the display screen 801 and the touch screen 802 is configured to:
[0057] The touch area is determined based on the touch information, and the actual touch point is determined based on the touch area;
[0058] Acquire historical touch points, and determine the writing process corresponding to the actual touch point based on the historical touch points. The writing process includes the pen-putting process and the pen-lifting process.
[0059] Based on the writing process, determine whether the actual touch point is a touch point generated by touching the display screen 801. If yes, mark the trajectory where the actual touch point is located and output it; if no, mark the trajectory where the actual touch point is located and do not output it.
[0060] In this application, the touch screen 802 includes an infrared emitting element and an infrared receiving element. Therefore, the touch screen 802 is an infrared touch screen, and the plane formed by the infrared emitting element and the infrared receiving element can be referred to as an infrared detection light grid.
[0061] In one implementation scenario, the position and scanning angle of each infrared emitting element and each infrared receiving element can be pre-set, and the maximum number of touch points that the display device can recognize can be set to N. The output flag for N touch tracks is set to 1 to indicate normal output and display, and 0 to indicate that the tracks are not output. Here, N is a positive integer greater than or equal to 1. Therefore, when marking the tracks where the actual touch points are located, only the value of the flag needs to be set.
[0062] In some embodiments, when the processor 803 determines the touch area based on touch information and determines the actual touch point based on the touch area, it may perform a one-cycle scan to acquire the touch area in each direction of the long and short sides of the touch screen 802, determine the position information of candidate touch points based on each touch area, and record the association between the candidate touch points and the touch area. The position information includes the coordinates, width, height, and area information of the candidate touch points.
[0063] Candidate touch points include fake touch points and real touch points. In one implementation scenario, fake touch points can be removed and real touch points can be obtained based on the relationship between candidate touch points and each touch area.
[0064] A real touch point is a touch point generated by the user's touch operation, including touch points generated when touching the display screen 801, and touch points generated when not touching the display screen 801. Among them, touch points generated when not touching the display screen 801 are touch points generated when a finger or stylus is located between the display screen 801 and the infrared detection light grid, and the light is blocked.
[0065] In addition to the pen-putting and pen-lifting processes, the writing process can also include the movement process. The pen-putting, movement, and pen-lifting processes constitute a complete touch event.
[0066] In some embodiments, when the processor 803 is used to determine the writing process corresponding to the actual touch point based on the historical touch points, it is configured to perform the following: Figure 9 The method shown, Figure 9 A flowchart illustrating a method for determining the writing process corresponding to a real touch point, provided in this application embodiment, is as follows:
[0067] S901: Match the actual touch point with the historical touch point.
[0068] S902: If a historical touch point exists that matches the actual touch point, determine that the actual touch point is a non-starting point of the trajectory.
[0069] S903: Based on the size relationship between the first information of the real touch point and the first information of the target historical touch point, determine the writing process corresponding to the real touch point.
[0070] Wherein, the target historical touch point is the last historical touch point in the trajectory of the actual touch point, and the first information is the width, height or area of the touch point.
[0071] When matching real touch points with historical touch points, it is necessary to match each real touch point, i.e., each trajectory, to avoid losing the trajectory. This application uses any real touch point as an example for illustration.
[0072] Since there are historical touch points that match the actual touch points, it can be determined that the actual touch point is not the first point of the trajectory. Therefore, the writing process corresponding to the actual touch point may be the pen-putting process or the pen-lifting process.
[0073] Figure 10 This application provides an embodiment of the writing process, illustrating the process of writing using a stylus. Figure 11 This application provides a schematic diagram illustrating the changes in the touch point during a pen stroke, in conjunction with... Figure 10 and Figure 11 It can be seen that the point of contact gradually increases during the writing process.
[0074] Figure 12 This application provides an embodiment of a pen-lifting process, a schematic diagram of the writing process based on a stylus. Figure 13 This application provides a schematic diagram illustrating the changes in the touch point during a pen-lifting process, in conjunction with... Figure 12 and Figure 13 It can be seen that the point of contact gradually decreases during the process of lifting the pen.
[0075] During the movement process, the stylus slides on the display screen 801. At this time, the size of the touch point remains basically unchanged or changes only slightly. This application is mainly based on the pen-putting and pen-lifting processes, so the movement process will not be described in detail.
[0076] As can be seen from the above, the size of the touch point changes differently during the pen-writing process and the pen-lifting process. Therefore, when the actual touch point is not the first point of the trajectory, the writing process corresponding to the current actual touch point can be determined based on the size relationship between the first information of the actual touch point and the first information of the target historical touch point.
[0077] Furthermore, after determining the writing process, since the change in touch point size is relatively large during the pen-putting and pen-lifting processes, but relatively small during the movement process, it is possible to determine whether the actual touch point is a touch point generated by touching the display screen 801 based on the change in touch point size.
[0078] In some embodiments, since the marker of the trajectory where the target historical touch point is located may be output (flag=1) or not output (flag=0), in order to eliminate the influence of the marker of the trajectory where the target historical touch point is located, when matching the real touch point and the historical touch point, the processor 803 may also reset the output marker of N trajectories to output and set flag=1.
[0079] In another implementation scenario, the processor 803 is further configured to: if the actual touch point does not match the historical touch point, determine that the actual touch point is the starting point of the trajectory, and mark the trajectory where the actual touch point is located as not to be output.
[0080] Since there are no historical touch points that match the actual touch point, it can be determined that the actual touch point is the starting point of its trajectory. Therefore, the writing process corresponding to the current actual touch point is the pen-falling process. In order to avoid writing in a continuous manner and falling too quickly, the trajectory where the actual touch point is located can be marked as not output, that is, the actual touch point is not output.
[0081] The trajectory where the actual touch point is located is not output; that is, the trajectory is marked, and the label of the mark is used to indicate that it is not output.
[0082] In some embodiments, the processor 803 is further configured to:
[0083] If the marker of the trajectory where the actual touch point is located is output, the coordinates of the actual touch point are transformed, and the display screen 801 is controlled to display based on the transformed coordinates of the actual touch point and the first information.
[0084] In one implementation scenario, the processor 803 may include a main control chip and a display chip. The main control chip converts the coordinates of the actual touch point and sends the converted coordinates and first information to the display chip, which then controls the display screen 801 to display the information. After the display is completed, the next cycle of the scanning process can continue.
[0085] In another implementation scenario, if the marker of the trajectory where the actual touch point is located is not output, then there is no need to output and display the actual touch point. Specifically, there is no need to convert the coordinates of the actual touch point, nor is there need to send the converted coordinates and the first information of the actual touch point to the display chip for display.
[0086] It should be noted that if there are multiple tracks, each track needs to be traversed, the label of each track needs to be determined, and the actual touch point coordinates need to be converted and displayed for each track marked as output, in order to avoid track loss.
[0087] This application provides a display device including a display screen 801, a touch screen 802, and a processor 803. The processor 803 can determine a touch area based on touch information and determine the actual touch point based on the touch area. It acquires historical touch points and determines the writing process corresponding to the actual touch point based on these historical touch points. The writing process includes a pen-putting process and a pen-lifting process. After determining the writing process, it can determine whether the actual touch point is a touch point generated by touching the display screen 801. If so, the trajectory of the actual touch point is marked and output, and subsequent coordinate transformation and other processes are executed to achieve display. If not, the trajectory of the actual touch point is marked but not output, and in this case, subsequent processes are not executed, and the actual touch point is not displayed. Since this application only outputs the touch points generated when the pen is lifted and the pen is put down, and suppresses the output of touch points generated when the pen is not touched, it effectively avoids the problem of continuous writing caused by the finger or stylus being between the display screen 801 and the infrared detection light grid. It also solves the problems of too fast pen strokes and slow pen lift, effectively improving the user's writing experience.
[0088] In one or more embodiments of this application, the processor 803, when used to determine the writing process corresponding to the real touch point based on the size relationship between the first information of the real touch point and the first information of the target historical touch point, is configured to perform the following: Figure 14 The method shown, Figure 14 A flowchart illustrating a method for determining the writing process corresponding to a real touch point, provided in this application embodiment, is as follows:
[0089] S1401: Determine the ratio of the first information of the actual touch point to the first information of the target historical touch point.
[0090] S1402: If the ratio is greater than 1, the writing process corresponding to the actual touch point is determined to be the pen-writing process.
[0091] S1403: If the ratio is less than 1, the writing process corresponding to the actual touch point is determined to be the pen lifting process.
[0092] The first piece of information can be the width, height, or area of the touch point. Taking the area of the touch point as an example, in one implementation scenario, when the ratio of the area of the actual touch point to the area of the target historical touch point is greater than 1, that is, when the area of the actual touch point is greater than the area of the target historical touch point, it can be seen that the touch point is gradually increasing in size. Therefore, it can be determined that the current writing process is the pen-writing process.
[0093] In another implementation scenario, when the ratio of the area of the actual touch point to the area of the target historical touch point is less than 1, that is, the area of the actual touch point is less than the area of the target historical touch point, it can be known that the touch point is gradually decreasing. Therefore, it can be determined that the current writing process is the pen lifting process.
[0094] When the first information includes the width and height of the touch point, the ratio of the width of the current actual touch point to the width of the target historical touch point can be determined and recorded as the first ratio. The ratio of the height of the actual touch point to the height of the target historical touch point can be recorded as the second ratio. At this time, the minimum value of the first ratio and the second ratio can be compared with 1, or the maximum value of the first ratio and the second ratio can be compared with 1, or the average value of the first ratio and the second ratio can be taken, etc., to determine the current corresponding writing process. This application does not limit this.
[0095] In some embodiments, when the processor 803 is used to determine whether the actual touch point is a touch point generated by touching the display screen 801 based on the writing process, it is configured to:
[0096] For the writing process corresponding to the real touch point, which is the pen-writing process, if the ratio is greater than the sum of 1 and the first threshold, the real touch point is determined to be a touch point generated without touching the display screen 801.
[0097] If the ratio is less than or equal to the sum of 1 and the first threshold, the actual touch point is determined to be a touch point generated by touching the display screen 801;
[0098] Wherein, the first threshold is a preset threshold for the change range of the first information of the touch point during the pen stroke process.
[0099] In the context of the pen stroke process, the larger the ratio of the first information of the actual touch point to the first information of the target historical touch point, the greater the increase in the size of the actual touch point. Similarly, the smaller the ratio, the smaller the increase in the size of the actual touch point.
[0100] The threshold value for the change in the first information of the touch point during the pen stroke process can be denoted as t1%, and the ratio of the first information of the actual touch point to the first information of the target historical touch point can be denoted as s. For the pen stroke process, s > 1 at this time.
[0101] In one implementation scenario, when the ratio s > 1 + t1%, it indicates that the actual touch point has increased significantly compared to the target historical touch point. Therefore, it can be determined that the finger or stylus has not yet touched the display screen 801, but is located between the display screen 801 and the infrared detection light grid. Thus, the actual touch point is determined to be a touch point generated without touching the display screen 801.
[0102] Since s > 1 + t1% at this time, s = the first information of the actual touch point / the first information of the target historical touch point.
[0103] Therefore:
[0104]
[0105] Further derivation yields: the first information of the actual touch point > (1 + t1%) * the first information of the target historical touch point
[0106]
[0107] in, It can be used to characterize the change range of the actual touch point based on the target historical touch point. Therefore, when s > 1 + t1%, it means that the change range of the actual touch point based on the target historical touch point is > t1.
[0108] In another implementation scenario, when the ratio s ≤ 1 + t1%, that is, based on the target historical touch point, the change range of the actual touch point ≤ t1%, it indicates that the increase in the actual touch point is smaller compared to the target historical touch point. Since the change range of the touch point is small during movement, it can be determined that the current finger or stylus has touched the display screen 801, and this actual touch point is the touch point generated by touching the display screen 801.
[0109] It should be noted that when the ratio s = 1 + t1%, the finger or stylus is in a critical state of contacting the display screen 801. The actual touch point at this time can be regarded as a touch point generated by touching the display screen 801, or it can be regarded as a touch point generated by not touching the display screen 801. It can be set according to actual needs, and this application does not limit it.
[0110] Figure 15 This application provides an embodiment of a comparative diagram illustrating the changes in the size of the actual touch point and the output during the pen-writing process, based on existing technology. (Refer to...) Figure 15As shown, S1 represents the prior art, where the size change and output of the actual touch point during the pen stroke process are described, and S2 represents the present application, where the size change and output of the actual touch point during the pen stroke process are described, where the actual touch point represented by a solid line represents the output state, and the actual touch point represented by a dashed line represents the no-output state.
[0111] Depend on Figure 15 It is known that in the current writing process, each actual touch point outputs data, which can lead to problems such as writing too fast and continuous strokes.
[0112] In this application, the first point and the actual touch points of s > 1 + t1% are suppressed and not output, thereby effectively avoiding the problems of writing too fast and writing in a continuous manner.
[0113] In some embodiments, when the processor 803 is used to determine whether the actual touch point is a touch point generated by touching the display screen 801 based on the writing process, it is configured to:
[0114] For the writing process corresponding to the real touch point as the pen lifting process, if the ratio is greater than or equal to the difference between 1 and the second threshold, the real touch point is determined to be a touch point generated by touching the display screen 801, and the first information of the target historical touch point is used as the first information of the real touch point.
[0115] If the ratio is less than the difference between 1 and the second threshold, the actual touch point is determined to be a touch point generated without touching the display screen 801;
[0116] The second threshold is a preset threshold for the change in the first information of the touch point during the pen lifting process.
[0117] During the pen lifting process, the touch point gradually decreases, and the ratio of the first information of the actual touch point to the first information of the target historical touch point is less than 1. When this ratio is larger, it indicates that the actual touch point decreases less compared to the target historical touch point; when this ratio is smaller, it indicates that the actual touch point decreases more compared to the target historical touch point.
[0118] Specifically, the threshold value of the change in the first information of the touch point during the pen lifting process can be denoted as t2%, and the ratio of the first information of the actual touch point to the first information of the target historical touch point can still be denoted as s. For the pen lifting process, s < 1 at this time.
[0119] In one implementation scenario, when the ratio s≥1-t2%, it indicates that the actual touch point is smaller than the target historical touch point. Therefore, it can be determined that the finger or stylus is still on the display screen 801 or very close to the display screen 801. Thus, it can be determined that the current actual touch point is still the touch point generated by touching the display screen 801.
[0120] Since s≥1-t2% at this time, that is:
[0121]
[0122] We can obtain: the information of the actual touch point is ≥ (1-t2%) * the first information of the target historical touch point.
[0123] Further derivation yields:
[0124]
[0125] Since the actual touch point decreases compared to the target historical touch point during the pen lifting process, for ease of description, the above formula can also be simplified. Considered as the change in the actual touch point based on the target historical touch point during the pen lifting process, when s≥1-t2%, that is, during the pen lifting process, the change in the actual touch point based on the target historical point is ≤t2%.
[0126] In another implementation scenario, when the ratio s < 1 - t2%, that is, during the pen lifting process, based on the target historical point, the change range of the actual touch point is > t2%, it can be indicated that the actual touch point becomes smaller than the target historical touch point. Therefore, it can be determined that the finger or stylus has now left the display screen 801 and is located between the display screen 801 and the infrared detection light network. This actual touch point is the touch point generated without touching the display screen 801.
[0127] It should be noted that when the ratio s = 1 - t2%, the finger or stylus is in a critical state between touching the display screen 801 and leaving the display screen 801. The actual touch point at this time can be regarded as a touch point generated by touching the display screen 801, or it can be regarded as a touch point generated by not touching the display screen 801. It can be set according to actual needs, and this application does not limit it.
[0128] Figure 16 This application provides an embodiment of a comparative diagram illustrating the changes in the size of the actual touch point and the output during the pen-lifting process, based on existing technology. (Refer to...) Figure 16As shown, S3 represents the prior art, where the size change and output of the actual touch point during pen lifting is described, and S4 represents the present application, where the size change and output of the actual touch point during pen lifting is described.
[0129] Depend on Figure 16 It is known that in the current pen lifting process, each real touch point outputs data until the height of the finger or stylus is higher than the infrared detection light grid, which can lead to problems such as sluggish pen lifting and continuous writing.
[0130] In this application, the actual touch points corresponding to s≥1-t2% are output, while the actual touch points corresponding to s<1-t2% are suppressed and not output, thereby effectively avoiding problems such as sluggish pen lifting and cursive writing.
[0131] In summary, when the actual touch point is not the first point of the trajectory, the current writing process can be determined as either a pen-falling process or a pen-lifting process based on the ratio of the first information of the actual touch point to the first information of the target historical touch point. During the pen-falling process, based on the relationship between this ratio and the sum of 1 and a first threshold, it is further determined whether the actual touch point is a touch point generated by touching the display screen 801. Touch points generated by touching the display screen 801 are then output, while touch points not touched by the display screen 801 are suppressed and not output to avoid excessively fast pen-falling. Simultaneously, during the pen-lifting process, based on the relationship between this ratio and the difference between 1 and a second threshold, it is further determined whether the actual touch point is a touch point generated by touching the display screen 801. Touch points generated by touching the display screen 801 are then output, while touch points that have left the display screen 801 and have not been touched by the display screen 801 are suppressed and not output to avoid sluggish pen-lifting and further prevent the problem of continuous writing.
[0132] Figure 17 This is a flowchart illustrating a touch display method provided in this application. The method can be executed by the aforementioned display device or its processor, such as... Figure 17 As shown, the method includes the following steps:
[0133] S1701: Receive touch information, determine the touch area based on the touch information, and determine the actual touch point based on the touch area.
[0134] The number of touch areas can be one or more. In some embodiments, the location information of candidate touch points can be determined based on each touch area, and the association between the candidate touch points and each touch area can be obtained. Since the candidate touch points include dummy touch points and real touch points, dummy touch points can be removed and real touch points can be obtained based on the association between the candidate touch points and each touch area.
[0135] The location information of the candidate touch point includes, but is not limited to, the coordinates, width, height, and area of the candidate touch point.
[0136] S1702: Obtain historical touch points, and determine the writing process corresponding to the actual touch point based on the historical touch points. The writing process includes the pen-putting process and the pen-lifting process.
[0137] Because the changes in the actual touch point differ between the pen-lifting and pen-falling processes compared to historical touch points—specifically, the touch point gradually increases during pen-falling and gradually decreases during pen-lifting—in one implementation scenario, if a historical touch point matching the actual touch point exists, the writing process corresponding to the current actual touch point can be determined based on the magnitude relationship between the actual touch point and the target historical touch point.
[0138] Among them, the target historical touch point is the last historical touch point in the trajectory of the actual touch point. The first information includes, but is not limited to, the width, height or area of the touch point, which is used to characterize the size of the touch point.
[0139] In another implementation scenario, if there is no historical touch point that matches the real touch point, then the real touch point is the first point of its trajectory. To avoid writing in a continuous manner and writing too quickly, the first point can be suppressed and not output.
[0140] S1703: Based on the writing process, determine whether the actual touch point is a touch point generated by touching the display screen. If yes, mark the trajectory where the actual touch point is located and output it; if no, mark the trajectory where the actual touch point is located and do not output it.
[0141] Actual touch points include touch points generated by touching the display screen, as well as touch points generated without touching the display screen. Touch points generated without touching the display screen are those caused by fingers or styluses being positioned between the display screen and the infrared detection light grid, thus blocking the infrared light.
[0142] Because the change in the touch point is relatively small when a finger or stylus slides across the display surface, the process of placing the finger or stylus between the display screen and the infrared detection grid, and finally onto the display surface, is much more significant. Specifically, the change in the touch point is much larger.
[0143] The process of lifting the stylus involves the finger or stylus leaving the display surface, then moving between the display and the infrared detection grid, and finally ending above the infrared detection grid. During this movement between the display and the infrared detection grid, the change in the touch point is significant; specifically, the touch point shrinks considerably.
[0144] Therefore, after determining the writing process, the change range of the current real touch point can be determined based on the target historical touch point, and the real touch point can be determined based on the change range to determine whether the real touch point is a touch point generated by touching the display screen.
[0145] This application provides a touch display method. For a given real touch point, the writing process corresponding to the current real touch point is determined through historical touch points. Based on the writing process, it is determined whether the real touch point is a touch point generated by touching the display screen. If not, that is, the real touch point is a touch point generated without touching the display screen, and the trajectory of the real touch point is marked as not output. Since this application suppresses and does not output touch points generated without touching the display screen during both the pen lifting and pen falling processes, it effectively avoids the problem of continuous writing caused by the finger or stylus being located between the display screen and the infrared detection light grid. It also solves problems such as too fast pen falling and slow pen lifting, effectively improving the user's writing experience.
[0146] Figure 18 This is a schematic diagram of the structure of a touch display device provided in this application. Figure 18 As shown, the touch display device includes:
[0147] Receiver module 1801 is used to receive touch information;
[0148] Processing module 1802 is used to determine the touch area based on the touch information and to determine the actual touch point based on the touch area;
[0149] The processing module 1802 is also used to acquire historical touch points and determine the writing process corresponding to the real touch point based on the historical touch points. The writing process includes the pen-putting process and the pen-lifting process.
[0150] The processing module 1802 is further configured to determine whether the actual touch point is a touch point generated by touching the display screen. If so, the trajectory of the actual touch point is marked and output; if not, the trajectory of the actual touch point is marked and not output.
[0151] The touch display device provided in this application embodiment can execute the touch display method in the above method embodiment, and its implementation principle and technical effect are similar, so they will not be repeated here. It should be noted that the above... Figure 18The division of modules shown is merely illustrative. This application does not limit the division of modules or the naming of modules.
[0152] This application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the methods described in the above embodiments.
[0153] The computer-readable storage medium may include various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical discs.
[0154] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the methods described in the above embodiments.
[0155] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
[0156] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.
Claims
1. A display device, characterized in that, The display device includes: A display screen is used to show the drawing strokes; The touchscreen includes an infrared emitting element and an infrared receiving element, used to respond to touch operations, acquire touch information, and send the touch information to a processor; A processor connected to the display screen and the touch screen is configured to: The touch area is determined based on the touch information, and the actual touch point is determined based on the touch area; Acquire historical touch points, and determine the writing process corresponding to the actual touch point based on the historical touch points. The writing process includes the pen-putting process and the pen-lifting process. Based on the writing process, determine whether the actual touch point is a touch point generated by touching the display screen. If yes, mark the trajectory of the actual touch point and output it; if no, mark the trajectory of the actual touch point and do not output it. The process of determining the writing point corresponding to the actual touch point based on the historical touch points is specifically configured as follows: Determine the ratio of the first information of the actual touch point to the first information of the target historical touch point; wherein, the target historical touch point is the last historical touch point in the trajectory of the actual touch point, and the first information is the width, height or area of the touch point; The method for determining whether the actual touch point is a touch point generated by touching the display screen based on the writing process is specifically configured as follows: For the writing process corresponding to the real touch point, which is the pen-writing process, if the ratio is greater than the sum of 1 and the first threshold, the real touch point is determined to be a touch point generated without touching the display screen. If the ratio is less than or equal to the sum of 1 and the first threshold, the actual touch point is determined to be a touch point generated by touching the display screen; Wherein, the first threshold is a preset threshold for the change range of the first information of the touch point during the pen stroke process.
2. The display device according to claim 1, characterized in that, When the processor is used to determine the writing process corresponding to the actual touch point based on the historical touch points, it is configured to: Match the actual touch points with the historical touch points; If a historical touch point exists that matches the actual touch point, the actual touch point is determined to be a non-first point of the trajectory. Based on the size relationship between the first information of the actual touch point and the first information of the target historical touch point, the writing process corresponding to the actual touch point is determined.
3. The display device according to claim 2, characterized in that, When the processor is used to determine the writing process corresponding to the real touch point based on the size relationship between the first information of the real touch point and the first information of the target historical touch point, it is configured to: If the ratio is greater than 1, the writing process corresponding to the actual touch point is determined to be the pen-writing process; If the ratio is less than 1, the writing process corresponding to the actual touch point is determined to be the pen lifting process.
4. The display device according to claim 3, characterized in that, The processor is configured to: determine whether the actual touch point is a touch point generated by touching the display screen based on the writing process. For the writing process corresponding to the real touch point as the pen lifting process, if the ratio is greater than or equal to the difference between 1 and the second threshold, the real touch point is determined to be a touch point generated by touching the display screen, and the first information of the target historical touch point is used as the first information of the real touch point. If the ratio is less than the difference between 1 and the second threshold, the actual touch point is determined to be a touch point generated without touching the display screen; The second threshold is a preset threshold for the change in the first information of the touch point during the pen lifting process.
5. The display device according to claim 2, characterized in that, The processor is also configured to: If the actual touch point does not match the historical touch point, the actual touch point is determined to be the starting point of the trajectory, and the trajectory containing the actual touch point is marked as not being output.
6. The display device according to any one of claims 1-5, characterized in that, The processor is also configured to: If the marker of the trajectory where the actual touch point is located is output, the coordinates of the actual touch point are transformed, and the display screen is controlled to display based on the transformed coordinates of the actual touch point and the first information.
7. A touch display method, characterized in that, The method includes: Receive touch information, determine the touch area based on the touch information, and determine the actual touch point based on the touch area; Acquire historical touch points, and determine the writing process corresponding to the actual touch point based on the historical touch points. The writing process includes the pen-putting process and the pen-lifting process. Based on the writing process, determine whether the actual touch point is a touch point generated by touching the display screen. If yes, mark the trajectory of the actual touch point and output it; if no, mark the trajectory of the actual touch point and do not output it. The process of determining the writing point corresponding to the actual touch point based on the historical touch points is specifically configured as follows: Determine the ratio of the first information of the actual touch point to the first information of the target historical touch point; wherein, the target historical touch point is the last historical touch point in the trajectory of the actual touch point, and the first information is the width, height or area of the touch point; The method for determining whether the actual touch point is a touch point generated by touching the display screen based on the writing process is specifically configured as follows: For the writing process corresponding to the real touch point, which is the pen-writing process, if the ratio is greater than the sum of 1 and the first threshold, the real touch point is determined to be a touch point generated without touching the display screen. If the ratio is less than or equal to the sum of 1 and the first threshold, the actual touch point is determined to be a touch point generated by touching the display screen; Wherein, the first threshold is a preset threshold for the change range of the first information of the touch point during the pen stroke process.
8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, implement the method of claim 7.
9. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method of claim 7.
Citation Information
Patent Citations
Method and device for processing touch signal of infrared touch screen, and terminal equipment
CN106557209A
Display device and touch point recognition method
CN112947800A