Touch response method, device, smart interactive panel and storage medium
The method and device differentiate between touch operations based on area thresholds and movement distances to accurately determine drawing or erasing modes, addressing the issue of distorted responses in touch response systems.
Patent Information
- Application Number
- JP2022573503
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-06-21
- Publication Date
- 2024-12-17
- Estimated Expiration
- 2042-06-21
Smart Images

Figure 0007600498000001 
Figure 0007600498000002 
Figure 0007600498000003
Abstract
Description
[Technical field]
[0001] FIELD OF THE DISCLOSURE The embodiments of the present invention relate to the technical field of touch, and in particular to a touch response method, device, smart interactive panel and storage medium. [Background technology]
[0002] When drawing on a terminal device using an infrared touch box, some users have the habit of drawing with their palm supported on the screen of the terminal device. During drawing, the infrared touch box can detect touch operation data by touching, and the terminal device can check the position of the contact point and the touch area based on the touch operation data, so as to meet the interaction needs of the drawing scene, and can distinguish whether it is pen drawing or palm support based on the touch area. Specifically, when pen drawing and palm support are distinguished based on the touch area, a stable touch area is formed due to the relatively fixed shape of the hard pen tip when drawing with a pen, whereas in the case of palm support, deformation occurs due to differences in contact angle and contact force, resulting in a change in the touch area. Meanwhile, in the terminal device, differences in touch area usually trigger different responses, such as a drawing operation response corresponding to a small touch area and an erasing operation response corresponding to a large touch area.
[0003] Due to a user's habit of drawing with the palm of the hand on the screen, the terminal device may detect multiple types of touch areas simultaneously during a touch operation, which may disrupt the terminal device's operational response based on the touch areas and make it impossible to accurately respond to the user's actual operational purpose. Summary of the Invention [Problem to be solved by the invention]
[0004] The present invention provides a touch response method, device, smart interactive panel and storage medium that solve the conventional technical problem that the operation response based on the touch area is distorted and cannot accurately respond to the user's actual operation purpose. [Means for solving the problem]
[0005] In a first aspect, an embodiment of the present invention provides a touch response method comprising: receiving a touch operation and acquiring touch operation data generated based on the current touch operation, the current touch operation including a first touch operation and a second touch operation, the touch operation data including a touch area, the touch area of the first touch operation being equal to or smaller than a preset area threshold, and the touch area of the second touch operation being larger than the preset area threshold; When the first touch operation is accepted first, a step of transitioning to a drawing mode; maintaining a drawing mode when a first touch operation is received first and a second touch operation is started to be received during the first touch operation; receiving a second touch operation first and transitioning to an erase mode; a step of switching modes and transitioning from the erase mode to the drawing mode when, after first receiving a second touch operation and transitioning to an erase mode, the first touch operation is started to be received during the second touch operation and the movement distance of the second touch operation from an initial time for accepting the second touch operation to an initial time for accepting the first touch operation is equal to or less than a first distance threshold; The touch response method includes a step of first accepting a second touch operation, transitioning to an erase mode, and then starting to accept a first touch operation during the second touch operation, and, if the movement distance of the second touch operation from the initial time for accepting the second touch operation to the initial time for accepting the first touch operation is greater than a first distance threshold, maintaining the erase mode.
[0006] In a second aspect, an embodiment of the present invention provides a touch responsive device comprising: a touch data acquisition unit that receives a touch operation and acquires touch operation data generated based on a current touch operation, the current touch operation including a first touch operation and a second touch operation, the touch operation data including a touch area, the touch area of the first touch operation being equal to or smaller than a preset area threshold, and the touch area of the second touch operation being larger than the preset area threshold; a drawing mode transition unit that transitions to a drawing mode when the first touch operation is received first; a drawing mode storage unit that stores a drawing mode when a first touch operation is received first and a second touch operation is started to be received during the first touch operation; an erase mode transition unit that first receives a second touch operation and transitions to an erase mode; an erasure mode switching unit that first accepts a second touch operation, transitions to an erase mode, and then starts accepting a first touch operation during the second touch operation, and when a moving distance of the second touch operation from an initial time for accepting the second touch operation to an initial time for accepting the first touch operation is equal to or less than a first distance threshold, switches modes and transitions from the erase mode to the drawing mode; The touch response device includes an erase mode holding unit that first accepts a second touch operation, transitions to an erase mode, and then starts accepting a first touch operation during the second touch operation, and holds the erase mode if the movement distance of the second touch operation is greater than a first distance threshold from an initial time at which the second touch operation is accepted to an initial time at which the first touch operation is accepted.
[0007] In a third aspect, an embodiment of the present invention is a smart interactive panel, comprising: one or more processors; a memory storing one or more programs; The one or more programs, when executed by the one or more processors, cause the smart interactive panel to implement the touch response method according to the first aspect.
[0008] In a fourth aspect, an embodiment of the present invention provides a computer readable storage medium having a computer program stored thereon, the computer readable storage medium comprising: The computer program provides a computer-readable storage medium which, when executed by a processor, implements the touch response method according to the first aspect. In the above touch response method, device, smart interactive panel, and storage medium, in the process of a touch operation, a touch operation is accepted, and touch operation data generated based on a current touch operation is obtained, the current touch operation includes a first touch operation and a second touch operation, the touch operation data includes a touch area, the touch area of the first touch operation is equal to or smaller than a preset area threshold, and the touch area of the second touch operation is larger than a preset area threshold. If the first touch operation is accepted first, the drawing mode is maintained if the first touch operation is accepted before transitioning to the drawing mode and the second touch operation starts to be accepted during the touch of the first touch operation. If the second touch operation is accepted first and transitioning to the erasing mode, the first touch operation starts to be accepted during the touch of the second touch operation, and the moving distance of the second touch operation is equal to or smaller than a first distance threshold from the initial time of accepting the second touch operation to the initial time of accepting the first touch operation, a mode switch is performed and the erasing mode is transitioned to the drawing mode from the erasing mode. If the second touch operation is accepted first and the erase mode is entered after the first touch operation is accepted while the second touch operation is being touched, and if the movement distance of the second touch operation from the initial time of accepting the second touch operation to the initial time of accepting the first touch operation is greater than a first distance threshold, the erase mode is maintained. When the drawing operation interface detects the first touch operation and the second touch operation based on the infrared touch, it determines which of the two touch operations is valid and which is invalid based on the context of the two touch operations, and maintains or switches to the corresponding mode according to the valid touch operation, and ignores the touch operation data generated corresponding to the invalid touch operation, thereby realizing accurate response in the drawing process and reducing interference with the display of the drawing process caused by erroneous operations. [Brief description of the drawings]
[0009] [Figure 1] 4 is a flowchart of a touch response method according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a schematic diagram of a hand state when drawing. [Diagram 3] FIG. 2 is a schematic diagram of contact points made by the palm of a hand when drawing. [Figure 4] Schematic diagram of different contact point combinations. [Diagram 5] FIG. 2 is a schematic diagram of multiple drawing contact points. [Figure 6] 1 is a structural schematic diagram of a touch response device according to an embodiment of the present invention; [Figure 7] 1 is a structural schematic diagram of a smart interactive panel according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] The present invention will be described in more detail below with reference to the drawings and examples. It is understood that the specific examples described here do not interpret the present invention and do not limit the present invention. In addition, for convenience of explanation, the drawings show only parts related to the present invention, not all structures.
[0011] Due to space limitations, not all possible embodiments are described in the specification of this application. After reading the specification of this application, a person skilled in the art can realize that any combination of technical features can be a preferred embodiment, as long as the technical features are not mutually contradictory.
[0012] Each embodiment will be described in detail below.
[0013] FIG. 1 is a flowchart of a touch response method according to an embodiment of the present invention, which is used in a smart interactive panel. As shown, the touch response method includes steps S110 to S160.
[0014] Step S110: Accept a touch operation, and obtain touch operation data generated based on the current touch operation, where the current touch operation includes a first touch operation and a second touch operation, the touch operation data includes a touch area, the touch area of the first touch operation is less than or equal to a preset area threshold, and the touch area of the second touch operation is greater than the preset area threshold.
[0015] For ease of understanding, the embodiment takes a smart interactive panel as a specific form of the terminal device, and uses the smart interactive panel to exemplarily describe the detailed touch response process in the present solution. The smart interactive panel may be an integrated device that uses touch technology to control the content displayed on the display screen and enable human-computer interaction operations, and integrates one or more functions such as a projector, an electronic whiteboard, curtains, audio equipment, a television, a video conference terminal, etc. Of course, the surface characteristics of the display surface of the smart interactive panel are not limited, for example, the surface characteristics of the smart interactive panel may be a flat surface, a curved surface, or a combination of multiple flat surfaces.
[0016] The area covered by the graphic interface displayed on the display screen of the smart interactive panel may be a touch detection area for detecting user operation, i.e., the range of the graphic interface and the touch detection area may substantially overlap, but may not overlap. When a touch operation is performed in the touch detection area, for example, when a drawing pen or a hand approaches or contacts a display screen having a touch function, the touch module of the display screen detects changes in infrared light, current, voltage, magnetic flux, or pressure (corresponding to specific configuration types such as an infrared display screen, a capacitive display screen, a resistive display screen, an electromagnetic display screen, or a pressure-sensitive display screen), converts these to obtain a touch signal including the coordinates of the touch position and the trigger time of the touch signal, and obtains touch data generated from the time when the drawing pen or the user's hand contacts until the contact is stopped by removing it based on the coordinates of the touch position and the trigger time of the touch signal, and performs a corresponding response on the display screen according to the touch data, for example, responding to the touch data as a drawing process. Of course, the drawing process is not limited to writing characters, and any input process that displays an operation trajectory performed on the display screen of the smart interactive panel can be considered as a drawing process. In addition, depending on the difference in the display element at the location where the touch operation occurs, the touch operation may respond as a user's click, drag, or other operation. These various response methods have different basic coordinate processing methods. Based on the hardware implementation of basic functions such as touch and display, various interactive display designs of smart interactive panels are possible. In addition, from the perspective of user interaction experience, in a smart interactive panel, the display interface and the touch detection area are usually the same interface, while in a laptop computer, the display interface and the touch detection area may be independent of each other as a whole, or may be partially independent and partially overlap.
[0017] A smart interactive panel includes at least one display screen. For example, a display screen with touch function is arranged in the smart interactive panel, and the display screen with touch function may be an infrared display screen, a capacitive display screen, a resistive display screen, an electromagnetic display screen, or a pressure-sensitive display screen, etc. In the display screen with touch function, a user may perform a touch operation by touching the display screen with his / her hand or a drawing pen, in which case the smart interactive panel detects the touch position and responds according to the touch position, thereby realizing the touch function. Different touch sensing modules used in the display screen with touch function will result in different raw tactile signals collected by the touch sensing modules, and the converted touch signals will also be completely different.
[0018] For an infrared display screen, the touch module is an infrared touch box, the collected tactile signals may include a signal indicating that infrared rays are blocked, and the converted touch signals may include a touch location signal, which may include the X and Y coordinates of the touch location. For a capacitive display screen, the touch module is a capacitive touch panel, the collected tactile signals may include the current of each electrode flowing through the touch screen, and the converted touch signals may include a touch location signal, which may include the X and Y coordinates of the touch location. For a resistive display screen, the touch module is a resistive touch panel, the collected tactile signals may include a voltage of the touch location, and the converted touch signals may include a touch location signal, which may include the X and Y coordinates of the touch location. In the electromagnetic display screen, the touch module is an electromagnetic panel, the collected tactile signal may include a change in magnetic flux and a frequency of the received electromagnetic signal, the converted touch signal may include a touch position signal corresponding to the change in magnetic flux and a pressure-sensitive signal corresponding to the frequency, the touch position signal may include the X and Y coordinates of the touch position, and the pressure-sensitive signal may include a pressure value.In the pressure-sensitive display screen, the touch module is a pressure sensor, the collected tactile signal may include a pressure signal, the converted touch signal may include a touch position signal, and the touch position signal may include the X and Y coordinates of the touch position.
[0019] This solution is mainly for an infrared display screen, that is, touch operation data is obtained by detecting the state of blocking infrared rays. On an infrared display screen, the size of the blocking area, that is, the area of the contact point, in addition to the touch position, can be determined from the state of blocking infrared rays. In this solution, continuous touch operation data is defined as being derived from the same touch operation, and the touch operation data corresponding to one touch operation records position information throughout the process from when the touch operation occurs to when it disappears. When this solution is implemented based on touch operation data detected by infrared touch, a response is not made based only on the touch operation data currently acquired, but a comprehensive response is made based on continuous touch operation data corresponding to the touch operation. In a form detected based on infrared touch, if the previously detected infrared blocking area exists continuously, regardless of the shape of the blocking area, the blocking area is a contact point, and the size of the contact point is represented by the touch area. For example, when a drawing pen touches the display screen, the blocking area is small and the corresponding touch area is small, and when a palm touches the display screen, the blocking area is large and the corresponding touch area is large.
[0020] In a scene where the touch data is used for a response of a drawing process, a drawing interface covering the entire display screen is first displayed on the display screen, and the display range of the drawing interface on the display screen may be adjusted through an operation such as roaming or zooming, and the drawing interface may cover the entire display screen and maintain a constant size and position relative to the display screen. In the drawing interface, a display control for interactive control of the drawing content and the drawing interface may be displayed during the drawing process. The drawing interface may be triggered and displayed after an application icon corresponding to a drawing application is detected. For example, a smart interactive panel displays a plurality of application icons including an application icon corresponding to an "electronic whiteboard", and when a trigger operation acting on the application icon is detected, an application window of the "electronic whiteboard" is displayed, and the application window becomes a drawing interface, and the display range of the drawing interface may be dynamically adjusted according to the operation. Also, for example, when a document is currently being displayed on a smart interactive panel, and system-level interactive controls such as annotation controls and desktop return controls are fixedly displayed at the top, and when a trigger operation acting on the annotation control is detected, an annotation page is fixedly displayed at the top on top of the currently displayed document, the annotation page becomes a drawing interface, and the display range and display ratio of the drawing interface may be statically fixed.
[0021] Taking a drawing interface corresponding to an "electronic whiteboard" as an example, the touch operations that can be responded to include triggers for the display control of the drawing interface and operations for the drawing content of the drawing interface. Triggers for the display control, such as creating a new page and closing a page, can usually be operated accurately, and the smart interactive panel can receive accurate control trigger information and switch the screen in response to the control trigger. The operations for the drawing content are mainly drawing operations and erasing operations, where the drawing operation corresponds to adding drawing strokes according to the touch operation data corresponding to the drawing operation in the drawing interface, and the erasing operation corresponds to deleting existing drawing strokes according to the touch operation data corresponding to the erasing operation in the drawing interface. In the case of drawing on a real blackboard, the contact area between the chalk and the blackboard is small when drawing, and the contact area between the eraser and the blackboard is large when erasing. In accordance with the habit of drawing on a real blackboard, in the smart interactive panel, drawing operations and erasing operations are generally distinguished by the touch area, that is, when the smart interactive panel detects a contact point with a small touch area on the drawing interface, it determines the contact point as a drawing contact point (in the embodiment of the present application, the corresponding touch operation is defined as the first touch operation), and when it detects a contact point with a large touch area, it determines the contact point as an erasing contact point (in the embodiment of the present application, the corresponding touch operation is defined as the second touch operation). Specifically, when drawing, it generates a drawing trace at the corresponding touch position following the movement of the drawing contact point, and specifically, when erasing, when it detects that the contact point has been erased, it displays a graphic mark of an eraser, and the graphic mark moves following the movement of the erasing contact point, and erases the drawing trace within the covered area by the graphic mark during the movement.
[0022] As long as there is no erroneous touch, the touch area can be used to switch to the drawing mode or the erasing mode, and the corresponding drawing or erasing operation can be performed. However, in actual operation, the user's clothing, drawing posture, etc. may all cause erroneous touch. As shown in the schematic diagram of the drawing hand state in FIG. 2, when drawing on the smart interactive panel in this posture, the drawing pen 21 is used to input handwriting, and when inputting handwriting, the palm 22 may approach or contact the smart interactive panel, generating a new contact point. That is, as shown in FIG. 3, the drawing interface 10 detects the drawing contact point 11 corresponding to the first touch operation and the erasing contact point 12 corresponding to the second touch operation, and the presence of multiple contact points causes the response of the drawing operation to be disturbed. Therefore, in this solution, when the drawing contact point or the erasing contact point is detected, the corresponding drawing operation or erasing operation is not performed, but the subsequent steps are used to comprehensively judge the touch operation data corresponding to the contact point in consideration of the user's drawing habits, thereby realizing an accurate response and avoiding the content in the drawing interface from changing other than the desired actual input due to erroneous operation in the drawing process. It should be noted that in FIG. 3, the circular drawing contact points 11 and erasing contact points 12 are merely exemplary shapes and size proportionalities and do not describe the actual shapes of the contact points.
[0023] Generally, a touch operation whose touch area is equal to or smaller than a preset area threshold is a first touch operation, and a touch operation whose touch area is larger than a preset area threshold is a second touch operation. Of course, when a special drawing is required, such as a large-area color graffiti or a bold input, the setting is different. In this case, the smart interactive panel sets a large drawing contact point according to the operation, and when a contact point of a corresponding size is received, it recognizes it as a drawing contact point and performs the drawing operation.
[0024] When the touch operation data generated based on the touch operations is obtained, a corresponding response is made in a drawing mode or an erasing mode based on the order of the touch operations and the movement distance when each touch operation is first. For the specific response process, refer to steps S120 to S160.
[0025] When this solution is specifically implemented, the period from when the contact points appear until all contact points disappear may be regarded as one processing cycle. For example, in the process of drawing a "V" shape, if there is no continuous drawing, two operations are required for two strokes, and the processing process of this solution can be executed once for each stroke.
[0026] Step S120: If a first touch operation is received first, switch to the drawing mode.
[0027] On a smart interactive panel, when touch operation data is generated based on one touch operation, a response is made corresponding to this unique touch operation. If this unique touch operation is determined to be the first touch operation (i.e., the drawing operation) based on the touch area, switch to the drawing mode.
[0028] Step S130: If a first touch operation is received first and a second touch operation starts to be received during the first touch operation, maintain the drawing mode.
[0029] When touch operation data is generated based on the first touch operation and the second touch operation, and the first touch operation (i.e., the drawing operation) is detected first among the multiple touch operations, within the period when the first touch operation exists, the first touch operation is a valid touch operation with the highest priority and must be responded to. Even if other touch operations are detected within the period when it exists, it is necessary to respond to the first touch operation while maintaining the drawing mode, that is, keep adding the drawing trace corresponding to the drawing interface according to the touch operation data corresponding to the first touch operation.
[0030] Step S140: If a second touch operation is received first, switch to the erasing mode.
[0031] In the process of receiving a touch operation, the smart interactive panel may generate touch operation data corresponding to one touch operation at first, and in this case, respond to this unique touch operation. If this unique touch operation is determined as a second touch operation (i.e., an erase operation) according to the touch area, the panel will enter an erase mode.
[0032] Step S150: If a second touch operation is first accepted and the mode transitions to the erase mode, and then the first touch operation begins to be accepted during the second touch operation, and the distance traveled by the second touch operation from the initial time at which the second touch operation is accepted to the initial time at which the first touch operation is accepted is equal to or less than the first distance threshold, a mode switch is performed, and the mode transitions from the erase mode to the drawing mode.
[0033] If the second touch operation is accepted first and the mode is switched to the erase mode, and then the first touch operation is immediately accepted, i.e., the second touch operation occurs before the initial time of the first touch operation and the movement distance is equal to or less than the first distance threshold, in which case it is determined that the actual touch operation was intended to erase rather than draw, and that the initial second touch operation was merely an erroneous operation due to the user's sleeve or personal drawing habit, and a corresponding mode switch is performed to switch from the erase mode to the drawing mode.
[0034] Step S160: If the second touch operation is accepted first, the mode transitions to the erase mode, and then the first touch operation starts to be accepted during the second touch operation, and the movement distance of the second touch operation from the initial time for accepting the second touch operation to the initial time for accepting the first touch operation is greater than the first distance threshold, the erase mode is maintained.
[0035] It is possible that initially only the second touch operation is accepted, and after transitioning to the erase mode, the second touch operation is performed to a certain extent before the first touch operation is accepted, i.e., the second touch operation occurs before the initial time of the first touch operation and the movement distance is greater than the first distance threshold. In this case, it is determined that the actual touch operation was intended to erase, and the second touch operation accepted later was an erroneous operation during the erase process, and the erase mode is continued.
[0036] In the implementation, if the clear mode is selected, the method may further include step S170 of updating the screen in the clear mode.
[0037] Step S170: in an erase mode, erase the corresponding drawing stroke according to the touch operation data generated based on the second touch operation, and ignore the first touch operation.
[0038] In the erase mode, there may be only the second touch operation or both the second touch operation and the first touch operation, but there is no response to the first touch operation. In this mode, the corresponding drawing stroke is erased according to the touch operation data generated based on the second touch operation, and there is no response to other touch operations. The specific erase process has been described above.
[0039] Corresponding to step S170, step S150 may include step S151 of restoring a screen that has been erased due to an erroneous operation.
[0040] Step S151: The drawn handwriting erased in the erase mode is restored.
[0041] The drawn handwriting that is erased due to an erroneous operation when the second touch operation is performed first, corresponding to the touch operation state described in step S150, is restored when the erase mode is switched to the drawing mode.
[0042] In the implementation, if the mode is the drawing mode, the method may further include step S180 of updating the screen in the drawing mode.
[0043] Step S180: In a drawing mode, add a drawing stroke according to the touch operation data generated based on the first touch operation, and ignore the second touch operation.
[0044] In the drawing mode, there may be only the first touch operation or both the first touch operation and the second touch operation, but there is no response to the second touch operation. In this mode, a corresponding drawing stroke is added according to the touch operation data generated based on the first touch operation, and there is no response to other touch operations. The specific drawing process has been described above.
[0045] In a specific drawing process, there may be a third touch operation in addition to the second touch operation, and for the third touch operation, step S180 further includes steps S181 to S183 for responding to the third touch operation in the drawing process.
[0046] Step S181: obtain touch operation data generated based on a third touch operation in the drawing mode, where the initial time of the third touch operation is later than the initial time of the current first touch operation and the initial time of the current second touch operation.
[0047] In the drawing mode, the simultaneously accepted touch operations may include, in addition to the first and second touch operations, a third touch operation that is accepted later than both of the first and second touch operations, and the response process corresponding to different touch operation data of the third touch operation may be different.
[0048] Step S182: If the third touch operation satisfies a preset drawing response condition, add a drawing stroke according to touch operation data generated based on the third touch operation, and the drawing response condition is that the touch area of the third touch operation is equal to or smaller than a preset area threshold, and the distance between the third touch operation at an initial time and the second touch operation at the same time is greater than a second distance threshold.
[0049] In the drawing process by the smart interactive panel, for one user, there is usually only one touch target at the same time. In the actual touch detection process, due to personal drawing habits, clothing, etc., the smart interactive panel may unexpectedly come into contact with the smart interactive panel, causing the smart interactive panel to detect multiple touch operations, that is, in addition to the normal and stable first touch operation, there may also be unstable extra touch operations. For such touch operations, the other drawing operation in the case of drawing by multiple people is deemed to be a valid touch operation, and this valid touch operation is a third touch operation that satisfies the preset drawing response condition, and its touch area must be equal to or smaller than the preset area threshold. Meanwhile, in the case of drawing by multiple people, the distance between the drawing operation by the second person and the second touch operation detected in the drawing process by the other person is sufficient, that is, the distance between the second touch operation at the same time is greater than the second distance threshold, and both the area and distance are satisfied. When this occurs, it is determined that the drawing response condition is satisfied, and the third touch operation is responded to and a corresponding drawing stroke is added.
[0050] Step S183: If the third touch operation does not satisfy the drawing response condition, the third touch operation is ignored.
[0051] If the touch area of the third touch operation is larger than a preset area threshold, i.e., the third touch operation corresponds to an erasing operation, or the distance between the third touch operation at the initial time and the second touch operation at the same time is equal to or smaller than a second distance threshold, i.e., the third touch operation is a drawing operation but is close to the second touch operation, it is regarded as an erroneous operation and no response is made, and the third touch operation is ignored in such cases.
[0052] Of course, if only the first touch operation is detected in the drawing mode, or if both the first and second touch operations are detected, only the first touch operation is responded to, that is, the process is performed as described in step S180.
[0053] Regarding the above-mentioned high-speed drawing process, a click response to the high-speed drawing can be performed in step S190.
[0054] Step S190: If a fourth touch operation is detected within a preset time after the touch operation is ended, the drawing mode is maintained.
[0055] In the case of a high-speed continuous drawing process, the pen is frequently raised and lowered, and in such a case, the number of erroneous operations increases when the pen is lowered, and in this case, the pen is often lowered when inputting the next character or figure. If the drawing operation type is determined for each pen down, when the palm touches the display screen before the pen tip, the eraser graphic mark is displayed when an erasing contact point is detected, and then, when a drawing contact point corresponding to the contact of the pen tip is detected, the display of the graphic mark is stopped and the drawing stroke is updated, so that the eraser is displayed blinking when switching strokes during high-speed drawing, which interferes with the high-speed drawing by the user. If the time determination is performed in step S190, and the time interval between the initial time of the current touch operation and the most recent drawing end time is short (i.e., a fourth touch operation is detected within a preset time after the touch operation ends), the drawing mode is maintained regardless of the type of the current touch operation. If the fourth touch operation is a drawing operation, add a drawing stroke in drawing mode, if the fourth touch operation is an erasing operation, ignore the touch operation in drawing mode, such a data processing mechanism corresponds to the actual drawing operation target when drawing, that is, responds to the high-frequency drawing operation that meets the time interval requirement as a direct stroke input. Specifically, the preset time length is an empirical value obtained by statistically calculating the drawing habit, for example, in the continuous drawing process, if the time interval between two adjacent strokes is within 0.5 seconds, the preset time length is set to 0.5 seconds, and specifically, it may be more accurate according to statistics, such as 0.45 seconds or 0.55 seconds.
[0056] 4 shows a schematic diagram of a combination of multiple touch points detected in one drawing operation. Here, the touch point 12a is determined as the touch point corresponding to the second touch operation according to the touch area S1, and is the first detected touch point, i.e., the first detected touch operation is the second touch operation, in this case, step S140 is executed, and the response state of the first touch operation detected during the second touch operation is determined according to the moving distance of the touch point 12a corresponding to the second touch operation until the first touch operation is detected. In this solution, when a new touch operation is detected when the contact point 12a has not obviously changed (i.e., the moving distance is less than or equal to the first distance threshold), and the new touch operation corresponding to the contact point 11a is determined to be the first touch operation based on the touch area S2, step S150 is executed, and when the contact point 12a has moved to the contact point 12b, i.e., when the moving distance of the second touch operation reaches R1 which exceeds the first distance threshold, the contact point 11a is detected and the new touch operation corresponding to the contact point 11a is determined to be the first touch operation based on the touch area S2 of the contact point 11a, step S160 is executed.
[0057] 5, the contact point 11 is the first contact point detected during the process of receiving the touch operation, and corresponds to the first touch operation, in this case, step S120 is executed, and the presence of the second touch operation is confirmed from the contact point 12c detected during the first touch operation, but the response state of the first touch operation is not affected, in this case, step S130 is executed. If the contact point 11c is detected after the contact points 11 and 12c are detected sequentially, the presence of the third touch operation is confirmed, and it is determined by the contact point 11c that the touch area corresponding to the third touch operation is equal to or smaller than the preset area threshold and the distance R2 between the third touch operation and the second touch operation is smaller than the second distance threshold, that is, the third touch operation corresponding to the contact point 11c does not satisfy the drawing response condition, in this case, step S183 is executed. If contact point 11d is detected after contact point 11 and contact point 12c are detected sequentially, the presence of a third touch operation is confirmed, and it is determined that the touch area corresponding to the third touch operation is equal to or smaller than a preset area threshold and that the distance R3 between the third touch operation and the second touch operation is greater than the second distance threshold, that is, the third touch operation corresponding to contact point 11d satisfies the drawing response condition, and in this case, step S182 is executed.
[0058] In this solution, the first distance threshold, the second distance threshold and the preset area threshold may be expressed in pixel units in the drawing interface, specifically, the distance between the touch points is described in integer units, but of course, may be defined as a decimal number, in this way to avoid the actual distance being equal to the corresponding threshold. Of course, each threshold may be specifically defined as a state, and when the distance is equal to the threshold, it is the corresponding state.
[0059] According to the above method, the process of performing a touch operation includes a step of receiving a touch operation and acquiring touch operation data generated based on a current touch operation, where the current touch operation includes a first touch operation and a second touch operation, the touch operation data including a touch area, the touch area of the first touch operation being equal to or smaller than a preset area threshold and the touch area of the second touch operation being larger than a preset area threshold; a step of transitioning to a drawing mode if the first touch operation is received first; a step of maintaining the drawing mode if the first touch operation is received first and the second touch operation starts to be received during the touch of the first touch operation; and a step of receiving the second touch operation first and transitioning to an erase mode. The method includes a step of switching modes and transitioning from the erase mode to the drawing mode if, after first accepting a second touch operation and transitioning to an erase mode, the first touch operation begins to be accepted during the touching of the second touch operation and the distance moved by the second touch operation from the initial time at which the second touch operation is accepted to the initial time at which the first touch operation is accepted is equal to or less than a first distance threshold, and a step of maintaining the erase mode if, after first accepting a second touch operation and transitioning to the erase mode, the first touch operation begins to be accepted during the touching of the second touch operation and the distance moved by the second touch operation from the initial time at which the second touch operation is accepted to the initial time at which the first touch operation is accepted is greater than the first distance threshold. When a first touch operation and a second touch operation on two contact points are detected in the drawing operation interface based on the infrared touch, a valid touch point of the two contact points is determined according to the touch operation data, and the touch operation data corresponding to the invalid touch point is discarded, the drawing interface updates the context of the two touch operations on the display screen according to the touch operation data corresponding to the valid touch point, and determines which of them is a valid touch operation and which is an invalid touch operation, and maintains or switches to a corresponding mode according to the valid touch operation, and ignores the touch operation data generated corresponding to the invalid touch operation, thereby realizing accurate response in the drawing process and reducing interference with the display of the drawing process caused by erroneous operations.
[0060] 6 is a structural schematic diagram of a touch-responsive device according to an embodiment of the present invention. As shown in FIG. 6, the touch-responsive device is applied to a terminal device, and includes a touch data acquisition unit 210, a drawing mode transition unit 220, a drawing mode storage unit 230, an erase mode transition unit 240, an erase mode switching unit 250, and an erase mode storage unit 260.
[0061] The touch data acquisition unit 210 receives a touch operation and acquires touch operation data generated based on the current touch operation, where the current touch operation includes a first touch operation and a second touch operation, the touch operation data includes a touch area, the touch area of the first touch operation is equal to or smaller than a preset area threshold, and the touch area of the second touch operation is larger than a preset area threshold. The drawing mode transition unit 220 transitions to the drawing mode when the first touch operation is received first. The drawing mode retention unit 230 retains the drawing mode when the first touch operation is received first and the second touch operation starts to be received during the touch of the first touch operation. The erase mode transition unit 240 receives the second touch operation first and transitions to the erase mode. When the erase mode switching unit 250 first accepts the second touch operation and transitions to the erase mode, and then starts accepting the first touch operation during the second touch operation, and the movement distance of the second touch operation from the initial time for accepting the second touch operation to the initial time for accepting the first touch operation is equal to or less than the first distance threshold, the erase mode switching unit 250 switches modes and transitions from the erase mode to the drawing mode. When the erase mode holding unit 260 first accepts the second touch operation and transitions to the erase mode, and then starts accepting the first touch operation during the second touch operation, and the movement distance of the second touch operation from the initial time for accepting the second touch operation to the initial time for accepting the first touch operation is greater than the first distance threshold, the erase mode holding unit 260 holds the erase mode.
[0062] Based on the above embodiment, the touch-responsive device further includes a drawing stroke erasing unit, in an erasing mode, erasing the corresponding drawing stroke according to the touch operation data generated based on the second touch operation, and ignoring the first touch operation.
[0063] Based on the above embodiment, the erasing mode switching unit 250 includes a handwriting recovery module for recovering the handwriting erased in the erasing mode.
[0064] Based on the above embodiment, the touch responsive device further includes a drawing stroke adding unit, in a drawing mode, adding a drawing stroke according to touch operation data generated based on the first touch operation, and ignoring the second touch operation.
[0065] Based on the above embodiment, the drawing handwriting adding unit includes: a third operation acquisition module that acquires touch operation data generated based on a third touch operation in a drawing mode, where an initial time of the third touch operation is later than an initial time of the current first touch operation and an initial time of the second touch operation; a third operation response module that adds the drawing handwriting according to the touch operation data generated based on the third touch operation if the third touch operation satisfies a preset drawing response condition, where the drawing response condition is that the touch area of the third touch operation is equal to or smaller than a preset area threshold and the distance between the third touch operation at the initial time and the second touch operation at the same time is greater than a second distance threshold; and a third operation clear module that ignores the third touch operation if the third touch operation does not satisfy the drawing response condition.
[0066] Based on the above embodiment, the touch responsive device further includes a continuous drawing storage unit for storing the drawing mode when a fourth touch operation is detected within a preset time after the touch operation is ended.
[0067] The touch-responsive device according to the embodiments of the present invention may be disposed in a terminal device and execute any of the touch-responsive methods according to the above embodiments, and have corresponding functions and beneficial effects.
[0068] In addition, in the above-mentioned embodiment of the touch response device, each part and module included in the device is merely logically divided according to function, and is not limited to these, as long as the desired function can be realized. Furthermore, the specific names of each functional part are merely for distinguishing them from each other, and do not limit the patent scope of the present invention.
[0069] Fig. 7 is a structural schematic diagram of a smart interactive panel according to an embodiment of the present invention. As shown in Fig. 7, the smart interactive panel includes a processor 310, a memory 320, an input device 330, an output device 340 and a communication device 350, in the smart interactive panel, the number of processors 310 may be one or more, in Fig. 7, one processor 310 is illustrated, and the processor 310, memory 320, input device 330, output device 340 and communication device 350 of the smart interactive panel may be connected by a bus or other method, in Fig. 7, the connection via a bus is illustrated.
[0070] The memory 320 is a computer-readable storage medium and can store software programs, computer-executable programs and modules, such as program instructions / modules (e.g., the touch data acquisition unit 210, the drawing mode transition unit 220, the drawing mode storage unit 230, the erase mode transition unit 240, the erase mode switching unit 250, and the erase mode storage unit 260 of the touch response device) corresponding to the touch response method in the embodiment of the present invention. The processor 310 executes the software programs, instructions and modules stored in the memory 320 to execute various functional applications and data processing of the smart interactive panel, that is, to realize the above-mentioned touch response method.
[0071] The memory 320 may include a program storage area and a data storage area, among which the program storage area may store an operating system, an application program required for at least one function, and the data storage area may store data created by the processor, etc. The memory 320 may further include a high-speed random access memory, a non-transitory memory, such as at least one disk storage device, a flash storage device, or other non-transitory solid-state storage device. In some embodiments, the memory 320 may include memories located remotely with respect to the processor 310, and these remote memories may be connected to the smart interactive panel via a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0072] The input device 330 receives input numeric and textual information and generates key signal inputs for user settings and function control of the smart interactive panel. The output device 340 may include a display device such as a display screen.
[0073] The above-mentioned smart interactive panel includes a touch-responsive device and can implement any touch-responsive method, with corresponding functions and beneficial effects.
[0074] An embodiment of the present invention also provides a computer-readable storage medium having a computer program stored thereon, the computer program being configured, when executed by a processor, to perform relevant operations of the touch response method according to any embodiment of the present application and to have corresponding functionality and beneficial effects.
[0075] As will be apparent to one skilled in the art, the embodiments of the present application may be provided as a method, a system, or a computer program product.
[0076] Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment that combines software and hardware. Furthermore, the present application may take the form of a computer program product embodied on a computer usable storage medium (including, but not limited to, a magnetic disk memory, a CD-ROM, an optical memory, etc.) that contains computer usable program code. The present application is described with reference to flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be noted that each step and / or block of the flowcharts and / or block diagrams, and combinations of steps and / or blocks of the flowcharts and / or block diagrams, may be implemented by computer program instructions. These computer program instructions may be supplied to a processor of a general purpose computer, a special purpose computer, an embedded processor, or other programmable data processing device to configure a machine, whereby the instructions executed by the processor of the computer or other programmable data processing device create an apparatus that implements a particular function in one or more steps of the flowcharts and / or in one or more blocks of the block diagrams. These computer program instructions may be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory create an article of manufacture that includes a command apparatus that implements a particular function in one or more steps of the flowcharts and / or one or more blocks of the block diagrams. These computer program instructions may be loaded into a computer or other programmable data processing device that performs example operational steps on the computer or other programmable device to perform a computer-implemented process, such that the instructions executing on the computer or other programmable device provide steps that implement the particular function in one or more steps of the flowcharts and / or one or more blocks of the block diagrams.
[0077] In a representative example of an arrangement, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory. The memory may include non-persistent, random access memory (RAM) and / or non-volatile memory, such as read only memory (ROM) or flash RAM, of computer-readable media. Memory is one example of a computer-readable medium.
[0078] Computer-readable media includes persistent and non-persistent media, removable and non-removable media, and may store information by any method or technology. Information may be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disk (DVD), other optical storage, magnetic cassette, magnetic tape memory or other magnetic storage device, any non-transmission media capable of storing information accessible by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.
[0079] It should be noted that the terms "comprise", "including" or any variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, product, or apparatus comprising a set of elements may include, in addition to those elements, other elements not expressly listed or elements inherent to such process, method, product, or apparatus. Unless further limited, an element qualified by the phrase "including a..." does not exclude the process, method, product, or apparatus that includes the element from including other identical elements.
[0080] The above are preferred embodiments of the present invention and the technical principles used. It is obvious to those skilled in the art that the present invention is not limited to the specific embodiments described herein, and those skilled in the art can make various obvious changes, adjustments and substitutions without departing from the scope of the present invention. Therefore, although the present invention has been described in detail by the above embodiments, the present invention is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is defined by the appended claims.
Claims
1. 1. A touch response method, comprising: receiving a touch operation and acquiring touch operation data generated based on a current touch operation, the current touch operation including a first touch operation and a second touch operation, the touch operation data including a touch area, the touch area of the first touch operation being equal to or smaller than a preset area threshold, and the touch area of the second touch operation being larger than a preset area threshold; transitioning to a drawing mode when the first touch operation is received first; holding a drawing mode when the first touch operation is received first and a second touch operation is started to be received during the first touch operation; receiving the second touch operation first and transitioning to an erase mode; a step of switching modes and transitioning from the erase mode to a drawing mode when the second touch operation is received first, the first touch operation is started to be received during the second touch operation, and a moving distance of the second touch operation from an initial time when the second touch operation is received to an initial time when the first touch operation is received is equal to or less than a first distance threshold; and after first accepting the second touch operation and transitioning to an erase mode, starting to accept the first touch operation during a touch to accept the second touch operation, and maintaining the erase mode when a moving distance of the second touch operation from an initial time when the second touch operation is accepted to an initial time when the first touch operation is accepted is greater than a first distance threshold. Touch response method.
2. and in the erasing mode, erasing the corresponding drawing stroke according to touch operation data generated based on the second touch operation, and ignoring the first touch operation. The touch responsive method of claim 1 .
3. the step of switching modes and transitioning from the erase mode to the drawing mode when the second touch operation is first received, the first touch operation is started to be received during touching of the second touch operation, and a moving distance of the second touch operation from an initial time when the second touch operation is received to an initial time when the first touch operation is received is equal to or less than a first distance threshold; and recovering the drawing trace erased in the erase mode. The touch responsive method of claim 2 .
4. The method further includes, in the drawing mode, adding a drawing stroke according to touch operation data generated based on the first touch operation, and ignoring the second touch operation. The touch response method according to any one of claims 1 to 3.
5. The step of adding a drawing stroke according to touch operation data generated based on the first touch operation in the drawing mode and ignoring the second touch operation includes: acquiring touch operation data generated based on a third touch operation in the drawing mode, wherein an initial time of the third touch operation is later than an initial time of the current first touch operation and an initial time of the second touch operation; adding a drawing trace according to touch operation data generated based on the third touch operation when the third touch operation satisfies a preset drawing response condition, the drawing response condition being that a touch area of the third touch operation is equal to or smaller than a preset area threshold and a distance between the third touch operation at an initial time and the second touch operation at the same time is greater than a second distance threshold; ignoring the third touch operation if the third touch operation does not satisfy the drawing response condition. The touch responsive method of claim 4.
6. In the drawing mode, after the step of adding a drawing stroke according to touch operation data generated based on the first touch operation and ignoring the second touch operation, and if a fourth touch operation is detected within a preset time after the touch operation is ended, maintaining the drawing mode. The touch responsive method of claim 4.
7. 1. A touch responsive device, comprising: a touch data acquisition unit that receives a touch operation and acquires touch operation data generated based on a current touch operation, the current touch operation including a first touch operation and a second touch operation, the touch operation data including a touch area, the touch area of the first touch operation being equal to or smaller than a preset area threshold, and the touch area of the second touch operation being larger than the preset area threshold; a drawing mode transition unit that transitions to a drawing mode when the first touch operation is received first; a drawing mode storage unit that stores a drawing mode when the first touch operation is received first and a second touch operation is started to be received during the first touch operation; an erase mode transition unit that first receives the second touch operation and transitions to an erase mode; an erasure mode switching unit that first accepts the second touch operation, transitions to an erasure mode, and then starts accepting the first touch operation during touching of the second touch operation, and when a moving distance of the second touch operation from an initial time when the second touch operation is accepted to an initial time when the first touch operation is accepted is equal to or less than a first distance threshold, switches modes and transitions from the erasure mode to a drawing mode; an erase mode holding unit that holds the erase mode when the second touch operation is first accepted, the touch mode is switched to an erase mode, and then the first touch operation is started to be accepted during a touch to accept the second touch operation, and a moving distance of the second touch operation from an initial time when the second touch operation is accepted to an initial time when the first touch operation is accepted is greater than a first distance threshold. Touch responsive device.
8. a handwriting erasing unit that, in the erasing mode, erases a corresponding drawn handwriting according to touch operation data generated based on the second touch operation and ignores the first touch operation. The touch responsive device of claim 7.
9. A smart interactive panel, comprising: one or more processors; a memory for storing one or more programs; A smart interactive panel, wherein the one or more programs, when executed by the one or more processors, cause the smart interactive panel to implement the touch response method according to any one of claims 1 to 3.
10. A computer-readable storage medium having a computer program stored thereon, the computer program implementing the touch response method according to any one of claims 1 to 3 when executed by a processor.
Citation Information
Patent Citations
Handwriting erasing method, system and device for electronic whiteboard and medium
CN114237417A
Method for acquiring handwritten input information and handwritten input device
JP2003015815A
Touch panel input device
JP2012252652A
Touch panel input device and input processing program
JP2015088147A
Input display device and input display method
JP2015225452A
