Method and apparatus for detecting touch action

Abstract

This application provides a method and apparatus for detecting touch actions. When a touch device performs a first touch action on the display screen of a display device, the touch device detects its relative position information during its movement and simultaneously sends the relative position information and pressure information to the display device. Subsequently, the display device compares the received relative position information with multiple detected movement path information to determine the correspondence between the movement path information and the received pressure information. When multiple touch devices simultaneously perform touch actions on the display screen, the display device can accurately match the movement information and pressure information belonging to the same touch device, thus improving the control effect of touch actions and the content to be displayed, and enhancing the user experience of the display device.

Description

Technical Field

[0001] This application relates to the field of electronic technology, and more particularly to a method and apparatus for detecting touch actions. Background Technology

[0002] Currently, more and more display devices are equipped with interactive display screens for users to interact with through the display page. For example, infrared touch screens allow the display screen to not only display images on the display side, but also allow users to perform touch actions such as clicking and sliding on the display side surface of the display screen using a stylus or other means to interact with the content at the corresponding position of the displayed image, or to realize the real-time display of the handwriting of the stylus.

[0003] In the prior art, styluses can also have pressure sensing function. When a user uses a stylus to perform touch actions on the display screen, the stylus can detect the current pressure of the stylus on the display screen and send the detected touch pressure information to the display device, so that the display device displays different handwriting on the display screen according to the pressure data corresponding to the touch pressure information.

[0004] Using existing technology, when multiple touch devices perform touch actions on the display device simultaneously, the display device cannot distinguish which touch device issued the detected touch position information and the received touch pressure information. This causes confusion in the correspondence between the touch position and touch pressure of different touch devices, affecting the display device's control over touch actions and the content to be displayed when multiple touch devices are touched at the same time, thereby reducing the user experience of the display device. Summary of the Invention

[0005] This application provides a method and apparatus for detecting touch actions, in order to solve the technical problem of confusion in the correspondence between the touch positions and touch pressures of different touch devices when multiple touch devices perform touch actions simultaneously in a display device.

[0006] This application provides a method for detecting touch actions, applicable to a display device, comprising: when multiple touch devices perform touch actions in multiple areas on a display screen, determining multiple movement path information corresponding to the touch actions in the multiple areas; receiving first pressure information and first relative position information sent by a first touch device among the multiple touch devices; wherein the first pressure information is used to indicate the pressure value exerted on the display screen by the first touch device when performing a first touch action in a first area on the display screen, and the first relative position information is used to indicate the relative position of the first touch device on the display screen when performing the first touch action; determining, based on the first relative position information, first movement path information corresponding to the first touch action of the first touch device from the multiple movement path information; and determining, based on the first movement path information and the first pressure information, first content corresponding to the first touch action displayed on the display screen.

[0007] In one embodiment of the first aspect of this application, determining the first movement path information corresponding to the first touch action of the first touch device from the plurality of movement path information based on the first relative position information includes: determining the movement path information belonging to the same area as the first relative position information among the plurality of movement path information as the first movement path information; or, determining the movement path information whose relative position distance to the first relative position information is less than a preset value among the plurality of movement path information as the first movement path information.

[0008] In one embodiment of the first aspect of this application, before determining the multiple movement path information corresponding to the touch actions in the multiple areas, the method further includes: determining the second relative position information of the second position of the first touch device on the display screen when the first touch device starts the first touch action; receiving the identification information of the first touch device sent by the first touch device; wherein the identification information is sent by the first touch device after determining that it has started the first touch action on the display screen; and sending the second relative position information to the first touch device.

[0009] In one embodiment of the first aspect of this application, after determining the multiple movement path information corresponding to the touch actions in the multiple areas, the method further includes: receiving first pressure information, first relative position information, and identification information of the first touch device sent by the first touch device among the multiple touch devices; the step of determining the first content corresponding to the first touch action displayed on the display screen based on the first movement path information and the first pressure information includes: determining the trajectory image corresponding to the first touch action displayed on the display screen based on the first movement path information; determining the thickness of the trajectory image based on the first pressure information; and determining the color of the trajectory image based on the identification information.

[0010] A second aspect of this application provides a method for detecting touch actions, applied to a first touch device, comprising: determining first pressure information of a first touch action performed by the first touch device in a first area on a display screen; determining first relative position information of the location of the first touch device; wherein the first relative position information is used to indicate the relative position of the first touch device on the display screen when performing the first touch action; and sending the first pressure information and the first relative position information to a display device so that the display device determines first content corresponding to the first touch action displayed on the display screen.

[0011] In a second aspect of this application, determining the first relative position information of the location of the first touch device includes: determining movement information of the first touch device moving from a second position to its current first position; wherein the second position is the position of the first touch device on the display screen when the touch action is initiated; and determining the first relative position information based on the movement information and the second relative position information of the second position on the display screen.

[0012] In a second aspect of this application, before determining the movement information of the first touch device moving from the second position to its current first position, the method further includes: when it is determined that the first touch device starts performing the first touch action on the display screen, sending identification information of the first touch device to the display device; and receiving the second relative position information of the second position on the display screen sent by the display device.

[0013] In a second aspect of this application, determining the first relative position information based on the movement information and the second relative position information includes: determining the absolute position change information from the second position to the first position based on the movement information; and changing the relative position of the second relative position information according to the same change method as the absolute position change information to obtain the first relative position information.

[0014] In a second aspect of this application, after determining the first relative position information of the location of the first touch device, the method further includes: sending the first pressure information, the first relative position information, and the identification information of the first touch device to the display device.

[0015] A third aspect of this application provides a touch action detection device, which can be a touch device and can serve as a first touch device to execute the touch action detection method provided in any embodiment of the first aspect of this application. For example, the device may include: a pressure detection component for determining first pressure information of the first touch action when the first touch device performs a first touch action in a first area on a display screen; a processing component for determining first relative position information of the location of the first touch device; wherein the first relative position information is used to indicate the relative position of the first touch device on the display screen when performing the first touch action; and a communication component for sending the first pressure information and the first relative position information to the display device so that the display device determines the first content corresponding to the first touch action displayed on the display screen.

[0016] In one embodiment of a third aspect of this application, the touch action detection device further includes: a movement detection component, configured to determine movement information of the first touch device moving from a second position to its current first position; wherein the second position is the position of the first touch device on the display screen when the touch action is initiated; the processing component is further configured to determine the first relative position information based on the movement information and the second relative position information of the second position on the display screen.

[0017] A fourth aspect of this application provides a touch action detection device, which may be a display device and can execute the touch action detection method provided in any embodiment of the second aspect of this application. For example, the device may include: a touch detection component, which determines multiple movement path information corresponding to touch actions in multiple areas on a display screen when multiple touch devices perform touch actions respectively; a communication component, which receives first pressure information and first relative position information sent by a first touch device among the multiple touch devices; wherein the first pressure information is used to indicate the pressure value of the first touch device on the display screen when performing a first touch action in a first area on the display screen, and the first relative position information is used to indicate the relative position of the first touch device on the display screen when performing the first touch action; a processing component, which determines first movement path information corresponding to the first touch action of the first touch device from the multiple movement path information based on the first relative position information; and determines first content corresponding to the first touch action displayed on the display screen based on the first movement path information and the first pressure information.

[0018] In summary, the touch action detection method and apparatus provided in this application can detect the relative position information of a touch device during its movement when the touch device performs a first touch action on the display screen of the display device, and simultaneously send the relative position information and pressure information to the display device. Subsequently, the display device compares the received relative position information with multiple detected movement path information to determine the correspondence between the movement path information and the received pressure information. When multiple touch devices simultaneously perform touch actions on the display screen, the display device can accurately match the movement information and pressure information belonging to the same touch device, enabling the display device to distinguish the pressure information of different touch devices. Furthermore, when multiple touch devices on the display device perform touch actions simultaneously, each touch device can display different content based on the pressure information, improving the control effect of touch actions and the content to be displayed, and enhancing the user experience of the display device. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 This is a schematic diagram illustrating the application scenario of this application;

[0021] Figure 2 To display an illustration of the handwriting shown on the screen;

[0022] Figure 3 This is a schematic diagram illustrating the process by which a display device determines the content to be displayed based on the touch input of a touch device.

[0023] Figure 4 A schematic diagram illustrating one method of dividing the display screen provided in this application into different areas;

[0024] Figure 5 A schematic diagram of an embodiment of information received by a display device;

[0025] Figure 6 A schematic diagram of the structure of an embodiment of the touch device provided in this application;

[0026] Figure 7 A flowchart illustrating an embodiment of the touch action detection method provided in this application;

[0027] Figure 8 A schematic diagram illustrating handwriting information for touch actions provided in an embodiment of this application;

[0028] Figure 9 This is a schematic diagram of another embodiment of information received by a display device. Detailed Implementation

[0029] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0030] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented, for example, in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0031] The technical solutions of this application will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0032] Figure 1 This is a schematic diagram illustrating the application scenario of this application, such as... Figure 1 As shown, this application can be applied to a display device 1, which includes any electronic device equipped with a display screen 11, such as a mobile phone, tablet computer, smart interactive flat panel, or student online learning terminal product. Specifically, the display screen 11 on the display device 1 can be used to display screen content to the user on its display side. At the same time, the display screen 11 also allows the user to use a stylus 2 or other means to perform touch actions such as clicking, sliding, and writing on the display side of the display screen 11, thereby realizing interactive operation on the content corresponding to the screen content displayed on the display screen 11, or realizing real-time display of the handwriting of the stylus 2 used by the user.

[0033] For display device 1, it is necessary to determine the specific touch position of stylus 2 on display screen 11 in order to further determine the subsequent operation or the specific content to be displayed based on the touch position. In order to determine the position of stylus 2's touch action, in some embodiments, display device 1 can set an infrared emitter and an infrared receiver on the display side of display screen 11. The infrared light emitted by the infrared emitter is received by the infrared receiver, and the infrared light emitted by the infrared emitter can form an infrared light matrix on the display side surface of display screen 11. When no stylus 2 touches display screen 11, the infrared light received by infrared receiver is relatively stable. When the user touches display screen 11 with stylus 2, stylus 2 can change the infrared light matrix on the surface of display screen 11, causing the infrared light received by infrared receiver to change. Then, the processing component 12 in display device 1 determines that a touch action has occurred on the surface of display screen 11 when the infrared light of infrared receiver changes, and further determines the specific position of the touch action.

[0034] In some embodiments, the stylus 2 may also have a pressure-sensing function. When a user uses the stylus 2 to perform touch actions on the display screen 11, the stylus 2 can detect the current pressure applied to the display screen 11 and send the detected touch pressure information to the display device 1, so that the display device 1 displays different handwriting 21 on the display screen 11 according to the magnitude of the pressure data corresponding to the touch pressure information. For example, Figure 2Schematic diagram of the handwriting displayed on the display screen. For the same stroke " / " on the display screen 11, when the display device 1 receives a relatively small pressure data 1, the displayed stroke is thinner; when the display device 1 receives a relatively large pressure data 2, the displayed stroke is thicker. At this time, when the user uses the stylus 2, it can be felt that the greater the touch pressure, the thicker the handwriting displayed on the display screen 11; the smaller the touch pressure, the thinner the handwriting displayed on the display screen 11, thus enhancing the interaction between the display device 1 and the user and enriching the functions of the display device.

[0035] In some embodiments, Figure 3 Schematic flowchart of a display device determining display content according to the touch of a touch device. As Figure 3 shown in the flowchart can be applied to scenarios such as Figure 1 shown in the scenario, and is executed by the processing component 12 in the touch device 2 and the display device 1. The touch device 2 can be a stylus in the scenario as Figure 1 shown, or other devices capable of performing touch actions on an infrared display screen. Then, as Figure 3 shown, when the user S10 uses the touch device 2 to perform a touch action on the display screen 11 of the display device 1, the processing component 12 of the display device 1 determines, in S112, the change in the infrared rays received by the infrared receiver, and determines that the touch position of the touch device 2 on the display screen 11 is a sliding touch from position A to position B. At the same time, the touch device 2 determines the touch pressure information of the touch device on the display device through S111. S111 and S112 should be executed simultaneously, so that the touch device 2 can determine the touch pressure information during the sliding touch of the touch device 2 from position A to position B through S111. Subsequently, the touch device 2 sends the determined touch pressure information to the processing component 12 through S13, and the processing component 12 jointly determines the content to be displayed according to the received touch pressure information and touch position information. For example, the content to be displayed can be the handwriting from position A to position B, and the thickness of the handwriting is related to the magnitude of the touch pressure. Finally, the processing component 12 controls the display screen 11 to display the determined handwriting from position A to position B.

[0036] In some embodiments, the display device 1 can also divide the display screen 11 into different regions. When different users use their respective touch devices 2, different touch devices 2 can simultaneously perform touch actions on different regions of the display screen 11. For example, Figure 4 Schematic diagram of a way to divide the display screen provided in this application into different regions. When implementing some specific functions, for example, when the display device is an intelligent interactive flat panel used by a teacher, during class, the teacher asks two students to do exercises simultaneously on both sides of the interactive flat panel. In this case, as Figure 4 The display screen 11 of the display device 1 shown can be divided into two areas, denoted as area A and area B. Two students can use two touch devices to complete the questions in the two areas respectively. When one student uses touch device 21 to slide in area A, display device 1 can display handwriting 201 in area A on the left side of display screen 11. When the other student uses touch device 22 to slide in area B, display device 1 can display handwriting 202 in area B on the right side of display screen 11. In some embodiments, handwriting 201 and handwriting 202 can also be distinguished by different colors.

[0037] In some embodiments, such as Figure 4 Each touch device shown also has a touch pressure sensing function. Each touch device can detect the touch pressure information during its own swipe and convert its respective touch pressure information according to the following... Figure 3 The text is sent to the display device 1 in the manner shown, and the display device determines the thickness of the strokes based on the amount of touch pressure. Figure 5 This is a schematic diagram of an embodiment of information received by a display device, wherein, corresponding to such... Figure 4 The processing component 12 within the display device 1 in the illustrated embodiment. For example... Figure 5 As shown, when touch device 21 performs a touch action in area A, touch device 22 also performs a touch action in area B. For processing component 12, it can detect touch position information a and touch position information b corresponding to the two touch devices on display screen 11, and can receive touch pressure information c sent by touch device 21 and touch pressure information d sent by touch device 22. However, at this time, processing component 12 cannot correlate the two received touch pressure information cd with the two detected touch position information ab. Even if it detects the touch positions of the two touch devices on display screen 11 and receives the pressure data from the two touch devices, it cannot distinguish which touch device specifically sent the touch position information or touch pressure information. Therefore, it cannot determine the handwriting content subsequently displayed by touch devices 21 and 22, making it impossible for processing component 12 to determine... Figure 5 The correspondence shown by the dashed line causes confusion in the correspondence between the touch position and touch pressure of different touch devices, affecting the control effect of the display device 1 on the touch action and the content to be displayed when multiple touch devices touch at the same time, thereby reducing the user experience of the display device 1.

[0038] Therefore, this application also provides a method for detecting touch actions. When a touch device performs a touch action on the display screen of a display device, the touch device detects its own position during movement and simultaneously sends its relative position information and pressure information to the display device. This allows the display device to compare the received position information with the movement path information of the detected touch device, thereby determining the correspondence between the movement path information and the received pressure information. When multiple touch devices perform touch actions on the display screen simultaneously, the display device can compare the received relative position information with multiple movement path information respectively, thereby determining the movement path information corresponding to the relative position information. Furthermore, the pressure information received along with the relative position information is correlated with the movement path information. This allows the display device to distinguish the correspondence between the movement path information and pressure information of different touch devices, thereby improving the control effect of the display device on touch actions and the content to be displayed when multiple touch devices are simultaneously touching, and enhancing the user experience of the display device.

[0039] Figure 6 This is a schematic diagram of the structure of an embodiment of the touch device provided in this application. Figure 6 In the illustrated embodiment, to implement the touch action detection method provided in this application, the touch device 2 specifically includes: a motion detection component 211, a processing component 212, a communication component 213, and a pressure detection component 214. The processing component 212 can be a CPU, MCU, SOC, or other processing chip, possessing the capability to process relevant data. The motion detection component 211 can be an accelerometer, gyroscope, or positioning chip, etc. When the touch device 2 moves, the motion detection component 211 can detect the movement of the touch device and determine movement parameters such as direction and distance, then send them to the processing component 212. The communication component 213 can be a chip providing wireless communication functions such as Wi-Fi or Bluetooth. The processing component 212 can communicate wirelessly with the display device 1 through the communication component 213, and the display device 1 also has a corresponding communication component to receive data sent by the touch device. The pressure detection component 214 can be a pressure sensor, etc., used to detect the pressure information of the touch device's touch action on the display screen.

[0040] The touch device provided in this application, when communicating with a display device, can also have unique identification information, such as a wireless communication ID, to distinguish different touch devices. This identification information can be a hardware identification code or other information uniquely identifying the touch device; or it can be the touch device's wireless communication address used as its identification information after establishing a wireless communication connection with the display device; or the display device can assign one-to-one corresponding identification information to all multiple touch devices connected to it according to a preset rule.

[0041] Figure 7 A flowchart illustrating an embodiment of the touch action detection method provided in this application is shown below. Figure 7 The illustrated embodiments can be applied to, for example, Figure 4 In the scenario shown, the process is executed by a display device and multiple touch devices. The method executed by the display device can be performed by a processing component within the display device, which may be a CPU, MCU, SOC, or other processing chip. Specifically, in Figure 7 In the example shown, the first touch device among multiple touch devices is used as an example. The first touch device can be any one of the multiple touch devices, such as... Figure 7 As shown, the touch action detection method provided in this embodiment includes:

[0042] S100: The first touch device performs a touch action on the display screen of the display device.

[0043] Specifically, the touch action detection method provided in this embodiment begins execution after the first touch device performs a touch action, for example, in... Figure 4 In the scenario shown, taking the first touch device 21 as an example, the first touch device 21 performs a first touch action on the display screen 11 of the display screen 1 under the user's control. In this embodiment, the first touch action is exemplified by the sliding action of the first touch device 21 on the display screen 11 when the user uses the first touch device 21 to write, forming handwriting 201. After the first touch device 21 begins to perform the first touch action on the display screen, the first touch device 21 and the display device 1 perform the following... Figure 7 The initialization process of the first part is shown.

[0044] S101: The first touch device determines to start the first touch action.

[0045] In some embodiments, the first touch device 21 can specifically determine that the first touch device 21 has performed a first touch action by detecting the pressure change detected by its pressure detection component. At the same time, the first touch device can also obtain the pressure information when the first touch device starts the first touch action at the second position through the pressure detection component in S101.

[0046] Figure 8 This is a schematic diagram of handwriting information for touch actions provided in the embodiments of this application. Figure 8 Taking the first touch device 21 as an example, under the control of the user, the first touch device 21 writes on the display screen 11 and performs a sliding first touch action. Assuming that the movement path of the first touch action is from x (denoted as the second position) to y (denoted as the third position), in S101, when the first touch device 21 contacts the display screen 11 at the initial second position x, the first touch device 21 can detect the change in pressure data through the pressure detection component 214 and obtain the pressure information of the touch device 2 at the second position.

[0047] S102: The processing component of the display device determines, through the display screen, the second relative position information of the second position on the display screen when the first touch device performs the first touch action.

[0048] Similarly Figure 8 Taking the first touch device 21 as an example, when the first touch device 21 contacts the display screen 11 at the initial second position x, the processing component 12 in the display device can detect the change in infrared light at the second position x on the display screen 11, thereby determining the second relative position information corresponding to the second position x on the display screen. At this time, the second relative position information determined by the display device 1 is the position relative to the display screen 11. A vertical coordinate system can be established on the display screen 11 along the directions of the long side and the wide side, and the second relative position information is the relative coordinate value of the second position x on the established coordinate system.

[0049] S103: The first touch device sends its identification information to the display device, and correspondingly, the display device receives the identification information sent by the first touch device.

[0050] Specifically, after determining the start of a touch action in S101, the first touch device can send its identification information to the display device in S103. This information can be sent via a communication component to the processing component in the display device. In some embodiments, the first touch device can also send the identification information and the pressure information detected by the second position to the display device together in S103.

[0051] In some embodiments, S101-S103 executed by the first touch device and S103 executed by the display device can be executed simultaneously by the first touch device and the processing component after the first touch device contacts the display screen at the initial second position. This application does not limit the order of S101-S103.

[0052] S104: The display device sends the detected second relative position information to the touch device, and the touch device receives the second relative position information sent by the display device.

[0053] Similarly Figure 8 The scenario shown is an example. After the display device detects the second relative position information of the second position x in S102, if it receives the identification information sent by the first touch device 21, it determines that the second relative position information of position x corresponds to the touch action of the first touch device 21. Furthermore, based on the fact that the second position x is within area A of the display screen 11, it can determine that the first touch action of the first touch device 21 was performed within area A. Therefore, after receiving the identification information sent by the first touch device 21, the display device can send the second relative position information of the second position x to the first touch device 21. Similarly, in... Figure 8 After the display device detects the relative position information of the second position m in S102, if it receives the identification information sent by the second touch device 22, it determines that the relative position information of the m position corresponds to the second touch action of the second touch device 22. Furthermore, based on the fact that the second position m is within area B of the display screen 11, it can be determined that the second touch action of the second touch device 22 is performed within area B. Therefore, after receiving the identification information sent by the second touch device 22, the display device can send the relative position information of the second position m to the second touch device 22.

[0054] In summary, after the first touch device begins its first touch action on the display screen in S100, it completes the first part of the initialization process. The first touch device obtains the second relative coordinates of the second position where it began the first touch action, enabling the subsequent second part of the detection process. The following section discusses... Figure 7 The detection process for S200-S207 shown is explained.

[0055] S200: When the first touch device performs a first touch action on the display, it determines its movement information.

[0056] Specifically, the first touch device can determine, through its motion detection device, the direction and distance of movement from the second position to the current first position. For example, the motion detection device can be an accelerometer and a gyroscope, allowing the first touch device to measure the distance moved. The specific implementation of calculating the distance using the accelerometer and gyroscope can refer to existing technologies; this application does not limit the specific calculation formula and principle here.

[0057] S201: The first touch device determines its current first relative position information based on the movement information obtained in S200 and the second relative position information obtained during the initialization process.

[0058] Among them, with Figure 8 The scenario shown is used as an example. Assuming the first touch action performed by the first touch device 21 is a sliding touch action between the second position x and the third position y within region A, the first touch device can determine the first relative position information of the first position z in S201 at any first position z between the aforementioned sliding actions. This first relative position information is the first relative position information of the first position z on the display screen, that is, the relative position of the first position z on the display screen, which can be represented by coordinates. In some embodiments, the first position z can also be the same as the third position y.

[0059] To determine the second position information, the first touch device 21 can determine the absolute position change information of the first touch device from the second position to the first position based on the movement information. Subsequently, following the same change pattern as the absolute position change information, the second relative position information of the second position x is changed to obtain the first relative position information of the first position z. For example, the change of each value in the coordinate system established on the display screen represents a distance of 1cm on the display screen. Therefore, when the movement information is a 1cm movement to the right of the display screen, the horizontal coordinates corresponding to the left and right sides of the coordinates (a, b) of the second relative position can be modified to obtain the coordinates (a+1, b) of the first relative position.

[0060] S202: When the first touch device performs a first touch action on the display, it determines the first pressure information.

[0061] Specifically, the first touch device can obtain first pressure information from the pressure detection component during the first touch action, so as to... Figure 8The scenario shown is used as an example. Suppose that the first touch action performed by the first touch device 21 is a sliding touch action between the second position x and the third position y in area A. Then the first pressure information can be the pressure value of the first position z, or it can be the average pressure between the second position x and the third position y, etc.

[0062] S203: When the first touch device performs a first touch action on the display, the display device determines the first movement path information, so as to... Figure 8 The scenario shown is used as an example. Assuming that the first touch action performed by the first touch device 21 is a sliding touch action between the second position x and the third position y in area A, the first movement path information is the handwriting 201 between the second position x and the third position y in the figure.

[0063] S204: The first touch device sends the first pressure information determined in S201, the first relative position information determined in S202, and the identification information of the first touch device to the display device through the communication component. Correspondingly, the processing component in the display device receives the first relative position information, the first pressure information, and the identification information sent from the touch device, so that the display device determines the first content corresponding to the first touch action in S205-S206 based on the first relative position information, the first pressure information, and the identification information, combined with the first movement path information obtained in S203.

[0064] S205: Since the display device may have multiple touch devices performing touch actions in multiple areas on the display screen, and the display device may simultaneously receive multiple movement path information corresponding to different touch actions in multiple areas, after receiving the first relative position information, first pressure information, and identification information sent by the first touch device, the display device first determines the first movement path information corresponding to the first touch device from the multiple movement path information based on the first relative position information in S205, thereby associating the first movement path information with the first pressure information (the first pressure information is received simultaneously with the first relative position information).

[0065] In some embodiments, determining the first movement path based on the first relative position information in S205 specifically includes: determining that, among the first relative position information and the acquired multiple movement path information, movement path information belonging to the same area is the first movement path information; or, determining that, among the first relative position information and the acquired multiple movement path information, movement path information where the distance between relative positions is less than a preset value is the first movement path information. For example, Figure 9 This is a schematic diagram of another embodiment of information received by a display device. Wherein, corresponding to... Figure 8In the scenario shown, when the first touch device 21 writes on the display screen 11 under the control of a user, and a first movement touch action occurs within area A of the display screen 11 from the second position x to the third position y, simultaneously, the second touch device 22 also writes on the display screen 11 under the control of another user, and a first movement touch action occurs within area B of the display screen 11 from the second position m to the third position n. At this time, the processing component 12 in the display device 1 will detect the first movement path information xy and the second movement path information mn. Simultaneously, the processing component will also receive "first relative position information z, first pressure information c, and marker information 21" sent by the touch device 21, and "second relative position information p, second pressure information d, and marker information 22" sent by the touch device 22.

[0066] To determine which touch device 21 the received pressure information c and pressure information d correspond to, the processing component 12 compares the first relative position z with the first movement path information xy and the second movement path information mn, respectively. Upon confirming that the first relative position z and the first movement path information xy both belong to region A, it determines that the first movement path information xy and the first pressure information c correspond to the same touch device, and specifically identifies the touch device 21 corresponding to the movement path based on the marking information 21. Similarly, the processing component 12 can confirm that the second relative position information p and the second movement path information mn both belong to region B, determine that the second movement path information mn and the second pressure information d correspond to the same touch device, and specifically identify the second touch device 22 based on the marking information 22.

[0067] It should be noted that, in this embodiment of the application, the display device divides the display screen into two areas, A and B, as an example. In specific implementations, the display screen can be divided into more areas, and the size and shape of each area are not limited. The specific implementation method and principle of the touch action detection method are the same, and will not be repeated here.

[0068] S206: The display device determines the first content corresponding to the first touch action performed by the first touch device based on the first movement path information and pressure information corresponding to the first touch device determined in S205. Then, in S207, the display device displays the content determined in S206 on the display screen 11.

[0069] Among them, with Figure 8The scenario shown is an example. When the first touch device 21 performs a first movement touch action from the second position x to the third position y on the display screen 11 under the control of a user, the display device uses the detected first movement path information xy and the first pressure information c determined in S205 to determine that the content to be displayed is a handwriting trajectory image of xy. The thickness of the handwriting trajectory image is proportional to the pressure value corresponding to the first pressure information c. Finally, the processing component 12 controls the display screen 11 to display the handwriting image in area A. Similarly, the processing component 12 can also determine the handwriting trajectory image of mn based on the second movement path information mn and the second pressure information d, and control the display screen 11 to display the handwriting trajectory image in area B.

[0070] In some embodiments, the processing component 12 may also display different colors for the handwriting of different touch devices according to the identification information of the touch devices corresponding to different touch actions. For example, the handwriting trajectory image of the first touch device 21 displayed in area A of the display screen 11 is blue, and the handwriting image of the second touch device 22 displayed in area B of the display screen 11 is red.

[0071] It is understandable that the above... Figure 7 The processes S201-S207 shown can be repeatedly executed after the first part is completed. That is, as the first touch device moves continuously on the display screen under the user's control, the first touch device and the display device can repeatedly and cyclically execute the above detection process, or execute the above detection process once at a preset time interval.

[0072] In some embodiments, if the first touch device does not detect pressure information for a period of time during the repeated execution of the above detection process, it can stop repeating the detection and end the entire process. The next time the first touch device detects pressure information, the entire touch action detection process is re-executed starting from the first initialization process.

[0073] In summary, the touch action detection method provided in this application can detect the relative position information of a touch device during its movement when the touch device performs a first touch action on the display screen of the display device, and simultaneously send the relative position information and pressure information to the display device. Subsequently, the display device compares the received relative position information with multiple detected movement path information to determine the correspondence between the movement path information and the received pressure information. When multiple touch devices simultaneously perform touch actions on the display screen, the display device can accurately match the movement information and pressure information belonging to the same touch device, enabling the display device to distinguish the pressure information of different touch devices. Furthermore, when multiple touch devices on the display device perform touch actions simultaneously, each touch device can display different content based on the pressure information, improving the control effect of touch actions and the content to be displayed, and enhancing the user experience of the display device.

[0074] In the foregoing embodiments, the touch action detection method provided by the embodiments of this application has been described. To implement the functions of the methods provided by the embodiments of this application, the electronic device serving as the execution subject may include hardware structures and / or software modules, implementing the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is executed in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.

[0075] In some embodiments, the first touch device for performing a detection method for touch actions may include, for example, Figure 6 The touch device shown includes a motion detection component 211, a processing component 212, a communication component 213, and a pressure detection component 214, which are respectively used to perform actions such as... Figure 7 The method steps corresponding to the touch action detection method shown are as follows: For example, when the first touch device performs a first touch action in a first area on the display screen, the pressure detection component 214 determines the first pressure information of the first touch action; the processing component 212 determines the first relative position information of the location of the first touch device; wherein, the first relative position information is used to indicate the relative position of the first touch device on the display screen when performing the first touch action; the communication component 213 sends the first pressure information and the first relative position information to the display device so that the display device determines the first content corresponding to the first touch action displayed on the display screen; the movement detection component 211 determines the movement information of the first touch device from a second position to its current first position. The specific implementation and principle can be found in the foregoing embodiments of this application, and will not be repeated here.

[0076] In some embodiments, a display device for performing a touch action detection method may include a touch detection component, a communication component, and a processing component. For example, the touch detection component determines multiple movement path information corresponding to touch actions in multiple areas of a display screen when multiple touch devices perform touch actions respectively. The communication component receives first pressure information and first relative position information sent by a first touch device among the multiple touch devices. The first pressure information indicates the pressure value exerted by the first touch device on the display screen when performing a first touch action in a first area of ​​the display screen, and the first relative position information indicates the relative position of the first touch device on the display screen when performing the first touch action. The processing component determines, based on the first relative position information, first movement path information corresponding to the first touch action of the first touch device from multiple movement path information; and determines, based on the first movement path information and the first pressure information, first content corresponding to the first touch action displayed on the display screen. The specific implementation and principle can be found in the foregoing embodiments of this application, and will not be repeated here.

[0077] It should be noted that the division of components and modules in the touch action detection device described above in this embodiment is merely a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. These modules can be implemented entirely in software via processing elements; they can be fully implemented in hardware; or some modules can be implemented by processing elements calling software, while others are implemented in hardware. A processing element can be a separate entity, or it can be integrated into a chip within the device. Alternatively, it can be stored as program code in the device's memory, and called and executed by a processing element of the device. The implementation of other modules is similar. Furthermore, these modules can be fully or partially integrated together, or implemented independently. The main control component described here can be an integrated circuit with signal processing capabilities. During implementation, each step of the above method or each of the above modules can be completed through the integrated logic circuit in the hardware of the main control component or through software instructions.

[0078] For example, these components / modules can be one or more integrated circuits configured to implement the above methods, such as one or more application-specific integrated circuits (ASICs), one or more digital signal processors (DSPs), or one or more field-programmable gate arrays (FPGAs). As another example, when a module is implemented using processing element scheduler code, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processor capable of calling program code. Furthermore, these modules can be integrated together to implement a system-on-a-chip (SOC).

[0079] In the above embodiments, all or part of the method steps executed by the touch action detection device can be implemented by software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented in whole or in part as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state disks (SSDs)).

[0080] This application also provides an electronic device, including: a processor and a memory; wherein, the memory stores a computer program, and when the processor executes the computer program, the processor can be used to perform a touch action detection method performed by a display device as in any of the foregoing embodiments of this application.

[0081] This application also provides an electronic device, including: a processor and a memory; wherein, the memory stores a computer program, and when the processor executes the computer program, the processor can be used to perform a touch action detection method as performed by any of the first touch devices in the foregoing embodiments of this application.

[0082] This application also provides a computer-readable storage medium storing a computer program, which, when executed, can be used to perform a touch action detection method performed by a display device as described in any of the foregoing embodiments of this application.

[0083] This application also provides a computer-readable storage medium storing a computer program, which, when executed, can be used to perform a detection method for a touch action performed by a first touch device as described in any of the foregoing embodiments of this application.

[0084] This application also provides a chip for executing instructions, the chip being used to perform a touch action detection method performed by a display device as described in any of the foregoing embodiments of this application.

[0085] This application also provides a chip for executing instructions, the chip being used to perform a touch action detection method performed by a display device as described in any of the foregoing embodiments of this application.

[0086] This application also provides a program product, which includes a computer program stored in a storage medium. At least one processor can read the computer program from the storage medium. When the at least one processor executes the computer program, it can implement the touch detection method executed by the touch detection device as in any of the foregoing embodiments of this application.

[0087] This application also provides a program product, which includes a computer program stored in a storage medium. At least one processor can read the computer program from the storage medium. When the at least one processor executes the computer program, it can implement the touch action detection method performed by the first touch device as in any of the foregoing embodiments of this application.

[0088] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0089] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A method for detecting touch actions, applied to a display device, characterized in that, include: When multiple touch devices perform touch actions in multiple areas of the display screen, determine multiple movement path information corresponding to the touch actions in the multiple areas; The system receives first pressure information and first relative position information simultaneously sent by the first touch device among the plurality of touch devices; wherein, the first pressure information is used to indicate the pressure value of the first touch device on the display screen when it performs a first touch action in a first area on the display screen, and the first relative position information is used to indicate the relative position of the first touch device on the display screen when it performs the first touch action. Based on the first relative position information, determine the first movement path information corresponding to the first touch action of the first touch device from the plurality of movement path information; Based on the first movement path information and the first pressure information, determine the first content corresponding to the first touch action displayed on the display screen; Before determining the multiple movement path information corresponding to the touch actions in the multiple areas, the method further includes: Determine the second relative position information of the second position of the first touch device on the display screen when the first touch action is initiated; Receive identification information of the first touch device sent by the first touch device; wherein the identification information is sent by the first touch device after determining that the first touch action has started on the display screen; The second relative position information is sent to the first touch device so that the first touch device determines the first relative position information based on its movement information and the second relative position information, wherein the movement information is the movement information of the first touch device moving from the second position to its current first position.

2. The method according to claim 1, characterized in that, The step of determining the first movement path information corresponding to the first touch action of the first touch device from the plurality of movement path information based on the first relative position information includes: Among multiple movement path information, the movement path information that belongs to the same area as the first relative position information is identified as the first movement path information; Alternatively, the first movement path information can be identified as the movement path information whose relative position to the first relative position information is less than a preset value among multiple movement path information.

3. The method according to claim 1 or 2, characterized in that, The step of determining the first content corresponding to the first touch action displayed on the display screen based on the first movement path information and the first pressure information includes: Based on the first movement path information, determine the trajectory image corresponding to the first touch action displayed on the display screen; The thickness of the trajectory image is determined based on the first pressure information; The color of the trajectory image is determined based on the identification information.

4. A method for detecting touch actions, applied to a first touch device, characterized in that, include: Determine the first pressure information of the first touch action performed by the first touch device in a first area on the display screen; First relative position information is used to determine the location of the first touch device; wherein, the first relative position information is used to indicate the relative position of the first touch device on the display screen when the first touch device performs the first touch action; Simultaneously send the first pressure information and the first relative position information to the display device, so that the display device can determine the first content corresponding to the first touch action displayed on the display screen; The first relative position information for determining the location of the first touch device includes: Determine the movement information of the first touch device from the second position to its current first position; wherein, the second position is the position of the first touch device on the display screen when the touch action is initiated; The first relative position information is determined based on the movement information and the second relative position information of the second position on the display screen; Before determining the movement information of the first touch device from the second position to its current first position, the method further includes: When it is determined that the first touch device starts performing the first touch action on the display screen, the identification information of the first touch device is sent to the display device; The first touch device receives the second relative position information of the second position on the display screen sent by the display device, so that the first touch device determines the first relative position information based on its movement information and the second relative position information.

5. The method according to claim 4, characterized in that, Determining the first relative position information based on the movement information and the second relative position information includes: The absolute position change information from the second position to the first position is determined based on the movement information; The first relative position information is obtained by changing the relative position of the second relative position information in the same way as the absolute position change information.

6. A touch action detection device, wherein the detection device is disposed on a first touch device, characterized in that, include: A pressure detection component is used to determine first pressure information of the first touch action when the first touch device performs a first touch action in a first area on a display screen; A processing component is used to determine first relative position information of the location of the first touch device; wherein the first relative position information is used to indicate the relative position of the first touch device on the display screen when the first touch device performs the first touch action; A communication component is used to simultaneously send the first pressure information and the first relative position information to a display device, so that the display device determines the first content corresponding to the first touch action displayed on the display screen. A motion detection component is used to determine motion information of the first touch device moving from a second position to its current first position; wherein, the second position is the position of the first touch device on the display screen when the touch action is initiated; The processing component is further configured to determine the first relative position information based on the movement information and the second relative position information of the second position on the display screen; before determining the movement information of the first touch device moving from the second position to its current first position, the processing component is further configured to: When it is determined that the first touch device starts performing the first touch action on the display screen, the identification information of the first touch device is sent to the display device; The first touch device receives the second relative position information of the second position on the display screen sent by the display device, so that the first touch device determines the first relative position information based on its movement information and the second relative position information.

7. A touch action detection device, said detection device being disposed on a display device, characterized in that, include: A touch detection component determines multiple movement path information corresponding to the touch actions in multiple areas of a display screen when multiple touch devices perform touch actions in those multiple areas. A communication component is used to receive first pressure information and first relative position information simultaneously sent by the first touch device among the plurality of touch devices; wherein, the first pressure information is used to indicate the pressure value of the first touch device on the display screen when performing a first touch action in a first area on the display screen, and the first relative position information is used to indicate the relative position of the first touch device on the display screen when performing the first touch action; A processing component is configured to determine, based on the first relative position information, first movement path information corresponding to a first touch action of the first touch device from the plurality of movement path information; and to determine, based on the first movement path information and the first pressure information, first content corresponding to the first touch action displayed on the display screen. Before determining the multiple movement path information corresponding to the touch actions in the multiple areas, the processing component is further configured to: Determine the second relative position information of the second position of the first touch device on the display screen when the first touch action is initiated; Receive identification information of the first touch device sent by the first touch device; wherein the identification information is sent by the first touch device after determining that the first touch action has started on the display screen; The second relative position information is sent to the first touch device so that the first touch device determines the first relative position information based on its movement information and the second relative position information, wherein the movement information is the movement information of the first touch device moving from the second position to its current first position.

Images