Data processing method and device, equipment and storage medium
By identifying and intercepting the writing behavior on the target display device and forwarding the touch operation data to the writing application, the problem of cumbersome operations in the prior art is solved, and efficient interaction of writing can be achieved without switching applications.
Patent Information
- Application Number
- CN202311308530.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-10
- Publication Date
- 2025-04-18
AI Technical Summary
In the prior art, users need to switch writing operations and other interactive operations by switching programs, resulting in cumbersome operations and low interaction efficiency.
By identifying the writing behavior on the target display device, the target touch operation data of the touch display screen is intercepted and forwarded to the writing application, so that it displays writing handwriting on the touch display screen, so that writing can be done without switching the application.
It simplifies user operations, improves the interaction efficiency between the user and the display device, and avoids other touch interaction applications responding to target touch operation data.
Smart Images

Figure CN119847642A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing, and in particular to a data processing method, apparatus, device and storage medium. Background Art
[0002] With the development of electronic technology, electronic devices are increasingly used in people's work and life, and the input methods of electronic devices are becoming more and more diverse, such as key input, touch screen input, and a combination of key input and touch input. In display devices such as electronic whiteboards, LCD touch all-in-one computers, and tablet computers, touch input provides a writing application that allows users to write on the display device.
[0003] Currently, users need to switch between writing and other interactive operations by switching programs, which is cumbersome and has low interaction efficiency. Summary of the invention
[0004] The present application provides a data processing method, apparatus, device and storage medium to solve the technical problem of cumbersome operations caused by switching writing operations and other interactive operations by switching programs.
[0005] In a first aspect, a data processing method is provided, which is applied to a target display device, wherein the target display device includes a touch display screen, and a writing application is installed in the target display device; the method includes:
[0006] When a writing behavior acting on the target display device is identified, intercepting target touch operation data acting on the touch display screen;
[0007] The target touch operation data is forwarded to the writing application, so that the writing application responds to the target touch operation data and displays the writing handwriting corresponding to the target touch operation data on the touch display screen.
[0008] In this technical solution, when the writing behavior acting on the target display device is identified, the target touch operation data acting on the touch display screen is intercepted, and then the target touch operation data is forwarded to the writing application, so that the writing application responds to the target touch operation data and displays the writing handwriting corresponding to the target touch operation data on the touch display screen; by intercepting the target touch operation data acting on the touch display screen, other touch interaction applications in the target display device can be prevented from obtaining the target touch operation data and responding, and by forwarding the target touch operation data to the writing application, the writing application can directly respond to the target touch operation data and display the writing handwriting, so that the user can write directly on the display device without switching applications, which can simplify user operations and improve the interaction efficiency between the user and the display device.
[0009] In combination with the first aspect, in a possible implementation, before intercepting the target touch operation data acting on the touch display screen, it also includes: obtaining a first touch area corresponding to the touch operation acting on the touch display screen; if the first touch area is within the first writing touch area range, determining that the writing behavior acting on the target display device is recognized. By detecting the touch area to identify the writing behavior, the writing behavior can be identified from the software level. While accurately identifying the writing behavior, there is no need to add additional hardware modules, saving costs.
[0010] In combination with the first aspect, in a possible implementation, different touch areas in the touch display screen correspond to different writing touch area ranges; before determining and identifying the writing behavior acting on the target display device, it also includes: obtaining a first touch area corresponding to the touch operation; and determining the writing touch area range corresponding to the first touch area as the first writing touch area range. By setting different writing touch area ranges for different touch areas, the accuracy of writing behavior recognition can be improved.
[0011] In combination with the first aspect, in a possible implementation, the touch display screen includes an elastic wave detection component; before intercepting the target touch operation data acting on the touch display screen, it also includes: obtaining the object material of the touch object acting on the touch display screen; if the object material is a preset writing pen material, determining that the writing behavior acting on the target display device is recognized. By detecting the material of the touch object acting on the touch display screen to identify the writing behavior, the writing behavior can be accurately identified.
[0012] In combination with the first aspect, in a possible implementation, the target display device also includes a pen lift detection component; before intercepting the target touch operation data acting on the touch display screen, it also includes: if the pen lift data generated by the pen lift detection component is obtained, it is determined that the writing behavior acting on the target display device is recognized.
[0013] In combination with the first aspect, in a possible implementation, the target display device also includes a writing pen; before intercepting the target touch operation data acting on the touch display screen, it also includes: if a contact message sent by the writing pen is received, it is determined that the writing behavior acting on the target display device is recognized, and the contact message is a message sent by the writing pen when it is recognized that it is in contact with the touch display screen.
[0014] In combination with the first aspect, in a possible implementation, the method further includes: in the case where the writing behavior is not recognized, sending the target touch operation data to the active application in the target display device, so that the active application responds to the target touch operation data. In the case where the writing behavior acting on the target display device is not detected, sending the target touch operation data to the active application in the target display device can enable the active application to respond to the target touch operation data and perform application interaction, without the user having to switch applications, thereby simplifying user operations.
[0015] In a second aspect, a data processing device is provided, which is applied to a target display device, wherein the target display device includes a touch display screen, and a writing application is installed in the target display device; the device includes:
[0016] A touch data interception module, configured to intercept target touch operation data acting on the touch display screen when a writing behavior acting on the target display device is identified;
[0017] The touch data forwarding module is used to forward the target touch operation data to the writing application, so that the writing application responds to the target touch operation data and displays the writing handwriting corresponding to the target touch operation data on the touch display screen.
[0018] In a third aspect, a display device is provided, comprising a memory, a touch display screen, and one or more processors, wherein the memory and the touch display screen are connected to the one or more processors, and the one or more processors are used to execute one or more computer programs stored in the memory. When the one or more processors execute the one or more computer programs, the display device implements the data processing method of the first aspect mentioned above.
[0019] In a fourth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the processor executes the data processing method of the first aspect.
[0020] The present application can achieve the following technical effects: by intercepting target touch operation data acting on the touch display screen, other touch interaction applications in the target display device can be prevented from obtaining the target touch operation data and responding; by forwarding the target touch operation data to the writing application, the writing application can directly respond to the target touch operation data and display the writing handwriting, so that the user can write directly on the display device without switching applications, which can simplify user operations and improve the interaction efficiency between the user and the display device. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] Figure 1A schematic diagram of the composition of a target display device provided in an embodiment of the present application;
[0022] Figure 2 A flowchart of a data processing method provided in an embodiment of the present application;
[0023] Figure 3 A schematic diagram of interaction with a target display device provided in an embodiment of the present application;
[0024] Figures 4A-4B A schematic diagram of the area and bottom shape of the pen tip provided in an embodiment of the present application;
[0025] Figure 5 is a structural schematic diagram of a data processing device provided in an embodiment of the present application;
[0026] Figure 6 It is a structural schematic diagram of a display device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0027] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.
[0028] The technical solution of the present application is applicable to a writing interaction scenario, which refers to a scenario in which a user writes on a target display device with a stylus pen. The target display device includes a touch screen, which may be a resistive touch screen, a capacitive inductive touch screen, or an infrared touch screen, etc. The target display device may be an electronic whiteboard, an intelligent interactive tablet, a touch screen computer, etc., but is not limited to the examples given here.
[0029] For ease of understanding, the target display device involved in this application is first introduced.
[0030] See also Figure 1 , Figure 1 A schematic diagram of the composition of a target display device provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the target display device 10 includes two parts: hardware 101 and software 102 .
[0031] The hardware 101 may include a touch display screen 1011, which is used to interact with the user and detect touch operation data. The touch operation data may include touch position, touch area, touch pressure, etc. The touch display screen 1011 can also respond to touch operation data and display a corresponding human-computer interaction interface.
[0032] Optionally, the touch display screen 1011 may further include an elastic wave detection component, which may be used to detect a medium type of a touch object acting on the touch display screen 1011, thereby detecting whether there is any writing behavior acting on the target display device 1011 according to the medium type of the touch object.
[0033] Optionally, the hardware 101 may further include a pen-lifting detection component 1012, which may be used to detect whether there is a writing behavior acting on the target display device 1011. When the writing behavior acting on the target display 1011 is identified, the pen-lifting detection component 1012 may send pen-lifting detection data to the software 102. In a feasible implementation, the pen-lifting detection component 1012 may include a light intensity sensor, a magnetic component and an optical path component provided on the writing pen. The light intensity sensor and the optical path component may detect changes in the magnetic field to detect whether the writing pen is close to the touch display screen, thereby detecting whether there is a writing behavior acting on the target display device 1011. In another feasible implementation, the pen-lifting detection component may also be a storage structure for storing the writing pen, a circuit board is provided in the storage structure, a contact switch is provided on the circuit board, and the circuit board may detect the state of the contact switch to detect whether the writing pen is stored in the storage structure, thereby indirectly detecting whether there is a writing behavior acting on the target display device 1011.
[0034] Optionally, the hardware 101 may further include a writing pen 1013 , and the writing pen 1013 may be provided with an electronic device for detecting whether the writing pen 1013 is close to the touch display screen 1011 .
[0035] The software 102 includes a driver software 1021 and an application software 1022. The driver software 1021 is an interface of the hardware 101, and is used to obtain data recognized by the hardware 101 and process the data recognized by the hardware 101. The driver software 1012 is also used to send the processed data to the application software 1022. The driver software 1022 can obtain the data recognized by the touch display screen 1011 through the human interface devices (human interface devices, HID) protocol, and can also obtain the data recognized by the touch display screen 1011 through local area network communication or universal serial bus (universal serial bus, USB) communication. The driver software 1021 and the application software 1022 can send the processed data to the application software 1022 through local inter-process communication (inter process communication, IPC).
[0036] The application software 1022 is a user application corresponding to the target display device, and the application software may include a writing application, a video application, a system application, and the like.
[0037] based on Figure 1 The target display device shown can implement the technical solution of the present application. The technical solution of the present application is described in detail below.
[0038] See also Figure 2 , Figure 2 A flow chart of a data processing method provided in an embodiment of the present application is shown in FIG. 1 . The method can be applied to a target display device. The structure of the target display device can be as follows: Figure 1 As shown. Figure 2 As shown, the method comprises the following steps:
[0039] S201, determining whether a writing behavior acting on a target display device is recognized.
[0040] Here, the writing behavior acting on the target display device refers to the behavior of the user picking up a writing pen and preparing to write on the target display device. There are several ways to identify whether there is a writing behavior acting on the target display device:
[0041] The first method is to detect the touch area to identify whether there is writing behavior on the target display device.
[0042] A first touch area corresponding to a touch operation on a touch display screen in a target display device can be obtained, and it can be determined whether the first touch area is within a first writing touch area range, where the first writing touch area range is set based on a contact area of a writing pen when writing (referring to the area where the writing pen contacts the touch display screen in the target display device); if the first touch area is within the first writing touch area range, it means that the touch operation is an interactive operation triggered by the writing pen, and it is determined that the writing behavior on the target display device is recognized; if the first touch area is not within the first writing touch area range, it means that the touch operation is an interactive operation triggered by other objects (such as a finger), and it is determined that the writing behavior on the target display device is not recognized.
[0043] For example, the first writing touch area ranges from 2 to 5 mm. If the first touch area is 3 mm, which is within 2 to 5 mm, it is determined that the writing behavior acting on the target display device is recognized; if the first touch area is 7 mm, which is not within 2 to 5 mm, it is determined that the writing behavior acting on the target display device is not recognized.
[0044] Among them, the first touch area can be detected by the touch display screen in the target display device, and the first touch area can be sent to the driver software in the target display device through the HID protocol; and then the driver software of the target display device can identify whether there is a writing behavior acting on the target display device. The first touch area can also be detected by the touch display screen in the target display device, and whether there is a writing behavior acting on the target display device, and then the recognition result is carried in the uncommon attributes in the HID protocol and sent to the driver software in the target display device through the HID protocol, or the recognition result is sent to the driver software in the target display device through LAN communication or USB communication. This application does not limit the specific components for processing data.
[0045] The touch display screen in the target display device can detect the first touch area by transmitting an infrared signal according to the infrared lamp blocked by the touch object, or can detect the first touch area according to the touch capacitance. This application does not limit the method of detecting the first touch area.
[0046] By detecting the touch area to identify writing behavior, writing behavior can be identified from the software level. While accurately identifying writing behavior, there is no need to add additional hardware modules, saving costs.
[0047] In some possible cases, the touch screen in the target display device can also be divided into multiple touch areas, and different writing touch areas can be set for different touch areas. In this case, after obtaining the first touch area corresponding to the touch operation acting on the touch screen in the target display device, the first touch area corresponding to the touch operation can also be obtained, and the first touch area corresponding to the touch operation refers to the touch area where the touch position of the touch operation on the touch screen is located; the writing touch area range corresponding to the first touch area is determined as the first writing touch area range.
[0048] For example, for a 76-inch display panel, assuming that the contact area of the writing pen is 3 mm, the screen can be equally divided into three touch areas at the top, middle and bottom, which are touch area 1, touch area 2 and touch area 3 respectively. For touch area 1 and touch area 3, a relatively small writing touch area range can be used, such as setting the writing touch area range of touch area 1 and touch area 3 to 2-5 mm; for touch area 2, a relatively large writing touch area range can be used, such as setting the writing touch area range of touch area 2 to 1-6 mm. If the first touch area corresponding to the touch operation is touch area 2, 1-6 mm is determined as the first writing touch area range.
[0049] By setting different writing touch area ranges for different touch zones, when the detection accuracy of the touch display screen is not high enough, it is possible to avoid recognizing the touch of a non-writing pen as writing behavior, or failing to recognize writing behavior, thereby improving the accuracy of writing behavior recognition.
[0050] The second method is to identify whether there is any writing behavior acting on the target display device based on the elastic wave detection component in the target display device.
[0051] The object material of the touch object acting on the touch display screen can be obtained; it is determined whether the object material of the touch object is a preset writing pen material; if the object material of the touch object is the preset writing pen material, it means that the touch object acting on the touch display screen is a writing pen, and it is determined that the writing behavior acting on the target display device is recognized; if the object material of the touch object is not the preset writing pen material, it means that the touch object acting on the touch display screen is not a writing pen, and it is determined that the writing behavior acting on the target display device is not recognized.
[0052] Among them, the touch display screen in the target display device can detect the elastic wave data of the touch object acting on the touch display screen through the elastic wave detection component in the touch display screen, and send the elastic wave data to the driver software in the target display device, and then the driver software detects the material of the touch object based on the elastic wave data and identifies whether there is writing behavior acting on the target display device. The touch display screen in the target display device can also detect the material of the touch object based on the elastic wave data and identify whether there is writing behavior acting on the target display device, and send the identification result to the driver software.
[0053] Since objects of different materials generate different elastic waves when touching the touch display screen in the target display device, the writing behavior can be accurately identified based on the elastic waves detected by the elastic wave detection component and the object material of the touching object is identified based on the elastic waves.
[0054] The third method is to identify whether there is any writing behavior acting on the target display device based on the pen lift detection component in the target display device.
[0055] It can be determined whether the pen lifting detection component in the target display device generates pen lifting data; if the pen lifting data generated by the pen lifting detection component in the target display device is obtained, it means that the writing pen is picked up by the user or is in contact with the target display device, and it is determined that the writing behavior acting on the target display device is recognized; if the pen lifting data generated by the pen lifting detection component in the target display device is not obtained, it means that the writing pen is not picked up by the user and is not in contact with the target display device, and it is determined that the writing behavior acting on the target display device is not recognized.
[0056] Among them, the pen lifting detection component in the target display device can determine whether to generate pen lifting data by detecting changes in the magnetic field or the state of the contact switch; when the pen lifting detection component in the target display device detects that the writing pen is close to the touch display screen or is taken out from the storage structure, the pen lifting detection component in the target display device generates pen lifting data and sends the pen lifting data to the driver software in the target display device; the driver software in the target display device can determine whether to recognize the writing behavior acting on the target display device based on whether the pen lifting data is received.
[0057] The fourth method is to identify whether there is any writing behavior acting on the target display device based on the writing pen carried by the electronic device.
[0058] When the electronic device in the writing pen recognizes that the writing pen is in contact with the touch display screen in the target display device, it will send a contact message; it can be determined whether the contact message sent by the writing pen is received; if the contact message sent by the writing pen is received, it means that the writing pen is in contact with the touch display screen, and it is determined that the writing behavior acting on the target display device is recognized; if the contact message sent by the writing pen is not received, it means that the writing pen is not in contact with the touch display screen, and it is determined that the writing behavior acting on the target display device is not recognized.
[0059] Whether the writing behavior acting on the target display device is recognized may be determined by any of the above methods; the method for determining whether the writing behavior acting on the target display device is recognized may not be limited to the above methods.
[0060] In the case where the writing behavior acting on the target display device is identified, step S202 is executed; in the case where the writing behavior acting on the target display device is not identified, step S204 is executed.
[0061] S202, intercepting target touch operation data acting on a touch display screen in a target display device.
[0062] Here, the target touch operation data acting on the touch display screen in the target display device refers to the data corresponding to the touch operation detected by the touch display screen in the target display device. The data corresponding to the touch operation includes but is not limited to touch position, touch area, touch force, touch time and other data.
[0063] Intercepting target touch operation data acting on the touch display screen in the target display device refers to preventing the target touch operation data from being sent to other applications in the target display device except the writing application.
[0064] The target touch operation data acting on the touch display screen in the target display device may be intercepted by the driver software in the target display device.
[0065] S203, forwarding the target touch operation data to the writing application in the target display device, so that the writing application in the target display device responds to the target touch operation data and displays the writing handwriting corresponding to the target touch operation data on the touch display screen.
[0066] Here, the writing application in the target display device can be an application that resides in the background of the target display device, that is, it always keeps running in the target display device. The driver software in the target display device can forward the target touch operation data to the writing application in the target display device. After receiving the target touch operation data, the writing application in the target display device can switch from the background of the target display device to the foreground of the target display device for display, and then draw the writing handwriting corresponding to the touch operation on the touch display screen in the target display device according to the target touch operation data. Among them, after intercepting the target touch operation data, the driver software in the target display device can save the target touch operation data to a preset path, and the writing application in the target display device can obtain the target touch operation data according to the preset path.
[0067] S204: Send the target touch operation data to the active application in the target display device, so that the active application responds to the target touch operation data.
[0068] Here, the driver software in the target display device may send the target touch operation data to the active application in the target display device. The active application in the target display device may refer to an application currently running in the target display device and displayed in the foreground of the target display device. Different active applications perform different operations in response to the target touch operation data.
[0069] In the above Figure 2In the corresponding technical solution, when the writing behavior acting on the target display device is identified, the target touch operation data acting on the touch display screen is intercepted, and then the target touch operation data is forwarded to the writing application, so that the writing application responds to the target touch operation data and displays the writing handwriting corresponding to the target touch operation data on the touch display screen; by intercepting the target touch operation data acting on the touch display screen, it is possible to prevent other touch interaction applications in the target display device from obtaining the target touch operation data and responding, and by forwarding the target touch operation data to the writing application, the writing application can directly respond to the target touch operation data and display the writing handwriting, so that the user can write directly on the display device without switching applications, which can simplify user operations and improve the interaction efficiency between the user and the display device; when the writing behavior acting on the target display device is not detected, the target touch operation data is sent to the active application in the target display device, which can enable the active application to respond to the target touch operation data and perform application interaction, without the user having to switch applications, thereby simplifying user operations.
[0070] The following is a specific example to illustrate the above Figure 2 The corresponding technical solution is introduced. Here, taking the method of detecting the touch area to identify whether there is a writing behavior acting on the target display device as an example, it is assumed that the target display device is a smart interactive tablet.
[0071] See also Figure 3 ,like Figure 3 As shown in P1 in FIG, when the user touches and interacts with the smart interactive tablet through a finger, since the touch area of the finger is not within the writing touch area range set based on the contact area of the writing pen when writing, the smart interactive tablet determines that the writing behavior acting on the target display device is not recognized, and the smart interactive tablet responds to the touch operation of the finger normally, and opens the application software e1 touched by the finger, such as Figure 3 As shown in P2 in Figure 3 As shown in P3 in FIG, when the user touches and interacts on the smart interactive tablet through the writing pen, since the touch area of the writing pen is within the writing touch area range set based on the contact area of the writing pen when writing, the smart interactive tablet determines that the writing behavior acting on the target display device is recognized, and the smart interactive tablet responds to the touch operation of the writing pen and displays the writing handwriting on the target display device, such as Figure 3 As shown in P4.
[0072] After identifying the writing behavior acting on the target display device, the target display device is in writing mode. In writing mode, the writing application in the target display device can also automatically adjust the handwriting type and / or writing color corresponding to the writing handwriting based on the user operation. The following is a detailed introduction.
[0073] 1. The writing application automatically adjusts the handwriting type corresponding to the handwriting
[0074] In a feasible implementation, the writing application in the target display device responds to the target touch operation data, and in the process of displaying the writing handwriting corresponding to the target touch operation data on the touch display screen in the target display device, can determine the first handwriting type corresponding to the second touch area according to the first corresponding relationship, the first corresponding relationship being the corresponding relationship between the handwriting type and the touch area, and the second touch area being the touch area determined according to the target touch operation data; the first writing handwriting matching the touch trajectory corresponding to the target touch operation data is displayed on the touch display screen in the target display device, and the first writing handwriting is a writing handwriting of the first handwriting type.
[0075] Among them, multiple writing pens can be pre-configured, and different writing pens have nibs of different thicknesses, or multiple nibs of different thicknesses can be pre-configured for the writing pens. Nibs of different thicknesses represent different types of writing pens. For example, a configuration has four nibs, representing a brush, a pencil, a fountain pen, and a ballpoint pen, respectively. The area of the brush nib is s1, the area of the pencil nib is s2, the area of the fountain pen nib is s3, and the area of the ballpoint pen nib is s4. The relationship between the areas of s1, s2, s3, and s4 is as follows: Figure 4A As shown, the first corresponding relationship can be shown in Table 1:
[0076] Touch area Handwriting type S≤s4 ballpoint pen s4<S≤s3 pen s3<S≤s2 pencil s2<S≤s1 Writing brush
[0077] Table 2
[0078] S represents the touch area. If the detected touch area is s4<S≤s3, according to Table 1, it can be determined that the user is using the tip of a pen to write on the touch display screen, and the pen handwriting matching the touch track corresponding to the target touch operation data is displayed on the touch display screen in the target display device.
[0079] By pre-setting pen tips of different thicknesses to represent different types of writing pens, and establishing a relationship between the touch area and the handwriting type, the type of writing handwriting is determined based on the relationship between the touch area and the handwriting type. Users only need to switch the pen tip to switch the handwriting type, without having to set the handwriting type in the writing application, thereby improving the traversability of writing operations.
[0080] In another feasible implementation, the writing application in the target display device can determine the touch pressure corresponding to the target touch operation data in the process of responding to the target touch operation data and displaying the writing handwriting corresponding to the target touch operation data on the touch display screen in the target display device. If the touch pressure is greater than a preset pressure threshold, the handwriting type of the writing handwriting is switched.
[0081] For example, writing handwriting is divided into fountain pen, writing brush, pencil and ballpoint pen according to the handwriting type, and fountain pen is the default writing handwriting type; after identifying the writing behavior acting on the target display device, the writing application displays the fountain pen handwriting matching the touch trajectory corresponding to the target touch operation data on the touch display screen; when it is detected that the touch pressure corresponding to the target touch operation data is greater than the preset pressure, the writing application switches the handwriting type and displays the writing brush trajectory matching the touch trajectory corresponding to the target touch operation data on the touch display screen; when it is detected again that the touch pressure corresponding to the target touch operation data is greater than the preset pressure, the writing application switches the handwriting type again and displays the pencil trajectory matching the touch trajectory corresponding to the target touch operation data on the touch display screen; when it is detected again that the touch pressure corresponding to the target touch operation data is greater than the preset pressure, the writing application switches the handwriting type again and displays the ballpoint pen trajectory matching the touch trajectory corresponding to the target touch operation data on the touch display screen; when it is detected again that the touch pressure corresponding to the target touch operation data is greater than the preset pressure, the writing application switches the handwriting type again and displays the fountain pen trajectory matching the touch trajectory corresponding to the target touch operation data on the touch display screen; and so on.
[0082] In this way, the user only needs to increase the pressure of the writing pen on the touch screen of the target display device to switch the type of handwriting, without having to set the handwriting type in the writing application, thereby improving the traversability of the writing operation.
[0083] The automatic adjustment of the handwriting type corresponding to the handwriting by the writing application may not be limited to the above implementation.
[0084] 2. The writing application automatically adjusts the handwriting color corresponding to the handwriting
[0085] In a feasible implementation, the writing application in the target display device responds to the target touch operation data, and in the process of displaying the writing handwriting corresponding to the target touch operation data on the touch display screen in the target display device, can determine the first handwriting color corresponding to the first touch shape according to the second corresponding relationship, the first corresponding relationship being the corresponding relationship between the handwriting color and the touch shape, and the first touch shape being the touch shape determined according to the target touch operation data; and displaying the second writing handwriting matching the touch trajectory corresponding to the target touch operation data on the touch display screen in the target display device, the second writing handwriting being the writing handwriting of the first handwriting color.
[0086] Among them, multiple writing pens can be pre-configured, and different writing pens have pen tips with different bottom shapes, or multiple pen tips with different bottom shapes can be pre-configured for the writing pen. Pen tips with different shapes represent writing pens of different colors. For example, there are 3 types of pen tips, and the bottom shapes of the pen tips are as follows: Figure 4BAs shown, they are 1: solid circle, 2: ring, and 3: a combination of a solid circle and a hollow circle. The second corresponding relationship can be shown in Table 2:
[0087]
[0088] Table 2
[0089] If the touch shape is determined to be a circle according to the target touch operation data, according to Table 2, it can be determined that the user is using a pen tip representing blue to write on the touch display screen, then blue handwriting matching the touch trajectory corresponding to the target touch operation data is displayed on the touch display screen in the target display device.
[0090] By pre-setting pen tips with different bottom shapes to represent writing pens of different colors, and establishing a relationship between handwriting color and touch shape, the color of the writing handwriting is determined according to the relationship between the touch shape and the handwriting color. Users only need to switch the pen tip to switch the type of handwriting, without having to select and set the color in the writing application, thereby improving the convenience of writing operations.
[0091] In another feasible implementation, the writing application in the target display device may determine the touch pause duration corresponding to the target touch operation data in the process of displaying the writing handwriting corresponding to the target touch operation data on the touch display screen in the target display device in response to the target touch operation data, and if the touch pause duration is greater than a first preset duration, the handwriting color of the writing handwriting is switched. The touch pause duration refers to the duration that the touch operation corresponding to the target touch operation data stops at a certain touch position on the touch display screen in the target display device.
[0092] For example, writing pens are divided into black, blue and red according to the handwriting color, assuming that black is the default writing handwriting color; after identifying the writing behavior acting on the target display device, the writing application displays black handwriting matching the touch trajectory corresponding to the target touch operation data on the touch display screen; when it is detected that the touch pause duration corresponding to the target touch operation data is greater than the first preset duration, the writing application switches the handwriting color and displays blue handwriting matching the touch trajectory corresponding to the target touch operation data on the touch display screen; when it is detected again that the touch pause duration corresponding to the target touch operation data is greater than the first preset duration, the writing application switches the handwriting color again and displays red handwriting matching the touch trajectory corresponding to the target touch operation data on the touch display screen; when it is detected again that the touch pause duration corresponding to the target touch operation data is greater than the first preset duration, the writing application switches the handwriting color again and displays black handwriting matching the touch trajectory corresponding to the target touch operation data on the touch display screen; and so on.
[0093] In this way, the user can switch the handwriting color by stopping the writing pen at a certain position of the target display device for a period of time, without having to select and set the color in the writing application, thereby improving the convenience of writing operations.
[0094] The automatic adjustment of the writing color corresponding to the handwriting type by the writing application may not be limited to the above implementation.
[0095] The method of the present application is introduced above, and the device of the present application is introduced below.
[0096] See also Figure 5 , Figure 5 Schematic diagram of a data processing device provided in an embodiment of the present application. The data processing device is applied to a target display device, and the structure of the target display device can be as follows Figure 1 As shown. Figure 5 As shown, the data processing device 30 includes:
[0097] A touch data interception module 301 is used to intercept target touch operation data acting on the touch display screen when a writing behavior acting on the target display device is identified;
[0098] The touch data forwarding module 302 is used to forward the target touch operation data to the writing application, so that the writing application responds to the target touch operation data and displays the writing handwriting corresponding to the target touch operation data on the touch display screen.
[0099] In a possible design, the above-mentioned data processing device 30 also includes a writing behavior recognition module 303, which is used to obtain a first touch area corresponding to the touch operation acting on the touch display screen; if the first touch area is within the range of the first writing touch area, it is determined that the writing behavior acting on the target display device is recognized.
[0100] In a possible design, different touch areas in the touch display screen correspond to different writing touch area ranges; the above-mentioned writing behavior recognition module 303 is also used to: obtain the first touch area corresponding to the touch operation; and determine the writing touch area range corresponding to the first touch area as the first writing touch area range.
[0101] In one possible design, the touch display screen includes an elastic wave detection component; the above-mentioned data processing device 30 also includes a writing behavior recognition module 303, which is used to obtain the object material of the touch object acting on the touch display screen; if the object material is a preset writing pen material, it is determined that the writing behavior acting on the target display device is recognized.
[0102] In one possible design, the target display device also includes a pen lift detection component; the above-mentioned data processing device 30 also includes a writing behavior recognition module 303, which is used to determine and recognize the writing behavior acting on the target display device if the pen lift data generated by the pen lift detection component is obtained.
[0103] In one possible design, the target display device also includes a writing pen; the above-mentioned data processing device 30 also includes a writing behavior recognition module 303, which is used to determine that the writing behavior acting on the target display device is recognized if a contact message sent by the writing pen is received, and the contact message is a message sent by the writing pen when it is recognized that it is in contact with the touch display screen.
[0104] In a possible design, the touch data forwarding module 302 is further used to: when the writing behavior is not recognized, send the target touch operation data to the active application in the target display device, so that the active application responds to the target touch operation data.
[0105] It should be noted that Figure 5 For the contents not mentioned in the corresponding embodiments, please refer to the description of the aforementioned method embodiments, which will not be repeated here.
[0106] The above-mentioned device, when identifying the writing behavior acting on the target display device, intercepts the target touch operation data acting on the touch display screen, and then forwards the target touch operation data to the writing application, so that the writing application responds to the target touch operation data and displays the writing handwriting corresponding to the target touch operation data on the touch display screen; by intercepting the target touch operation data acting on the touch display screen, other touch interaction applications in the target display device can be prevented from obtaining the target touch operation data and responding, and by forwarding the target touch operation data to the writing application, the writing application can directly respond to the target touch operation data and display the writing handwriting, so that the user can write directly on the display device without switching applications, which can simplify user operations and improve the interaction efficiency between the user and the display device.
[0107] See also Figure 6 , Figure 6 4 is a schematic diagram of a display device provided in an embodiment of the present application, wherein the display device 40 includes a processor 401, a memory 402, and a touch display screen 403. The memory 402 and the touch display screen 403 are connected to the processor 401, for example, via a bus.
[0108] The processor 401 is configured to support the display device 40 to perform the corresponding functions in the method in the above method embodiment. The processor 401 can be a central processing unit (CPU), a network processor (NP), a hardware chip or any combination thereof. The above hardware chip can be an application specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The above PLD can be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.
[0109] The memory 402 is used to store program codes, etc. The memory 402 may include a volatile memory (VM), such as a random access memory (RAM); the memory 402 may also include a non-volatile memory (NVM), such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD) or a solid-state drive (SSD); the memory 402 may also include a combination of the above-mentioned types of memories.
[0110] The processor 401 may call the program code to perform the following operations:
[0111] When a writing behavior acting on the target display device is identified, intercepting target touch operation data acting on the touch display screen;
[0112] The target touch operation data is forwarded to the writing application, so that the writing application responds to the target touch operation data and displays the writing handwriting corresponding to the target touch operation data on the touch display screen.
[0113] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a computer, the computer executes the method described in the above embodiment.
[0114] A person skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.
[0115] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.
Claims
1. A data processing method, characterized in that: Applied to a target display device, the target display device includes a touch display screen, and a writing application is installed in the target display device; the method includes: When a writing behavior acting on the target display device is identified, intercepting target touch operation data acting on the touch display screen; The target touch operation data is forwarded to the writing application, so that the writing application responds to the target touch operation data and displays the writing handwriting corresponding to the target touch operation data on the touch display screen.
2. The method according to claim 1, characterized in that Before intercepting the target touch operation data acting on the touch display screen, the method further includes: Acquiring a first touch area corresponding to a touch operation on the touch display screen; If the first touch area is within the first writing touch area range, it is determined that the writing behavior acting on the target display device is recognized.
3. The method according to claim 2, characterized in that Different touch areas in the touch display screen correspond to different writing touch area ranges; Before determining and identifying the writing behavior acting on the target display device, the method further includes: Acquire a first touch area corresponding to the touch operation; The writing touch area range corresponding to the first touch region is determined as the first writing touch area range.
4. The method according to claim 1, characterized in that: The touch display screen includes an elastic wave detection component; before intercepting the target touch operation data acting on the touch display screen, it also includes: Acquiring the object material of the touch object acting on the touch display screen; If the material of the object is a preset writing pen material, it is determined that the writing behavior acting on the target display device is recognized.
5. The method according to claim 1, characterized in that The target display device further includes a pen-lifting detection component; before intercepting the target touch operation data acting on the touch display screen, it also includes: If the pen-lifting data generated by the pen-lifting detection component is acquired, it is determined that the writing behavior acting on the target display device is recognized.
6. The method according to claim 1, characterized in that The target display device further includes a writing pen; and before intercepting the target touch operation data acting on the touch display screen, the method further includes: If a contact message sent by the writing pen is received, it is determined that the writing behavior acting on the target display device is recognized, and the contact message is a message sent by the writing pen when it is recognized that it is in contact with the touch display screen.
7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: In a case where the writing behavior is not recognized, the target touch operation data is sent to an active application in the target display device, so that the active application responds to the target touch operation data.
8. A data processing device, characterized in that: Applied to a target display device, the target display device includes a touch display screen, and a writing application is installed in the target display device; the device includes: A touch data interception module, configured to intercept target touch operation data acting on the touch display screen when a writing behavior acting on the target display device is identified; The touch data forwarding module is used to forward the target touch operation data to the writing application, so that the writing application responds to the target touch operation data and displays the writing handwriting corresponding to the target touch operation data on the touch display screen.
9. A display device, characterized in that: The device comprises a memory, a processor and a touch display screen, wherein the memory and the touch display screen are connected to the processor, and the processor is used to execute one or more computer programs stored in the memory. When the processor executes the one or more computer programs, the display device implements the method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the processor is caused to perform the method according to any one of claims 1 to 7.