Handwriting input method, device, electronic device and storage medium for third-party applications
By creating a transparent handwriting layer on the electronic ink screen device and projecting it does not overlap with the non-content area of the third-party application, the problem of complex interface settings during handwriting input is solved, and the efficiency and user experience of handwriting input are improved.
Patent Information
- Application Number
- CN202410614760.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-17
- Publication Date
- 2025-03-04
- Estimated Expiration
- 2044-05-17
AI Technical Summary
When handwriting input of third-party applications on electronic ink screen devices, the handwriting layer covers the third-party application interface, resulting in the inability to quickly set up third-party applications, reducing the efficiency of handwriting input.
By detecting the display interface configuration information of third-party applications, a transparent handwriting layer is created and the projection in the normal direction of the display interface does not overlap with the non-content area, so that the non-content area is not blocked when handwriting is input, allowing it to be manipulated without switching to the third-party application interface.
It improves the efficiency and user experience of handwriting input of third-party applications of electronic ink screens, and reduces the operation complexity and interface switching times during handwriting input.
Smart Images

Figure CN118426866B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of handwriting input technology, and in particular to a handwriting input method, device, electronic device and storage medium for third-party applications based on an ink screen. Background Art
[0002] Electronic ink screen technology uses electrophoresis technology to display images. The display effect of this type of screen is very close to that of traditional paper, so it is also called "electronic paper". Electronic ink is usually made of a thin film composed of a large number of microcapsules. The microcapsules contain pigment particles with different charges. In the initial state, the pigment particles are suspended in the microcapsules. When an electric field in a certain direction is applied, the corresponding pigment particles are pushed to the top, and the microcapsules will display different colors. Microcapsules of different colors form various texts and patterns.
[0003] As the number of application functions of electronic ink screen devices increases, more and more people install third-party applications on electronic ink screen devices for use. However, due to the technical characteristics of electronic ink screens, when performing handwriting input in third-party applications, it is necessary to generate a handwriting layer above the interface of the third-party application, and then perform handwriting input on the handwriting layer. However, the handwriting layer is generally covered on the interface of the third-party application, and the third-party application cannot be quickly set up during handwriting input. During handwriting input, it is usually necessary to set up the third-party application or set the handwriting input content and the content of the third-party application interface. At this time, it is necessary to exit from the handwriting layer and switch to the interface of the third-party application before the third-party application can be controlled. This will bring inconvenience to handwriting input and reduce the efficiency of handwriting input. Summary of the invention
[0004] The present application provides a handwriting input method, device, electronic device and storage medium based on an electronic ink screen for third-party applications, so as to improve the efficiency of handwriting input for third-party applications on an electronic ink screen.
[0005] In a first aspect, the present application provides a handwriting input method for a third-party application based on an ink screen, which includes:
[0006] In response to a start signal for handwriting input to a third-party application, detecting configuration information of a display interface of the third-party application;
[0007] Creating a handwriting layer on the display interface of the third-party application according to the configuration information of the display interface, wherein the handwriting layer is a transparent layer, and a projection of the handwriting layer in the normal direction of the display interface does not overlap with a non-content area on the display interface of the third-party application;
[0008] Obtain the handwriting content input by handwriting on the handwriting layer;
[0009] The handwritten content is displayed in a display interface of the third-party application.
[0010] In some embodiments of the present application, the step of creating a handwriting layer above the display interface of the third-party application according to the configuration information of the display interface includes:
[0011] Obtaining a location area of a non-content area on the display interface of the third-party application according to the configuration information of the display interface;
[0012] The area corresponding to the display interface of the third-party application is removed from the location area of the non-content area to obtain a handwriting area;
[0013] A handwriting layer overlapping the handwriting area is created above the display interface of the third-party application.
[0014] In some embodiments of the present application, before the step of creating a handwriting layer on the display interface of the third-party application according to the configuration information of the display interface, the handwriting layer is a transparent layer, and the projection of the handwriting layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application, the handwriting input method further includes:
[0015] A tool layer is created above the display interface, the tool layer is provided with virtual function keys, and the tool layer is movable.
[0016] In some embodiments of the present application, the projection of the tool layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application, and the projection of the handwriting layer in the normal direction of the display interface does not overlap with the projection of the tool layer in the normal direction of the display interface;
[0017] The step of removing the position area of the non-content area from the area corresponding to the display interface of the third-party application to obtain the handwriting area includes:
[0018] The handwriting area is obtained by removing the location area of the non-content area and the area corresponding to the tool layer from the area corresponding to the display interface of the third-party application.
[0019] In some embodiments of the present application, the tool layer is located above the handwriting layer, and the area of the tool layer is smaller than the area of the handwriting layer.
[0020] In some embodiments of the present application, before the step of creating a handwriting layer on the display interface of the third-party application according to the configuration information of the display interface, the handwriting layer is a transparent layer, and the projection of the handwriting layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application, the handwriting input method further includes:
[0021] Obtaining a location area of the content protection zone of the ink screen according to the configuration information of the display interface;
[0022] The step of removing the position area of the non-content area from the area corresponding to the display interface of the third-party application to obtain the handwriting area includes:
[0023] The area corresponding to the display interface of the third-party application is removed from the position area of the non-content area and the position area of the content protection area to obtain a handwriting area.
[0024] In some embodiments of the present application, after the step of acquiring the handwriting content inputted by handwriting on the handwriting layer, the handwriting input method further includes:
[0025] Merging the handwritten content and the display content of the display interface of the third-party application into a record file for storage;
[0026] The virtual function keys include a record viewing key, and the record file is viewed by clicking the record viewing key.
[0027] In some embodiments of the present application, the step of obtaining the handwritten content inputted by handwriting on the handwriting layer includes:
[0028] Obtaining data report points of handwriting input on the handwriting layer;
[0029] It is determined whether the data report point is a data report point input by a stylus pen, and if so, the data report point is converted into handwritten content.
[0030] In some embodiments of the present application, the step of obtaining the handwritten content inputted by handwriting on the handwriting layer includes:
[0031] Obtaining data report points of handwriting input on the handwriting layer;
[0032] Determining whether the data report point is a data report point input by a stylus pen, and if the data report point is a data report point input by a stylus pen, converting the data report point into handwritten content;
[0033] When the data reporting point does not belong to the data reporting point input by the stylus, it is determined whether the data reporting point belongs to the preset information, and if so, the third-party application is operated according to the data reporting point.
[0034] In some embodiments of the present application, the virtual function keys include a parameter setting key and an erase key:
[0035] The parameter setting key is used to set the handwriting parameters of the stylus, and the erase key is used to erase the handwriting of the stylus on the ink screen.
[0036] In some embodiments of the present application, the non-content area includes a toolbar, a scroll bar, and a status bar.
[0037] In a second aspect, the embodiment of the present application further provides a handwriting input device for a third-party application based on an ink screen, which includes:
[0038] a detection module, the detection module being used to detect configuration information of a display interface of a third-party application in response to a start signal for handwriting input to the third-party application;
[0039] A first layer module, the first layer module is used to create a handwriting layer above the display interface of the third-party application according to the configuration information of the display interface, the handwriting layer is a transparent layer, and the projection of the handwriting layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application;
[0040] An acquisition module, the acquisition module is used to acquire the handwriting content input by handwriting on the handwriting layer;
[0041] A driving module, wherein the driving module is used to display the handwritten content in a display interface of the third-party application.
[0042] In a third aspect, an embodiment of the present application further provides an electronic device, including:
[0043] one or more processors;
[0044] A memory for storing one or more programs;
[0045] When the one or more programs are executed by the one or more processors, the electronic device implements the handwriting input method as described in any one of the first aspects.
[0046] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the handwriting input method as described in any one of the first aspects is implemented.
[0047] The present application provides a method, device, electronic device and storage medium for handwriting input of a third-party application based on an ink screen, wherein the handwriting input method comprises: in response to a start signal for handwriting input to a third-party application, detecting the configuration information of the display interface of the third-party application; creating a handwriting layer above the display interface of the third-party application according to the configuration information of the display interface, wherein the handwriting layer is a transparent layer, and the projection of the handwriting layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application; obtaining the handwritten content of the handwriting input on the handwriting layer; and displaying the handwriting content in the display interface of the third-party application. The present application sets the projection of the handwriting layer in the normal direction of the display interface to not overlap with the non-content area on the display interface of the third-party application, so that the handwriting layer will not block the non-content area of the third-party application. When performing handwriting input, the third-party application can be controlled without switching to the display interface of the third-party application, which can improve the efficiency and user experience of handwriting input of third-party applications on the electronic ink screen. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] Figure 1 A flowchart of Embodiment 1 of the handwriting input method for a third-party application based on an ink screen provided by the present application;
[0049] Figure 2 This is a flowchart of step S20 of embodiment 1 of the handwriting input method for a third-party application based on an ink screen provided by the present application;
[0050] Figure 3 A flowchart of Embodiment 2 of the handwriting input method for a third-party application based on an ink screen provided by the present application;
[0051] Figure 4 This is a flowchart of step S20 of embodiment 2 of the handwriting input method for a third-party application based on an ink screen provided by this application;
[0052] Figure 5 A flowchart of Embodiment 3 of the handwriting input method for a third-party application based on an ink screen provided by the present application;
[0053] Figure 6 This is a flowchart of step S20 of embodiment 3 of the handwriting input method for a third-party application based on an ink screen provided by this application;
[0054] Figure 7 A flowchart of Embodiment 4 of the handwriting input method for a third-party application based on an ink screen provided by the present application;
[0055] Figure 8 This is a flowchart of step S30 of embodiment 1 of the handwriting input method for a third-party application based on an ink screen provided by the present application;
[0056] Fig. 9 This is a flowchart of step S30 of embodiment 2 of the handwriting input method for a third-party application based on an ink screen provided by the present application;
[0057] Fig.10 A schematic diagram of the structure of a handwriting input device for handwriting of a third-party application based on an ink screen provided by this application;
[0058] Fig.11 A schematic diagram of the structure of the electronic device provided in this application. DETAILED DESCRIPTION
[0059] The embodiments of the present application are further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the embodiments of the present application, rather than to limit the embodiments of the present application. It should also be noted that, for ease of description, only parts related to the embodiments of the present application are shown in the accompanying drawings, rather than all structures.
[0060] The terms "first", "second", etc. in the specification and claims of this application are used to distinguish similar objects, but not to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more, and it cannot be understood as indicating or implying relative importance. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship. In addition, unless otherwise clearly specified and limited, the terms "set", "install", "connect", "connect", and "connect in series" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected, or indirectly connected through an intermediate medium, or it can be a connection between two elements. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood in specific circumstances.
[0061] The handwriting input method provided in the embodiment of the present application can be used for a display device equipped with an ink screen. The display device can be an electronic device such as a tablet computer, a mobile phone, an e-reader, a personal digital assistant (PDA) based on an ink screen. Specifically, the display device may include an ink screen, an image processing module, a microcontroller, a screen driver module, a timing control circuit, and a power control circuit.
[0062] The following is a detailed description of the various embodiments of the present application.
[0063] Figure 1 This is a flowchart of Example 1 of the handwriting input method for a third-party application based on an ink screen provided in the present application. The handwriting input method for a third-party application based on an ink screen provided in the embodiment of the present application can be executed by a handwriting input device for a third-party application based on an ink screen. The handwriting input device for a third-party application based on an ink screen can be implemented in hardware and / or software and integrated in a display device equipped with an ink screen.
[0064] The following description is made by taking the handwriting input method of a third-party application based on an ink screen executed by a handwriting input device based on an ink screen as an example. Figure 1 , the handwriting input method comprises:
[0065] Step S10: In response to a start signal for handwriting input to a third-party application, detecting configuration information of a display interface of the third-party application.
[0066] Among them, the start signal can be a signal triggered by a virtual button, a physical button or a remote control method on the ink screen, or it can be a signal triggered by a virtual button on the display interface of the handwriting layer. In addition, it can be understood that in a handwriting drawing input of a stylus, including a writing drop operation, a writing movement operation and a writing lift operation, when the writing drop operation of the stylus is detected (for example, a start signal to start handwriting drawing for a third-party application), it can be determined that the writing drawing input has entered, and when the writing lift operation of the stylus is detected (for example, an end signal of handwriting drawing for a third-party application), it can be determined that the writing drawing input is completed. In other words, the start signal can also be a writing drop operation of the stylus.
[0067] The handwriting layer is used to continuously collect coordinate information corresponding to the handwriting drawing input when the handwriting drawing input is detected, and the drawing layer is used to display the relevant content of the handwriting drawing.
[0068] When a start signal for handwriting input to a third-party application is received, configuration information of the display interface of the third-party application is obtained, wherein the configuration information of the display interface of the third-party application includes the control name, control type, control coordinate position, control area size and control area shape on the display interface of the third-party application, and the controls include content display controls, tool controls, title controls, menu controls, scroll bars and status controls, etc.
[0069] Step S20: create a handwriting layer above the display interface of the third-party application according to the configuration information of the display interface, wherein the handwriting layer is a transparent layer, and the projection of the handwriting layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application.
[0070] Among them, the configuration information of the display interface of the third-party application includes the control name, control type, control coordinate position, control area size and control area shape on the display interface of the third-party application, and the control includes content display control, tool control, title control, menu control, scroll bar and status control. When a handwriting layer is created above the display interface of the third-party application according to the configuration information of the display interface, the projection of the handwriting layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application, and the non-content area refers to the other area on the display interface of the third-party application except the area corresponding to the content display control, so the areas corresponding to the tool control, menu control and scroll bar on the display interface of the third-party application are not covered by the handwriting layer, so when handwriting input is performed, the third-party application can be controlled without switching to the display interface of the third-party application. In one embodiment of the present application, the non-content area includes a toolbar, a scroll bar and a status bar.
[0071] Step S30: Acquire the handwritten content inputted on the handwriting layer.
[0072] The handwritten content may include a handwritten drawing trajectory, or may be a symbol or text converted from handwritten drawing information.
[0073] The handwriting layer can generate a corresponding handwriting drawing trajectory in response to the handwriting drawing input. For example, the interactive interface of the handwriting layer displayed on the ink screen provides a handwriting drawing component, wherein the handwriting drawing component is used to receive the data report point of the handwriting drawing input of the stylus, and determine the coordinate information corresponding to the handwriting drawing input. The handwriting layer can determine the handwriting drawing information based on the coordinate information and the default or set handwriting parameters (wherein the handwriting width, handwriting color, handwriting type, etc. of the handwriting trajectory correspond to the handwriting parameters).
[0074] Exemplarily, when a third-party application is running on the ink screen and the third-party application enters the handwriting drawing state, the ink screen detects the handwriting drawing input of the handwriting layer. When the handwriting drawing input is detected, the coordinate information corresponding to the handwriting drawing input is continuously collected, and the handwriting drawing information corresponding to the handwriting drawing input is determined based on the coordinate information collected in real time.
[0075] Step S40: display the handwritten content in the display interface of the third-party application.
[0076] The handwritten content may be combined with the initial display content in the display interface of the third-party application and then displayed in the display interface of the third-party application, or the handwritten content may be converted into text and then added to the display interface of the third-party application for display.
[0077] To summarize, the present application sets the projection of the handwriting layer in the normal direction of the display interface to not overlap with the non-content area on the display interface of the third-party application. Therefore, the handwriting layer will not block the non-content area of the third-party application. When handwriting input is performed, the third-party application can be controlled without switching to the display interface of the third-party application, which can improve the efficiency of handwriting input of third-party applications on the electronic ink screen and the user experience.
[0078] Please refer to Figure 2 , Figure 2 This is a flowchart of step S20 of the first embodiment of the handwriting input method for a third-party application based on an ink screen provided by the present application. Further, in one embodiment of the present application, the step of creating a handwriting layer above the display interface of the third-party application according to the configuration information of the display interface includes:
[0079] Step S201: obtaining a location area of a non-content area on the display interface of the third-party application according to the configuration information of the display interface;
[0080] Step S202: removing the non-content area from the area corresponding to the display interface of the third-party application to obtain a handwriting area;
[0081] Step S203: creating a handwriting layer overlapping the handwriting area above the display interface of the third-party application.
[0082] As can be seen from the above, the configuration information of the display interface of the third-party application includes the control name, control type, control coordinate position, control area size and control area shape on the display interface of the third-party application, and the control includes content display control, tool control, title control, menu control, scroll bar and status control, etc. The present application obtains the position area of the non-content area on the display interface of the third-party application, and the non-content area refers to the other area on the display interface of the third-party application except the area corresponding to the content display control, and then removes the position area of the non-content area from the area corresponding to the display interface of the third-party application to obtain the handwriting area, and finally creates a handwriting layer overlapping with the handwriting area above the display interface of the third-party application.
[0083] Please refer to Figure 3 , Figure 3This is a flow chart of the second embodiment of the handwriting input method for a third-party application based on an ink screen provided by this application. Figure 1 On the basis of the provided handwriting input method, further, before the step of creating a handwriting layer above the display interface of the third-party application according to the configuration information of the display interface, the handwriting layer is a transparent layer, and the projection of the handwriting layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application, the handwriting input method also includes:
[0084] Step S12: creating a tool layer above the display interface, wherein the tool layer is provided with virtual function keys and the tool layer is movable.
[0085] The present application is provided with a tool layer, and virtual function keys are provided on the tool layer. The virtual function keys can be used to set handwritten content or handwriting input handwriting or third-party applications, which can improve the interactive convenience of handwriting input on the ink screen. Moreover, the tool layer is movable, so the tool layer can be moved at any time to avoid the tool layer blocking the non-content area on the display interface of the third-party application, thereby ensuring that the third-party application can be freely set. Furthermore, the tool layer can be a transparent layer or an opaque layer. In one embodiment of the present application, the tool layer is preferably a transparent layer, so that the tool layer will not block the third-party application.
[0086] On the basis of the above, further, the virtual function keys include a parameter setting key and an erase key:
[0087] The parameter setting key is used to set the handwriting parameters of the stylus, and the erase key is used to erase the handwriting of the stylus on the ink screen.
[0088] The parameter setting key is used to set the handwriting parameters of the stylus, which are used for the corresponding format when drawing handwriting traces, such as handwriting width, handwriting color, handwriting type (such as marker, pencil, pen, brush, eraser, etc.), etc. The user's usage habits can be met by adjusting the handwriting parameters. The erase key is used to erase the handwriting of the stylus on the ink screen. When the user finds that the handwriting content is wrong or does not meet the requirements after handwriting input, the handwriting can be deleted by clicking the erase key.
[0089] Please refer to Figure 4 , Figure 4 This is a flowchart of step S20 of the second embodiment of the handwriting input method for a third-party application based on an ink screen provided by this application. Figure 3On the basis of the provided handwriting input method, further, the projection of the tool layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application, and the projection of the handwriting layer in the normal direction of the display interface does not overlap with the projection of the tool layer in the normal direction of the display interface;
[0090] The step of removing the position area of the non-content area from the area corresponding to the display interface of the third-party application to obtain the handwriting area includes:
[0091] Step S2022: remove the location area of the non-content area and the area corresponding to the tool layer from the area corresponding to the display interface of the third-party application to obtain a handwriting area.
[0092] This application prevents the tool layer from affecting the operation of the non-content area on the display interface of the third-party application and the operation of the handwriting layer by setting the projection of the tool layer in the normal direction of the display interface to not overlap with the non-content area on the display interface of the third-party application, and by setting the projection of the handwriting layer in the normal direction of the display interface to not overlap with the projection of the tool layer in the normal direction of the display interface. Therefore, the handwriting area is obtained by removing the position area of the non-content area and the area corresponding to the tool layer from the area corresponding to the display interface of the third-party application, and the handwriting layer is prevented from covering the tool layer, ensuring that the virtual function keys can be used normally.
[0093] On the basis of the above, further, the tool layer is located above the handwriting layer, and the area of the tool layer is smaller than the area of the handwriting layer. The tool layer is arranged above the handwriting layer, so that the tool layer can be used normally, and the area of the tool layer is smaller than the area of the handwriting layer, and at the same time, it can be ensured that the handwriting layer has a large enough area for the user's handwriting input.
[0094] Please refer to Figure 5 and Figure 6 , Figure 5 This is a flowchart of Embodiment 3 of the handwriting input method for a third-party application based on an ink screen provided in this application. Figure 6 This is a flowchart of step S20 of the third embodiment of the handwriting input method for a third-party application based on an ink screen provided by this application. Figure 1On the basis of the provided handwriting input method, further, in an embodiment of the present application, before the step of creating a handwriting layer above the display interface of the third-party application according to the configuration information of the display interface, the handwriting layer is a transparent layer, and the projection of the handwriting layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application, the handwriting input method also includes:
[0095] Step S14: obtaining a location area of the content protection zone of the ink screen according to the configuration information of the display interface;
[0096] The step of removing the position area of the non-content area from the area corresponding to the display interface of the third-party application to obtain the handwriting area includes:
[0097] Step S2024: Remove the position area of the non-content area and the position area of the content protection area from the area corresponding to the display interface of the third-party application to obtain a handwriting area.
[0098] The content protection zone may include a floating ball, a floating window, and an area on the ink screen where the content cannot be captured or changed. Therefore, the present application removes the location area of the non-content area and the location area of the content protection zone from the area corresponding to the display interface of the third-party application to obtain a handwriting area, thereby preventing the content of the content protection zone from being blocked, thereby making the display interface of the ink screen of the present application have a better user experience.
[0099] Please refer to Figure 7 , Figure 7 This is a flowchart of the fourth embodiment of the handwriting input method for a third-party application based on an ink screen provided by this application. Figure 3 On the basis of the provided handwriting input method, further, in an embodiment of the present application, after the step of obtaining the handwriting content handwritten input on the handwriting layer, the handwriting input method further includes:
[0100] Step S32: merging the handwritten content and the display content of the display interface of the third-party application into a record file for storage;
[0101] The virtual function keys include a record viewing key, and the record file is viewed by clicking the record viewing key.
[0102] In the present application, the handwritten content and the display content of the display interface of the third-party application are combined to form a record file for storage, so that the user can select and display the historical handwritten content in the record file. Specifically, the user only needs to click the record view button to view the record file, and then select the historical handwritten content to be displayed in the record file. For example, when the user is still dissatisfied with the current handwritten content after multiple handwriting inputs, or feels that the previous historical handwritten content is more appropriate, the user can click the record view button to browse the historical handwritten content of the record file, and then select the appropriate historical handwritten content to display on the display interface of the third-party application, thereby improving the interactive experience of the ink screen.
[0103] Please refer to Figure 8 , Figure 8 This is a flowchart of step S30 of the first embodiment of the handwriting input method for a third-party application based on an ink screen provided by the present application. Further, in the first embodiment of the present application, the step of obtaining the handwriting content inputted by handwriting on the handwriting layer includes:
[0104] Step S301, obtaining a data report point of handwriting input on the handwriting layer;
[0105] Step S302: determine whether the data point is a data point input by a stylus pen, and if so, convert the data point into handwritten content.
[0106] The existing ink screen can receive handwriting input information from fingers and handwriting input information from a stylus. In actual use, in order to avoid the handwriting input information being mistakenly generated by the finger touching the handwriting layer of the ink screen, the present application obtains the data report point of the handwriting input on the handwriting layer, and then determines whether the data report point belongs to the data report point of the stylus input. If so, the data report point is converted into handwriting content. If the data report point does not belong to the data report point of the stylus input, the data report point is not converted into handwriting content, thereby intercepting the input information generated by the finger touching the handwriting layer.
[0107] Please refer to Fig. 9 , Fig. 9 This is a flowchart of step S30 of embodiment 2 of the handwriting input method for a third-party application based on an ink screen provided by the present application. Further, in an embodiment of the present application, the step of obtaining the handwriting content of the handwriting input on the handwriting layer includes:
[0108] Step S303, obtaining the data report point of the handwriting input on the handwriting layer;
[0109] Step S304, determining whether the data report point is a data report point input by a stylus pen, and if the data report point is a data report point input by a stylus pen, converting the data report point into handwritten content;
[0110] When the data reporting point does not belong to the data reporting point input by the stylus, it is determined whether the data reporting point belongs to the preset information, and if so, the third-party application is operated according to the data reporting point.
[0111] The existing ink screen can receive handwriting input information from fingers and handwriting input information from a stylus. In actual use, in order to avoid the handwriting input information being mistakenly generated by the finger touching the handwriting layer of the ink screen, the present application obtains the data report point of the handwriting input on the handwriting layer, and then determines whether the data report point belongs to the data report point of the stylus input. If the data report point belongs to the data report point of the stylus input, the data report point is converted into handwritten content; if the data report point does not belong to the data report point of the stylus input, it is determined whether the data report point belongs to preset information. If so, the third-party application is operated according to the data report point. The present application operates the third-party application with the data report point of the finger handwriting input that belongs to the preset information, thereby intercepting the data report point of the finger handwriting input that does not belong to the preset information, thereby further improving the convenience of using the ink screen during handwriting input.
[0112] For example, the preset information may be a data point when two fingers move in opposite directions, a data point when two fingers move toward each other, etc. When the preset information is a data point when two fingers move in opposite directions, the display interface of the third-party application is zoomed in according to the data point; when the preset information is a data point when two fingers move toward each other, the display interface of the third-party application is zoomed out according to the data point. For example, the preset information may be a data point when a finger slides to the left, a data point when a finger slides to the right, etc. When the preset information is a data point when a finger slides to the left, the display interface of the third-party application is switched to the next page according to the data point; when the preset information is a data point when a finger slides to the right, the display interface of the third-party application is switched to the previous page according to the data point.
[0113] Fig.10 This is a schematic diagram of the structure of the handwriting input device for the third-party application based on the ink screen provided by this application. Fig.10 The handwriting input device for the third-party application based on the ink screen includes a detection module 10, a first layer module 20, an acquisition module 30 and a driving module 40.
[0114] Wherein, the detection module 10 is used to detect the configuration information of the display interface of the third-party application in response to the start signal of handwriting input to the third-party application;
[0115] A first layer module 20, the first layer module 20 is used to create a handwriting layer above the display interface of the third-party application according to the configuration information of the display interface, the handwriting layer is a transparent layer, and the projection of the handwriting layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application;
[0116] An acquisition module 30, the acquisition module 30 is used to acquire the handwriting content inputted by handwriting on the handwriting layer;
[0117] A driving module 40 is used to display the handwritten content in the display interface of the third-party application.
[0118] The present application arranges the projection of the handwriting layer in the normal direction of the display interface to not overlap with the non-content area on the display interface of the third-party application, so that the handwriting layer will not block the non-content area of the third-party application. When performing handwriting input, the third-party application can be controlled without switching to the display interface of the third-party application, thereby improving the efficiency of handwriting input of third-party applications on the electronic ink screen and the user experience.
[0119] The handwriting input device also includes:
[0120] The second layer module is used to create a tool layer above the display interface. The tool layer is provided with virtual function keys, and the tool layer is movable.
[0121] The handwriting input device also includes:
[0122] A position module, the position module is used to obtain the position area of the content protection zone of the ink screen according to the configuration information of the display interface.
[0123] The handwriting input device for a third-party application based on an ink screen provided in an embodiment of the present application is included in an electronic device and can be used to execute any handwriting input method for a third-party application based on an ink screen provided in the above embodiments, and has corresponding functions and beneficial effects.
[0124] It is worth noting that in the above-mentioned embodiment of the handwriting input device for handwriting of third-party applications based on the ink screen, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific name of each functional unit is only for the convenience of distinguishing each other, and is not used to limit the scope of protection of this application.
[0125] Fig.11 A schematic diagram of the structure of the electronic device provided in this application, such as Fig.11 As shown, the electronic device includes one or more processors; a memory for storing one or more programs; when the one or more programs are executed by the one or more processors, the electronic device implements the handwriting input method for the third-party application based on the ink screen as described above, Fig.11 A processor 201 is taken as an example.
[0126] The memory 202 is a computer-readable storage medium that can be used to store software programs, computer executable programs and modules. The processor 201 executes various functional applications and data processing of the electronic device by running the software programs, instructions and modules stored in the memory 202, thereby realizing the above-mentioned handwriting input method.
[0127] The memory 202 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and at least one application required for a function; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 202 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 202 may further include a memory remotely arranged relative to the processor 201, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0128] The electronic device mentioned above includes a handwriting input device, which can be used to execute any of the handwriting input methods mentioned above and has corresponding functions and beneficial effects.
[0129] The embodiment of the present application also provides a storage medium containing computer executable instructions, which are used to perform the handwriting input method when executed by a computer processor. When the computer program is executed by the processor, it can also implement the relevant operations in the handwriting input method provided in any embodiment of the present application, and has corresponding functions and beneficial effects.
[0130] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products.
[0131] Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the process Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0132] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory. The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0133] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.
[0134] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.
[0135] Note that the above are only preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.
Claims
1. A handwriting input method for a third-party application based on an ink screen, characterized in that: include: In response to a start signal for handwriting input to a third-party application, detecting configuration information of a display interface of the third-party application; Creating a handwriting layer on the display interface of the third-party application according to the configuration information of the display interface, wherein the handwriting layer is a transparent layer, and the projection of the handwriting layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application; Obtain the handwriting content input by handwriting on the handwriting layer; Displaying the handwritten content in a display interface of the third-party application; The step of creating a handwriting layer above the display interface of the third-party application according to the configuration information of the display interface includes: Obtaining a location area of a non-content area on the display interface of the third-party application according to the configuration information of the display interface; The area corresponding to the display interface of the third-party application is removed from the location area of the non-content area to obtain a handwriting area; A handwriting layer overlapping the handwriting area is created above the display interface of the third-party application.
2. The handwriting input method according to claim 1, characterized in that: Before the step of creating a handwriting layer on the display interface of the third-party application according to the configuration information of the display interface, the handwriting layer being a transparent layer, and the projection of the handwriting layer in the normal direction of the display interface not overlapping with the non-content area on the display interface of the third-party application, the handwriting input method further includes: A tool layer is created above the display interface, the tool layer is provided with virtual function keys, and the tool layer is movable.
3. The handwriting input method according to claim 2, characterized in that: The projection of the tool layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application, and the projection of the handwriting layer in the normal direction of the display interface does not overlap with the projection of the tool layer in the normal direction of the display interface; The step of removing the position area of the non-content area from the area corresponding to the display interface of the third-party application to obtain the handwriting area includes: The handwriting area is obtained by removing the location area of the non-content area and the area corresponding to the tool layer from the area corresponding to the display interface of the third-party application.
4. The handwriting input method according to claim 2, characterized in that: The tool layer is located above the handwriting layer, and the area of the tool layer is smaller than the area of the handwriting layer.
5. The handwriting input method according to claim 1, characterized in that: Before the step of creating a handwriting layer on the display interface of the third-party application according to the configuration information of the display interface, the handwriting layer being a transparent layer, and the projection of the handwriting layer in the normal direction of the display interface not overlapping with the non-content area on the display interface of the third-party application, the handwriting input method further includes: Obtaining a location area of the content protection zone of the ink screen according to the configuration information of the display interface; The step of removing the position area of the non-content area from the area corresponding to the display interface of the third-party application to obtain the handwriting area includes: The area corresponding to the display interface of the third-party application is removed from the position area of the non-content area and the position area of the content protection area to obtain a handwriting area.
6. The handwriting input method according to claim 2, characterized in that: After the step of acquiring the handwriting content inputted by handwriting on the handwriting layer, the handwriting input method further includes: Merging the handwritten content and the display content of the display interface of the third-party application into a record file for storage; The virtual function keys include a record viewing key, and the record file is viewed by clicking the record viewing key.
7. The handwriting input method according to claim 1, characterized in that: The step of obtaining the handwritten content input by handwriting on the handwriting layer comprises: Obtaining data report points of handwriting input on the handwriting layer; It is determined whether the data report point is a data report point input by a stylus pen, and if so, the data report point is converted into handwritten content.
8. The handwriting input method according to claim 1, characterized in that: The step of obtaining the handwritten content input by handwriting on the handwriting layer comprises: Obtaining data report points of handwriting input on the handwriting layer; Determining whether the data report point is a data report point input by a stylus pen, and if the data report point is a data report point input by a stylus pen, converting the data report point into handwritten content; When the data reporting point does not belong to the data reporting point input by the stylus, it is determined whether the data reporting point belongs to the preset information, and if so, the third-party application is operated according to the data reporting point.
9. The handwriting input method according to claim 2, characterized in that: The virtual function keys include a parameter setting key and an erase key: The parameter setting key is used to set the handwriting parameters of the stylus, and the erase key is used to erase the handwriting of the stylus on the ink screen.
10. The handwriting input method according to claim 1, characterized in that: The non-content area includes a tool bar, a scroll bar and a status bar.
11. A handwriting input device for a third-party application based on an ink screen, characterized in that: include: a detection module, the detection module being used to detect configuration information of a display interface of a third-party application in response to a start signal for handwriting input to the third-party application; A first layer module, the first layer module is used to create a handwriting layer above the display interface of the third-party application according to the configuration information of the display interface, the handwriting layer is a transparent layer, and the projection of the handwriting layer in the normal direction of the display interface does not overlap with the non-content area on the display interface of the third-party application; An acquisition module, the acquisition module is used to acquire the handwriting content input by handwriting on the handwriting layer; A driving module, the driving module is used to display the handwritten content in the display interface of the third-party application; The step of creating a handwriting layer above the display interface of the third-party application according to the configuration information of the display interface includes: Obtaining a location area of a non-content area on the display interface of the third-party application according to the configuration information of the display interface; The area corresponding to the display interface of the third-party application is removed from the location area of the non-content area to obtain a handwriting area; A handwriting layer overlapping the handwriting area is created above the display interface of the third-party application.
12. An electronic device, characterized in that: include: one or more processors; A memory for storing one or more programs; When the one or more programs are executed by the one or more processors, the electronic device implements the handwriting input method as described in any one of claims 1-10.
13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the handwriting input method according to any one of claims 1 to 10 is implemented.
Citation Information
Patent Citations
Character input method, device and equipment for ink screen and storage medium
CN117148981A
Handwriting input method and device for third-party application, electronic equipment and storage medium
CN117931314A