Writing method, interactive panel and storage medium

Abstract

The invention provides a writing method, an interactive panel and a storage medium, and the method comprises the steps: displaying a writing layer on an interface in an overlapping manner when it is confirmed that a moving operation is executed by a preset touch object. And when the text edit box obtaining the input focus exists or the moving slave operation points to a certain text edit box, displaying a toolbar at a preset position of the text edit box. After it is confirmed that the moving operation is terminated, text content corresponding to the moving operation is displayed in the text editing box, and the writing layer is closed. And when an operation on a certain text editing control in the toolbar is received, editing the text content according to an editing mode corresponding to the text editing control. According to the method and the device, the text content can be edited through the text editing control in the toolbar, so that the text content can be edited without calling a soft keyboard, the editing process of the text content can be simplified, and the input efficiency of the text content can be improved.

Description

A writing method, an interactive panel and a storage medium TECHNICAL FIELD

[0001] The present application relates to the technical field of terminals, and more particularly, to a writing method, an interactive panel and a storage medium. BACKGROUND

[0002] At present, an interactive panel usually supports a handwriting input mode, in which a user can quickly input text content to the interactive panel by using a handwriting pen, thereby improving the input efficiency of the text content.

[0003] Although the handwriting input mode can improve the input efficiency of the text content, it has certain limitations in editing the input text content. For example, in the process of inserting a space character into the input text content, the handwriting input mode usually does not support the input of the space character, so it is necessary to call a soft keyboard to insert the space character into the text content. In the process of deleting part or all of the characters in the input text content, the handwriting input mode usually draws a line on the characters to be deleted, which is not easy for the user to master due to insufficient visualization, so the user often needs to call the soft keyboard to delete the characters in the text content. In short, although the handwriting input mode can improve the input efficiency of the text content, it may need to frequently switch the input mode when editing the input text content, resulting in low input efficiency of the text content.

[0004] SUMMARY

[0005] The present application provides a writing method, an interactive panel and a storage medium, which can improve the input efficiency of the text content.

[0006] In a first aspect, a writing method is provided, which includes: displaying a first interface, the first interface including at least one text editing box; receiving a first movement operation occurring on the first interface; confirming that the first movement operation is performed by a preset first touch object, superimposing and displaying a first writing layer of a first writing application on the first interface, and adding and displaying first writing traces on the first writing layer based on the first movement operation; when the first movement operation points to a target text editing box in the at least one text editing box, obtaining text content in a standard font based on the first writing traces after confirming that the first movement operation is terminated; displaying the text content in the target text editing box, and displaying a toolbar at a preset position of the target text editing box and closing the first writing layer; wherein the toolbar includes at least one text editing control; and after displaying the text content in the target text editing box, when an operation on a target text editing control in the at least one text editing control is received, editing the displayed text content according to a first editing mode corresponding to the target text editing control; and displaying the edited text content in the target text editing box.

[0007] The above technical solution receives a first movement operation occurring on a first interface, confirms that the first movement operation is performed by a preset first touch object, superimposes and displays a first writing layer of a first writing application on the first interface, and adds and displays first writing traces on the first writing layer based on the first movement operation. When the first movement operation points to a target text editing box in the at least one text editing box, text content in a standard font is obtained based on the first writing traces after confirming that the first movement operation is terminated, the text content is displayed in the target text editing box, and a toolbar is displayed at a preset position of the target text editing box and the first writing layer is closed. When an operation on a target text editing control in the at least one text editing control is received, the displayed text content is edited according to a first editing mode corresponding to the target text editing control, and the edited text content is displayed in the target text editing box. Since the method displays a toolbar at a preset position of a text editing box during input of text content into the text editing box, the toolbar includes one or more text editing controls. For the text content input into the text editing box, a user can edit the text content through the text editing controls in the text editing box, so that the editing of the text content can be performed without calling a soft keyboard and without frequent switching of input modes, thereby simplifying the editing process of the text content and improving the input efficiency of the text content.

[0008] In a second aspect, a writing method is provided, which includes: displaying a first interface, the first interface including at least one text editing box; receiving a first movement operation occurring on the first interface; confirming that the first movement operation is performed by a preset first touch object, and superimposing a first writing layer of a first writing application on the first interface; when there is a target text editing box obtaining an input focus in the at least one text editing box, displaying a toolbar at a preset position of the target text editing box, and adding and displaying a first writing trace on the first writing layer based on the first movement operation; wherein the toolbar includes at least one text editing control; after confirming that the first movement operation is terminated, obtaining text content of a standard font based on the first writing trace; wherein the input focus is triggered by a click operation occurring on the first interface; displaying the text content in the target text editing box, and closing the first writing layer; and after displaying the text content in the target text editing box, when an operation on a target text editing control in the at least one text editing control is received, editing the displayed text content according to a first editing mode corresponding to the target text editing control; and displaying the edited text content in the target text editing box.

[0009] The above technical solution receives a first movement operation occurring on a first interface, confirms that the first movement operation is performed by a preset first touch object, and superimposes a first writing layer of a first writing application on the first interface. When there is a target text editing box obtaining an input focus in the at least one text editing box, a toolbar is displayed at a preset position of the target text editing box, and a first writing trace is added and displayed on the first writing layer based on the first movement operation. After confirming that the first movement operation is terminated, text content of a standard font is obtained based on the first writing trace. The text content is displayed in the target text editing box, and the first writing layer is closed. When an operation on a target text editing control in the at least one text editing control is received, the displayed text content is edited according to a first editing mode corresponding to the target text editing control, and the edited text content is displayed in the target text editing box. Since the method displays a toolbar at a preset position of a text editing box during input of text content into the text editing box, the toolbar includes one or more text editing controls. For the text content of the input text editing box, a user can edit the text content through the text editing controls in the text editing box, so that the editing of the text content can be performed without calling a soft keyboard and without frequent switching of input modes, thereby simplifying the editing process of the text content and improving the input efficiency of the text content.

[0010] Optionally, the superimposed display of the first writing layer of the first writing application on the first interface comprises: superimposed display of the first writing layer of a first size on the first interface; wherein the area of the first writing layer of the first size is greater than the area of the target text editing box and less than the area of the first interface; obtaining the duration of the first movement operation; when the duration is greater than a preset duration, displaying the first writing layer of a second size; wherein the second size is greater than the first size.

[0011] Optionally, the at least one text editing control comprises an input control for inputting space characters and a deletion control for deleting characters; and the editing of the displayed text content according to the first editing mode corresponding to the target text editing control comprises: determining a text editing position from the displayed text content; in the case that the target text editing control is the input control, inputting a space character at the text editing position; or in the case that the target text editing control is the deletion control, deleting characters before the text editing position in the text content.

[0012] Optionally, the at least one text editing control comprises a switching control for switching input modes, and the method further comprises: when receiving an operation on the switching control, hiding the toolbar; and after hiding the toolbar, displaying a soft keyboard to edit the text content in the target text editing box through the soft keyboard.

[0013] Optionally, the display of the toolbar at the preset position of the target text editing box comprises: hiding a soft keyboard corresponding to the target text editing box; and after hiding the soft keyboard, displaying the toolbar at the preset position.

[0014] Optionally, the obtaining of the text content of a standard font based on the first writing trace comprises: optical character recognition of the first writing trace to obtain at least one candidate text content and the accuracy of each candidate text content; and determination of the text content from the at least one candidate text content based on the accuracy of each candidate text content.

[0015] Optionally, the method further comprises: listening to whether the target text editing box loses the input focus; and when the target text editing box loses the input focus, hiding the toolbar.

[0016] Optionally, when the first movement operation is directed to the target text edit box, the first writing trace displayed in the first writing layer is a first color writing trace; when the first movement operation is not directed to any of the at least one text edit box, the first writing trace displayed in the first writing layer is a second color writing trace; wherein the first color is different from the second color.

[0017] Optionally, when the target text edit box exists in the at least one text edit box, the first writing trace displayed in the first writing layer is a first color writing trace; when the target text edit box does not exist in the at least one text edit box, the first writing trace displayed in the first writing layer is a second color writing trace; wherein the first color is different from the second color.

[0018] Optionally, the method further comprises: receiving a second movement operation occurring on the first writing layer, the second movement operation passing through the target text edit box; confirming that the second movement operation is performed by the first touch object, then determining a second editing mode corresponding to the second movement operation according to the second movement operation; editing the text content according to the second editing mode; and displaying the edited text content in the target text edit box.

[0019] Optionally, the determining the second editing mode corresponding to the second movement operation according to the second movement operation comprises: adding and displaying a second writing trace on the first writing layer based on the second movement operation; when it is confirmed that the second movement operation passes through the text content displayed in the target text edit box and the second writing trace is a first preset writing trace, determining that the second editing mode is deleting text; when it is confirmed that the second movement operation passes through the text content displayed in the target text edit box and the second writing trace is a second preset writing trace, determining that the second editing mode is selecting text; and when it is confirmed that the second writing trace is a third preset writing trace, determining that the second editing mode is splitting text content or combining text content.

[0020] Optionally, when the first movement operation is not directed to a text edit box, the method further comprises: receiving a third movement operation, the third movement operation having an overlap with the first writing trace, and the third movement operation being performed by a preset second touch object; and erasing the first writing trace according to the third movement operation.

[0021] Optionally, when the target text edit box does not exist in the at least one text edit box, the method further comprises: receiving a third movement operation, the third movement operation overlapping the first writing trace, and the third movement operation being performed by a preset second touch object; and erasing the first writing trace according to the third movement operation.

[0022] Optionally, the erasing the first writing trace according to the third movement operation comprises: confirming a first overlapping area of the third movement operation and the first writing trace; and erasing writing trace in the first overlapping area in the first writing trace.

[0023] Optionally, the method further comprises: receiving a fourth movement operation occurring on the first interface; confirming that the fourth movement operation is performed by a preset third touch object; updating the first interface according to the fourth movement operation; and displaying the updated first interface.

[0024] Optionally, the updating the first interface comprises: slidingly updating the first interface; or flipping the first interface.

[0025] In a third aspect, a writing device is provided, which comprises: a display module configured to display a first interface, the first interface comprising at least one text edit box; a receiving module configured to receive a first movement operation occurring on the first interface; the display module is further configured to confirm that the first movement operation is performed by a preset first touch object, to superimpose a first writing layer of a first writing application on the first interface, and to add and display a first writing trace on the first writing layer based on the first movement operation; a obtaining module configured to, when the first movement operation is directed to a target text edit box in the at least one text edit box, obtain text content in a standard font based on the first writing trace after confirming that the first movement operation is terminated; the display module is further configured to display the text content in the target text edit box, and to display a toolbar at a preset position of the target text edit box and to close the first writing layer; wherein the toolbar comprises at least one text edit control; and an editing module configured to, after the text content is displayed in the target text edit box, edit the displayed text content according to a first editing mode corresponding to a target text edit control in the at least one text edit control when an operation on the target text edit control is received; the display module is further configured to display the edited text content in the target text edit box.

[0026] In a fourth aspect, a writing device is provided, which includes: a display module configured to display a first interface, the first interface including at least one text editing box; a receiving module configured to receive a first movement operation occurring on the first interface; the display module is further configured to confirm that the first movement operation is performed by a preset first touch object, and to display a first writing layer of a first writing application on the first interface; the display module is further configured to, when there is a target text editing box obtaining an input focus in the at least one text editing box, display a toolbar at a preset position of the target text editing box, and add and display a first writing trace on the first writing layer based on the first movement operation; the toolbar includes at least one text editing control; a obtaining module is configured to, after confirming that the first movement operation is terminated, obtain text content in a standard font based on the first writing trace; the input focus is triggered by a click operation occurring on the first interface; the display module is further configured to display the text content in the target text editing box, and to close the first writing layer; an editing module is configured to, after the text content is displayed in the target text editing box, edit the displayed text content according to a first editing mode corresponding to a target text editing control in the at least one text editing control when an operation on the target text editing control is received; and the display module is further configured to display the edited text content in the target text editing box.

[0027] In a fifth aspect, an interactive tablet is provided, which includes a memory and a processor, the memory is configured to store executable program code; the processor is configured to call and run the executable program code from the memory, so that the interactive tablet executes the writing method in the first aspect or any possible implementation manner of the first aspect.

[0028] In a sixth aspect, a computer readable storage medium is provided, which stores computer program code; when the computer program code is run on a computer, the computer executes the writing method in the first aspect or any possible implementation manner of the second aspect.

[0029] In a seventh aspect, a computer program product is provided, which includes computer program code; when the computer program code is run on a computer, the computer executes the writing method in the first aspect or any possible implementation manner of the second aspect. BRIEF DESCRIPTION OF DRAWINGS

[0030] FIG. 1 is a structural schematic diagram of an interactive tablet according to an embodiment of the present application;

[0031] FIG. 2 is a scene schematic diagram of a writing method according to an embodiment of the present application;

[0032] FIG. 3 is a schematic flow chart of a writing method according to an embodiment of the present application;

[0033] FIG. 4 is a schematic diagram of a text input scenario according to an embodiment of the present application;

[0034] FIG. 5 is a schematic diagram of another text input scenario according to an embodiment of the present application;

[0035] FIG. 6 is a schematic diagram of another text input scenario according to an embodiment of the present application;

[0036] FIG. 7 is a schematic diagram of another text input scenario according to an embodiment of the present application;

[0037] FIG. 8 is a schematic diagram of another text input scenario according to an embodiment of the present application;

[0038] FIG. 9 is a schematic diagram of a text deletion scenario according to an embodiment of the present application;

[0039] FIG. 10 is a schematic diagram of another text deletion scenario according to an embodiment of the present application;

[0040] FIG. 11 is a schematic flow chart of another writing method according to an embodiment of the present application;

[0041] FIG. 12 is a schematic diagram of a Windows system architecture according to an embodiment of the present application;

[0042] FIG. 13 is a schematic diagram of another writing method scenario according to an embodiment of the present application;

[0043] FIG. 14 is a schematic flow chart of a writing method according to an embodiment of the present application;

[0044] FIG. 15 is a schematic diagram of another text input scenario according to an embodiment of the present application;

[0045] FIG. 16 is a schematic diagram of an interface change according to an embodiment of the present application;

[0046] FIG. 17 is a schematic flow chart of another writing method according to an embodiment of the present application;

[0047] FIG. 18 is a schematic diagram of a writing device structure according to an embodiment of the present application;

[0048] FIG. 19 is a schematic diagram of a writing device structure according to an embodiment of the present application;

[0049] FIG. 20 is a schematic diagram of an interactive tablet structure according to an embodiment of the present application. DETAILED DESCRIPTION

[0050] The technical solutions in the present application will be described clearly and exhaustively below with reference to the drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " represents the meaning of or, for example, A / B can represent A or B: "and / or" in the text is only a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent: A exists alone, A and B exist together, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two. Hereinafter, the terms "first", "second" are only for descriptive purposes, and cannot be understood as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include one or more features.

[0051] The writing method of the present application can be applied to an interactive panel, which is an integrated device for manipulating the content displayed on the display screen through touch technology and realizing man-machine interactive operation, which integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound, a television and a video conference terminal. Of course, the interactive panel does not include the limitation of the surface characteristics of the display surface, for example, the interactive panel can be a plane, a curved surface or a splicing of multiple planes, etc.

[0052] Fig. 1 is a structural schematic diagram of an interactive panel provided by an embodiment of the present application. As shown in Fig. 1, the interactive panel 100 includes a touch-sensitive display screen 110 and a control mainboard 120. The touch-sensitive display screen 110 is used to detect the position information of the touch object and the touch object type of the touch object; the control mainboard 120 is used to control and coordinate the interactive panel 100 and external devices, so that various independent hardware in the interactive panel 100 can work as a stable whole. As an example, the touch-sensitive display screen 110 is a display screen with touch function; for example, an infrared display screen, a capacitive display screen, a resistive display screen, an electromagnetic display screen or a pressure-sensitive display screen, etc. On the touch-sensitive display screen 110, the user can realize writing operation or other operation by touching the touch-sensitive display screen 110 with fingers, writing pens or other touch media (hereinafter collectively referred to as touch objects); accordingly, the interactive panel 100 detects the position information when the fingers or the writing pens touch the touch-sensitive display screen 110, and responds according to the position information to realize the touch-based man-machine interactive function.

[0053] In the embodiments of the present application, the sensing data that the touch-sensitive display 110 can detect includes not only the position information, but also the judgment result of the type of the touch object through the directly detected touch signal or the specific signal detected by the auxiliary sensor. For example, the type of the touch object can be distinguished according to the size of the contact point when the touch object contacts the touch-sensitive display 110, the physical signal (such as sound, etc.) with distinguishability generated when the touch object contacts the touch-sensitive display 110, the wireless signal with identification capability generated when the touch object contacts the touch-sensitive display 110, etc. That is, the touch-sensitive display 110 can not only send the position information of the touch to the control motherboard 120, but also send the type of the touch object to the control motherboard 120.

[0054] For example, the control motherboard 120 is installed with at least one operating system, such as an Android system, a Linux system, a Windows system, a HongMeng system, etc., which is used to control and coordinate the interactive tablet 100 and external devices, so that various independent hardware in the interactive tablet 100 can work coordinately as a stable whole. The architecture level where the operating system is located is defined as a system layer. On the basis of the system layer, the interactive tablet 100 is installed with application programs developed to meet different fields and different problems of users, and the architecture level where the application programs are located is defined as an application layer.

[0055] In the embodiment of the present application, the interactive tablet 100 can be installed with at least one writing application program with writing function. The writing application program can be an application program provided by the operating system, or an application program downloaded from a third-party device or server. Optionally, the writing application program has other editing functions in addition to the writing function based on the touch operation, such as a deletion function, an insertion table function, an insertion picture function, an insertion figure function, a table drawing function, a figure drawing function, etc., which are not limited here.

[0056] In the related art, when a space character needs to be inserted into the input text content in the process of inputting the text content into the interactive tablet through the handwriting input mode, the soft keyboard needs to be called to insert the space character into the text content because the handwriting input mode does not support the input of the space character. When part or all of the characters in the input text content need to be deleted, the handwriting input mode usually draws a line on the characters to be deleted. This mode is not easy to be mastered by the user because of the insufficient visualization, so the user often needs to call the soft keyboard to delete the characters in the text content. In short, although the handwriting input mode can improve the input efficiency of the text content, the input mode needs to be frequently switched when the input text content is edited, which leads to a low input efficiency of the text content.

[0057] Therefore, the application provides a writing method, an interactive panel and a storage medium. The method can directly generate and display writing traces when a preset first touch object performs a touch moving operation on a first interface, and can display the writing traces as soon as a pen is put down. If there is a text editing box that obtains an input focus or the moving operation points to a certain text editing box, the writing traces can be directly converted into text content in a standard font and input into the text editing box. Meanwhile, a toolbar including one or more text editing controls can be displayed at a preset position of the text editing box. When a user needs to edit the text content in the text editing box, the text content can be edited through the text editing controls in the toolbar, so that the editing of the text content can be performed without calling a soft keyboard and frequent switching of input modes, thereby simplifying the editing process of the text content and improving the input efficiency of the text content. Moreover, the method can enable writing at any position of the first interface through the preset touch object to directly input the text content or generate the writing traces, without relying on repeated opening and closing of the soft keyboard or writing software for text input or trace writing, thereby improving the convenience of writing on the interactive panel, improving the writing efficiency and enhancing the user experience.

[0058] FIG. 2 is a scene schematic diagram of a writing method according to an embodiment of the application. Exemplarily, (a) of FIG. 2 shows a scene schematic diagram of writing by a writing pen, and (b) of FIG. 2 shows a scene schematic diagram of writing by a finger. Exemplarily, as shown in (a) of FIG. 2, when a main thread detects that a writing pen performs a writing operation on a first interface of an interactive panel, a first writing layer of a first writing application is displayed on the first interface, the first writing layer receives a first writing trace, and the main thread continuously detects a lifting duration of the first writing pen. If the lifting duration is greater than a preset duration, it is determined that the writing is completed, and the first writing trace is collected.

[0059] Meanwhile, another thread traverses all the opened windows from top to bottom to obtain the positions of the windows, and determines a target window based on the positions of the windows and a drop position (the drop position is a starting position of the writing operation). Specifically, the window in which the drop position is located is detected, and the opened window in which the drop position is located is determined as the target window by traversing the opened windows of the first interface. After the target window is determined, whether the drop position of the writing operation exists in an editing box (hereinafter referred to as a first editing box) is determined based on the drop position and the positions of the editing boxes in the target window. For example, the position of the first editing box in which the drop position is located can be determined by traversing the editing boxes, and attribute information of the first editing box is obtained. If the attribute information meets a preset condition of the editing box, the first editing box is determined as the target text editing box.

[0060] Further, when the drop point position of the writing operation exists a target text editing box, after confirming the termination of the writing operation, the text content of the standard font is obtained according to the first writing trace, the text content is displayed in the target text editing box, and the first writing layer is closed. In addition, when the drop point position of the writing operation does not exist a target text editing box, after confirming the termination of the writing operation, the first writing trace is displayed in the first writing layer for the user to view. It should be noted that the writing pen is a pen matched with the interactive tablet.

[0061] Optionally, the first writing layer can be a transparent writing layer or a semi-transparent writing layer, which is not limited here. Optionally, the editing box preset condition includes but is not limited to: the editing box is a text editing supported editing box, the position of the editing box is located in the first interface of the interactive tablet, the editing box exists an input box that can input text, and the like, which is not limited here. Optionally, the drop point position can be represented based on coordinate data; for example, taking the upper left corner of the first interface as the origin, the horizontal direction as the x-axis, and the vertical direction as the y-axis, the drop point position of the writing operation is determined based on the coordinate data. The establishment position of the coordinate system can be determined according to actual conditions, which is not limited here. Optionally, the preset time length can be 300 ms, 350 ms, 380 ms, and the like, which is not limited here.

[0062] Exemplarily, in the case that the type of the writing pen matches the preset type successfully, it is detected that the writing pen exists a moving operation in the first interface of the interactive tablet. It can be understood that when it is determined that the writing pen exists a moving operation in the first interface of the interactive tablet, the drop point position of the moving operation is determined. It can be understood that the moving operation can include but is not limited to: a writing operation, a text deletion, a text selection, and the like, which is not limited here. Exemplarily, the main thread detects the moving operation of the finger on the first interface, updates the first interface according to the moving operation, and displays the updated first interface.

[0063] FIG. 3 is a schematic flowchart of a writing method provided by an embodiment of the present application. As shown in FIG. 3, the method includes the following processes:

[0064] S301, display a first interface.

[0065] Exemplarily, the interactive tablet can be a Windows system conference tablet, an Android tablet, and the like. The first interface can be a webpage interface or an input interface of an application program, and the like, and the first interface includes at least one text editing box. The text editing box is used to receive the text content of the standard font input by the user, and the standard font is relative to the handwritten font, for example, a Chinese character font, an English font, and the like. Optionally, the standard font can also be set with a specific font format, for example, the Chinese character font can have a Fangsong, a bold, a Microsoft Yahei, and the like.

[0066] S302, receiving a first moving operation occurring on the first interface.

[0067] Optionally, the first moving operation can be any one of a writing operation, a text selection, and a text deletion. Exemplarily, when the first moving operation is a writing operation, the writing operation occurring on the first interface is received. It can be understood that the illustrated example is only one case that can be adopted in actual application, and the specific case can be determined according to actual conditions, which is not limited herein.

[0068] S303, confirming that the first moving operation is performed by a preset first touch object, superimposing and displaying a first writing layer of a first writing application program on the first interface, and adding and displaying a first writing trace on the first writing layer based on the first moving operation.

[0069] The first touch object is a pen tip of a writing pen. Optionally, the first writing application program can be an application program provided by an operating system of the interactive tablet, or can be an application program downloaded from a third-party device or a server, which is not limited herein. Optionally, in the embodiment of the present application, the first writing application program is a note application program installed in the operating system of the interactive tablet. In one implementation, when detecting whether the first moving operation is performed by the preset touch object, the type of the touch object can be determined by detecting a touch signal or by detecting specific information of the touch object through an auxiliary sensor. For example, different touch object types can be distinguished according to a touch point size when the touch object contacts the first interface; different touch object types can be distinguished according to a physical signal with a recognizable degree generated when the touch object contacts the first interface; and different touch object types can be distinguished according to a wireless signal with an identifiable ability generated when the touch object contacts the first interface. The determination of the type of the touch object can be determined according to actual conditions, which is not limited herein. In another implementation, when detecting whether the first moving operation is performed by the preset touch object, the type of the touch object can be determined by receiving a touch object type sent by the touch-sensitive display screen. For example, the high-precision touch-sensitive display screen is adopted in the embodiment of the present application, which can not only recognize position information of the touch object touching the touch-sensitive display screen, but also recognize a specific shape of the touch object, so as to distinguish the specific type of the touch object. Therefore, the touch data reception of the first writing application program is redesigned in the software architecture or software logic of the present application, so as to meet the data acquisition in different states.

[0070] Exemplarily, when the interactive tablet is started, the first writing application is started to run in the background, and at this time, the first writing layer of the first writing application is not displayed on the interactive tablet. During the running of the interactive tablet, when the touch object performs a touch operation on the touch-sensitive display screen of the interactive tablet, the operating system of the interactive tablet will receive touch data. The first writing application will determine in real time whether there is another writing application running, and if there is, the first writing application will not establish a connection with the driver layer (corresponding to the driver) of the operating system, and the operating system will respond to the data distribution. That is, the first writing application is started and runs in the background; the first writing application establishes a data channel with the driver under the condition that the first interface is not the interface of a writing application, and disconnects the data channel with the driver under the condition that the first interface is the interface of a writing application; the data channel is used to transmit the touch data sent by the touch-sensitive display screen, and the touch data at least includes touch position data detected by the touch-sensitive display screen and the specific type of the touch object. According to the type of the first interface, the connection state of the data channel between the first writing application and the driver is set, which can directly avoid unnecessary display of the first writing layer of the first writing application in the case that writing can be supported at present.

[0071] If there is no other writing application running, the first writing application establishes a connection with the driver layer of the operating system, and informs the driver layer of the judgment rule or condition (such as intercepting the touch data of a specific pen) of the touch data to be intercepted. The driver layer judges according to the received touch data, and if it is judged that the touch data is generated by a pen (the touch object type is a preset first medium type), the touch data is intercepted and sent to the first writing application for response. If it is judged that the touch data is not generated by a pen, the operating system responds to the touch data distribution, so that in combination with other steps of the embodiment of the application, when the user uses a specific pen to write on the interactive tablet, the user can write on the interactive tablet by lifting the pen, or directly lift the pen to input text or edit text in the text input box, which can improve the convenience of writing on the interactive tablet, thereby improving the writing efficiency and greatly improving the user experience.

[0072] As shown in FIG. 4, FIG. 4 is a scene diagram of text input provided by an embodiment of the application. When it is confirmed that the first moving operation is performed by the pen head of the writing pen, the first writing layer can be displayed on the first interface, and the first writing layer can be a transparent writing layer, a semi-transparent writing layer or an opaque writing layer. At the same time, the moving track of the first moving operation can be obtained, the moving track is converted into a first writing trace, and the first writing trace is displayed on the first writing layer.

[0073] S304, when the first moving operation points to a target text edit box in the at least one text edit box, after confirming the termination of the first moving operation, obtaining the text content of the standard font based on the first writing trace.

[0074] The target text edit box pointed to by the first moving operation can be a text edit box located at the landing position of the first moving operation. Illustratively, the landing position of the first moving operation and the positions of the text edit boxes included in the first interface can be detected, it is determined whether there is a text edit box at the landing position of the first moving operation, if there is a text edit box, the text edit box at the landing position is determined as the target text edit box. At the same time, after confirming the termination of the first moving operation, the moving track of the first moving operation is collected to obtain the first writing trace, and then text recognition is performed based on the first writing trace to obtain at least one candidate text, and one candidate text is determined as the text content of the standard font from the at least one candidate text.

[0075] Optionally, the landing position can be the starting position of the first moving operation on the first interface. For example, the landing position can be represented by coordinate data, the coordinate data taking the top left corner of the first interface as the origin, the horizontal direction as the x-axis and the vertical direction as the y-axis, and the landing position is, for example, (100, 200), which means that the landing position is at horizontal coordinate 100 and vertical coordinate 200 in the first interface. In the process of determining whether there is a text edit box at the landing position, the target window where the landing position is located can be determined, and the positions of the at least one text edit box in the target window can be obtained, if the landing position is located in the position range of a text edit box in the target window, it is determined that the first moving operation points to the text edit box, and the text edit box is the target text edit box. As shown in FIG. 4, the starting point of the first writing trace is the landing position of the first moving operation, and the landing position is located in the position range of the text edit box, so the text edit box can be determined as the target text edit box.

[0076] In order to determine the target window where the drop point is located, each window opened in the first interface can be traversed to obtain the position of each window, and the target window is determined based on the position of each window and the drop point position. Specifically, the top window in the first interface is found through the GetTopWindow interface of the User32.dll module in the system architecture layer of the windows system architecture, the position (window size) of the top window is determined through the GetWindowRect interface of the User32.dll module, and it is detected whether the position of the top window contains the drop point position. If the position of the top window contains the drop point position, the top window is determined as the target window. If the position of the top window does not contain the drop point position, the reference window is found one by one downward through the GetWindow interface of the User32.dll module, the position of the reference window is determined through the GetWindowRect interface of the User32.dll module, and it is detected whether the position of the reference window contains the drop point position. If the position of the reference window contains the drop point position, the reference window is determined as the target window.

[0077] For example, the top window in the first interface is found through the GetTopWindow interface, and the position of the top window is determined as (100, 100, 750, 800) through the GetWindowRect interface, indicating that the position coordinates of the top-left corner of the top window are (100, 100), the position coordinates of the bottom-right corner of the top window are (750, 800), the drop point position is (650, 650), the position of the top window is determined to contain the drop point position, and the top window is determined as the target window. Alternatively, the top window in the first interface is found through the GetTopWindow interface, and the position of the top window is determined as (100, 100, 750, 800) through the GetWindowRect interface, indicating that the position coordinates of the top-left corner of the top window are (100, 100), the position coordinates of the bottom-right corner of the top window are (750, 800), the drop point position is (850, 850), the position of the top window is determined not to contain the drop point position, the reference window is found one by one downward from the top window through the GetWindow interface, the position of the reference window is determined, and it is detected whether the position of the reference window contains the drop point position. In the case where the position of the reference window contains the drop point position, the reference window is determined as the target window. It can be understood that the way of detecting whether the position of the reference window contains the drop point position can refer to the way of detecting whether the position of the top window contains the drop point position in the foregoing disclosed embodiments, which will not be described here. After the target window where the drop point is located is determined, each text editing box in the target window is traversed to determine the position of the text editing box (hereinafter referred to as the text editing box) where the drop point is located, and the attribute information of the text editing box is obtained. If the attribute information satisfies the editing box preset condition, it is determined that the first moving operation points to the text editing box.

[0078] Optionally, the edit box preset condition includes that the text edit box is an edit box supporting text editing, and the position of the text edit box is located in the first interface. The edit box preset condition can be determined according to actual conditions, which is not specifically limited here. Illustratively, each text edit box can be traversed by a UIAComWrapper module, the position of each text edit box can be obtained by a BoudingRectangle interface, and the position of the edit box in which the drop point position is located can be determined; the attribute information of the edit box in which the drop point position is located can be obtained by a FindAll interface in the UIAComWrapper module, and if the attribute information meets the edit box preset condition, it is determined that the first moving operation is directed to the text edit box in which the drop point position is located. For example, each text edit box is traversed, the position of each text edit box is obtained by a BoudingRectangle interface, and the position of each text edit box is represented by coordinate data, such as the position of the text edit box being (100, 100, 200, 300), indicating that the position coordinates of the upper left corner of the text edit box are (100, 100), and the position coordinates of the lower right corner of the text edit box are (200, 300); after the position of each text edit box is determined, the position of the edit box in which the drop point position is located is detected. The attribute information of the edit box is obtained by a FindAll interface, and if the attribute information meets the edit box preset condition, it is determined that the first moving operation is directed to the text edit box. Alternatively, each text edit box is traversed, the position of each text edit box is obtained by a BoudingRectangle interface, and if the drop point position is located outside the positions of all text edit boxes, it is determined that there is no target text edit box, i.e., it is determined that the first moving operation is not directed to the text edit box. Alternatively, each text edit box is traversed, the position of each text edit box is obtained by a BoudingRectangle interface, and the position of the text edit box in which the drop point position is located is determined. The attribute information of the text edit box in which the drop point position is located is obtained by a FindAll interface, and if the attribute information does not meet the edit box preset condition, it is determined that the first moving operation is not directed to the text edit box.

[0079] In the above scheme, each text edit box is traversed, the position of the edit box in which the drop point position is located is determined, the attribute information of the edit box in which the drop point position is located is obtained, and if the attribute information meets the edit box preset condition, it is determined that the first moving operation is directed to the text edit box in which the drop point position is located; since the process of determining that the first moving operation is directed to the text edit box first traverses each text edit box, and then determines whether the text edit box in which the drop point position is located meets the condition by screening according to the edit box preset condition, the accuracy of determining whether the first moving operation is directed to the text edit box can be improved, thereby improving the writing accuracy.

[0080] Exemplarily, after confirming that the first moving operation is terminated, the collected first writing trace can be subjected to optical character recognition (OCR) recognition to obtain N candidate texts, and then in response to a selection operation on the N candidate texts, the text content is determined. For example, the N candidate texts include {“each”, “every”, “every other”}, and the user can select “each”, and then “each” is determined as the text content. Alternatively, the number of candidate texts can be preset; for example, the first writing trace is subjected to text recognition to obtain 5 candidate texts. Alternatively, the number of candidate texts can be determined based on the confidence corresponding to the recognition result; for example, the first writing trace is subjected to text recognition to obtain a candidate text with a confidence greater than 80%. Alternatively, the first writing trace is subjected to text recognition, and in a case where the confidence corresponding to the recognition result is all less than 60%, the recognition text with the highest confidence is determined as the candidate text.

[0081] Exemplarily, when the first moving operation is directed to the text editing box, after the at least one candidate text of the standard font is obtained by recognizing the first writing trace, the at least one candidate text can be displayed in the candidate pop-up window. At this time, a selection operation occurring in the candidate pop-up window can be received, and the text content is determined from the at least one candidate text based on the selection operation. For example, the candidate pop-up window can be displayed at a target position, and the distance between the target position and the position of the target text editing box is less than a preset distance threshold. The preset distance threshold is, for example, 3 cm, 5 cm, etc., which is not limited herein. For example, the candidate pop-up window is arranged below the position of the target text editing box; or the candidate pop-up window is arranged to the right of the position of the target text editing box.

[0082] FIG. 5 is a schematic diagram of another text input scenario provided by an embodiment of the present application. As shown in FIG. 5, after confirming that the first moving operation is terminated, the first writing trace is subjected to OCR text recognition to obtain 3 candidate texts, and the 3 candidate texts are displayed in the candidate pop-up window. The 3 candidate texts include {“Micro”, “Micy0”, “Microsoft”}. At this time, the user can select one of the 3 candidate texts according to the requirement and click (selection operation), and after receiving the click operation of the user, the candidate text clicked by the user can be determined as the text content. It can be understood that when the candidate texts are multiple, the multiple candidate texts can be sequentially displayed in the candidate pop-up window according to the size of the confidence of each candidate text obtained by the OCR text recognition. As shown in FIG. 5, the confidence of the candidate texts “Micro”, “Micy0” and “Microsoft” from high to low is “Micro”, “Micy0” and “Microsoft” in turn, and the candidate texts can be sequentially displayed in the candidate pop-up window as “Micro”, “Micy0”, “Microsoft”.

[0083] Optionally, the step of obtaining the text content of the standard font based on the first writing handwriting can comprise: performing optical character recognition on the first writing handwriting to obtain at least one candidate text content and an accuracy of each candidate text content; and determining the text content from the at least one candidate text content based on the accuracy of each candidate text content.

[0084] In an implementation, in the process of obtaining the text content corresponding to the first writing handwriting, first, the first writing handwriting can be subjected to OCR text recognition to obtain one or more texts, and at the same time, the confidence (i.e., accuracy) of each text is obtained, and each obtained text is a candidate text. After obtaining at least one candidate text, the candidate text with the highest accuracy can be directly determined from the at least one candidate text as the text content based on the accuracy of each candidate text, and the text content is displayed in the target text editing box. As described above, after obtaining at least one candidate text, the text content can be directly determined from the at least one candidate text as the candidate text with the highest accuracy without determining the text content through the candidate pop-up window. In the above scheme, in the process of obtaining the text content based on the first writing handwriting, the text content can be directly determined from the at least one candidate text according to the accuracy of each candidate text recognized, which can simplify the text input operation and improve the text input efficiency.

[0085] S305, displaying the text content in the target text editing box, displaying the toolbar at a preset position of the target text editing box, and closing the first writing layer.

[0086] The toolbar includes at least one text editing control. The preset position can be a position below, above, left of, or right of the target text editing box, and the distance between the target text editing box and the position is less than a preset distance threshold. The preset distance threshold can be set to 1 cm, 2 cm, etc., which is not limited herein. In this embodiment, after obtaining the text content based on the first writing handwriting, the text content can be displayed in the target text editing box, and the first writing layer can be closed. At the same time, the toolbar can be displayed at a preset position of the target text editing box. As shown in FIG. 6, FIG. 6 is a schematic diagram of another text input scenario provided by the present application. After determining that the candidate text "Micro" is the text content, the text content "Micro" can be displayed in the target text editing box, and the first writing layer can be closed, and at the same time, the toolbar can be displayed at a preset position below the target text editing box. In combination with FIG. 5, when the text content is determined from the at least one candidate text through the candidate pop-up window, after determining the text content from the at least one candidate text, the candidate pop-up window and the first writing layer can be closed first, and then the toolbar can be displayed.

[0087] As shown in FIG. 6, the toolbar can include text editing controls such as an input control for inputting a space character and a delete control for deleting a character, and can also include a close control for closing the toolbar, and other controls such as a switching control for switching the text input mode. It should be understood that the types and quantities of the text editing controls can include, but are not limited to, the above examples.

[0088] Optionally, displaying the toolbar at the preset position of the target text editing box includes: hiding the soft keyboard corresponding to the target text editing box; and displaying the toolbar at the preset position after the soft keyboard is hidden.

[0089] In actual applications, when it is determined that the first movement operation is directed to the target text editing box, the target text editing box can be set to obtain an input focus. At this time, the interactive panel first starts and displays the soft keyboard corresponding to the target text editing box, and displays the soft keyboard at a position close to the target text editing box. In order to avoid interference of the soft keyboard with the handwriting input of the user, and to avoid interference of the soft keyboard with the normal display of the toolbar, the soft keyboard can be hidden first, and the toolbar can be displayed at the preset position after the soft keyboard is hidden.

[0090] S306, when receiving an operation on a target text editing control in the at least one text editing control, editing the displayed text content according to a first editing mode corresponding to the target text editing control.

[0091] S307, displaying the edited text content in the target text editing box.

[0092] In the embodiment, after the toolbar is displayed, if an operation of a user on a certain text editing control (i.e., a target text editing control) in the toolbar is received, the text displayed in the target text editing box can be edited according to a first editing mode corresponding to the target text editing control, and then the edited text content can be displayed in the target text editing box. As shown in FIG. 6, when the text content is displayed in the target text editing box, an input cursor can be displayed simultaneously. The input cursor is used to indicate a text editing position, and the text editing position can be located at the tail of the text content by default, so that the input cursor is located at the tail of the text content. The operation of the user on the text editing control is, for example, a click operation. After receiving a click operation of the user on the delete control once, one character located before the input cursor in the text content can be deleted, so as to complete one editing of the text content, obtain the edited text content, and then display the edited text content in the target text editing box. Similarly, after receiving a click operation of the user on the input control once, a space character can be inserted at the position of the input cursor, then the space character and the text content are combined to obtain the edited text content, and the edited text content is displayed in the target text editing box.

[0093] In an implementation, the user can manually adjust the text editing position. As shown in FIG. 7, which is a schematic diagram of another scenario of text input according to an embodiment of the present application, after the text content is displayed, if the user determines that it is necessary to insert other characters between the character "c" and the character "r" or delete one or more characters before the character "r" in the text content, the user can click the position between the character "c" and the character "r" using a second touch object, which is the tail of a handwriting pen. At this time, the user's clicking position can be determined as the text editing position, and the input cursor is inserted at the position. The above is only an exemplary example, and the method for specifically determining the text editing position can include but is not limited to the above example.

[0094] Optionally, when there is historical text in the text editing box, the historical text and the text content can be spliced, and the spliced text content is displayed in the target text editing box. For example, after the text content corresponding to the first handwriting trace is determined, the historical text in the text editing box can be obtained through the Current.Value interface, then the text content and the historical text are spliced to obtain new text content, and the historical text is replaced by the new text content through the SetValue interface, so as to achieve the purpose of displaying the text content in the text editing box.

[0095] Optionally, the at least one text editing control comprises an input control for inputting a space character and a delete control for deleting a character. The step of editing the displayed text content according to the first editing mode corresponding to the target text editing control can comprise: determining a text editing position from the displayed text content; in the case that the target text editing control is an input control, inputting a space character at the text editing position; or in the case that the target text editing control is a delete control, deleting a character in the text content before the text editing position. As shown in FIG. 6 and FIG. 7, the input control and the delete control are included in the toolbar. After displaying the text content, the user can determine a text editing position according to a requirement by using the second touch object, for example, a position between "c" and "r". In the process of determining the text editing position, the user can click the text editing position by using the second touch object or the third touch object to position an input cursor at the text editing position, and the input cursor indicates the text editing position. At this time, when the user needs to delete a character before the input cursor, the user can click the delete control, and the interactive tablet can delete one character before the input cursor each time a click operation is received to obtain edited text content. When the user needs to insert a space character at the position of the input cursor, the user can click the input control, and the interactive tablet can insert a space character at the position of the input cursor each time a click operation is received to obtain edited text content composed of space characters and other characters. It should be understood that the method of determining the text editing position, the type and number of text editing controls, and the specific operation method of the text editing control can include but are not limited to the above examples.

[0096] In the above scheme, the toolbar comprises a delete control or an input control for inputting a space character, which can assist the handwriting pen to quickly delete a character in the text content or add a space character in the text content through the delete control and the input control, so that the user can edit the text content without calling the soft keyboard, thereby improving the text editing efficiency and further improving the text input efficiency.

[0097] Optionally, the at least one text editing control comprises a switching control for switching the input mode, and the method further comprises: when receiving an operation on the switching control, hiding the toolbar; and after hiding the toolbar, displaying the soft keyboard to edit the text content in the target text editing box through the soft keyboard. As shown in FIG. 7, the toolbar comprises the switching control. After displaying the toolbar, if the user needs to switch the text input mode from the handwriting input mode to the key input mode, the user can click the switching control, and the interactive tablet can respond to the click operation of the user, close the toolbar, and display the soft keyboard after closing the toolbar. As shown in FIG. 8, FIG. 8 is a schematic diagram of another text input scenario provided by an embodiment of the present application. After closing the toolbar, the soft keyboard can be displayed at a preset position of the target text editing box, and at this time, the user can edit the text in the target text editing box through the soft keyboard. The method of editing the text in the target text editing box through the soft keyboard can be set according to requirements, and the present embodiment does not limit this.

[0098] In the above solution, the toolbar comprises the switching control for switching the input mode, and the switching control can help the user to quickly switch the input mode, which can not only improve the text input efficiency of the user, but also make the interactive tablet meet different needs of the user, thereby improving the user experience of the interactive tablet.

[0099] Optionally, the first writing layer of the first writing application is displayed on the first interface in a first size, the area of the first writing layer of the first size is greater than the area of the target text editing box and smaller than the area of the first interface, the duration of the first movement operation is obtained, and when the duration is greater than a preset duration, the first writing layer of a second size is displayed, wherein the second size is greater than the first size.

[0100] In an implementation, when it is determined that the first movement operation is performed by the first touch object and it is determined that the first movement operation is directed to the target text editing box, the first writing layer of the first size can be displayed first. As shown in FIG. 5, the first writing layer shown in FIG. 5 is the first writing layer of the first size. The area of the first writing layer of the first size is greater than the area of the region where the target text editing box is located, and can completely cover the target text editing box. The interactive tablet can start timing when receiving the first movement operation, the duration of the timing is the duration of the first movement operation, and when the duration of the timing is greater than or equal to a preset duration (for example, 300 milliseconds), the first writing layer of the second size is displayed, and the second size is, for example, the size of the first interface, and at this time, the first writing layer covers the entire first interface. At this time, the user can write on the first writing layer of the larger size through the first touch object.

[0101] In the above scheme, when the duration of the first moving operation is greater than the preset duration, the first writing layer of a larger size is displayed, which can cover a larger range in the first interface, and can avoid interruption of writing caused by accidental touch of other controls in the first interface during writing, thereby ensuring the smoothness of the writing process.

[0102] Optionally, when the first moving operation is directed to the target text editing box, the first writing trace displayed in the first writing layer is a first color writing trace; when the first moving operation is not directed to any of the at least one text editing box, the first writing trace displayed in the first writing layer is a second color writing trace; wherein the first color is different from the second color.

[0103] In the embodiment, when the first moving operation is directed to the target text editing box, the target text editing box can be set to obtain input focus, and it can be determined that the user needs to input text content to the target text editing box through the first touch object. At this time, when the first writing trace is displayed on the first writing layer, the first writing trace of the first color can be displayed, and the first color is blue for example. Conversely, when the first moving operation is not directed to any of the at least one text editing box, it can be determined that no text editing box obtains input focus, and it can be determined that the user needs to make text annotations through the first touch object. At this time, when the first writing trace is displayed on the first writing layer, the first writing trace of the second color can be displayed, and the second color is red for example.

[0104] In the above scheme, the first color writing trace is displayed when the first moving operation is directed to the text editing box, and the second color writing trace is displayed when the first moving operation is not directed to the text editing box. Different colors are used to display writing traces under different operations, which can facilitate the user to distinguish the writing traces under different operations.

[0105] Optionally, the method can further include: receiving a second moving operation occurring on the first writing layer, the second moving operation passing through the target text editing box; confirming that the second moving operation is performed by the first touch object, then determining a second editing mode corresponding to the second moving operation according to the second moving operation; editing the text content according to the second editing mode; and displaying the edited text content in the target text editing box. The second moving operation can be any one of text selection and text deletion.

[0106] Optionally, the step of determining the second editing mode corresponding to the second movement operation according to the second movement operation can include: adding and displaying a second writing trace on the first writing layer based on the second movement operation; when it is confirmed that the second movement operation passes through the text content displayed in the target text editing box and the second writing trace is a first preset writing trace, determining that the second editing mode is deleting text. For example, the second movement operation can be drawing a wavy line on the text content displayed in the text editing box, i.e., the first preset writing trace is a wavy line. When it is confirmed that the second movement operation passes through the text content displayed in the target text editing box and the second writing trace is a second preset writing trace, it is determined that the second editing mode is selecting text; for example, the second movement operation can be drawing a horizontal line on the text content displayed in the text editing box, i.e., the second preset writing trace is a horizontal line.

[0107] When it is confirmed that the second writing trace is a third preset writing trace, it is determined that the editing mode corresponding to the second movement operation is splitting the text content or combining the text content; for example, the second movement operation can be drawing a vertical line between the text content displayed in the text editing box, drawing a vertical line between the split text content can combine the text content, and drawing a vertical line between the combined text content can split the text content, i.e., the third preset writing trace is a vertical line. In the above scheme, the editing mode corresponding to the second movement operation is determined through the writing trace of the second movement operation, which can quickly determine the editing mode corresponding to the second movement operation, thereby improving the writing efficiency.

[0108] For example, when the second editing mode is deleting text, the text content is edited according to the second editing mode, including: determining a first bounding rectangle of the second writing trace and a second bounding rectangle of the text content in the target text editing box; determining an intersection area of the first bounding rectangle and the second bounding rectangle; determining the first text content covered by the intersection area; and deleting the first text content in the text content. Specifically, the first bounding rectangle of the second writing trace and the second bounding rectangle of the text content are obtained in the text editing box through the Text Pattern attribute of the editing box, and the intersection area of the first bounding rectangle and the second bounding rectangle is determined; and the first text content covered by the intersection area is obtained through the RangeFromPoint interface.

[0109] Exemplarily, after determining the first text content covered by the intersection region, the first text content in the text content is deleted; or, based on the historical text in the text editing box and the first text content, a first sub-text before the first text content and a second sub-text after the first text content in the historical text are determined; the first sub-text and the second sub-text are spliced to obtain updated text; and the updated text is displayed in the text editing box. Specifically, the first text content can be selected through a Select interface, and a delete message is simulated to be sent, so that the first text content in the historical text is deleted. Or, the first sub-text and the second sub-text are spliced to obtain updated text, and the historical text is replaced by the updated text through a SetValue interface.

[0110] The above scheme, when the second mobile operation corresponds to the editing mode of deleting text, determines the intersection region of the first bounding rectangle and the second bounding rectangle, and determines the first text content covered by the intersection region, and then deletes the first text content in the text content; since the first text content is the text content covered by the intersection region, the accuracy of the first text content can be improved, and the user experience is improved.

[0111] FIG. 9 is a scene diagram of text deletion provided by an embodiment of the present application. As shown in FIG. 9, when the second editing mode is deleting text, the first bounding rectangle of the second writing trace and the second bounding rectangle of the text content are obtained in the text editing box, and the first text content covered by the intersection region of the first bounding rectangle and the second bounding rectangle is determined to be "sd". Further, "sd" can be selected through a Select interface, and a delete message is simulated to be sent to delete "sd"; or, it is determined that the first text content is "sd", based on the first text content "sd" and the historical text "A sd okq eat", it is determined that the first sub-text is "A" and the second sub-text is "okq eat", the first sub-text and the second sub-text are spliced to obtain updated text "Aokq eat", and "Aokq eat" is updated to the text editing box through a SetValue interface.

[0112] Exemplarily, when the second editing mode is selecting text, the text content is edited according to the second editing mode, including: determining a second overlapping region of the second writing trace and the text content; based on the second overlapping region, determining second text content in the second overlapping region; and selecting the second text content in the text content. As shown in FIG. 9, the text content is "A sd okq eat", and the second text content in the second overlapping region of the second writing trace and the text content is "sd", so "sd" is selected. It can be understood that the selected text content can be displayed by highlighting, or displayed by a display mode different from other text content, to improve the convenience of user viewing.

[0113] According to the above scheme, when the second editing mode is text selection, the second text content in the second overlapping area of the second writing trace and the text content is determined, and the second text content in the text content is selected. Since the second text content is determined through the second overlapping area of the second writing trace and the text content, the accuracy of the second text content can be improved, thereby improving the user convenience.

[0114] For example, when the second editing mode is splitting or combining the text content, the text content is edited according to the second editing mode, including: determining a target position of the second writing trace in the text editing box; determining third text content adjacent to the target position in the text editing box based on the target position; and splitting or combining the third text content in the text content. For example, the text content is “A’s sdok q eats”, the target position of the second writing trace in the text editing box is determined to be between the character “s” and the character “d”, the third text content adjacent to the target position in the text editing box is determined to be “A’s s” and “dok q eats”, and the third text content in the text content is split to obtain the split text content “A’s s dok q eats”. Alternatively, the text content is “A’s sdok q eats”, the target position of the second writing trace in the text editing box is determined to be between the character “k” and the character “q”, the third text content adjacent to the target position in the text editing box is determined to be “A’s sdok” and “q eats”, and the third text content in the text content is combined to obtain the combined text content “A’s sdok q eats”.

[0115] According to the above scheme, when the second editing mode is splitting or combining the text content, the third text content adjacent to the target position in the text editing box is determined, and the third text content in the text content is split or combined. Since only simple operations need to be performed by the user during splitting or combining the third text content in the text content, the user convenience for text writing is improved.

[0116] For example, after the text content is edited according to the second editing mode, the edited text content is displayed in the text editing box for the user to view. Alternatively, when the second editing mode is text deletion, the text content is edited according to the second editing mode, including: identifying a target character in the text content covered by the second writing trace; and deleting the target character.

[0117] In an implementation manner, in the process of performing the text deletion, the user can perform the text deletion operation above the target text editing box, so that the second writing trace covers part or all of the characters in the text content, and the characters covered by the second writing trace are target characters. As shown in FIG. 10, FIG. 10 is a schematic diagram of another text deletion scenario provided by an embodiment of the present application. The touch event corresponding to the second moving operation can be monitored through the accessibility service in the interactive tablet. After the touch event corresponding to the second moving operation is monitored, the touch points on the second writing trace can be saved, and then the second writing trace can be constructed based on the touch points on the second writing trace. The touch points on the second writing trace include the touch point a, the touch point b, the touch point c, the touch point d and the touch point e shown in FIG. 10. The target characters covered by the second writing trace are “think”, “listen” and “song”. After the second writing trace is displayed, the target characters “think”, “listen” and “song” covered by the second writing trace can be directly deleted to achieve the deletion operation on the text content.

[0118] Optionally, identifying the target characters in the text content covered by the second writing trace includes: determining a third bounding rectangle in which each character in the text content is located; determining a target bounding rectangle covered by the second writing trace from all the third bounding rectangles; and determining the characters in the target bounding rectangle as the target characters.

[0119] As shown in FIG. 10, after the second moving operation is received and it is determined that the second editing manner is to delete the text, the accessibility service object corresponding to the first moving operation can be obtained through the accessibility service. The rectangular frames of each character included in the text content, i.e., the third bounding rectangles, can be obtained from the accessibility service object, which are rect1, rect2, rect3 and rect4 shown in FIG. 10. Then, the stroke line can be constructed based on the touch points a, b, c, d and e in the second writing trace. The stroke line can be a Bezier curve. The third bounding rectangles (rect2, rect3 and rect4) covered by the Bezier curve are the target bounding rectangles covered by the second writing trace. After the target bounding rectangles are determined, the characters in the target bounding rectangles are determined as the target characters, and the characters “think” and “song” in the target bounding rectangles can be deleted. Optionally, in the process of determining the target bounding rectangles, the intersection points of the Bezier curve and the third bounding rectangles can be determined, and the third bounding rectangles in which the intersection points and the touch points on the Bezier curve are located are determined as the target bounding rectangles. As shown in FIG. 10, the intersection points of the Bezier curve and the third bounding rectangles include c1, d1 and e1. The third bounding rectangles rect2, rect3 and rect4 in which the points b, c1, d1 and e1 are located can be determined as the target bounding rectangles.

[0120] In the above scheme, when the second editing mode is deleting text, a third bounding rectangle in which each character in the text content is located is determined, a target bounding rectangle covered by the second writing trace is determined from all the third bounding rectangles, and the characters in the target bounding rectangle are deleted. In this way, the user can form the second writing trace by simple writing, quickly delete specific characters of the text content through the second writing trace, and the efficiency of text editing can be improved.

[0121] Optionally, the first preset writing trace is a continuous writing trace, and a number of landing points of the first preset writing trace on the text content is greater than or equal to a preset number. In an implementation manner, after determining that the second moving operation is terminated, the second writing trace can be added and displayed on the first writing layer based on the second moving operation, and the number of traces of the second writing trace can be counted. Then, it is determined whether the number of traces of the second writing trace is 1. If the number of traces of the second writing trace is equal to 1, it is determined that the second writing trace is a continuous writing trace. If the number of traces of the second writing trace is greater than 1, it is determined that the second writing trace is not a continuous writing trace.

[0122] Meanwhile, the number of landing points of the second writing trace on the text content can be counted to obtain a number of landing points. Then, when the second writing trace is a continuous writing trace and the number of landing points is greater than or equal to the preset number, it is determined that the second writing trace is the first preset writing trace, and it is further determined that the editing mode corresponding to the second moving operation is deleting text. The preset number is, for example, 5, and the preset number can be specifically set according to actual conditions, which is not limited in the embodiment.

[0123] For example, when the second editing mode is selecting text, a second overlapping area of the second writing trace and the text content is determined, the second text content in the second overlapping area of the second writing trace and the text content is determined based on the second overlapping area, and the second text content in the text content is selected. For example, the text content is "A's sdokq eats", and the second text content "sd" in the second overlapping area of the second writing trace and the text content is determined. Then, "sd" is selected. It can be understood that the selected text content can be displayed by highlighting or by a display manner different from other text content, so as to improve the convenience of user viewing.

[0124] In the above scheme, when the second editing mode is selecting text, the second text content in the second overlapping area of the second writing trace and the text content is determined, and the second text content in the text content is selected. Since the second text content is determined by the second overlapping area of the second writing trace and the text content, the accuracy of the second text content can be improved, thereby improving the convenience of user use.

[0125] Exemplarily, when the second editing method is to split the text content or combine the text content, determine the target position of the second writing stroke in the target text editing box; based on the target position, determine the third text content adjacent to the target position in the target text editing box; split or combine the third text content in the text content. For example, if the text content is "A's sdok q eats", determine that the target position of the second writing stroke in the target text editing box is the position between the character "s" and the character "d", determine that the third text content adjacent to the target position in the target text editing box is "A's s" and "dok q eats", and split the third text content in the text content to obtain the split text content as "A's s dok q eats". Or, if the text content is "A's sdok q eats", determine that the target position of the second writing stroke in the target text editing box is the position between the character "k" and the character "q", determine that the third text content adjacent to the target position in the target text editing box is "A's sdok" and "q eats", and combine the third text content in the text content to obtain the combined text content as "A's sdokq eats".

[0126] In the above solution, when the second editing method is to split the text content or combine the text content, determine the third text content adjacent to the target position in the target text editing box, and split or combine the third text content in the text content; since only simple operations need to be performed by the user during the process of splitting or combining the third text content in the text content, the convenience of the user for text writing is improved.

[0127] Optionally, the method may further include: when the first moving operation does not point to the text editing box, receive a third moving operation, the third moving operation overlaps with the first writing stroke, and the third moving operation is performed by a preset second touch object; erase the first writing stroke according to the third moving operation. Exemplarily, when the first moving operation does not point to any text editing box, the first writing stroke may be displayed on the first writing layer to make it more convenient for the user to view the writing stroke. Then, a third moving operation can be received, the third moving operation overlaps with the first writing stroke, and the third moving operation is performed by the second touch object, and the first writing stroke can be erased according to the third moving operation. Specifically, confirm the first overlapping area between the third moving operation and the first writing stroke, and erase the writing stroke in the first overlapping area of the first writing stroke. It should be noted that the third moving operation is an erasing operation on the first writing stroke. In addition, the second touch object may be the tail of the writing pen. <着

[0128] Optionally, the writing strokes in the first writing strokes can be all erased or partially erased, which can be determined according to actual conditions and is not limited here. In the above scheme, if the first movement operation is not directed to the text editing box, the third movement operation is received, the first overlapping area of the third movement operation and the first writing strokes is confirmed, and the writing strokes in the first overlapping area of the first writing strokes are erased. Since the writing strokes to be erased are determined according to the first overlapping area of the third movement operation and the first writing strokes, the accuracy of the writing strokes to be erased can be ensured, thereby improving the convenience of use of the user.

[0129] Optionally, the method can further include receiving a fourth movement operation occurring on the first interface, confirming that the fourth movement operation is performed by a preset third touch object, updating the first interface according to the fourth movement operation, and displaying the updated first interface. The third touch object is a finger of the user, and the way of confirming whether the fourth movement operation is performed by the preset third touch object can refer to the way in the foregoing disclosed embodiments, which will not be repeated here. In this embodiment, when the user determines that the first interface needs to be updated, the user can perform the fourth movement operation by the third touch object, and the fourth movement is, for example, sliding on the first interface by the third touch object. When the fourth movement operation is received, the first interface can be updated by sliding or flipping to update the first interface, and then the updated first interface is displayed.

[0130] In the above scheme, different updating ways are provided, so that the user can select different updating ways, thereby improving the user experience.

[0131] The technical solution above receives a first moving operation occurring on the first interface, confirms that the first moving operation is performed by a preset first touch object, superimposes and displays a first writing layer of a first writing application on the first interface, and adds and displays a first writing trace on the first writing layer based on the first moving operation. When the first moving operation is directed to a target text editing box in the at least one text editing box, after confirming that the first moving operation is terminated, text content in a standard font is obtained based on the first writing trace, the text content is displayed in the target text editing box, a toolbar is displayed at a preset position of the target text editing box, and the first writing layer is closed. When an operation on a target text editing control in the at least one text editing control is received, the displayed text content is edited according to a first editing mode corresponding to the target text editing control, and the edited text content is displayed in the target text editing box. Since the method displays the toolbar at a preset position of the text editing box in the process of inputting the text content into the text editing box, the toolbar includes one or more text editing controls. For the text content that has been input into the text editing box, the user can edit the text content through the text editing controls in the text editing box, so that the editing of the text content can be performed without calling the soft keyboard and without frequently switching the input mode, thereby simplifying the editing process of the text content and improving the input efficiency of the text content. Meanwhile, the preset touch object can write at any position on the first interface through the same writing application, so that the text content can be directly input or the writing trace can be generated without relying on repeatedly opening and closing the soft keyboard or the writing software for character input or trace writing, the convenience of writing on the interactive tablet is improved, the writing efficiency is improved, and the user experience is improved.

[0132] FIG. 11 is a schematic flowchart of another writing method provided by an embodiment of the present application. As shown in FIG. 11, the method includes:

[0133] S1101, receiving a first moving operation occurring on the first interface, and determining a landing position of the first moving operation on the first interface.

[0134] For example, when the first mobile operation is a writing operation, the writing operation occurring on the first interface is received, and the landing position of the first mobile operation on the first interface is determined. The first landing position can be determined by directly detecting the touch signal or by detecting specific information of the touch object through an auxiliary sensor to determine the type of the touch object and the landing position. For example, the landing position can be represented based on coordinate data; for example, taking the upper left corner of the first interface as the origin, the horizontal direction as the x-axis, and the vertical direction as the y-axis, so as to determine the landing position of the mobile operation based on the coordinate data, such as the landing position (100, 200). The establishment position of the coordinate system can be determined according to actual conditions, which is not specifically limited here.

[0135] S1102, superimposedly displaying a first writing layer on the first interface and receiving a first writing trace.

[0136] S1103, determining that the first writing trace is collected after the first mobile operation is terminated.

[0137] For example, if it is confirmed that the first mobile operation is performed by a preset first touch object, the first writing layer of the first writing application is superimposedly displayed on the first interface, and the first writing trace is collected through the first writing layer. It can be understood that the user does not continuously write during the writing process, and there can be a short pause during the writing process; for example, if the input device is a writing pen, the user can have a lifting duration of the writing pen during the writing process with the writing pen, so that the lifting duration of the writing pen can be used to determine whether the user has finished writing. For example, the lifting duration of the writing pen during the writing process is monitored in real time, if the lifting duration of the writing pen is greater than a preset duration, it is determined that the user has finished writing, and it is determined that the first mobile operation is terminated; if the lifting duration of the writing pen is less than or equal to the preset duration, it is determined that the first mobile operation is not terminated. For example, the preset duration is 300 ms, the lifting duration of the writing pen is detected in real time, if the lifting duration of the writing pen is 500 ms, it is determined that the first mobile operation is terminated, and the first writing trace is collected. Alternatively, the preset duration can be set to 300 ms, 350 ms, 380 ms, etc., which is not specifically limited here.

[0138] S1104, determining whether the first mobile operation is directed to a text editing box; if not, S1105 is performed; if yes, S1106 is performed.

[0139] Exemplarily, a target window in which the drop position is located can be determined, and it is determined whether the first movement operation is directed to a text edit box based on the drop position and a position of at least one text edit box in the target window. For example, the target window in which the drop position is located is determined, and the position of the at least one text edit box in the target window is obtained. It is detected whether the drop position is located at the position of a text edit box in the target window. If the drop position is located at the position of a text edit box in the target window, it is determined that the first movement operation is directed to the text edit box, and the text edit box directed by the first movement operation is a target text edit box. Alternatively, the manner of detecting whether the first movement operation is directed to the text edit box can refer to the manner in the foregoing disclosed embodiments, which will not be described herein again.

[0140] S1105, display the first writing trace on the first writing layer.

[0141] S1106, recognize the first writing trace to obtain candidate texts.

[0142] S1107, determine text content from the at least one candidate text.

[0143] Exemplarily, when the first movement operation is not directed to the text edit box, the first writing trace is displayed on the first writing layer. When the first movement operation is directed to the text edit box, the first writing trace is subjected to OCR text recognition to obtain at least one candidate text. Exemplarily, the text content can be determined from the at least one candidate text through a candidate pop-up window, or the text content can be directly determined from the at least one candidate text according to the accuracy of each candidate text.

[0144] S1108, display the text content in the target text edit box, display a toolbar at a preset position of the target text edit box, and close the first writing layer.

[0145] S1109, when an operation on a target text edit control in the at least one text edit control is received, edit the displayed text content according to a first edit mode corresponding to the target text edit control.

[0146] S1110, display the edited text content in the target text edit box. The understanding of steps 1106 to 1110 can refer to the foregoing examples, and the present embodiment will not be described herein again.

[0147] FIG. 12 is a schematic diagram of an architecture of a Windows system provided by an embodiment of the present application.

[0148] For example, as shown in FIG. 12, the Windows system includes a UI architecture layer, a system architecture layer, and the like, wherein the UI architecture layer includes a WPF architecture layer, and the WPF architecture layer includes a UIAComWrapper module; and the system architecture layer includes a User32.dll module.

[0149] In this embodiment, the top window opened in the first interface can be found through the GetTopWindow interface of the User32.dll module, the position (window size) of the top window can be determined through the GetWindowRect interface of the User32.dll module, and it is determined whether the drop position is in the position of the top window. If the drop position is in the position of the top window, the top window is determined as the target window. If the drop position is not in the position of the top window, the windows are found one by one downward through the GetWindow interface of the User32.dll module, and the position of the window is determined through the GetWindowRect interface of the User32.dll module. If the drop position is in the position of the window, the current window is determined as the target window. After the target window is determined, each text edit box in the target window is obtained through the UIAComWrapper module, the position (edit box size) of each text edit box is obtained through the BoudingRectangle interface, and the position of the first edit box in which the drop position is located is determined. The attribute information of the first edit box is obtained through the FindAll interface in the UIAComWrapper module. If the attribute information meets the preset condition of the edit box, the text edit box pointed by the first moving operation is determined as the target text edit box.

[0150] Further, when the first moving operation points to the text edit box, after it is confirmed that the first moving operation is terminated, the text content of the standard font is obtained based on the first writing trace. Specifically, the historical text of the text edit box is obtained through the Current.Value interface, the text content of the standard font is spliced with the historical text to obtain spliced text, and the spliced text is replaced with the historical text through the SetValue interface. In addition, the second moving operation can also be received, it is confirmed that the second moving operation is performed by the preset first touch object, the second editing mode corresponding to the second moving operation is determined according to the second moving operation, and if the second editing mode is deleting text, the text content is edited and the edited text content is displayed in the text edit box.

[0151] Specifically, based on the second mobile operation, a second writing trace is added and displayed on the first writing layer, a first bounding rectangle of the second writing trace in the text editing box and a second bounding rectangle of the text content are determined through the Text Pattern attribute of the editing box within the text editing box, an intersection area of the first bounding rectangle and the second bounding rectangle is determined based on the first bounding rectangle and the second bounding rectangle, and the first text content covered by the intersection area is deleted from the text content through the RangeFromPoint interface.

[0152] The above technical solution receives a first mobile operation occurring on a first interface, confirms that the first mobile operation is performed by a preset first touch object, and superimposes and displays a first writing layer of a first writing application on the first interface. When there is a target text editing box obtaining an input focus in the at least one text editing box, a toolbar is displayed at a preset position of the target text editing box, and a first writing trace is added and displayed on the first writing layer based on the first mobile operation. After confirming that the first mobile operation is terminated, text content in a standard font is obtained based on the first writing trace. The text content is displayed in the target text editing box, and the first writing layer is closed. When an operation on a target text editing control in the at least one text editing control is received, the displayed text content is edited according to a first editing mode corresponding to the target text editing control, and the edited text content is displayed in the target text editing box. Since the method displays a toolbar at a preset position of a text editing box during input of text content into the text editing box, the toolbar includes one or more text editing controls. For the text content input into the text editing box, a user can edit the text content through the text editing controls in the text editing box, so that the editing of the text content can be performed without calling a soft keyboard and without frequent switching of input modes, thereby simplifying the editing process of the text content and improving the input efficiency of the text content.

[0153] Fig. 13 is a scenario schematic diagram of another writing method according to an embodiment of the present application. Exemplarily, (a) of Fig. 13 shows a scenario schematic diagram in which a text editing box obtains input focus, (b) of Fig. 13 shows a scenario schematic diagram in which a writing pen writes, and (c) of Fig. 13 shows a scenario schematic diagram in which a finger writes. Exemplarily, as shown in (a) of Fig. 13, when the main thread detects a click operation of a finger on the first interface of the interactive panel, it determines the landing position of the click operation on the first interface, and if the landing position is located in the region of a certain text editing box, it determines that the text editing box is the target text editing box that obtains input focus. As shown in (b) of Fig. 13, when the main thread detects a writing operation of a writing pen on the first interface of the interactive panel, it displays a first writing layer of a first writing application on the first interface. At this time, if it is determined that there is a target text editing box that obtains input focus, it displays a toolbar at a preset position of the target text editing box. After the first writing layer is displayed, the writing pen traces are received through the first writing layer, and the lifting duration of the writing pen is continuously detected. If the lifting duration is greater than a preset duration, it is determined that the writing operation is terminated, the writing is completed, and the writing pen traces are collected. Further, after the writing operation is terminated, the text content of the standard font is obtained according to the writing pen traces, the text content is displayed in the target text editing box, and the first writing layer is closed. Then, when an operation on a target text editing control in the at least one text editing control is received, the displayed text content is edited according to the first editing mode corresponding to the target text editing control, and the edited text content is displayed in the target text editing box. In addition, if it is determined that there is no target text editing box that obtains input focus, after the writing operation is terminated, the writing pen traces are displayed on the first writing layer for the user to view.

[0154] Fig. 14 is a schematic flowchart of a writing method according to an embodiment of the present application. As shown in Fig. 14, the method includes the following processes:

[0155] S1401, display a first interface.

[0156] S1402, receive a first movement operation occurring on the first interface.

[0157] S1403, confirm that the first movement operation is performed by a preset first touch object, and display a first writing layer of a first writing application on the first interface.

[0158] Optionally, the first writing layer of the first writing application is superimposed and displayed on the first interface, comprising: superimposing and displaying the first writing layer of the first size on the first interface; obtaining a duration of the first movement operation; when the duration is greater than a preset duration, displaying the first writing layer of the second size. The understanding of steps 1401 to 1403 can refer to the embodiment shown in FIG. 3, and the present embodiment will not be repeated here.

[0159] S1404, when at least one text editing box exists in the target text editing box obtaining input focus, displaying the toolbar at a preset position of the target text editing box, and adding and displaying the first writing trace on the first writing layer based on the first movement operation.

[0160] In the present embodiment, after receiving the first movement operation performed by the first touch object, it is first determined whether there is a target text editing box obtaining input focus in the at least one text editing box in the first interface. In combination with FIG. 13, when the user needs to input text content to a certain text editing box, the user can first perform a click operation on the text editing box to make the text editing box obtain input focus, and then the user can perform the first movement operation through the first touch object. Correspondingly, after receiving the click operation of the user on the certain text editing box, the interactive tablet determines that the text editing box obtains input focus. After determining that the text editing box obtains input focus, if the first movement operation is received and it is confirmed that the first movement operation is performed by the first touch object, the first writing layer of the first writing application can be superimposed and displayed on the first interface, and it can be determined that there is a target text editing box obtaining input focus. At this time, the toolbar can be displayed at a preset position of the target text editing box, and the first writing trace can be added and displayed on the first writing layer based on the first movement operation. As shown in FIG. 15, FIG. 15 is another scene diagram of text input provided by the present embodiment. After determining that there is a target text editing box obtaining input focus, the first writing trace can be displayed on the first writing layer, and the toolbar can be displayed at a preset position of the target text editing box.

[0161] Optionally, the toolbar is displayed at the preset position of the target text editing box, comprising: hiding the soft keyboard corresponding to the target text editing box; after hiding the soft keyboard, displaying the toolbar at the preset position.

[0162] Optionally, the method further comprises: monitoring whether the target text edit box loses the input focus; and hiding the toolbar when the target text edit box loses the input focus. In this embodiment, after it is determined that there is the target text edit box that has the input focus, whether the target text edit box loses the input focus is monitored, and the toolbar is hidden after the target text edit box loses the input focus. In the above scheme, the corresponding toolbar is hidden in time after the text edit box loses the input focus, so that the toolbar can be prevented from affecting other controls that have the input focus.

[0163] S1405, after confirming that the first moving operation is terminated, obtaining the text content of the standard font based on the first writing trace.

[0164] Optionally, obtaining the text content of the standard font based on the first writing trace comprises: performing optical character recognition on the first writing trace to obtain at least one candidate text content and the accuracy of each candidate text content; and determining the text content from the at least one candidate text content based on the accuracy of each candidate text content. The input focus is triggered by a click operation occurring on the first interface.

[0165] S1406, displaying the text content in the target text edit box and closing the first writing layer.

[0166] In this embodiment, after the first writing trace and the toolbar are displayed, whether the first moving operation is terminated is monitored, the first writing layer is closed after the first moving operation is terminated, the first writing trace generated by the first moving operation on the first writing layer is collected, the text content is determined based on the first writing trace, and the text content is displayed in the target text edit box. The method of displaying the text content in the target text edit box is shown in FIG. 7, and details are not described herein. As shown in FIG. 16, which is a schematic diagram of the change of an interface provided by an embodiment of the present application, the user can first determine the target text edit box from at least one text edit box included in the first interface, and then click the target text edit box in the first interface using a finger to make the target text edit box have the input focus. After the target text edit box is clicked, the user performs the first moving operation. After receiving the first moving operation, the interactive tablet determines that there is the target text edit box that has the input focus, displays the first writing layer on the first interface, displays the suspension layer on the first writing layer, the suspension layer is a transparent layer, displays the toolbar on the suspension layer, and the toolbar is located at a preset position of the target text edit box.

[0167] During execution of the first movement operation, a first writing trace is collected by the first writing layer based on a movement track of the first movement operation, and the first writing trace is displayed on the first writing layer. After the first movement operation ends, the first writing layer is closed, and text content is obtained based on the first writing trace, and the text content is displayed on the target text editing box, and the toolbar is displayed on the floating layer.

[0168] S1407, upon receiving an operation on a target text editing control in the at least one text editing control, editing the displayed text content according to a first editing mode corresponding to the target text editing control.

[0169] S1408, displaying the edited text content in the target text editing box.

[0170] In this embodiment, after displaying the text content in the target text editing box, an operation of a user on a target text editing control in the at least one text editing control can be received, the displayed text content is edited according to a first editing mode corresponding to the target text editing control, and then the edited text content is displayed in the target text editing box. For a better understanding of steps 1407 and 1408, please refer to the embodiment shown in FIG. 3, which will not be repeated here.

[0171] Optionally, the at least one text editing control includes an input control for inputting a space character and a deletion control for deleting a character, and editing the displayed text content according to the first editing mode corresponding to the target text editing control includes: determining a text editing position from the displayed text content; in a case where the target text editing control is the input control, inputting a space character at the text editing position; or in a case where the target text editing control is the deletion control, deleting a character before the text editing position in the text content.

[0172] Optionally, the at least one text editing control includes a switching control for switching an input mode, and the method further includes: when an operation on the switching control is received, hiding the toolbar; after the toolbar is hidden, displaying a soft keyboard to edit the text content in the target text editing box through the soft keyboard. Optionally, when there is a target text editing box in the at least one text editing box, the first writing trace displayed in the first writing layer is a first color writing trace; when there is no target text editing box in the at least one text editing box, the first writing trace displayed in the first writing layer is a second color writing trace; wherein the first color is different from the second color.

[0173] In the embodiment, when the target text edit box with input focus exists in the at least one text edit box, it can be determined that the user needs to perform handwriting input by the first touch object. When the first writing trace is displayed on the first writing layer, the first writing trace in the first color, for example, blue, can be displayed. On the contrary, when the target text edit box with input focus does not exist in the at least one text edit box, it can be determined that the user needs to perform text annotation by the first touch object. When the first writing trace is displayed on the first writing layer, the first writing trace in the second color, for example, red, can be displayed.

[0174] In the above solution, the writing trace in the first color is displayed when the target text edit box with input focus exists, and the writing trace in the second color is displayed when the target text edit box with input focus does not exist. The writing traces in different operations can be displayed by different colors, so that the user can distinguish the writing traces in different operations.

[0175] Optionally, the method can further include: receiving a second moving operation occurring on the first writing layer, the second moving operation passing through the target text edit box; confirming that the second moving operation is performed by the first touch object, determining a second editing mode corresponding to the second moving operation according to the second moving operation; editing the text content according to the second editing mode; and displaying the edited text content in the target text edit box.

[0176] Optionally, determining the second editing mode corresponding to the second moving operation according to the second moving operation includes: adding and displaying a second writing trace on the first writing layer based on the second moving operation; when it is confirmed that the second moving operation passes through the text content displayed in the target text edit box and the second writing trace is a first preset writing trace, determining that the second editing mode is deleting text; for example, the second moving operation can be drawing a wavy line on the text content displayed in the text edit box. When it is confirmed that the second moving operation passes through the text content displayed in the target text edit box and the second writing trace is a second preset writing trace, determining that the second editing mode is selecting text; for example, the second moving operation can be drawing a horizontal line on the text content displayed in the text edit box. When it is confirmed that the second writing trace is a third preset writing trace, determining that the editing mode corresponding to the second moving operation is splitting the text content or combining the text content; for example, the second moving operation can be drawing a vertical line between the text content displayed in the text edit box. Drawing a vertical line between the split text content can combine the text content, and drawing a vertical line between the combined text content can split the text content.

[0177] Optionally, when the target text editing box does not exist in the at least one text editing box, the method can further include: receiving a third movement operation, the third movement operation overlapping the first writing trace, and the third movement operation being performed by a preset second touch object; and erasing the first writing trace according to the third movement operation.

[0178] In the embodiment, when the target text editing box obtaining the input focus does not exist in the at least one text editing box, a third movement operation can be received, the third movement operation overlapping the first writing trace, and the third movement operation being performed by a preset second touch object. The first writing trace can be erased according to the third movement operation. Specifically, the first overlapping area of the third movement operation and the first writing trace can be determined, and the writing trace in the first overlapping area of the first writing trace can be erased. It should be noted that the third movement operation is an erasing operation of the first writing trace. In addition, the second touch object can be a tail of a writing pen.

[0179] Optionally, the writing trace in the first writing trace can be completely erased or partially erased, which can be determined according to actual conditions and is not limited herein. In the above scheme, when the target text editing box obtaining the input focus does not exist in the at least one text editing box, the third movement operation is received, the first overlapping area of the third movement operation and the first writing trace is determined, and the writing trace in the first overlapping area of the first writing trace is erased. Since the writing trace to be erased is determined according to the first overlapping area of the third movement operation and the first writing trace, the accuracy of the writing trace to be erased can be ensured, thereby improving the convenience of user use.

[0180] Optionally, the method can further include: receiving a fourth movement operation occurring on the first interface, determining that the fourth movement operation is performed by a preset third touch object, updating the first interface according to the fourth movement operation, and displaying the updated first interface. Optionally, the fourth movement operation can be any one of a writing operation, a text selection, and a text deletion. In addition, when the first interface is updated, the first interface can be updated by sliding or flipping. By providing different updating manners, the user can select different updating manners, thereby improving the user experience.

[0181] FIG. 17 is a schematic flowchart of another writing method provided by an embodiment of the present application. As shown in FIG. 17, the method includes:

[0182] S1701, receiving a first movement operation occurring on a first interface.

[0183] For example, when the first movement operation is a writing operation, the writing operation occurring on the first interface is received, and a landing position of the first movement operation on the first interface is determined.

[0184] Optionally, the first landing position can be determined by directly detecting the touch signal or by detecting specific information of the touch object through an auxiliary sensor.

[0185] For example, the landing position can be represented based on coordinate data; for example, taking the upper left corner of the first interface as the origin, the horizontal direction as the x-axis and the vertical direction as the y-axis, so as to determine the landing position of the movement operation based on the coordinate data, such as the landing position (100, 200). The establishment position of the coordinate system can be determined according to actual conditions, which is not limited here.

[0186] S1702, superimposedly displaying a first writing layer on the first interface and receiving a first writing trace.

[0187] For example, if it is confirmed that the first movement operation is performed by the preset first touch object, the first writing layer of the first writing application is superimposedly displayed on the first interface, and the first writing trace is obtained by collecting the movement track of the first movement operation through the first writing layer.

[0188] S1703, determining whether there is a target text editing box obtaining an input focus in the at least one text editing box; if yes, performing S1705; if no, performing S1704.

[0189] S1704, displaying the first writing trace on the first writing layer.

[0190] S1706, displaying a toolbar at a preset position of the target text editing box, adding and displaying the first writing trace on the first writing layer.

[0191] S1706, identifying the first writing trace to obtain a candidate text.

[0192] S1707, determining the text content from the at least one candidate text.

[0193] For example, the text content can be determined from the at least one candidate text through a candidate pop-up window, or the text content can be directly determined from the at least one candidate text according to the accuracy of each candidate text.

[0194] S1708, displaying the text content in the target text editing box and closing the first writing layer.

[0195] S1709, when receiving an operation on a target text editing control in the at least one text editing control, editing the displayed text content according to the first editing mode corresponding to the target text editing control

[0196] S1710, if a second click operation on the target text edit box is received, a first writing layer is superimposed and displayed on the first interface according to the second click operation. The understanding of steps 1706 to 1710 can be referred to the foregoing examples, and the present embodiment will not be described here.

[0197] FIG. 18 is a structural schematic diagram of a writing device provided by an embodiment of the present application. As shown in FIG. 8, the writing device 1800 includes a display module 1801 configured to display a first interface, wherein the first interface includes at least one text edit box; a receiving module 1802 configured to receive a first movement operation occurring on the first interface; the display module 1801 is further configured to confirm that the first movement operation is performed by a preset first touch object, superimpose and display a first writing layer of a first writing application on the first interface, and add and display a first writing trace on the first writing layer based on the first movement operation; a obtaining module 1803 configured to, when the first movement operation points to a target text edit box in the at least one text edit box, obtain text content in a standard font based on the first writing trace after confirming termination of the first movement operation; the display module 1801 is further configured to display the text content in the target text edit box, and display a toolbar at a preset position of the target text edit box, and close the first writing layer; wherein the toolbar includes at least one text edit control; an editing module 1804 configured to, after the text content is displayed in the target text edit box, edit the displayed text content according to a first editing manner corresponding to a target text edit control in the at least one text edit control when an operation on the target text edit control is received; and the display module 1801 is further configured to display the edited text content in the target text edit box.

[0198] FIG. 19 is a structural schematic diagram of a writing device according to an embodiment of the present application. As shown in FIG. 19, the writing device 1900 comprises: a display module 1901 configured to display a first interface, wherein the first interface comprises at least one text editing box; a receiving module 1902 configured to receive a first movement operation occurring on the first interface; the display module 1901 is further configured to confirm that the first movement operation is performed by a preset first touch object, and to display a first writing layer of a first writing application on the first interface; the display module 1901 is further configured to, when there is a target text editing box obtaining an input focus in the at least one text editing box, display a toolbar at a preset position of the target text editing box, and add and display a first writing trace on the first writing layer based on the first movement operation; wherein the toolbar comprises at least one text editing control; a obtaining module 1903 configured to, after confirming that the first movement operation is terminated, obtain text content in a standard font based on the first writing trace; wherein the input focus is triggered by a click operation occurring on the first interface; the display module 1901 is further configured to display the text content in the target text editing box, and to close the first writing layer; an editing module 1904 configured to, after the text content is displayed in the target text editing box, receive an operation on a target text editing control in the at least one text editing control, and edit the displayed text content according to a first editing mode corresponding to the target text editing control; and the display module 1901 is further configured to display the edited text content in the target text editing box.

[0199] FIG. 20 is a structural schematic diagram of an interactive tablet according to an embodiment of the present application. As shown in FIG. 20, the interactive tablet 2000 comprises a memory 2010 and a processor 2020, wherein the memory 2010 stores executable program code 2030, and the processor 2020 is configured to invoke and execute the executable program code 2030 to execute a writing method. As an example, the memory 2010 can be configured to store a program related to the writing method according to an embodiment of the present application, and the processor 2020 can invoke the program related to the writing method stored in the memory 2010 to execute the writing method according to an embodiment of the present application. The embodiment can divide the device into functional modules according to the above method examples, for example, each functional module can be provided, or two or more functions can be integrated into one processing module, and the integrated module can be realized in the form of hardware. It should be noted that the division of the modules in the embodiment is illustrative, and is only a logical functional division, and another division mode can be used in actual implementation. It should be understood that the device provided in the embodiment is configured to execute the above writing method, and thus the same effect as the above implementation method can be achieved.

[0200] The application further provides a computer readable storage medium, which stores computer program codes, and when the computer program codes are run on a computer, the computer is caused to execute the above-mentioned related method steps to realize the writing method provided in the above-mentioned embodiments. The computer readable storage medium can include but is not limited to any type of disk, including a floppy disk, an optical disk, a Digital Video Disc (DVD), a Compact Disc Read-Only Memory (CD-ROM), a micro drive, and a magneto-optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable read only memory (EEPROM), a Dynamic Random Access Memory (DRAM), a Video Random Access Memory (VRAM), a flash memory device, a magnetic card or an optical card, a nanosystem (including a molecular memory IC), or any type of medium or device suitable for storing instructions and / or data.

[0201] The application further provides a computer program product, which, when run on a computer, causes the computer to execute the above-mentioned related steps to realize the writing method provided in the above-mentioned embodiments.

[0202] The above is only a specific embodiment of the application, but the protection scope of the application is not limited to this. Any person skilled in the art can easily think of changes or replacements within the technical range disclosed in the application, which should be covered in the protection scope of the application. Therefore, the protection scope of the application should be subject to the protection scope of the claims.

Claims

1. A writing method characterized by, The method comprises: displaying a first interface, the first interface comprising at least one text editing box; receiving a first movement operation occurring on the first interface; confirming that the first movement operation is performed by a preset first touch object, superimposing and displaying a first writing layer of a first writing application on the first interface, and adding and displaying first writing strokes on the first writing layer based on the first movement operation; when the first movement operation points to a target text editing box in the at least one text editing box, obtaining text content in a standard font based on the first writing strokes after confirming that the first movement operation terminates; displaying the text content in the target text editing box, displaying a toolbar at a preset position of the target text editing box, and closing the first writing layer; wherein the toolbar comprises at least one text editing control; and, after displaying the text content in the target text editing box, editing the displayed text content according to a first editing mode corresponding to a target text editing control in the at least one text editing control when an operation on the target text editing control is received; displaying the edited text content in the target text editing box.

2. A writing method characterized by, The method comprises: displaying a first interface, the first interface comprising at least one text editing box; receiving a first movement operation occurring on the first interface; confirming that the first movement operation is performed by a preset first touch object, superimposing and displaying a first writing layer of a first writing application on the first interface; when there is a target text editing box obtaining an input focus in the at least one text editing box, displaying a toolbar at a preset position of the target text editing box, and adding and displaying first writing strokes on the first writing layer based on the first movement operation; wherein the toolbar comprises at least one text editing control; the input focus is triggered by a click operation occurring on the first interface; after confirming that the first movement operation terminates, obtaining text content in a standard font based on the first writing strokes; displaying the text content in the target text editing box, and closing the first writing layer; and, after displaying the text content in the target text editing box, editing the displayed text content according to a first editing mode corresponding to a target text editing control in the at least one text editing control when an operation on the target text editing control is received; displaying the edited text content in the target text editing box.

3. The method of claim 1 or 2, wherein, The superimposing and displaying of the first writing layer of the first writing application on the first interface comprises: superimposing and displaying the first writing layer of a first size on the first interface; wherein the area of the first writing layer of the first size is greater than the area of the target text editing box and smaller than the area of the first interface; obtaining a duration of the first movement operation; when the duration is greater than a preset duration, displaying the first writing layer of a second size; wherein the second size is greater than the first size.

4. The writing method according to claim 1 or 2, characterized by, The at least one text editing control comprises an input control for inputting a space character and a deletion control for deleting a character; The editing of the displayed text content according to the first editing mode corresponding to the target text editing control comprises: determining a text editing position in the displayed text content; in the case that the target text editing control is the input control, inputting a space character at the text editing position; or in the case that the target text editing control is the deletion control, deleting a character before the text editing position in the text content.

5. The writing method according to claim 1 or 2, wherein The at least one text editing control comprises a switching control for switching an input mode, and the method further comprises: When receiving an operation on the switching control, the tool bar is hidden; and after the tool bar is hidden, a soft keyboard is displayed to edit the text content in the target text editing box through the soft keyboard.

6. The writing method according to claim 1 or 2, wherein The displaying of the tool bar at the preset position of the target text editing box comprises: The soft keyboard corresponding to the target text editing box is hidden; and after the soft keyboard is hidden, the tool bar is displayed at the preset position.

7. The writing method according to claim 1 or 2, wherein The text content in the standard font based on the first writing trace comprises: performing optical character recognition on the first writing trace to obtain at least one candidate text content and an accuracy of each candidate text content; and determining the text content from the at least one candidate text content based on the accuracy of each candidate text content.

8. The method of claim 2, wherein, The method further comprises: listening to whether the target text editing box loses the input focus; and when the target text editing box loses the input focus, the tool bar is hidden.

9. The method of claim 1, wherein, In the step of adding and displaying the first writing trace on the first writing layer based on the first moving operation, when the first moving operation is directed to the target text editing box, the first writing trace displayed in the first writing layer is a writing trace in a first color; When the first moving operation is not directed to any of the at least one text editing box, the first writing trace displayed in the first writing layer is a writing trace in a second color; and the first color is different from the second color.

10. The method of claim 2, wherein, In the step of adding and displaying the first writing trace on the first writing layer based on the first moving operation, when the target text editing box exists in the at least one text editing box, the first writing trace displayed in the first writing layer is a writing trace in a first color; and when the target text editing box does not exist in the at least one text editing box, the first writing trace displayed in the first writing layer is a writing trace in a second color; and the first color is different from the second color.

11. The method of claim 1 or 2, wherein, The method further comprises: Receiving a second moving operation occurring on the first writing layer, the second moving operation passing through the target text editing box; Confirming that the second moving operation is performed by the first touch object, and then determining a second editing mode corresponding to the second moving operation according to the second moving operation; According to the second editing mode, the text content is edited; The edited text content is displayed in the target text editing box.

12. The writing method according to claim 11, wherein, The second editing mode corresponding to the second movement operation is determined according to the second movement operation, and the second editing mode includes: A second writing trace is added and displayed on the first writing layer based on the second movement operation; When it is confirmed that the second movement operation passes through the text content displayed in the target text editing box and the second writing trace is a first preset writing trace, it is determined that the second editing mode is deleting text; When it is confirmed that the second movement operation passes through the text content displayed in the target text editing box and the second writing trace is a second preset writing trace, it is determined that the second editing mode is selecting text; When it is confirmed that the second writing trace is a third preset writing trace, it is determined that the second editing mode is splitting text content or combining text content.

13. The writing method according to claim 1, wherein When the first movement operation is not directed to a text editing box, the method further includes: A third movement operation is received, the third movement operation has an overlap with the first writing trace, and the third movement operation is performed by a preset second touch object; According to the third movement operation, the first writing trace is erased.

14. The writing method according to claim 2, wherein When the target text editing box does not exist in the at least one text editing box, the method further includes: A third movement operation is received, the third movement operation has an overlap with the first writing trace, and the third movement operation is performed by a preset second touch object; According to the third movement operation, the first writing trace is erased.

15. The writing method according to claim 13 or 14, characterized in that, The erasing of the first writing trace according to the third movement operation includes: A first overlap region of the third movement operation and the first writing trace is confirmed; Writing traces in the first overlap region in the first writing trace are erased.

16. The writing method according to claim 1 or 2, wherein The method further includes: receiving a fourth movement operation occurring on the first interface; confirming that the fourth movement operation is performed by a preset third touch object, updating the first interface according to the fourth movement operation; and displaying the updated first interface.

17. The writing method according to claim 16, wherein The updating of the first interface includes: sliding update of the first interface; or page turning of the first interface.

18. An interactive whiteboard, comprising: It includes: A memory for storing executable program codes; A processor for calling and running the executable program codes from the memory, so that the interactive tablet performs the writing method according to any one of claims 1 to 17.

19. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, when the computer program is executed, the writing method according to any one of claims 1 to 17 is realized. The computer readable storage medium stores a computer program, when the computer program is executed, the writing method according to any one of claims 1 to 17 is realized.

Images