Smart handwriting display device, smart handwriting display method and electronic device

Abstract

The present invention relates to a smart handwriting display device, a smart handwriting display method, and an electronic device. The method includes: obtaining a user's handwriting information, determining at least one handwriting group corresponding to the handwriting information, and performing a page division process on the at least one handwriting group to obtain subpages corresponding to each handwriting group. In this embodiment, the content of each handwriting group is written on a corresponding subpage, thereby separating the content of different handwriting groups, maintaining a clean display area, and improving communication efficiency.

Description

[Technical Field]

[0001] The present invention relates to the field of data processing technology, and in particular to a smart handwriting display device, a smart handwriting display method and an electronic device. [Background technology]

[0002] Electronic whiteboards, also known as smart interactive tablets, smart handwriting display devices, or IWBs (Interactive Whiteboards), are becoming more widely used in communication situations. During meetings, users can use a stylus to write content on the electronic whiteboard. To improve communication, users can use the electronic whiteboard's flowchart function to add or delete topics, subtopics, or subsubtopics in the flowchart interface by clicking the add or delete controls.

[0003] In practical applications, such as brainstorming, users do not necessarily know the content of each topic in advance. Usually, a lot of content is written directly on the electronic whiteboard, which results in a large amount of content being left on the electronic whiteboard, ultimately making it difficult to effectively use the communication content. Summary of the Invention [Means for solving the problem]

[0004] SUMMARY OF THE INVENTION The present invention provides a smart handwriting display device, a smart handwriting display method and an electronic device to solve the shortcomings of the related art.

[0005] According to a first aspect of an embodiment of the present invention, there is provided a smart handwriting display device comprising a display and a processor, the processor comprising: controlling the display to display a handwriting application interface; acquiring handwriting information of a user and controlling the handwriting application interface to display the handwriting; determining at least one signature group corresponding to the handwritten signature information; performing a page division process on the at least one handwriting group to obtain sub-pages corresponding to each of the handwriting groups; Each of the stroke groups includes at least one handwritten stroke.

[0006] In one embodiment, the smart handwriting display device further comprises an input device connected to the processor, and the processor acquiring the user's handwriting information comprises: The method includes obtaining input data transmitted from the input device and determining the handwritten signature information based on the input data.

[0007] In one embodiment, the input device includes a touch component, and the processor obtaining input data transmitted from the input device comprises: The method includes obtaining a set of touch point data collected by a touch component on the current page in response to a user's touch operation, and obtaining the input data.

[0008] In one embodiment, the input device includes a positioning component, and the processor obtaining input data transmitted from the input device comprises: The method includes receiving a set of handwritten trajectory points data collected by the positioning component, and obtaining the input data based on the set of handwritten trajectory points data.

[0009] In one embodiment, the input device includes a communication component connected to the processor, and the processor obtaining input data transmitted from the input device comprises: The communication component receives touch point data sets or handwriting trace image data transmitted from a remote device to obtain the input data.

[0010] In one embodiment, the handwriting information includes at least one of a locus point data set, a touch point data set, and a pixel point data set.

[0011] In one embodiment, the touch point data set includes at least one of original touch point data, interpolated touch point data, and sparsely sampled touch point data, and the pixel point data set includes at least one of line width adjusted pixel point data and stroke fitting pixel point data.

[0012] In one embodiment, the pixel point data set includes at least one of interpolated pixel point data, sparsely sampled pixel point data, line width adjusted pixel point data, and stroke fitted pixel point data.

[0013] In one embodiment, the processor determining at least one signature group corresponding to the handwritten signature information comprises: The method includes performing a grouping process on the handwritten information to obtain at least one handwriting group.

[0014] In one embodiment, the grouping method includes automatic grouping.

[0015] In one embodiment, the processor performing a grouping process on the handwritten information to obtain at least one handwriting group includes: projecting each of the handwritten information onto at least one coordinate axis to obtain a projection histogram; determining division positions on each coordinate axis based on the peaks and valleys of the projected histogram; generating a dividing line based on the dividing position of each coordinate axis to obtain at least one handwriting group.

[0016] In one embodiment, the processor performing a grouping process on the handwritten information to obtain at least one handwriting group includes: clustering handwriting points in the handwritten information to obtain a category to which each handwriting point belongs and a plurality of category centers; determining the handwriting points of one category as one handwriting group to obtain at least one handwriting group.

[0017] In one embodiment, the clustering method comprises a density-based clustering algorithm or a spectral clustering algorithm.

[0018] In one embodiment, the processor performing a grouping process on the handwritten information to obtain at least one handwriting group includes: acquiring strokes in the handwritten information; and clustering each stroke in the handwritten signature information to obtain at least one signature group.

[0019] In one embodiment, the processor performing a grouping process on the handwritten information to obtain at least one handwriting group includes: performing a line segmentation process on the handwritten information to obtain a plurality of handwritten lines; and clustering the plurality of handwriting lines to obtain at least one handwriting group.

[0020] In one embodiment, the processor performs a line segmentation process on the handwritten information to obtain a plurality of handwritten lines, and then further: The dragging device is used to combine two lines of writing in response to detecting that one line of writing among the plurality of lines of writing has been dragged into an area where another line of writing is located.

[0021] In one embodiment, when the processor clusters the plurality of handwriting lines to obtain at least one handwriting group, the processor further If there are multiple handwriting groups, the dragging unit is used to combine the two handwriting groups to obtain at least one handwriting group in response to detecting that one handwriting group among the multiple handwriting groups has been dragged into an area where another handwriting group is located.

[0022] In one embodiment, the grouping method includes performing grouping according to a grouping shape drawn by a user.

[0023] In one embodiment, when the processor performs a grouping process on the handwritten information to obtain at least one handwriting group, the processor further In response to detecting a grouping figure in the handwriting application interface, a grouping process is performed on the handwritten trace information based on the grouping figure to obtain at least one trace group.

[0024] In one embodiment, the grouping figure includes a line, and the processor performs a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group, obtaining at least one line in the handwriting application interface that exceeds a predetermined length; and dividing the handwritten signature information based on the at least one line to obtain at least one signature group.

[0025] In one embodiment, the grouping figure includes a target character, and the processor performs a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group, The method includes grouping the handwritten information based on a positional relationship between the target character and the handwritten strokes to obtain at least one handwritten group.

[0026] In one embodiment, grouping the handwritten information based on a positional relationship between the target character and the handwritten stroke to obtain at least one handwritten group includes: performing a recognition process on the handwritten information to obtain text information corresponding to the handwritten information; Obtaining a predetermined number of characters at the beginning of each line in the text information, and obtaining at least one target character that satisfies a predetermined rule; Dividing at least one line of handwriting corresponding to each target character into one handwriting group to obtain at least one handwriting group.

[0027] In one embodiment, the grouping figure includes a line, and the processor performs a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group, performing a line segmentation process on the handwritten information to obtain a plurality of handwritten lines; In response to detecting at least one line exceeding a predetermined length in the handwriting application interface, obtaining a handwriting line corresponding to each line; If the line connects two lines of writing, combining the two lines of writing to obtain one group of writing; if the line passes through one line of writing, dividing the line of writing to obtain two groups of writing.

[0028] In one embodiment, the processor further comprises: generating a jump interface between the handwriting group and the subpage; The jump interface is used to jump to a subpage corresponding to the handwriting group in response to being triggered; The jump interface includes at least one of a button, a link address, or a hyperlink.

[0029] In one embodiment, the processor performs a page division process on at least one handwriting group to obtain sub-pages corresponding to each handwriting group, copying the handwriting of each handwriting group; and pasting the handwritten strokes into a subpage corresponding to the stroke group.

[0030] In one embodiment, the processor performs a page division process on at least one handwriting group to obtain sub-pages corresponding to each handwriting group, Recognizing handwriting of each handwriting group and obtaining text information; and pasting the text information into a subpage corresponding to the handwriting group.

[0031] In one embodiment, the processor performs a page division process on at least one handwriting group to obtain sub-pages corresponding to each handwriting group, In response to detecting that the page split control has been triggered, obtaining the input page split shape; performing a page division process on the at least one handwriting group based on the page division pattern to obtain sub-pages corresponding to each handwriting group.

[0032] In one embodiment, the processor further comprises: If the at least one handwriting group is a plurality of handwriting groups, obtain a logical relationship between the plurality of handwriting groups; It is used to generate a logical interface for displaying the logical relationships.

[0033] In one embodiment, the logical interface is used to display on the main page or to display in a reduced form within each sub-page.

[0034] In one embodiment, the processor obtaining a logical relationship between the plurality of handwriting groups includes: adjusting the plurality of handwriting groups to a logical edit state in response to detecting that a page split control has been triggered; and acquiring a logical relationship between the plurality of handwriting groups in response to detecting an operation of associating any two handwriting groups.

[0035] In one embodiment, the processor obtaining a logical relationship between the plurality of handwriting groups includes: In response to detecting a predetermined indication mark input by a user in the handwriting application interface, determining a membership relationship of at least two handwriting groups corresponding to the predetermined indication mark, and obtaining a logical relationship of the plurality of handwriting groups; The predetermined indicator markings include at least one of a one-way arrow, a two-way arrow, a connecting line, Chinese numerals, Arabic numerals, English letters, and predetermined mnemonics.

[0036] In one embodiment, the processor obtaining a logical relationship between the plurality of handwriting groups includes: obtaining position data of the plurality of handwriting groups; generating a relative positional relationship of the plurality of handwriting groups based on the position data; determining a logical relationship matching the relative positional relationship in a predetermined logical relationship library as a logical relationship between the plurality of handwriting groups; The relative positional relationship includes at least one of a circular, up-down, left-right, star-shaped, triangular, rectangular, pyramidal, and tree-shaped.

[0037] In one embodiment, the processor further comprises: obtaining a recommended chart template based on the logical relationship; It is used to generate logical relationships depending on the recommended chart template selected by the user.

[0038] In one embodiment, the processor obtaining a logical relationship between the plurality of handwriting groups includes: Obtaining a pre-configured chart template; obtaining position data and time data of the plurality of handwriting groups; and matching the pre-defined chart template based on the position data and the time data to obtain a logical relationship between the plurality of handwriting groups.

[0039] In one embodiment, the processor further comprises: It is used to determine the logical relationship of the handwriting groups based on the grouping shapes.

[0040] In one embodiment, the processor further comprises: The sub-pages corresponding to each handwriting group are processed and used to obtain a multimedia file in a specified format.

[0041] In one embodiment, the processor further comprises: In response to detecting the input preset template, the content corresponding to each handwriting group is matched with the preset template to obtain a multimedia file.

[0042] In one embodiment, when the multimedia file of the specified format is a Word file, the processor processes the subpage corresponding to each handwriting group to obtain the multimedia file of the specified format, Create a blank Word document and Inserting each handwriting group and the content of its sub-page into the Word blank document to obtain a target Word file.

[0043] In one embodiment, when the multimedia file of the specified format is a web page file, the processor processes the subpage corresponding to each handwriting group to obtain the multimedia file of the specified format, setting parameters of a web page template based on each handwriting group; Inserting the content of the sub-page corresponding to each handwriting group into the corresponding position of the web page template to obtain a target web page file.

[0044] In one embodiment, the processor further comprises: In the process of displaying the handwriting application interface, an additional element is acquired; inserting the additional element into the handwriting application interface in response to detecting operation of an insert control of the handwriting application interface by auxiliary software; Used to align content within the handwriting application interface in response to detecting manipulation of an alignment control of the handwriting application interface by auxiliary software.

[0045] According to a second aspect of an embodiment of the present invention, there is provided a smart handwriting display method applied to a smart handwriting display device, the smart handwriting display device comprising a display and a processor, the method comprising: controlling the display to display a handwriting application interface; acquiring handwriting information of a user and controlling the handwriting application interface to display the handwriting; determining at least one signature group corresponding to the handwritten signature information; performing a page division process on the at least one handwriting group to obtain sub-pages corresponding to each of the handwriting groups; Each of the stroke groups includes at least one handwritten stroke.

[0046] In one embodiment, the handwriting information includes at least one of a locus point data set, a touch point data set, and a pixel point data set.

[0047] In one embodiment, the touch point data set includes at least one of original touch point data, interpolated touch point data, and sparsely sampled touch point data; The pixel point data set includes at least one of pixel point data after line width adjustment and pixel point data after stroke fitting.

[0048] In one embodiment, determining at least one signature group corresponding to the handwritten signature information comprises: The method includes performing a grouping process on the handwritten information to obtain at least one handwriting group.

[0049] In one embodiment, the grouping method includes automatic grouping.

[0050] In one embodiment, performing a grouping process on the handwritten information to obtain at least one handwriting group includes: projecting each of the handwritten information onto at least one coordinate axis to obtain a projection histogram; determining division positions on each coordinate axis based on the peaks and valleys of the projected histogram; generating a dividing line based on the dividing position of each coordinate axis to obtain at least one handwriting group.

[0051] In one embodiment, performing a grouping process on the handwritten information to obtain at least one handwriting group includes: clustering handwriting points in the handwritten information to obtain a category to which each handwriting point belongs and a plurality of category centers; determining the handwriting points of one category as one handwriting group to obtain at least one handwriting group.

[0052] In one embodiment, the clustering method comprises a density-based clustering algorithm or a spectral clustering algorithm.

[0053] In one embodiment, performing a grouping process on the handwritten information to obtain at least one handwriting group includes: acquiring strokes in the handwritten information; and clustering each stroke in the handwritten signature information to obtain at least one signature group.

[0054] In one embodiment, performing a grouping process on the handwritten information to obtain at least one handwriting group includes: performing a line segmentation process on the handwritten information to obtain a plurality of handwritten lines; and clustering the plurality of handwriting lines to obtain at least one handwriting group.

[0055] In one embodiment, after performing line segmentation processing on the handwritten information to obtain a plurality of handwritten lines, the method further comprises: In response to detecting that one of the plurality of handwritten lines has been dragged into an area in which another of the plurality of handwritten lines is located, the method further includes combining the two handwritten lines.

[0056] In one embodiment, the clustering of the plurality of handwriting lines to obtain at least one handwriting group comprises: If there are a plurality of handwriting groups, the method includes combining the two handwriting groups to obtain at least one handwriting group in response to detecting that one handwriting group among the plurality of handwriting groups has been dragged into an area where another handwriting group is located.

[0057] In one embodiment, the grouping method includes performing grouping according to a grouping shape drawn by a user.

[0058] In one embodiment, performing a grouping process on the handwritten information to obtain at least one handwriting group includes: In response to detecting the grouped graphic in the handwriting application interface, performing a grouping process on the handwritten trace information based on the grouped graphic to obtain at least one trace group.

[0059] In one embodiment, the grouping figure includes a line, and performing a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group includes: obtaining at least one line in the handwriting application interface that exceeds a predetermined length; and dividing the handwritten signature information based on the at least one line to obtain at least one signature group.

[0060] In one embodiment, the grouping figure includes a target character, and performing a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group includes: The method includes grouping the handwritten information based on a positional relationship between the target character and the handwritten strokes to obtain at least one handwritten group.

[0061] In one embodiment, grouping the handwritten information based on a positional relationship between the target character and the handwritten stroke to obtain at least one handwritten group includes: performing a recognition process on the handwritten information to obtain text information corresponding to the handwritten information; Obtaining a predetermined number of characters at the beginning of each line in the text information, and obtaining at least one target character that satisfies a predetermined rule; Dividing at least one line of handwriting corresponding to each target character into one handwriting group to obtain at least one handwriting group.

[0062] In one embodiment, the grouping figure includes a line, and performing a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group includes: performing a line segmentation process on the handwritten information to obtain a plurality of handwritten lines; In response to detecting at least one line exceeding a predetermined length in the handwriting application interface, obtaining a handwriting line corresponding to each line; If the line connects two lines of writing, combining the two lines of writing to obtain one group of writing; if the line passes through one line of writing, dividing the line of writing to obtain two groups of writing.

[0063] In one embodiment, the grouped shapes are hand-drawn shapes.

[0064] In one embodiment, the method further comprises: generating a jump interface between the handwriting group and the subpage; jumping to a subpage corresponding to the handwriting group in response to the jump interface being triggered; The jump interface includes at least one of a button, a link address, or a hyperlink.

[0065] In one embodiment, performing a page division process on at least one handwriting group to obtain sub-pages corresponding to each handwriting group includes: copying the handwriting of each handwriting group; and pasting the handwritten strokes into a subpage corresponding to the stroke group.

[0066] In one embodiment, performing a page division process on at least one handwriting group to obtain sub-pages corresponding to each handwriting group includes: Recognizing handwriting of each handwriting group and obtaining text information; and pasting the text information into a subpage corresponding to the handwriting group.

[0067] In one embodiment, performing a page division process on at least one handwriting group to obtain sub-pages corresponding to each handwriting group includes: In response to detecting that the page split control has been triggered, obtaining the input page split shape; performing a page division process on the at least one handwriting group based on the page division pattern to obtain sub-pages corresponding to each handwriting group.

[0068] In one embodiment, the method further comprises: If the at least one handwriting group is a plurality of handwriting groups, obtaining a logical relationship between the plurality of handwriting groups; and generating a logical interface for displaying the logical relationship.

[0069] In one embodiment, the logical interface is used to display on the main page or to display in a reduced form within each sub-page.

[0070] In one embodiment, obtaining a logical relationship between the plurality of handwriting groups includes: adjusting the plurality of handwriting groups to a logical edit state in response to detecting that a page split control has been triggered; and acquiring a logical relationship between the plurality of handwriting groups in response to detecting an operation of associating any two handwriting groups.

[0071] In one embodiment, obtaining a logical relationship between the plurality of handwriting groups includes: In response to detecting a predetermined indication mark input by a user in the handwriting application interface, determining a membership relationship of at least two handwriting groups corresponding to the predetermined indication mark, and obtaining a logical relationship of the plurality of handwriting groups; The predetermined indicator markings include at least one of a one-way arrow, a two-way arrow, a connecting line, Chinese numerals, Arabic numerals, English letters, and predetermined mnemonics.

[0072] In one embodiment, obtaining a logical relationship between the plurality of handwriting groups includes: obtaining position data of the plurality of handwriting groups; generating a relative positional relationship of the plurality of handwriting groups based on the position data; determining a logical relationship matching the relative positional relationship in a predetermined logical relationship library as a logical relationship between the plurality of handwriting groups; The relative positional relationship includes at least one of a circular, up-down, left-right, star-shaped, triangular, rectangular, pyramidal, and tree-shaped.

[0073] In one embodiment, the method further comprises: obtaining a recommended chart template based on the logical relationship; generating a logical relationship according to the recommended chart template selected by the user.

[0074] In one embodiment, obtaining a logical relationship between the plurality of handwriting groups includes: Obtaining a pre-configured chart template; obtaining position data and time data of the plurality of handwriting groups; and matching the pre-defined chart template based on the position data and the time data to obtain a logical relationship between the plurality of handwriting groups.

[0075] In one embodiment, the method further comprises: determining a logical relationship of the handwriting groups based on the grouping shapes;

[0076] In one embodiment, the method further comprises: This involves processing the sub-pages corresponding to each handwriting group to obtain a multimedia file in a specified format.

[0077] In one embodiment, the method further comprises: In response to detecting the input preset template, matching the content corresponding to each handwriting group with the preset template to obtain a multimedia file.

[0078] In one embodiment, when the multimedia file of the specified format is a Word file, processing the subpage corresponding to each handwriting group to obtain the multimedia file of the specified format includes: Create a blank Word document and Inserting each handwriting group and the content of its sub-page into the Word blank document to obtain a target Word file.

[0079] In one embodiment, when the multimedia file of the specified format is a web page file, processing the sub-page corresponding to each handwriting group to obtain the multimedia file of the specified format includes: setting parameters of a web page template based on each handwriting group; Inserting the content of the sub-page corresponding to each handwriting group into the corresponding position of the web page template to obtain a target web page file.

[0080] In one embodiment, the method further comprises: acquiring an additional element during the process of displaying the handwriting application interface; inserting the additional element into the handwriting application interface in response to detecting, by auxiliary software, operation of an insert control of the handwriting application interface; and aligning content within the handwriting application interface in response to detecting manipulation of an alignment control of the handwriting application interface by auxiliary software.

[0081] According to a third aspect of an embodiment of the present invention, there is provided a smart handwriting display device for use in a smart handwriting display device, the smart handwriting display device comprising a display and a processor, the device comprising: a handwriting interface display module for controlling the display to display a handwriting application interface; a handwriting display module for acquiring handwriting information of a user and controlling the handwriting application interface to display the handwriting; a handwriting group determination module for determining at least one handwriting group corresponding to the handwritten handwriting information; a handwriting group page division processing module for performing page division processing on the at least one handwriting group to obtain sub-pages corresponding to each of the handwriting groups; Each of the stroke groups includes at least one handwritten stroke.

[0082] According to a fourth aspect of an embodiment of the present invention, there is provided an electronic device, the electronic device including a display, a processor, and a memory for storing a computer program executable by the processor, the processor being configured to perform the method by executing the computer program in the memory.

[0083] According to a fifth aspect of an embodiment of the present invention, there is provided a computer-readable storage medium, wherein an executable computer program stored in the storage medium is executed by a processor to implement the above method. [Effects of the Invention]

[0084] The technical solutions according to the embodiments of the present invention may include the following beneficial effects:

[0085] As can be seen from the above embodiment, in the technical solution of the embodiment of the present invention, a display is controlled to display a handwriting application interface, then a user's handwriting information is obtained, and the handwriting application interface is controlled to display the handwriting, then at least one handwriting group corresponding to the handwriting information is determined, where the handwriting group includes at least one handwriting, and finally, a page division process is performed on the at least one handwriting group to obtain subpages corresponding to each handwriting group. In this way, in this embodiment, the content of each handwriting group is written on the corresponding subpage, thereby separating the content of different handwriting groups from each other, maintaining a clean display area, and improving communication efficiency.

[0086] It should be noted that the above general description and the following detailed description are merely exemplary and explanatory and are not intended to limit the present invention.

[0087] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present invention and, together with the description, serve to explain the principles of the invention. [Brief explanation of the drawings]

[0088] [Figure 1] 1 is a flowchart illustrating an information processing method according to an embodiment. [Figure 2] 10 is a flowchart for acquiring handwritten information according to an embodiment. [Figure 3] 1 is a flowchart for obtaining handwriting groups according to one embodiment. [Figure 4] FIG. 10 is a schematic diagram illustrating a projected histogram according to an embodiment. [Figure 5] FIG. 2 is a schematic diagram showing a division position according to an embodiment. [Figure 6] FIG. 2 is a schematic diagram showing a dividing line according to an embodiment. [Figure 7]FIG. 1 is a schematic diagram illustrating a handwriting group according to an embodiment. [Figure 8] 1 is a flowchart for obtaining handwriting groups according to one embodiment. [Figure 9] 1 is a flowchart for obtaining handwriting groups according to one embodiment. [Figure 10] FIG. 10 is a schematic diagram illustrating grouping by lines according to an embodiment. [Figure 11] 1 is a flowchart for obtaining handwriting groups according to one embodiment. [Figure 12] FIG. 1 is a schematic diagram illustrating a target character according to an embodiment. [Figure 13] 1 is a flowchart for obtaining handwriting groups according to one embodiment. [Figure 14] FIG. 1 is a schematic diagram illustrating joining two lines of writing according to an embodiment. [Figure 15] FIG. 10 is a schematic diagram illustrating a triangular page division control according to one embodiment. [Figure 16] FIG. 10 is a schematic diagram illustrating movement of a subpage according to an embodiment. [Figure 17] FIG. 2 is a schematic diagram illustrating buttons and hyperlinks according to an embodiment. [Figure 18] FIG. 10 is a schematic diagram illustrating a jump to a subpage according to an embodiment. [Figure 19] 10 is a flowchart for acquiring an extrinsic parameter matrix of a monocular camera according to an embodiment. [Figure 20] FIG. 10 is a schematic diagram for displaying a logical interface within a main page according to one embodiment. [Figure 21] FIG. 10 is a schematic diagram for displaying a logical interface in full screen according to one embodiment. [Figure 22] FIG. 10 is a schematic diagram for displaying a logical interface within a subpage according to one embodiment. [Figure 23] 1 is a flowchart for obtaining a logical relationship according to one embodiment. [Figure 24]FIG. 10 is a schematic diagram for creating a logical relationship using a drop-down menu according to one embodiment. [Figure 25] FIG. 10 is a schematic diagram for displaying a predetermined mark on a display according to an embodiment. [Figure 26] FIG. 1 is a schematic diagram for creating logical relationships using predetermined indicators according to one embodiment. [Figure 27] 1 is a flowchart for obtaining a logical relationship according to one embodiment. [Figure 28] FIG. 10 is a schematic diagram for determining a logical relationship between groups of handwriting using position data according to one embodiment. [Figure 29] FIG. 10 is a schematic diagram showing four recommended chart templates according to one embodiment. [Figure 30] 1 is a flowchart for obtaining logical relationships between multiple handwriting groups according to one embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0089] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following detailed description of preferred embodiments of the present invention is provided by way of example only and is illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise specified. The exemplary embodiments described below do not represent all embodiments consistent with the present invention. They are merely examples of devices consistent with certain aspects of the present invention as detailed in the appended claims. It should be noted that the features in the following examples and embodiments can be combined with each other unless inconsistent.

[0090] To address the above technical challenges, embodiments of the present invention provide an information processing method applicable to devices equipped with smart handwriting display devices, electronic whiteboards, and the like. For ease of explanation, the following technical solutions of each embodiment will be described using the smart handwriting display device as the executing entity. The smart handwriting display device includes a processor (System on Chip, SOC), a display component, a touch component, and a communication component. The processor is installed with an operating system such as Android, Kirin, or Windows, and various application software can be installed to realize various functions such as office work and meetings. For example, a handwriting software app can be installed to realize handwriting functions, allowing users to write and annotate on the display screen during meetings. The display component may include a display screen, whose size is usually larger than 50 inches, e.g., 55, 65, 75, 86, 98, or 110 inches, to meet the viewing needs of multiple users. The touch component may include at least one of infrared touch, capacitive touch, and electromagnetic touch for detecting signals such as handwriting and user interaction. The communication component may include, but is not limited to, a communication module such as WiFi and Bluetooth, which supports wireless screen projection and Bluetooth connection with other devices, and the communication component may further be used to connect the smart handwriting display device to a cloud server, and the cloud service may perform AI-supporting functions, such as realizing AI functions in the cloud.

[0091] The smart handwriting display device includes handwriting software that supports writing with a handwriting pen (active pen or passive pen) or a finger. A touch component or a mobile terminal such as a remotely connected mobile phone acquires handwriting touch locus points, downsamples the touch locus points, and then performs handwriting fitting based on the touch locus points, such as smoothing the handwritten strokes using a Bezier curve, and further performs handwriting line width adjustment and stroke simulation based on the speed or pressure, and then controls a processor to display the handwritten strokes on a display. For the process by which an operating system generates handwriting, please refer to the related art.

[0092] In addition, the smart handwriting display device can realize functions such as wireless screen projection and remote video conferencing with remote devices such as mobile terminals, personal computers, and other smart handwriting display devices.

[0093] 1 is a block diagram illustrating a smart handwriting display device according to an embodiment. Referring to FIG. 1, the smart handwriting display device includes a display and a processor, and the processor is configured to perform steps 11 to 14.

[0094] In step 11, the display is controlled to display a handwriting application interface.

[0095] In this embodiment, the processor may communicate with a display to generate a handwriting application interface and transmit the handwriting application interface to the display, thereby controlling the display to display the handwriting application interface, whereby a user can write in the handwriting application interface, for example, by using the handwriting pen to write content such as a handwriting group in the handwriting application interface.

[0096] In step 12, the handwriting information of the user is obtained, and the handwriting application interface is controlled to display the handwriting.

[0097] In this embodiment, as shown in Figure 2, in step 21, the processor of the smart handwriting display device may receive input data sent from the input device, and in step 22, the processor may determine handwriting information of the user based on the input data.

[0098] In this embodiment, the smart handwriting display apparatus includes an input device connected to the processor, and the processor may communicate with the input device to obtain input data sent from the input device.

[0099] In one example, the input device may be a touch component, which may collect touch point data sets within a current page in response to a user's trigger operation and send the touch point data sets to a processor, thereby allowing the processor to obtain input data.

[0100] In one example, the input device is a touch device, and the touch device may detect a triggered position, record coordinate data of the touch point, and also record time data of the touch point. In this case, the touch component may collect a set of touch point data within the current page in response to a user's trigger operation, and send the set of touch point data to the processor. In this way, the processor can obtain input data. In this case, it is understood that the input data may include the original touch point data. The touch point data includes coordinate data and / or time data. In this way, the processor can obtain input data.

[0101] In another example, the smart handwriting display device includes a communication component such as a WiFi module, a Bluetooth module, or a GPRS module. The communication component is connected to a processor. The smart handwriting display device can communicate with a counterpart communication component of a mobile terminal through the communication component. The mobile terminal includes a touch device. When a user performs a touch operation on the display of the mobile terminal, the touch device detects the triggered position, records coordinate data of the touch point, and may also record time data of the touch point. When the smart handwriting display device communicates with the mobile terminal, the processor of the smart handwriting display device may obtain a touch point data set or handwriting trace image data transmitted from the mobile terminal. That is, the touch point data set includes touch data of multiple touch points collected by the touch device of the mobile terminal, and the touch data includes coordinate data and / or time data, or handwriting trace image data collected by the mobile terminal. The processor may then use the touch point data set as input data. In this way, in this embodiment, users do not need to write on the smart handwriting display device, and each user can write using their own mobile terminal and display it on the smart handwriting display device, which can be applied to situations where multiple users communicate in a meeting and improve writing efficiency.

[0102] In yet another example, the smart handwriting display device includes a communication component, such as a wireless module (e.g., a WiFi module, a Bluetooth module, or a GPRS module) or a wired module. The smart handwriting display device can communicate with a communication component of a personal computer via the communication component. The personal computer includes an input device (e.g., a mouse) that can adjust a cursor movement trajectory. When a user moves or operates the input device, the cursor moves within the display area. At this time, the personal computer may record cursor coordinate data and may also record time data when the cursor reaches that position. When the smart handwriting display device communicates with the personal computer, a processor of the smart handwriting display device may obtain a touch point data set transmitted from the personal computer. That is, the touch point data set includes movement data of multiple cursor trajectory points detected by the personal computer in the display area, and the movement data includes cursor coordinate data and / or time data. The processor may use the touch point data set as input data. Similarly, the processor may obtain handwriting image data transmitted from the personal computer via the communication component to input data. In this way, in this embodiment, users do not need to write on the smart handwriting display device, and each user can write using a personal computer and display it on the smart handwriting display device, which can be applied to situations where multiple users communicate in a meeting and improve writing efficiency.

[0103] In yet another example, a smart handwriting display device may be interconnected with multiple smart handwriting display devices via a communication component. For convenience of explanation, the other smart handwriting display device interconnected with the smart handwriting display device is referred to as the other-side smart handwriting display device. The other-side smart handwriting display device may be installed in a remote conference room during a remote conference. As can be understood, the smart handwriting display device and the other-side smart handwriting display device have the same layout. When a user writes on the other-side smart handwriting display device, the touch device in the other-side smart handwriting display device detects the triggered position, records the coordinate data of the touch point, and may also record the time data of the touch point. In this case, the processor of the other-side smart handwriting display device may obtain a set of touch point data collected by the touch device within the current page. The set of touch point data includes touch data of multiple touch points collected by the touch device, and the touch data includes coordinate data and / or time data. When the smart handwriting display device is interconnected with the other-side smart handwriting display device, the processor of the smart handwriting display device can obtain the touch point data shared by the other-side smart handwriting display device. The processor of the smart handwriting display device then uses the touch point data set as input data. In this way, in this embodiment, users in different geographical locations can write on their respective smart handwriting display devices and share the data with other interconnected smart handwriting display devices, which is applicable to situations where multiple users communicate in a remote conference, and all users can view the same content together, thereby improving communication efficiency.

[0104] The mobile terminals, personal computers, and multiple shared conference all-in-one boards may be collectively referred to as remote devices to distinguish them from smart handwriting display devices that display handwriting application interfaces.

[0105] In another example, the smart handwriting display device may include a positioning component, which may include, but is not limited to, a camera (e.g., a depth camera) or a radar (e.g., a millimeter-wave radar). For example, assuming that the positioning component is a camera, the camera can capture images within a predetermined range and determine the position of the user's hand based on the images. Recognizing the user's hand and identifying its position may be achieved using a neural network model. The camera may continuously collect multiple frames of images to obtain the positions of the user's hand at different positions, and determine the user's air writing gesture based on the positions. That is, the processor may receive the handwriting trajectory point data set collected by the positioning component and obtain input data based on the handwriting trajectory point data set. In this way, in this embodiment, the user can write content in the air, thereby improving writing efficiency.

[0106] As can be seen from the above examples, the handwriting information may include at least one of a trajectory point data set, a touch point data set, and a pixel point data set. In one example, the trajectory point data set may include trajectory point data of a positioning component such as a camera or radar. The touch point data set may include touch point data collected locally or transmitted by a remote device. The pixel point data set may include pixel points of a handwriting image generated based on the trajectory point data and the touch point data.

[0107] For example, the processor may perform interpolation (including position data interpolation and time data interpolation), such as linear interpolation or quadratic interpolation, on the original touch point data to obtain several interpolated touch point data based on the original touch points, thereby expanding the touch point data. For example, the processor may perform sparse sampling on the original touch point data to obtain sparsely sampled touch point data based on the original touch points. For the trajectory point data, the processor may increase or decrease the trajectory points using the same interpolation or sparse sampling method as the touch point data, thereby adjusting the number of trajectory points. For example, the processor may determine a stroke based on the original touch point data, and then perform line width adjustment, such as thickening or thinning, on the stroke to obtain pixel point data after the line width adjustment. For example, the processor may determine a stroke based on the original touch point data, and then perform stroke fitting on the stroke to obtain pixel point data after the stroke fitting. In this way, in this embodiment, by expanding or reducing data, for example, fitting the horizontal strokes of Chinese characters into "silkworm heads and swallowtails," and increasing or decreasing the corresponding pixel point data accordingly, the needs of different scenes can be met and the user experience can be improved.

[0108] The processor may also perform anti-aliasing, smoothing, curve fitting, and other processing on the handwritten traces, and may select a method for processing the handwritten traces according to specific scenes. Corresponding solutions are included in the scope of protection of the present invention.

[0109] In this embodiment, after determining the user's handwritten information, the processor may control the display to display the handwritten information on the handwriting application interface, thereby making it easier for the user to view the handwritten information.

[0110] In step 13, at least one signature group corresponding to the handwritten signature information is determined, the signature group including at least one handwritten signature.

[0111] In this embodiment, the smart handwriting display device may determine at least one handwriting group corresponding to the handwritten information. For example, the processor may perform a grouping process on the handwritten information to obtain at least one handwriting group. In one example, the processor may perform the grouping process based on locus points in the handwritten information. In one example, the processor may perform the grouping process based on touch points in the handwritten information. In one example, the processor may perform the grouping process based on pixel points in the handwritten information. In one example, the processor may perform the grouping process based on touch points or locus points in the handwritten information, and perform the grouping process on the pixel points based on a correspondence between the touch points or locus points and the pixel points.

[0112] In this embodiment, the grouping process method of the processor includes automatic grouping and grouping according to a grouping figure drawn by the user.

[0113] In one example, the automatic grouping includes a projection method. Referring to FIG. 3, in step 31, the processor may project the handwritten signature information onto at least one coordinate axis to obtain a projection histogram. Referring to FIG. 4, FIG. 4 shows the effect of a projection histogram obtained by projecting onto the Y-axis direction. In step 32, the processor may determine a division position on each coordinate axis based on the peaks and valleys of the projection histogram. As shown in FIG. 5, division positions 51, 52, 53, and 54 can be determined based on the projection histogram. In step 33, the processor may generate division lines based on the division positions on each coordinate axis to obtain at least one handwritten signature group. Referring to FIG. 6, the processor determines division lines 61, 62, 63, and 64 based on the division positions 51, 52, 53, and 54, respectively. The dividing lines 61 and 62 can determine a first handwriting group, the dividing lines 62 and 63 can determine a second handwriting group, and the dividing lines 63 and 64 can determine a third handwriting group, resulting in a total of three handwriting groups. As can be seen, the processor can determine handwriting within each handwriting group based on the maximum and minimum values ​​of the locus points in the handwritten handwriting information between two adjacent dividing lines. The effect is shown in Figure 7, which shows handwriting groups 71, 72, and 73. In this way, this embodiment can be applied to a scene where text is written line by line.

[0114] In another example, the automatic grouping includes employing a clustering method. Referring to FIG. 8 , in step 81, the processor may cluster the handwriting points in the handwritten information to obtain a category to which each handwriting point belongs and multiple category centers. The clustering method may include a density-based clustering algorithm or a spectral clustering algorithm. The density-based clustering algorithm defines a cluster as a maximal set of density-connected points, divides sufficiently dense areas into clusters, and can find clusters of any shape in a spatial database. The spectral clustering algorithm defines an affinity matrix representing the similarity between pairs of data points based on a given sample data set, calculates the eigenvalues ​​and eigenvectors of the matrix, and selects appropriate eigenvectors to cluster different data points. Of course, engineers may select an appropriate clustering algorithm according to a specific scenario. In scenarios where touch points can be classified, corresponding solutions are within the scope of protection of the present invention. In step 82, the processor may determine handwriting points of one category as one handwriting group to obtain at least one handwriting group. In this way, in this embodiment, the handwritten information can be divided into handwritten groups by the clustering method, and is applicable to scenes where the handwritten information is relatively sparse, and the solution is simple and easy to implement.

[0115] In yet another example, in step 82, the processor determines the handwriting points of one category as one handwriting group, thereby obtaining at least one handwriting group. As shown in FIG. 9, the method includes steps 91 to 94. In step 91, the processor may obtain a circumscribing rectangle of the trajectory points of each category to obtain at least one candidate handwriting group. For example, for the trajectory points of each category, the processor may obtain the outermost touch points in four directions, i.e., up, down, left, and right, and generate a circumscribing rectangle based on the four touch points. Alternatively, the processor may obtain a circumscribing rectangle for each category by setting the cluster center of the category as the center point of the rectangle and adjusting the length and / or width of the rectangle so that the rectangle exactly covers all the touch points of the category. As can be understood, when one circumscribing rectangle is obtained, one candidate handwriting group is obtained.

[0116] In step 92, the processor may obtain a candidate handwriting group to which the centroid of each stroke of the handwritten signature belongs. After obtaining each stroke, the processor may obtain the centroid of each stroke. The abscissa of the centroid is the average of the abscissas of all touch points, and the ordinate of the centroid is the average of the ordinates of all touch points. After obtaining the centroid of each stroke, the processor may determine the region in which the centroid is located, i.e., the candidate handwriting group to which the centroid belongs.

[0117] In step 93, if the candidate handwriting group to which the centroid of each stroke belongs is different from the candidate handwriting group corresponding to the cluster, the processor may adjust the category to which the stroke belongs. If the candidate handwriting group to which the centroid of each stroke belongs is different from the candidate handwriting group corresponding to the cluster, i.e., if the centroid of a stroke is located in one handwriting group and some points of the stroke are located in another category, the processor may adjust the category to which the stroke belongs, i.e., adjust the category of all touch points of the stroke to the candidate handwriting group to which the centroid is located.

[0118] In step 94, the processor may update the bounding rectangle of each candidate handwriting group to obtain at least one handwriting group. After updating the candidate handwriting group to which each stroke belongs, the touch points within the candidate handwriting group also change. In this case, the processor may update the bounding rectangle of each candidate handwriting group to obtain at least one handwriting group. In this way, by adjusting the bounding rectangle according to the stroke centroid, this example can prevent noise caused by the clustering operation and improve the accuracy of the handwriting group.

[0119] In another example, in step 82, the processor may obtain a bounding rectangle of the trajectory points of each category to obtain at least one handwriting group. For example, the processor may cluster each stroke in the handwritten handwriting information, and each cluster may be grouped into one handwriting group to obtain at least one handwriting group. Thus, in this example, clustering the strokes may cluster the strokes into characters, words, or sentences. The increased granularity of the clustering may improve the efficiency and accuracy of the clustering.

[0120] In another example, in step 82, the processor obtaining the circumscribing rectangle of the trajectory points of each category to obtain at least one handwriting group includes the processor performing a line segmentation process on the handwritten information to obtain multiple handwriting lines, and performing a clustering process on the multiple handwriting lines to obtain at least one handwriting group. Here, the line segmentation process may be performed using a projection method to obtain multiple handwriting lines. The processor performing a clustering process on the multiple handwriting lines is advantageous for dividing handwriting belonging to the same paragraph. Each handwriting paragraph corresponds to one handwriting group, and at least one handwriting group is obtained. In this way, in this embodiment, by using handwriting lines as the clustering target, the granularity is increased, the clustering data can be reduced, and the efficiency and accuracy of the clustering can be improved.

[0121] In consideration of the possibility that certain deviations may occur in the division of handwriting lines, the processor may display the circumscribing rectangle of each handwriting line on the display. If a handwriting line with deviations is found, the user may drag the handwriting line into an area where another handwriting line is located so that there is an overlapping portion between the two handwriting lines. In this case, the processor may combine the two handwriting lines to obtain a single new handwriting line. In this way, in this embodiment, combining handwriting lines can improve the division accuracy of handwriting groups.

[0122] In consideration of the possibility of certain deviations in the division of the handwriting groups, the processor may display the circumscribing rectangle of each handwriting group on the display. If a deviating handwriting line is found, the user may drag the handwriting group into an area where another handwriting group is located so that there is an overlap between the two handwriting groups. In this case, the processor may combine the two handwriting groups to obtain a new handwriting group. In this way, in this embodiment, by combining two handwriting groups, the accuracy of the division of the handwriting groups can be improved.

[0123] In this embodiment, the processor may perform grouping according to a grouping shape drawn by a user. For example, in response to detecting a grouping shape in the handwriting application interface, the processor may perform a grouping process on the handwritten information based on the grouping shape to obtain at least one handwriting group. The grouping shape may be a shape input by a user via an input device or a shape drawn by a user, such as a line, a triangle, a rectangle, a tree, or a pyramid.

[0124] In one example, the processor may perform object detection using a CNN neural network to recognize grouped shapes in a handwriting application interface. Alternatively, the processor may use an RNN neural network, such as an LSTM, to detect input handwritten trajectory points to obtain grouped shapes for handwritten input. In some embodiments, other recognition methods may be employed to obtain at least one handwriting group, such as shape recognition based on information such as the number of turning points between handwritten trajectory points input by a user and the slope of lines before and after the turning points.

[0125] In one example, the grouped figure includes at least one line, and the processor performing a grouping process on the handwritten information to obtain at least one handwritten group includes the following: a user draws a line within the display area of ​​the smart handwriting display device. Considering that the line drawn by the user to divide the group is usually longer than the size of a character, the processor may acquire at least one line within the display area of ​​the smart handwriting display device that exceeds a predetermined length (e.g., 1.6 to 3 times the line spacing). The line may be at least one line segment, at least one curved line segment, or a shape composed of curved line segments, such as a triangle, a "K" shape, or a circle. Next, the processor may divide the handwritten information based on the at least one line to obtain at least one handwritten group. As shown in FIG. 10 , the display area 100 of the smart handwriting display device includes two lines, a vertical line 102 and a horizontal line 103. The vertical line 102 and the horizontal line 103 divide the handwriting application interface into four regions to obtain four handwritten groups 101.

[0126] In another example, the grouped graphic includes the target characters. In step 82, the processor may perform a grouping process on the handwritten stroke information based on the grouped graphic to obtain at least one stroke group. For example, the handwritten stroke information may be grouped based on the positional relationship between the target characters and the handwritten strokes to obtain at least one stroke group. Referring to FIG. 11, it includes steps 111 to 113.

[0127] In step 111, the processor may perform an identification process on the handwritten stroke information to obtain the text information corresponding to the handwritten stroke information. Here, text recognition may be realized using networks such as Convolutional Neural Networks (CNN) or Recurrent Neural Networks (RNN), and is not limited thereto. In step 112, the processor may obtain a predetermined number of characters at the beginning position of each line in the text information to obtain at least one target character that satisfies a preset rule. Here, the predetermined number may be 1 to 5. The preset rule may be set according to a specific scene. Taking sorting in order as an example, it may be in numerical order, alphabetical order, etc. The target character may be an Arabic numeral in a preset rule (for example, arranged in order) such as 1, 2, 3, 4 ···, or a Chinese numeral arranged in order such as one, two, three, four, ···, or an English letter arranged in order such as A, B, C, D ···, or a, b, c, d ···. Referring to FIG. 12, the target characters 120 are "1", "2", and "3".

[0128] The reason for setting the predetermined number is that the target character usually appears in combination with one other character. Taking Arabic numerals as an example, the number 1 can take the form of "1", "(1)", "1)", "1.", "1," etc. Therefore, the processor may detect a predetermined number of characters and determine that at least one target character has been obtained when only one character among the predetermined number of characters at the beginning of a line is sorted in order. Of course, the target character may also be selected as other characters or character combinations with unique meanings, and corresponding solutions are within the scope of protection of the present invention.

[0129] In step 113, the processor may divide at least one line of handwriting corresponding to each target character into one handwriting group to obtain at least one handwriting group. Each time a user writes one target character, the user typically writes one sentence or paragraph in succession. For example, one sentence may correspond to one line, and one paragraph may correspond to multiple lines. Therefore, the processor may divide at least one line of handwriting corresponding to each target character into one handwriting group to obtain at least one handwriting group. In this way, in this embodiment, dividing handwriting groups by the target character at the beginning of a line can improve the division accuracy.

[0130] In yet another example, the grouped figure includes at least one line. In step 82, the processor may perform a grouping process on the handwritten information based on the grouped figure to obtain at least one handwriting group. Referring to Figure 13, this process includes steps 131 to 133.

[0131] In step 131, the processor may perform a line segmentation process on the handwritten information to obtain multiple handwritten lines. The line segmentation process can be realized by the projection method in the above embodiment, and will not be described here. In step 132, in response to detecting at least one line exceeding a predetermined length in the display area of ​​the smart handwriting display device, the processor may acquire handwritten lines corresponding to each line. After acquiring the lines, the processor may determine whether there is an overlapping area between the lines and the handwritten lines to determine the handwritten lines corresponding to the lines. For example, the user may draw at least one line in the display area to combine or divide handwritten lines. For example, a connecting line may be drawn between two handwritten lines to combine the two lines; a line segment may be drawn in the middle of a handwritten line to divide the line; or a line segment may be drawn horizontally in the middle of a handwritten line to delete the line. Referring to FIG. 14, the top diagram of FIG. 14 includes a line segment 140 located between two lines of writing in the first row, in which case the processor combines the two lines of writing into one line of writing, resulting in the bottom diagram of FIG. 14.

[0132] In step 133, if the line connects two handwriting lines, the processor may combine the two handwriting lines to obtain one handwriting group, and if the line passes through one handwriting line, the processor may divide the handwriting line to obtain two handwriting groups. In this way, in this embodiment, handwriting lines are combined or divided by drawing a line to obtain handwriting groups, thereby improving the accuracy of the handwriting groups.

[0133] It should be noted that the above embodiments introduce different technical solutions for obtaining handwriting groups, and under the condition that there is no contradiction, two or more of the above technical solutions can be combined to form a new technical solution, which also falls within the scope of protection of the present invention.

[0134] In step 14, a page division process is performed on at least one handwriting group to obtain sub-pages corresponding to each handwriting group.

[0135] In this step, the sub-pages after pagination may be sub-pages that cannot be displayed simultaneously, i.e., multiple sub-pages are obtained after pagination of handwriting groups within a main page, and each sub-page can be switched from the main page, but the main page and each sub-page cannot be displayed simultaneously. Alternatively, the sub-pages after pagination can be displayed simultaneously, i.e., multiple sub-pages are obtained after pagination of handwriting groups within a main page, and each sub-page can be switched from the main page, and multiple sub-pages can be displayed simultaneously, and the user can choose to write in one of the sub-pages or multiple sub-pages.

[0136] In one example, the processor may perform a page division process for at least one handwriting group, i.e., generate one sub-page for each handwriting group, to obtain sub-pages corresponding to each handwriting group. As can be understood, in this example, the processor automatically creates sub-pages corresponding to each handwriting group without the user being aware of it, thereby improving creation efficiency.

[0137] In one example, the smart handwriting display device allows a user to manually divide pages, and the user can trigger a page division control within a current page. FIG. 15 illustrates a triangular page division control. The processor detects whether the page division control is triggered. After detecting that the page division control is triggered, the processor may obtain an input page division shape, such as the oval page division shape 152 shown in FIG. 15, in response to detecting that the page division control is triggered, to obtain at least one page division shape. The page division shape may have a shape such as a rectangle, a circle, an oval, or the like. As shown in FIG. 15, the page division shape may include numbers such as "1," "2," and "3" indicating the number of subpages in the same handwriting group. The processor may perform page division processing on at least one handwriting group based on the page division shape to obtain subpages corresponding to each handwriting group.

[0138] During the writing process for each subpage, the subpage can be gradually shifted based on the user's writing speed, clicking the up or left button, or the amount of content contained in the subpage, thereby leaving more space and facilitating writing. Referring to FIG. 16 , a user writes content within a subpage, and when the user reaches the bottom edge of the display area after writing up to the fourth line, the effect is shown in the upper diagram of FIG. 16 . At this time, the processor shifts the subpage up, hiding the first line "XXXX," and shifts the second through fourth lines up, changing them to lines 1-3, leaving the fourth line blank. The user is then allowed to continue writing content on the fourth line, the effect is shown in the lower diagram of FIG. 16 . When the user clicks the Save button, the processor may split the last subpage to obtain multiple subpages of the same page size (e.g., A4). In this embodiment, by assigning a subpage to each handwriting group, content corresponding to each subpage can be written. This prevents the content of all handwriting groups from being concentrated on the same page, which is advantageous for improving the readability of meeting content and improving communication efficiency.

[0139] In one example, after determining the subpage corresponding to each handwriting group, the processor may generate a jump interface between the handwriting group and the subpage. When the jump interface is triggered, the processor may jump to the subpage corresponding to the handwriting group according to the display screen. The jump interface may include, but is not limited to, a button, a link address, or a hyperlink. FIG. 17 shows a button 172 and a hyperlink 171. The jump interface may be set around each handwriting group or at a specified location (e.g., the lower right corner) of the display screen. For example, when the jump interface is set at the lower right corner, the jump interface may include an "up" button, a "down" button, a subpage page number display area, and a confirmation button. The page number of the subpage is adjusted by the "up" button or the "down" button. When the target subpage is reached, the processor may jump to the target subpage upon detecting that the confirmation button has been triggered.

[0140] The button is used to directly jump from a handwriting group to a subpage after being triggered. The link address is used to directly jump from a handwriting group to a subpage after being clicked. The hyperlink refers to the theme content being changed in a different form (for example, color change, bolding, etc.) to jump to the subpage after the handwriting group is clicked. It should be understood that engineers can select an appropriate jump method according to specific scenarios, and corresponding solutions are within the protection scope of the present invention.

[0141] In one example, after determining the subpage corresponding to each handwriting group, the user can write in the subpage. If only subpages corresponding to handwriting groups appear, the (writing) user may determine the handwriting group within a certain time before jumping to the subpage and may forget which handwriting group they are in as the communication progresses. A user who communicates but does not write may not know the current handwriting group, which may affect communication efficiency. Therefore, in this embodiment, the processor may copy the handwritten signature of each handwriting group and paste the handwritten signature into the subpage corresponding to the handwriting group. Referring to FIG. 18, the upper diagram of FIG. 18 shows multiple handwriting groups (182, 183, 184) displayed on the main page. After entering the subpage 181 corresponding to the first handwriting group, the processor may copy the first handwriting group 182 and paste it into the subpage 181. In this example, the processor may fix the handwriting group 182 to the upper left corner of the subpage 181, making it easier for the user to write content in other blank areas. In this way, in this embodiment, by copying and pasting a handwriting group onto a subpage, the user can easily understand the handwriting group corresponding to the subpage, improving communication efficiency during meetings. In addition, the user's original handwriting can be preserved, which not only maintains the consistency of the handwriting of all content within the subpage, but also preserves the user's user experience.

[0142] In one example, after determining the subpage corresponding to each handwriting group, the user can write within the subpage. If only the subpage corresponding to the handwriting group appears, the (writing) user may determine the handwriting group within a certain time to jump to the subpage and may forget the handwriting group as the communication progresses. For a user who only communicates but does not write, they may not know the handwriting group, which affects the communication efficiency. Therefore, in this embodiment, the processor may recognize the handwritten handwriting of each handwriting group and obtain text information. Here, the processor may recognize the text information using a neural network such as CNN or RNN, which will be omitted here. Note that the above text information is standard text information such as regular script or Song typeface, rather than handwritten handwriting. Then, the processor may paste the text information onto the subpage corresponding to the handwriting group. Referring to FIG. 19, the handwritten handwriting "How to improve work efficiency" in the upper figure of FIG. 19 is recognized and converted into regular script "How to improve work efficiency". Then, the regular script "How to improve work efficiency" is pasted at the upper left corner of the lower figure of FIG. 19. In this way, in this embodiment, by copying the handwriting group and pasting it onto the subpage, the user can easily grasp the handwriting group corresponding to the subpage and improve the communication efficiency of the meeting. Also, in this example, the handwritten handwriting can be converted into a standard font, improving the viewing efficiency and communication efficiency.

[0143] After determining the multiple handwriting groups and the subpages corresponding to each handwriting group, the user can jump to each subpage via the main page (where all the handwriting groups are located) and write the content of the related handwriting group in each subpage. Considering the logical relationships between the handwriting groups, such as parallel and progressive relationships, to facilitate the user's clarification of the logical relationships, in this embodiment, if there are multiple handwriting groups, the processor may obtain the logical relationships between the multiple handwriting groups. Then, the processor may generate a logical interface for displaying the logical relationships. Referring to FIG. 20 , assume that three handwriting groups are included in the main page 201 and the logical relationships between the three handwriting groups are two-by-two. In this case, the processor may generate a logical interface 202 including the logical relationships 203.

[0144] In one scenario, while a user is writing a group of handwritings on the main page, the processor may generate logical relations and logical interfaces and display them in the blank space around the cursor in a shrinking manner. After the user has finished writing all the groups of handwritings, the processor may generate recommended logical relations and display them in the logical interface. If the user determines that the logical relations are correct, the user may click on the logical interface. When the processor detects that the logical interface has been triggered, the processor may display the logical interface in full screen, the effect of which is shown in FIG. 21. This makes it convenient for the user to analyze the current meeting from a global perspective.

[0145] In another scenario, during the process of a user writing the contents of a handwriting group on a subpage, the processor may display a logical interface within each subpage. In this scenario, the logical interface may be displayed in a reduced size at a predetermined position on the subpage, the effect of which is shown in FIG. 22. For example, the logical interface may be displayed behind or below the handwriting group. This makes it easier for the user to determine the position of the handwriting group among all other handwriting groups. In some examples, the processor may display the same handwriting group in the logical interface and the subpage in the same format, for example, in a bold font, with the same background color (e.g., green), the same font color (e.g., red), etc. As shown in FIG. 22, the first handwriting group is highlighted with a grayscale background color, which makes it easier for the user to locate the same handwriting group within the logical interface at a glance, thereby improving the viewing experience.

[0146] In this embodiment, the processor may obtain the logical relationship between the multiple handwriting groups in different ways.

[0147] 23 , in step 231, the processor may detect whether a page division control is triggered, and the page division control is displayed on a main page (including all or some of the stroke groups). After detecting that the page division control is triggered, the processor may adjust the plurality of stroke groups to a logical editing state in response to detecting that the page division control is triggered. Here, the logical editing state may include, but is not limited to, stroke group jumping, flickering, dashed borders, etc., to distinguish the stroke groups from non-editable states.

[0148] In step 232, the processor may obtain a logical relationship between the handwriting groups in response to detecting an operation that associates any two handwriting groups.

[0149] For example, the operation of relating two groups of strokes may be to connect the two groups of strokes by drawing a line, i.e., to connect the two groups of strokes by a line segment.

[0150] For example, each handwriting group corresponds to a logical creating control that creates a logical relationship. Clicking on the logical creating control may display a drop-down menu containing other handwriting groups. Selecting one of the handwriting groups may display a lower-level drop-down menu, which includes logical relationships between the two handwriting groups (e.g., parallel, progressive, causal, etc.). Referring to FIG. 24 , each group corresponds to a logical creating control 241. When the logical creating control 241 is triggered, for example, the logical creating control 241 for the first handwriting group becomes black, indicating that it has been triggered, and a drop-down menu 242 is displayed showing selectable handwriting groups 2 and 3. When handwriting group 2 is selected, a lower-level drop-down menu 243 may be displayed, which displays the logical relationship between the two handwriting groups. When parallel is selected, the two handwriting groups establish a parallel logical relationship.

[0151] For example, when one of the handwriting groups is clicked, an input box may pop up, allowing the user to input handwriting groups that have a logical relationship with the handwriting group. As can be understood, to facilitate user input, the processor may temporarily number each handwriting group and delete the temporary number after determining the logical relationship of all handwriting groups. After detecting that a handwriting group has been input into an input box, a next input box may be displayed behind the previous input box. The next input box is used to input the logical relationship between the two handwriting groups. Referring to FIG. 25 , when the first handwriting group 251 is clicked, an input box appears, allowing the user to input the number 2, indicating that handwriting group 2 is selected. Thereafter, a next input box 253 appears, allowing the user to input "parallel," indicating that there is a parallel logical relationship between handwriting group 1 and handwriting group 2. By repeating the above operation, the logical relationship between all handwriting groups can be obtained. In this manner, in this embodiment, the user manually sets the logical relationship between multiple handwriting groups, thereby obtaining accurate logical relationships and enhancing the user's sense of participation.

[0152] In one example, after obtaining the handwriting groups, the user may manually set a logical relationship between the handwriting groups. In this case, the user may input a predetermined indicator into the handwriting application interface, i.e., the main page, to determine the affiliation relationship between at least two handwriting groups corresponding to the predetermined indicator, thereby obtaining the logical relationship between the handwriting groups. The predetermined indicator may include at least one of a one-way arrow, a two-way arrow, a connecting line, Chinese numerals, Arabic numerals, English letters, and a predetermined mnemonic. Referring to FIG. 26 , the main page includes two predetermined indicators, a one-way arrow 261 and a two-way arrow 262. The one-way arrow 261 indicates that the first handwriting group and the second handwriting group belong to a forward relationship, and the two-way arrow 262 indicates that the second handwriting group and the third handwriting group belong to a two-way parallel relationship.

[0153] The English letters may be used in order (e.g., A, B, C, D, ...) or in the order of a word (e.g., SWOT). The predetermined mnemonic includes letters in several units (e.g., letters S, W, O, and T in SWOT), and J11, J22, and J33 respectively indicate the first element in the first layer, the second element in the second layer, and the third element in the third layer of the pyramid. In response to detecting a predetermined indicator input by a user in the handwriting application interface, the processor may determine the membership relationship of at least two handwriting groups corresponding to the predetermined indicator, and obtain a logical relationship between the multiple handwriting groups.

[0154] In one example, the processor may acquire logical relationships between multiple handwriting groups, as shown in FIG. 27, including steps 271 to 273. In step 271, the processor may acquire position data for the multiple handwriting groups. The position data for a handwriting group may be the coordinate position of its center point or the coordinate position of one of its corner points (top, bottom, left, or right), and may be set according to a specific scene. In step 272, the processor may generate relative positional relationships between the multiple handwriting groups based on the position data. The relative positional relationships may include at least one of circular, top, bottom, left, right, star, triangle, rectangle, pyramid, and tree. In step 273, the processor may determine a logical relationship between the multiple handwriting groups that matches the relative positional relationships in a preset logical relationship library. The preset logical relationship library includes several preset logical relationships, and each preset logical relationship includes a unique logical relationship corresponding to a certain number of handwriting groups. That is, even if the number of handwriting groups is the same, different logical relationships may be associated with each other. 28, the position data of the three handwriting groups are respectively position 281, position 282, and position 283. The processor can match the logical relationship 284 that the three positions belong to a triangle based on the positions 281, 282, and 283. In this way, since the logical relationship of the handwriting groups is determined by the position data in this embodiment, it can be applied to a scene where a user writes handwriting at different positions, and the accuracy of the logical relationship can be improved.

[0155] It can be understood that the greater the number of handwriting groups, the greater the logical relationships determined by the processor. In this case, the processor may obtain a recommended chart template based on the logical relationships. The effects of four recommended chart templates are shown from left to right in FIG. 29, which facilitates the user's selection of a target template. The processor may then generate a logical relationship according to the recommended chart template selected by the user.

[0156] In one example, the processor obtains the logical relationship between the plurality of handwriting groups, including steps 301 to 303 with reference to FIG.

[0157] In step 301, the processor may obtain a preset chart template. The preset chart template may be selected by the user before writing the handwriting group, during the process of writing the handwriting group, or after writing all the handwriting groups. In step 302, the processor may obtain position data and time data of multiple handwriting groups. The position data of the handwriting group may be the position of a center point, and the time data may be the time at the center point. In step 303, the processor may match the preset chart template based on the position data and the time data to obtain a logical relationship between the multiple handwriting groups. Here, the preset chart template may refer to the recommended chart template shown in FIG. 29.

[0158] In some embodiments, the processor may determine the logical relationships of the handwriting groups based on the grouping shape. For example, if the grouping shape is a cross, the handwriting groups may be divided into logical relationships corresponding to the SWOT template. The user can determine the logical relationships of the handwriting groups by setting the grouping shape as needed, such as a triangle, a circle, a pyramid, or a tree, which is advantageous in improving the efficiency of determining the logical relationships.

[0159] Considering that users may need to output a discussion plan after a meeting is completed, related technologies can only output a meeting plan in image format, requiring users to re-enter the content. In this embodiment, a processor may process subpages corresponding to each handwriting group to obtain a multimedia file in a specified format. The multimedia file may include, but is not limited to, office files (e.g., Word, PPT, Visio), images, web pages, or videos. Taking a PPT file as an example, the processor may generate a main page, a logical interface, subpages for the first handwriting group, subpages for the second handwriting group, etc., in this order. This facilitates users' content modification, content copying, and layout adjustment, which is beneficial to improving processing efficiency and accelerating the execution of the meeting plan when creating the final file.

[0160] In one example, if the multimedia file of the specified format is a Word file, the processor processes the subpages corresponding to each handwriting group to obtain the multimedia file of the specified format, which includes the processor creating a blank Word document and inserting the contents of each handwriting group and its subpage into the blank Word document to obtain a target Word file. In this way, in this embodiment, the meeting content can be output as the target Word file without re-entering it, which is convenient for the user to process the file later.

[0161] In one example, if the multimedia file of the specified format is a web page file, the processor processes the sub-pages corresponding to each handwriting group to obtain the multimedia file of the specified format, which includes the processor setting parameters of a web page template according to each handwriting group, and inserting the contents of the sub-pages corresponding to each handwriting group into the corresponding positions of the web page template to obtain a target web page file. In this way, in this embodiment, the meeting content can be output as a target web page file and directly displayed on related websites without re-entering, thereby achieving the effect of timely synchronization of the meeting content.

[0162] Considering that several existing files may be opened during a meeting, users may perform operations such as deletion on the existing files during the meeting discussion. For example, if a smart handwriting display device displays a Word file and a user needs to modify the Word file on the smart handwriting display device, the existing file cannot be directly modified because it is content shared by another device (e.g., a screen projection display). Therefore, in one example, auxiliary software may be pre-configured in the smart handwriting display device, and the auxiliary software may operate controls on the current page. During the process of displaying the current page, the processor may obtain additional elements. In response to detecting that the insert control on the current page has been operated by the auxiliary software, the processor may insert the additional elements into the current page. In response to detecting that the alignment control on the current page has been operated by the auxiliary software, the processor may align the contents of the current page. In this way, this embodiment allows additional elements to be inserted into an existing file, thereby improving processing efficiency. The above embodiment describes a technical solution for inserting additional elements. The modifying and deleting operations are similar to the above technical solution, in which the auxiliary software operates corresponding controls to modify or delete content in an existing file.

[0163] In one example, after the conference is completed, the user may select a preset template from a template library. In response to detecting the input preset template, the processor may match the content corresponding to each handwriting group to the preset template. For example, if the preset template is a binary tree, the processor may place the main page at the root node of the binary tree, then place each handwriting group at a subnode of the binary tree, and then place the content of each handwriting group at a leaf node of the binary tree, and finally output a multimedia file. In this way, in this embodiment, by processing the conference content, the effort required for processing subsequent conference content can be reduced.

[0164] The above has described the various embodiments of the present invention. In the technical solution of the embodiments of the present invention, handwritten information of a user is obtained, then at least one handwritten group corresponding to the handwritten information is determined, and finally, a page division process is performed for the at least one handwritten group to obtain subpages corresponding to each handwritten group. In this way, in this embodiment, the content of each handwritten group is written on a corresponding subpage, thereby separating the content of different handwritten groups, maintaining a clean display area, and improving communication efficiency.

[0165] In an embodiment, there is further provided a smart handwriting display method applied to a smart handwriting display device, the smart handwriting display device comprising a display and a processor, the method comprising: controlling the display to display a handwriting application interface; acquiring handwriting information of a user and controlling the handwriting application interface to display the handwriting; determining at least one signature group corresponding to the handwritten signature information; performing a page division process on the at least one handwriting group to obtain sub-pages corresponding to each of the handwriting groups; Each of the stroke groups includes at least one handwritten stroke.

[0166] In one embodiment, the handwriting information includes at least one of a locus point data set, a touch point data set, and a pixel point data set.

[0167] In one embodiment, the touch point data set includes at least one of original touch point data, interpolated touch point data, and sparsely sampled touch point data, and the pixel point data set includes at least one of line width adjusted pixel point data and stroke fitting pixel point data.

[0168] In one embodiment, determining at least one signature group corresponding to the handwritten signature comprises performing a grouping process on the handwritten signature to obtain at least one signature group.

[0169] In one embodiment, the grouping method includes automatic grouping.

[0170] In one embodiment, performing a grouping process on the handwritten information to obtain at least one handwriting group includes: projecting each of the handwritten information onto at least one coordinate axis to obtain a projection histogram; determining division positions on each coordinate axis based on the peaks and valleys of the projected histogram; generating a dividing line based on the dividing position of each coordinate axis to obtain at least one handwriting group.

[0171] In one embodiment, performing a grouping process on the handwritten information to obtain at least one handwriting group includes: clustering handwriting points in the handwritten information to obtain a category to which each handwriting point belongs and a plurality of category centers; determining the handwriting points of one category as one handwriting group to obtain at least one handwriting group.

[0172] In one embodiment, the clustering method comprises a density-based clustering algorithm or a spectral clustering algorithm.

[0173] In one embodiment, performing a grouping process on the handwritten information to obtain at least one handwriting group includes: acquiring strokes in the handwritten information; and clustering each stroke in the handwritten signature information to obtain at least one signature group.

[0174] In one embodiment, performing a grouping process on the handwritten information to obtain at least one handwriting group includes: performing a line segmentation process on the handwritten information to obtain a plurality of handwritten lines; and clustering the plurality of handwriting lines to obtain at least one handwriting group.

[0175] In one embodiment, after performing line segmentation processing on the handwritten information to obtain a plurality of handwritten lines, the method further comprises: In response to detecting that one of the plurality of handwritten lines has been dragged into an area in which another of the plurality of handwritten lines is located, the method further includes combining the two handwritten lines.

[0176] In one embodiment, the clustering of the plurality of handwriting lines to obtain at least one handwriting group comprises: If there are a plurality of handwriting groups, the method includes combining the two handwriting groups to obtain at least one handwriting group in response to detecting that one handwriting group among the plurality of handwriting groups has been dragged into an area where another handwriting group is located.

[0177] In one embodiment, the grouping method includes performing grouping according to a grouping shape drawn by a user.

[0178] In one embodiment, performing a grouping process on the handwritten information to obtain at least one handwriting group includes: In response to detecting a grouped graphic in the handwriting application interface, a grouping process is performed on the handwritten trace information based on the grouped graphic to obtain at least one trace group.

[0179] In one embodiment, the grouping figure includes a line, and performing a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group includes: obtaining at least one line in the handwriting application interface that exceeds a predetermined length; and dividing the handwritten signature information based on the at least one line to obtain at least one signature group.

[0180] In one embodiment, the grouping figure includes a target character, and performing a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group includes: The method includes grouping the handwritten information based on a positional relationship between the target character and the handwritten strokes to obtain at least one stroke group.

[0181] In one embodiment, grouping the handwritten information based on a positional relationship between the target character and the handwritten stroke to obtain at least one handwritten group includes: performing a recognition process on the handwritten information to obtain text information corresponding to the handwritten information; Obtaining a predetermined number of characters at the beginning of each line in the text information, and obtaining at least one target character that satisfies a predetermined rule; Dividing at least one line of handwriting corresponding to each target character into one handwriting group to obtain at least one handwriting group.

[0182] In one embodiment, the grouping figure includes a line, and performing a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group includes: performing a line segmentation process on the handwritten information to obtain a plurality of handwritten lines; In response to detecting at least one line exceeding a predetermined length in the handwriting application interface, obtaining a handwriting line corresponding to each line; If the line connects two lines of writing, combining the two lines of writing to obtain one group of writing; if the line passes through one line of writing, dividing the line of writing to obtain two groups of writing.

[0183] In one embodiment, the grouped shapes are hand-drawn shapes.

[0184] In one embodiment, the method further comprises: generating a jump interface between the handwriting group and the subpage; jumping to a subpage corresponding to the handwriting group in response to the jump interface being triggered; The jump interface includes at least one of a button, a link address, or a hyperlink.

[0185] In one embodiment, performing a page division process on at least one handwriting group to obtain sub-pages corresponding to each handwriting group includes: copying the handwriting of each handwriting group; and pasting the handwritten strokes into a subpage corresponding to the stroke group.

[0186] In one embodiment, performing a page division process on at least one handwriting group to obtain sub-pages corresponding to each handwriting group includes: Recognizing handwriting of each handwriting group and obtaining text information; and pasting the text information into a subpage corresponding to the handwriting group.

[0187] In one embodiment, performing a page division process on at least one handwriting group to obtain sub-pages corresponding to each handwriting group includes: In response to detecting that the page split control has been triggered, obtaining the input page split shape; performing a page division process on the at least one handwriting group based on the page division pattern to obtain a sub-page corresponding to each handwriting group.

[0188] In one embodiment, the method further comprises: If the at least one handwriting group is a plurality of handwriting groups, obtaining a logical relationship between the plurality of handwriting groups; and generating a logical interface for displaying the logical relationship.

[0189] In one embodiment, the logical interface is used to display on the main page or to display in a reduced form within each sub-page.

[0190] In one embodiment, obtaining a logical relationship between the plurality of handwriting groups includes: adjusting the plurality of handwriting groups to a logical edit state in response to detecting that a page split control has been triggered; and acquiring a logical relationship between the plurality of handwriting groups in response to detecting an operation of associating any two handwriting groups.

[0191] In one embodiment, obtaining a logical relationship between the plurality of handwriting groups includes: In response to detecting a predetermined indication mark input by a user in the handwriting application interface, determining a membership relationship of at least two handwriting groups corresponding to the predetermined indication mark, and obtaining a logical relationship of the plurality of handwriting groups; The predetermined indicator markings include at least one of a one-way arrow, a two-way arrow, a connecting line, Chinese numerals, Arabic numerals, English letters, and predetermined mnemonics.

[0192] In one embodiment, obtaining a logical relationship between the plurality of handwriting groups includes: obtaining position data of the plurality of handwriting groups; generating a relative positional relationship of the plurality of handwriting groups based on the position data; determining a logical relationship matching the relative positional relationship in a predetermined logical relationship library as a logical relationship between the plurality of handwriting groups; The relative positional relationship includes at least one of a circular, up-down, left-right, star-shaped, triangular, rectangular, pyramidal, and tree-shaped.

[0193] In one embodiment, the method further comprises: obtaining a recommended chart template based on the logical relationship; generating a logical relationship according to the recommended chart template selected by the user.

[0194] In one embodiment, obtaining a logical relationship between the plurality of handwriting groups includes: Obtaining a pre-configured chart template; obtaining position data and time data of the plurality of handwriting groups; and matching the pre-defined chart template based on the position data and the time data to obtain a logical relationship between the plurality of handwriting groups.

[0195] In one embodiment, the method further comprises determining a logical relationship of the handwriting groups based on the grouping graphic.

[0196] In one embodiment, the method further includes processing the sub-pages corresponding to each handwriting group to obtain a multimedia file in a specified format.

[0197] In one embodiment, the method further comprises: In response to detecting the input preset template, matching the content corresponding to each handwriting group with the preset template to obtain a multimedia file.

[0198] In one embodiment, when the multimedia file of the specified format is a Word file, processing the subpage corresponding to each handwriting group to obtain the multimedia file of the specified format includes: Create a blank Word document and Inserting each handwriting group and the content of its sub-page into the Word blank document to obtain a target Word file.

[0199] In one embodiment, when the multimedia file of the specified format is a web page file, processing the sub-page corresponding to each handwriting group to obtain the multimedia file of the specified format includes: setting parameters of a web page template based on each handwriting group; Inserting the content of the sub-page corresponding to each handwriting group into the corresponding position of the web page template to obtain a target web page file.

[0200] In one embodiment, the method further comprises: acquiring an additional element during the process of displaying the handwriting application interface; inserting the additional element into the handwriting application interface in response to detecting, by auxiliary software, manipulation of an insert control of the handwriting application interface; and aligning content within the handwriting application interface in response to detecting manipulation of an alignment control of the handwriting application interface by auxiliary software.

[0201] In one embodiment, a smart handwriting display device is provided for application in a smart handwriting display device, the smart handwriting display device comprising a display and a processor, the device comprising: a handwriting interface display module for controlling the display to display a handwriting application interface; a handwriting display module for acquiring handwriting information of a user and controlling the handwriting application interface to display the handwriting; a handwriting group determination module for determining at least one handwriting group corresponding to the handwritten handwriting information; a handwriting group page division processing module for performing page division processing on the at least one handwriting group to obtain sub-pages corresponding to each of the handwriting groups; Each of the stroke groups includes at least one handwritten stroke.

[0202] In one embodiment, there is further provided an electronic device including a display, a processor, and a memory for storing a computer program executable by the processor, the processor configured to perform the method by executing the computer program in the memory.

[0203] In an embodiment, a computer-readable storage medium is further provided, which includes, for example, an executable computer program, which, when executed by a processor, realizes the method of the above embodiment. The computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0204] Other embodiments of the present invention will readily occur to those skilled in the art after considering the specification and practicing the present disclosure. The present invention is intended to cover any modifications, uses, or adaptations of the present invention which follow the general principles of the present invention and include means known or commonly used in the art that are not disclosed herein. It is to be understood that the specification and examples are exemplary only, with the true scope and spirit of the invention being indicated by the following claims.

[0205] It should be understood that the present invention is not limited to the exact construction described above and illustrated in the accompanying drawings, and various modifications and changes can be made without departing from the scope of the present invention, which is limited only by the appended claims. [Explanation of symbols]

[0206] 51, 52, 53, 54 Delimiter positions 61, 62, 63, 64 Dividers 71, 72, 73, 101, 182, 183, 184, 251 Handwriting Group 100 display area 102 vertical lines 103 Horizontal Line 120 target characters 140 line segments 152 Page Split Shapes 171 Hyperlinks 172 buttons 181 subpages 201 Main Page 202 Logical Interface 203, 284 logical relations 241 Logical Creation Control 242, 243 Drop-down menu 253 Input Box 261 One-Way Arrow 262 Double Arrow 281, 282, 283 Position

Claims

1. A smart handwriting display device comprising a display and a processor, The processor: controlling the display to display a handwriting application interface; acquiring handwriting information of a user and controlling the handwriting application interface to display the handwriting; determining at least one signature group corresponding to the handwritten signature information; performing a page division process on the at least one handwriting group to obtain sub-pages corresponding to each of the handwriting groups; each of said groups of signatures includes at least one handwritten signature; A smart handwriting display device characterized by:

2. The smart handwriting display device further comprises an input device connected to the processor, and the processor acquiring the user's handwriting information comprises: obtaining input data transmitted from the input device; and determining the handwritten signature information based on the input data.

2. The smart handwriting display device according to claim 1.

3. The input device includes a touch component, and the processor acquiring input data transmitted from the input device includes: Acquiring a set of touch point data collected by a touch component on the current page in response to a user's touch operation to obtain the input data; 3. The smart handwriting display device according to claim 2.

4. The input device includes a positioning component, and the processor acquiring input data transmitted from the input device includes: receiving a set of handwritten trajectory points data collected by the positioning component; and obtaining the input data based on the set of handwritten trajectory points data.

3. The smart handwriting display device according to claim 2.

5. The input device includes a communication component connected to the processor, and the processor acquiring input data transmitted from the input device includes: and obtaining, by the communication component, a set of touch point data or handwriting trace image data transmitted from a remote device to obtain the input data.

3. The smart handwriting display device according to claim 2.

6. The handwriting information includes at least one of a trajectory point data set, a touch point data set, and a pixel point data set.

2. The smart handwriting display device according to claim 1.

7. the touch point data set includes at least one of original touch point data, interpolated touch point data, and sparsely sampled touch point data; The pixel point data set includes at least one of pixel point data after line width adjustment and pixel point data after stroke fitting.

7. The smart handwriting display device according to claim 6.

8. The processor determining at least one signature group corresponding to the handwritten signature information includes: performing a grouping process on the handwritten information to obtain at least one handwriting group; 2. The smart handwriting display device according to claim 1.

9. The grouping process method includes automatic grouping.

9. The smart handwriting display device according to claim 8.

10. The processor performs a grouping process on the handwritten information to obtain at least one handwriting group, projecting each of the handwritten information onto at least one coordinate axis to obtain a projection histogram; determining division positions on each coordinate axis based on the peaks and valleys of the projected histogram; generating a division line based on the division position of each coordinate axis to obtain at least one handwriting group; 10. The smart handwriting display device according to claim 9.

11. The processor performs a grouping process on the handwritten information to obtain at least one handwriting group, clustering handwriting points in the handwritten information to obtain a category to which each handwriting point belongs and a plurality of category centers; determining the handwriting points of one category as one handwriting group to obtain at least one handwriting group; 10. The smart handwriting display device according to claim 9.

12. The clustering method comprises a density-based clustering algorithm or a spectral clustering algorithm.

12. The smart handwriting display device according to claim 11.

13. The processor performs a grouping process on the handwritten information to obtain at least one handwriting group, acquiring strokes in the handwritten information; clustering each stroke in the handwritten information to obtain at least one handwriting group; 10. The smart handwriting display device according to claim 9.

14. The processor performs a grouping process on the handwritten information to obtain at least one handwriting group, performing a line segmentation process on the handwritten information to obtain a plurality of handwritten lines; clustering the plurality of handwriting lines to obtain at least one handwriting group; 10. The smart handwriting display device according to claim 9.

15. The processor performs a line segmentation process on the handwritten information to obtain a plurality of handwritten lines, and then further: a dragging unit configured to drag one of the plurality of handwritten lines into an area where another of the plurality of handwritten lines is located, the dragging unit being configured to drag the two handwritten lines together; 15. The smart handwriting display device of claim 14.

16. When the processor clusters the plurality of handwriting lines to obtain at least one handwriting group, the processor further If there are a plurality of handwriting groups, in response to detecting that one handwriting group among the plurality of handwriting groups has been dragged into an area where another handwriting group is located, combining the two handwriting groups to obtain at least one handwriting group; 15. The smart handwriting display device of claim 14.

17. the grouping processing method includes performing grouping in accordance with a grouping figure drawn by a user; 9. The smart handwriting display device according to claim 8.

18. When the processor performs a grouping process on the handwritten information to obtain at least one handwriting group, the processor further In response to detecting a grouping figure in the handwriting application interface, a grouping process is performed on the handwritten trace information based on the grouping figure to obtain at least one trace group.

18. The smart handwriting display device of claim 17.

19. The grouping figure includes a line, and the processor performs a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group, obtaining at least one line in the handwriting application interface that exceeds a predetermined length; and dividing the handwritten signature information based on the at least one line to obtain at least one signature group.

20. The smart handwriting display device of claim 18.

20. The grouping figure includes a target character, and the processor performs a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group. and grouping the handwritten information based on a positional relationship between the target character and the handwritten stroke to obtain at least one handwritten group.

20. The smart handwriting display device of claim 18.

21. The method of grouping the handwritten information based on the positional relationship between the target character and the handwritten stroke to obtain at least one handwritten group includes: performing a recognition process on the handwritten information to obtain text information corresponding to the handwritten information; acquiring a predetermined number of characters at the beginning of each line in the text information, and obtaining at least one target character that satisfies a predetermined rule; Dividing at least one line of handwriting corresponding to each target character into one handwriting group to obtain at least one handwriting group; 21. The smart handwriting display device of claim 20.

22. The grouping figure includes a line, and the processor performs a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group, performing a line segmentation process on the handwritten information to obtain a plurality of handwritten lines; In response to detecting at least one line exceeding a predetermined length in the handwriting application interface, obtaining a handwriting line corresponding to each line; If the line connects two lines of writing, combining the two lines of writing to obtain one group of writing, and if the line passes through one line of writing, dividing the line of writing to obtain two groups of writing.

20. The smart handwriting display device of claim 18.

23. The grouped shapes are hand-drawn shapes. A smart handwriting display device according to any one of claims 18 to 22.

24. The processor further comprises: generating a jump interface between the handwriting group and the subpage; The jump interface is used to jump to a subpage corresponding to the handwriting group in response to being triggered; the jump interface includes at least one of a button, a link address, or a hyperlink; 2. The smart handwriting display device according to claim 1.

25. The processor performs a page division process on at least one handwriting group to obtain sub-pages corresponding to each handwriting group, copying the handwriting of each handwriting group; pasting the handwritten strokes into a subpage corresponding to the stroke group.

2. The smart handwriting display device according to claim 1.

26. The processor performs a page division process on at least one handwriting group to obtain sub-pages corresponding to each handwriting group, Recognizing handwriting of each handwriting group and obtaining text information; pasting the text information into a subpage corresponding to the handwriting group.

2. The smart handwriting display device according to claim 1.

27. The processor performs a page division process on at least one handwriting group to obtain sub-pages corresponding to each handwriting group, In response to detecting that the page split control has been triggered, obtaining the input page split shape; performing a page division process on the at least one handwriting group based on the page division pattern to obtain sub-pages corresponding to each handwriting group; 2. The smart handwriting display device according to claim 1.

28. The processor further comprises: If the at least one handwriting group is a plurality of handwriting groups, obtain a logical relationship between the plurality of handwriting groups; used to generate a logical interface for displaying the logical relationship; 2. The smart handwriting display device according to claim 1.

29. The logical interface is used to display on the main page or to display in a reduced form within each sub-page.

29. The smart handwriting display device of claim 28.

30. The processor obtaining a logical relationship between a plurality of groups of handwriting is adjusting the plurality of handwriting groups to a logical edit state in response to detecting that a page split control has been triggered; and acquiring a logical relationship between the plurality of handwriting groups in response to detecting an operation of associating any two handwriting groups.

29. The smart handwriting display device of claim 28.

31. The processor obtaining a logical relationship between a plurality of groups of handwriting is In response to detecting a predetermined indication mark input by a user in the handwriting application interface, determining a membership relationship of at least two handwriting groups corresponding to the predetermined indication mark, and obtaining a logical relationship of the plurality of handwriting groups; the predetermined indicator markings include at least one of a one-way arrow, a two-way arrow, a connecting line, Chinese numerals, Arabic numerals, English letters, and predetermined mnemonics; 29. The smart handwriting display device of claim 28.

32. The processor obtaining a logical relationship between a plurality of groups of handwriting is obtaining position data of the plurality of handwriting groups; generating a relative positional relationship of the plurality of handwriting groups based on the position data; determining a logical relationship matching the relative positional relationship in a predetermined logical relationship library as a logical relationship between the plurality of handwriting groups; The relative positional relationship includes at least one of a circular, up-down, left-right, star-shaped, triangular, rectangular, pyramidal, and tree-shaped.

29. The smart handwriting display device of claim 28.

33. The processor further comprises: obtaining a recommended chart template based on the logical relationship; used to generate logical relationships according to the recommended chart template selected by the user; 29. The smart handwriting display device of claim 28.

34. The processor obtaining a logical relationship between a plurality of groups of handwriting is Obtaining a pre-configured chart template; obtaining position data and time data of the plurality of handwriting groups; and matching the pre-defined chart template based on the position data and the time data to obtain a logical relationship between the plurality of handwriting groups.

29. The smart handwriting display device of claim 28.

35. The processor further comprises: used to determine a logical relationship of the handwriting groups based on the grouping shapes; A smart handwriting display device according to any one of claims 17 to 21.

36. The processor further comprises: Processing the sub-pages corresponding to each handwriting group to obtain a multimedia file in a specified format; 2. The smart handwriting display device according to claim 1.

37. The processor further comprises: In response to detecting the input preset template, matching the content corresponding to each handwriting group with the preset template to obtain a multimedia file; 2. The smart handwriting display device according to claim 1.

38. When the multimedia file of the specified format is a Word file, the processor processes the subpage corresponding to each handwriting group to obtain the multimedia file of the specified format; Creating a blank Word document; Inserting each handwriting group and the content of its sub-page into the Word blank document to obtain a target Word file.

37. The smart handwriting display device of claim 36.

39. If the multimedia file of the specified format is a web page file, the processor processes the subpage corresponding to each handwriting group to obtain the multimedia file of the specified format. setting parameters of a web page template based on each handwriting group; Inserting the content of the sub-page corresponding to each handwriting group into the corresponding position of the web page template to obtain a target web page file.

37. The smart handwriting display device of claim 36.

40. The processor further comprises: In the process of displaying the handwriting application interface, an additional element is acquired; inserting the additional element into the handwriting application interface in response to detecting operation of an insert control of the handwriting application interface by auxiliary software; used to align content within the handwriting application interface in response to detecting manipulation of an alignment control of the handwriting application interface by auxiliary software; 2. The smart handwriting display device according to claim 1.

41. A smart handwriting display method applied to a smart handwriting display device, the smart handwriting display device comprising a display and a processor, the method comprising: controlling the display to display a handwriting application interface; acquiring handwriting information of a user and controlling the handwriting application interface to display the handwriting; determining at least one signature group corresponding to the handwritten signature information; performing a page division process on the at least one handwriting group to obtain sub-pages corresponding to each of the handwriting groups; each of said groups of signatures includes at least one handwritten signature; A smart handwriting display method.

42. The handwriting information includes at least one of a trajectory point data set, a touch point data set, and a pixel point data set.

42. The smart handwriting display method of claim 41.

43. the touch point data set includes at least one of original touch point data, interpolated touch point data, and sparsely sampled touch point data; The pixel point data set includes at least one of pixel point data after line width adjustment and pixel point data after stroke fitting.

43. The smart handwriting display method of claim 42.

44. Determining at least one signature group corresponding to the handwritten signature information includes: performing a grouping process on the handwritten information to obtain at least one handwriting group; 42. The smart handwriting display method of claim 41.

45. The grouping process method includes automatic grouping.

45. The smart handwriting display method of claim 44.

46. performing a grouping process on the handwritten information to obtain at least one handwriting group; projecting each of the handwritten information onto at least one coordinate axis to obtain a projection histogram; determining division positions on each coordinate axis based on the peaks and valleys of the projected histogram; generating a division line based on the division position of each coordinate axis to obtain at least one handwriting group; 46. ​​The smart handwriting display method of claim 45.

47. performing a grouping process on the handwritten information to obtain at least one handwriting group; clustering handwriting points in the handwritten information to obtain a category to which each handwriting point belongs and a plurality of category centers; determining the handwriting points of one category as one handwriting group to obtain at least one handwriting group; 46. ​​The smart handwriting display method of claim 45.

48. The clustering method comprises a density-based clustering algorithm or a spectral clustering algorithm.

48. The smart handwriting display method of claim 47.

49. performing a grouping process on the handwritten information to obtain at least one handwriting group; acquiring strokes in the handwritten information; clustering each stroke in the handwritten information to obtain at least one handwriting group; 46. ​​The smart handwriting display method of claim 45.

50. performing a grouping process on the handwritten information to obtain at least one handwriting group; performing a line segmentation process on the handwritten information to obtain a plurality of handwritten lines; clustering the plurality of handwriting lines to obtain at least one handwriting group; 46. ​​The smart handwriting display method of claim 45.

51. After performing line segmentation processing on the handwritten information to obtain a plurality of handwritten lines, the method further comprises: merging two handwritten lines in response to detecting that one handwritten line of the plurality of handwritten lines has been dragged into an area where another handwritten line is located; 51. The smart handwriting display method of claim 50.

52. Clustering the plurality of handwriting lines to obtain at least one handwriting group includes: and if there are a plurality of handwriting groups, in response to detecting that one handwriting group among the plurality of handwriting groups has been dragged into an area where another handwriting group is located, combining the two handwriting groups to obtain at least one handwriting group.

51. The smart handwriting display method of claim 50.

53. the grouping processing method includes performing grouping in accordance with a grouping figure drawn by a user; 45. The smart handwriting display method of claim 44.

54. performing a grouping process on the handwritten information to obtain at least one handwriting group; In response to detecting a grouped graphic in the handwriting application interface, performing a grouping process on the handwritten trace information based on the grouped graphic to obtain at least one trace group.

54. The smart handwriting display method of claim 53.

55. The grouping figure includes a line, and performing a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group includes: obtaining at least one line in the handwriting application interface that exceeds a predetermined length; and dividing the handwritten signature information based on the at least one line to obtain at least one signature group.

55. The smart handwriting display method of claim 54.

56. The grouped figure includes a target character, and performing a grouping process on the handwritten information based on the grouped figure to obtain at least one handwriting group, and grouping the handwritten information based on a positional relationship between the target character and the handwritten stroke to obtain at least one handwritten group.

55. The smart handwriting display method of claim 54.

57. The method of grouping the handwritten information based on the positional relationship between the target character and the handwritten stroke to obtain at least one handwritten group includes: performing a recognition process on the handwritten information to obtain text information corresponding to the handwritten information; acquiring a predetermined number of characters at the beginning of each line in the text information, and obtaining at least one target character that satisfies a predetermined rule; Dividing at least one line of handwriting corresponding to each target character into one handwriting group to obtain at least one handwriting group; 57. The smart handwriting display method of claim 56.

58. The grouping figure includes a line, and performing a grouping process on the handwritten information based on the grouping figure to obtain at least one handwriting group includes: performing a line segmentation process on the handwritten information to obtain a plurality of handwritten lines; In response to detecting at least one line exceeding a predetermined length in the handwriting application interface, obtaining a handwriting line corresponding to each line; If the line connects two lines of writing, combining the two lines of writing to obtain one group of writing, and if the line passes through one line of writing, dividing the line of writing to obtain two groups of writing.

55. The smart handwriting display method of claim 54.

59. The grouped shapes are hand-drawn shapes. The smart handwriting display method according to any one of claims 54 to 58.

60. The method further comprises: generating a jump interface between the handwriting group and the subpage; jumping to a subpage corresponding to the handwriting group in response to the jump interface being triggered; the jump interface includes at least one of a button, a link address, or a hyperlink; 42. The smart handwriting display method of claim 41.

61. performing page division processing on at least one handwriting group and obtaining sub-pages corresponding to each handwriting group; copying the handwriting of each handwriting group; pasting the handwritten strokes into a subpage corresponding to the stroke group.

42. The smart handwriting display method of claim 41.

62. performing page division processing on at least one handwriting group and obtaining sub-pages corresponding to each handwriting group; Recognizing handwriting of each handwriting group and obtaining text information; pasting the text information into a subpage corresponding to the handwriting group.

42. The smart handwriting display method of claim 41.

63. performing page division processing on at least one handwriting group and obtaining sub-pages corresponding to each handwriting group; In response to detecting that the page split control has been triggered, obtaining the input page split shape; performing a page division process on the at least one handwriting group based on the page division pattern to obtain sub-pages corresponding to each handwriting group; 42. The smart handwriting display method of claim 41.

64. The method further comprises: If the at least one handwriting group is a plurality of handwriting groups, obtaining a logical relationship between the plurality of handwriting groups; generating a logical interface for displaying the logical relationship; 42. The smart handwriting display method of claim 41.

65. The logical interface is used to display on the main page or to display in a reduced form within each sub-page.

65. The smart handwriting display method of claim 64.

66. obtaining a logical relationship between the plurality of handwriting groups, adjusting the plurality of handwriting groups to a logical edit state in response to detecting that a page split control has been triggered; and acquiring a logical relationship between the plurality of handwriting groups in response to detecting an operation of associating any two handwriting groups.

65. The smart handwriting display method of claim 64.

67. obtaining a logical relationship between the plurality of handwriting groups, In response to detecting a predetermined indication mark input by a user in the handwriting application interface, determining a membership relationship of at least two handwriting groups corresponding to the predetermined indication mark, and obtaining a logical relationship of the plurality of handwriting groups; the predetermined indicator markings include at least one of a one-way arrow, a two-way arrow, a connecting line, Chinese numerals, Arabic numerals, English letters, and predetermined mnemonics; 65. The smart handwriting display method of claim 64.

68. obtaining a logical relationship between the plurality of handwriting groups, obtaining position data of the plurality of handwriting groups; generating a relative positional relationship of the plurality of handwriting groups based on the position data; determining a logical relationship matching the relative positional relationship in a predetermined logical relationship library as a logical relationship between the plurality of handwriting groups; The relative positional relationship includes at least one of a circular, up-down, left-right, star-shaped, triangular, rectangular, pyramidal, and tree-shaped.

65. The smart handwriting display method of claim 64.

69. The method further comprises: obtaining a recommended chart template based on the logical relationship; generating a logical relationship according to the recommended chart template selected by the user; 65. The smart handwriting display method of claim 64.

70. obtaining a logical relationship between the plurality of handwriting groups, Obtaining a pre-configured chart template; obtaining position data and time data of the plurality of handwriting groups; and matching the pre-defined chart template based on the position data and the time data to obtain a logical relationship between the plurality of handwriting groups.

65. The smart handwriting display method of claim 64.

71. The method further comprises: determining a logical relationship of the handwriting groups based on the grouping graphic; The smart handwriting display method according to any one of claims 53 to 57.

72. The method further comprises: processing the sub-pages corresponding to each handwriting group to obtain a multimedia file in a specified format; 42. The smart handwriting display method of claim 41.

73. The method further comprises: In response to detecting the input preset template, matching the content corresponding to each handwriting group with the preset template to obtain a multimedia file.

42. The smart handwriting display method of claim 41.

74. When the multimedia file of the specified format is a Word file, processing the subpage corresponding to each handwriting group to obtain the multimedia file of the specified format includes: Creating a blank Word document; Inserting each handwriting group and the content of its sub-page into the Word blank document to obtain a target Word file.

73. The smart handwriting display method of claim 72.

75. When the multimedia file of the specified format is a web page file, processing the sub-page corresponding to each handwriting group to obtain the multimedia file of the specified format is performed. setting parameters of a web page template based on each handwriting group; Inserting the content of the sub-page corresponding to each handwriting group into the corresponding position of the web page template to obtain a target web page file.

73. The smart handwriting display method of claim 72.

76. The method further comprises: acquiring an additional element during the process of displaying the handwriting application interface; inserting the additional element into the handwriting application interface in response to detecting, by auxiliary software, operation of an insert control of the handwriting application interface; aligning content within the handwriting application interface in response to detecting, by auxiliary software, manipulation of an alignment control of the handwriting application interface.

42. The smart handwriting display method of claim 41.

77. A smart handwriting display device for use in a smart handwriting display device, the smart handwriting display device comprising a display and a processor, the device comprising: a handwriting interface display module for controlling the display to display a handwriting application interface; a handwriting display module for acquiring handwriting information of a user and controlling the handwriting application interface to display the handwriting; a handwriting group determination module for determining at least one handwriting group corresponding to the handwritten handwriting information; a handwriting group page division processing module for performing page division processing on the at least one handwriting group to obtain sub-pages corresponding to each of the handwriting groups; each of said groups of signatures includes at least one handwritten signature; A smart handwriting display device characterized by:

78. An electronic device, The display and a processor; a memory for storing a computer program executable by said processor; The processor is configured to execute a computer program in the memory to perform the method of any one of claims 41 to 76. An electronic device characterized by:

79. A computer-readable storage medium, wherein an executable computer program in the computer-readable storage medium, when executed by a processor, implements the method of any one of claims 41 to 76. A computer-readable storage medium comprising:

Images