Display device and method of chart display thereof

Abstract

The present disclosure provides a display device and a method for chart display, comprising a display screen and a control circuit, wherein the control circuit comprises a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read the programs in the memory and perform the following steps: identifying writing track information of a display area of the display screen to obtain a data recognition result; determining a chart type corresponding to a chart drawing instruction of a user in response to the chart drawing instruction; drawing a chart of the chart type corresponding to the chart drawing instruction according to the data recognition result in response to the chart drawing instruction of the user, and displaying the drawn chart in the display area. The present disclosure is used to identify table data written by a user and display the table data drawn into a chart on an electronic whiteboard, provides a scheme for automatically drawing a chart, can accurately show the change rule of a data group, and improves the interactive experience of an intelligent meeting.

Description

[0001] Cross Reference to Related Applications

[0002] The present application claims priority to the Chinese patent application No. 202110819109.8, filed on July 20, 2021, entitled "An Electronic Whiteboard and a Method for Displaying Graphs Thereof", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0003] The present disclosure relates to the field of human-computer interaction, in particular to a display device and a method for displaying graphs thereof. BACKGROUND

[0004] Meetings are one of the most common forms of work, but with the continuous development of the times and the continuous progress of science and technology, the traditional meeting mode is no longer suitable for the needs of modern office, and the efficiency and interactive experience of meetings gradually appear in enterprise meetings. Therefore, intelligent meetings are proposed, which are office products integrated with electronic whiteboards, computers, and remote conference terminals and other devices, and have multiple functions such as interactive intelligent whiteboards.

[0005] With the progress of high-precision positioning technologies such as infrared, electromagnetic, and capacitive touch, electronic whiteboards can already realize touch writing, but in the process of using electronic whiteboards for writing, it is often necessary to present the data set on the electronic whiteboard in the form of a graph, but currently one way is to draw a graph by hand, which is not only inefficient but also difficult to accurately show the change rule of the data set, causing unnecessary deviation in later analysis; another way is to project a graph drawn by a computer onto an electronic whiteboard, which is cumbersome to operate and not suitable for use in meeting interactions, resulting in poor interactive experience of meetings. SUMMARY

[0006] The present disclosure provides a display device and a method for displaying graphs thereof, which is used to identify table data written by a user and display the table data drawn into a graph on the display device, provides a scheme for automatically drawing a graph, and can accurately show the change rule of the data set, thereby improving the interactive experience of intelligent meetings.

[0007] In a first aspect, the present disclosure provides a display device, comprising: a display screen, a control circuit, wherein:

[0008] The display screen is configured to display content.

[0009] The control circuit comprises a processor and a memory, the memory is configured to store programs executable by the processor, and the processor is configured to read the programs in the memory and perform the following steps:

[0010] The writing track information of the display area of the display screen is recognized to obtain a data recognition result;

[0011] A chart type corresponding to the chart drawing instruction of the user is determined in response to the chart drawing instruction of the user.

[0012] A chart of the chart type corresponding to the chart drawing instruction of the user is drawn according to the data recognition result in response to the chart drawing instruction of the user, and the drawn chart is displayed on the display area.

[0013] In a second aspect, a chart display method is provided, including:

[0014] The writing track information of the display area of the display screen is recognized to obtain a data recognition result;

[0015] A chart type corresponding to the chart drawing instruction of the user is determined in response to the chart drawing instruction of the user.

[0016] A chart of the chart type corresponding to the chart drawing instruction of the user is drawn according to the data recognition result in response to the chart drawing instruction of the user, and the drawn chart is displayed on the display area.

[0017] In a third aspect, a chart display apparatus is provided, including:

[0018] A recognition unit is configured to recognize the writing track information of the display area of the display screen to obtain a data recognition result.

[0019] A determination unit is configured to determine a chart type corresponding to the chart drawing instruction of the user in response to the chart drawing instruction of the user.

[0020] A drawing unit is configured to draw a chart of the chart type corresponding to the chart drawing instruction of the user according to the data recognition result in response to the chart drawing instruction of the user, and display the drawn chart on the display area.

[0021] In a fourth aspect, a text recognition model is provided, including: a plurality of RNN network layers, and at least two outputs connected to any one RNN network layer after the first two RNN network layers.

[0022] The at least two outputs include the outputs of any two RNN network layers before the any one RNN network layer.

[0023] In a fifth aspect, an automatic grid projection method is provided, including:

[0024] Obtaining writing track information of a display area of a display screen;

[0025] determine each row separation line and each column separation line according to the first projection histogram of the writing trajectory information on the first coordinate axis and the second projection histogram of the writing trajectory information on the second coordinate axis;

[0026] determine each cell according to each row separation line and each column separation line.

[0027] In a sixth aspect, the embodiments of the present disclosure further provide an electronic device, including a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read the programs in the memory and execute the steps of the method in the first aspect or the fourth aspect or the fifth aspect.

[0028] In a seventh aspect, the embodiments of the present disclosure further provide a computer storage medium, which stores a computer program, and the program is executed by a processor to implement the steps of the method in the first aspect or the fourth aspect or the fifth aspect.

[0029] These aspects or other aspects of the present disclosure will be more apparent in the following description of the embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0030] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following will briefly introduce the drawings needed to be used in the embodiment description. Obviously, the drawings in the following description are only some of the embodiments of the present disclosure, and for those skilled in the art, other drawings can also be obtained from these drawings without creative labor.

[0031] Figure 1 A structural schematic diagram of a display device provided by the embodiments of the present disclosure;

[0032] Figure 2A A schematic diagram of a display area of a first electronic whiteboard provided by the embodiments of the present disclosure;

[0033] Figure 2B A schematic diagram of a display area of a second electronic whiteboard provided by the embodiments of the present disclosure;

[0034] Figure 2C A schematic diagram of a display area of a third electronic whiteboard provided by the embodiments of the present disclosure;

[0035] Figure 2D A schematic diagram of a display area of a fourth electronic whiteboard provided by the embodiments of the present disclosure;

[0036] Figure 3 A writing trajectory recognition schematic diagram provided by the embodiments of the present disclosure;

[0037] Figure 4A display schematic diagram of a line chart provided by an embodiment of the present disclosure;

[0038] Figure 5 A display schematic diagram of a histogram provided by an embodiment of the present disclosure;

[0039] Figure 6 A display schematic diagram of a pie chart provided by an embodiment of the present disclosure;

[0040] Figure 7A A display schematic diagram of a first writing area and chart area provided by an embodiment of the present disclosure;

[0041] Figure 7B A display schematic diagram of a second writing area and chart area provided by an embodiment of the present disclosure;

[0042] Figure 7C A display schematic diagram of a third writing area and chart area provided by an embodiment of the present disclosure;

[0043] Figure 7D A display schematic diagram of a fourth writing area and chart area provided by an embodiment of the present disclosure;

[0044] Figure 7E A display schematic diagram of a fifth writing area and chart area provided by an embodiment of the present disclosure;

[0045] Figure 8A A first writing content modification comparison schematic diagram provided by an embodiment of the present disclosure;

[0046] Figure 8B A second writing content modification comparison schematic diagram provided by an embodiment of the present disclosure;

[0047] Figure 9A A line chart comparison display schematic diagram provided by an embodiment of the present disclosure;

[0048] Figure 9B A histogram comparison display schematic diagram provided by an embodiment of the present disclosure;

[0049] Figure 9C A pie chart comparison display schematic diagram provided by an embodiment of the present disclosure;

[0050] Figure 10 An implementation flowchart of a chart drawing manner provided by an embodiment of the present disclosure;

[0051] Figure 11 An implementation flowchart of drawing a line chart provided by an embodiment of the present disclosure;

[0052] Figure 12 An implementation flowchart of drawing a histogram provided by an embodiment of the present disclosure;

[0053] Figure 13 An implementation flowchart of drawing a pie chart is provided for the embodiments of the present disclosure.

[0054] Figure 14 An implementation flowchart of a chart display method in a writing scenario with table lines is provided for the embodiments of the present disclosure.

[0055] Figure 15A A schematic diagram of a guide template for displaying a column chart is provided for the embodiments of the present disclosure.

[0056] Figure 15B A schematic diagram of an editing interface for displaying a column chart is provided for the embodiments of the present disclosure.

[0057] Figure 15C A schematic diagram of a writing interface for displaying a column chart is provided for the embodiments of the present disclosure.

[0058] Figure 15D A schematic diagram of a full-screen interface for displaying a column chart is provided for the embodiments of the present disclosure.

[0059] Figure 15E A schematic diagram of a full-screen interface for displaying a column chart is provided for the embodiments of the present disclosure.

[0060] Figure 16A A schematic diagram of a guide template for displaying a radar chart is provided for the embodiments of the present disclosure.

[0061] Figure 16B A schematic diagram of an editing interface for displaying a radar chart is provided for the embodiments of the present disclosure.

[0062] Figure 16C A schematic diagram of a writing interface for displaying a radar chart is provided for the embodiments of the present disclosure.

[0063] Figure 16D A schematic diagram of a writing interface for displaying a radar chart is provided for the embodiments of the present disclosure.

[0064] Figure 16E A schematic diagram of a full-screen interface for displaying a radar chart is provided for the embodiments of the present disclosure.

[0065] Figure 17A A schematic diagram of a guide template for displaying a pie chart is provided for the embodiments of the present disclosure.

[0066] Figure 17B A schematic diagram of an editing interface for displaying a pie chart is provided for the embodiments of the present disclosure.

[0067] Figure 17C A schematic diagram of a writing interface for displaying a pie chart is provided for the embodiments of the present disclosure.

[0068] Figure 17D A schematic diagram of an update interface of a pie chart provided by an embodiment of the present disclosure is shown in FIG. 17;

[0069] Figure 17E A schematic diagram of a full screen interface of a pie chart provided by an embodiment of the present disclosure is shown in FIG. 18;

[0070] Figure 18A A schematic diagram of a guide template of a line chart provided by an embodiment of the present disclosure is shown in FIG. 19;

[0071] Figure 18B A schematic diagram of an edit interface of a line chart provided by an embodiment of the present disclosure is shown in FIG. 20;

[0072] Figure 18C A schematic diagram of a writing interface of a line chart provided by an embodiment of the present disclosure is shown in FIG. 21;

[0073] Figure 18D A schematic diagram of a full screen interface of a line chart provided by an embodiment of the present disclosure is shown in FIG. 22;

[0074] Figure 19 A flowchart of a chart display method in a writing scenario of a title prompt provided by an embodiment of the present disclosure is shown in FIG. 23;

[0075] Figure 20 A writing schematic diagram of a line chart in a writing scenario of a title prompt provided by an embodiment of the present disclosure is shown in FIG. 24;

[0076] Figure 21 A strategy schematic diagram of row-column segmentation provided by an embodiment of the present disclosure is shown in FIG. 25;

[0077] Figure 21A A projection histogram of an X-axis provided by an embodiment of the present disclosure is shown in FIG. 26;

[0078] Figure 21B A projection histogram of a zoomed-in mapped X-axis provided by an embodiment of the present disclosure is shown in FIG. 27;

[0079] Figure 21C A projection histogram of a Y-axis provided by an embodiment of the present disclosure is shown in FIG. 28;

[0080] Figure 21D A projection histogram of a zoomed-in mapped Y-axis provided by an embodiment of the present disclosure is shown in FIG. 29;

[0081] Figure 21E A projection histogram of a Y-axis provided by an embodiment of the present disclosure is shown in FIG. 30;

[0082] Figure 21F A projection histogram of a zoomed-in mapped Y-axis provided by an embodiment of the present disclosure is shown in FIG. 31;

[0083] Figure 21GA row-column segmentation schematic diagram provided by an embodiment of the present disclosure;

[0084] Figure 21H A row-column segmentation schematic diagram provided by an embodiment of the present disclosure;

[0085] Figure 22 A first row-column segmentation strategy implementation flowchart provided by an embodiment of the present disclosure;

[0086] Figure 23 A second row-column segmentation strategy implementation flowchart provided by an embodiment of the present disclosure;

[0087] Figure 24 A text recognition model schematic diagram provided by an embodiment of the present disclosure;

[0088] Figure 25 A chart display method implementation flowchart provided by an embodiment of the present disclosure;

[0089] Figure 26 A chart display device schematic diagram provided by an embodiment of the present disclosure;

[0090] Figure 27 An electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0091] In order to make the objects, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below with reference to the drawings. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of protection of the present disclosure.

[0092] In the embodiments of the present disclosure, the term "and / or" describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B can mean that there are three cases of A alone, A and B together, and B alone. The character " / " generally represents that the associated objects before and after it are in an "or" relationship.

[0093] The application scenarios described in the embodiments of the present disclosure are used to more clearly illustrate the technical solutions of the embodiments of the present disclosure, and do not constitute a limitation on the technical solutions provided by the embodiments of the present disclosure. Those of ordinary skill in the art can know that as new application scenarios appear, the technical solutions provided by the embodiments of the present disclosure are also applicable to similar technical problems. In the description of the present disclosure, unless otherwise specified, the meaning of "multiple" is two or more.

[0094] The intelligent conference is an office product integrating electronic whiteboard, computer and remote conference terminal and other devices, and has multiple functions such as interactive intelligent whiteboard. With the rise of intelligent conference, the importance of conference efficiency and interactive experience in enterprise conference gradually appears. How to improve the conference efficiency and interactive experience of intelligent conference is also the main problem concerned at present. With the progress of high-precision positioning technologies such as infrared, electromagnetic and capacitive touch, electronic whiteboard can realize touch writing, but in the process of writing on the electronic whiteboard, the data group on the electronic whiteboard often needs to be presented in the form of a chart, but currently the chart needs to be hand-drawn, which is not only inefficient but also difficult to accurately show the change rule of the data group, causing unnecessary deviation in later analysis. The way of projecting the chart drawn by computer on the electronic whiteboard is complicated and not suitable for use in conference interaction, the conference efficiency is low, and the user's interactive experience is poor.

[0095] The display device and the chart display method provided by the embodiment can automatically recognize the trajectory information written by the user, and display the content written by the user in the form of a chart on the electronic whiteboard, provide a scheme of automatically generating and displaying a chart according to the content written by the user, improve the conference efficiency, and improve the user's interactive experience.

[0096] In some embodiments, the display device in the embodiment includes but is not limited to an electronic whiteboard, the electronic whiteboard includes a touch component for obtaining handwriting trajectory information. Optionally, the electronic whiteboard further includes a camera, a radar and other components for obtaining handwriting trajectory information.

[0097] It should be noted that the electronic whiteboard in the embodiment is not a traditional electronic whiteboard written with a marker pen or a chalk, but a large-size (generally more than 50 inches) intelligent interactive display device with touch handwriting function; on the intelligent interactive display device, an electronic whiteboard writing program is installed, and a user can write on the display device by using a finger, an active pen or a passive pen, and the intelligent interactive display device can include a liquid crystal display (LCD), an organic electroluminescence display (OLED), an electronic ink display module, and can display the writing trace in real time.

[0098] The principle of performing chart display provided in this embodiment is that after receiving a chart drawing instruction of a user, the obtained writing track information is recognized, and then a chart is drawn and displayed by using the data recognition result, so that the content written by the user is automatically drawn into a chart for display, and the interactive experience is effectively improved. It is easy to understand that the electronic whiteboard provided in this embodiment can receive writing track information of a user, and in implementation, the writing track information and touch instructions of the user can be received through a configured touch component. The embodiment does not make too many limitations on the specific manner of obtaining the writing track information.

[0099] In some embodiments, as shown in Figure 1 The display device provided in this embodiment includes a display screen 100 and a control circuit 101, where:

[0100] The display screen 100 is configured to perform content display;

[0101] The control circuit 101 includes a processor and a memory, the memory is configured to store a program executable by the processor, and the processor is configured to read the program in the memory and perform the following steps:

[0102] The writing track information of the display area of the display screen is recognized to obtain a data recognition result;

[0103] In response to a chart drawing instruction of a user, a chart type corresponding to the chart drawing instruction is determined;

[0104] In response to the chart drawing instruction of the user, a chart of the chart type corresponding to the chart drawing instruction is drawn according to the data recognition result, and the drawn chart is displayed on the display area.

[0105] In some embodiments, the display device in this embodiment includes but is not limited to an electronic whiteboard, and the electronic whiteboard includes a touch component configured to obtain handwriting track information. The electronic whiteboard in this embodiment further includes a camera, a radar and other components configured to obtain handwriting track information. The control circuit in this embodiment can further include at least one of a driving control circuit, a clock module and a rendering engine, and the memory in this embodiment can be configured to store instructions, data and other information having storage requirements.

[0106] In some embodiments, the writing trajectory information can be acquired in any of the following manners, including but not limited to: at least one of a touch component, a camera component, and a radar component configured in the electronic whiteboard, or the writing trajectory information of the user writing on the terminal can also be acquired in real time by the terminal in communication connection with the electronic whiteboard. The writing scenario in the present embodiment is applicable to writing performed by the user through a finger or a stylus, writing performed by the user through the terminal in communication connection with the electronic whiteboard, and writing performed by the user through a non-contact display screen (air writing) manner. The present embodiment does not make too many limitations on the specific manner of acquiring the writing trajectory information.

[0107] It should be noted that the implementation process of identifying the writing trajectory information and the response to the user's chart drawing instruction in the present embodiment are not limited in the order. In the implementation, the writing trajectory information can be identified to obtain the data recognition result, and then the user's chart drawing instruction can be responded. Alternatively, the user's chart drawing instruction can be responded first, and then the writing trajectory information can be identified to obtain the data recognition result.

[0108] It should be noted that the position of the writing trajectory information of the user in the display area and the position of the corresponding chart in the display area in the present embodiment are not overlapped. In this way, the user can simultaneously see the content written by the user and the chart drawn, the conference interaction efficiency is improved through the automatic drawing of the chart, and the user's interaction experience is improved without affecting the normal content interaction.

[0109] In some embodiments, in the intelligent drawing chart mode of the known chart type, the drawing of the chart is triggered after it is determined that the user stops writing and waits for a preset time. The present embodiment can also respond to the instruction triggered after the user stops writing and waits for a preset time in the intelligent drawing chart mode of the known chart type, identify the writing trajectory information of the display area of the display screen to obtain a data recognition result, draw a chart according to the data recognition result, and display the chart. In the implementation, if the user stops writing in the display area and waits for a preset time, the writing trajectory information of the display area is identified to obtain a data recognition result, a chart is drawn according to the data recognition result, and the drawn chart is displayed in the display area. In the implementation, the timing of identifying the writing trajectory information and drawing and displaying the chart according to the data recognition result can be determined according to the timing of receiving the chart drawing instruction.

[0110] In some embodiments, the timing of identifying the writing trajectory information in the present embodiment is that if it is determined that the user stops writing and still does not write after waiting for a preset time, the writing trajectory information of the display area of the display screen is identified to obtain a data recognition result.

[0111] In some embodiments, in the smart drawing chart mode of the known chart type, when it is determined that the gesture instruction of the user is received, drawing of the chart is triggered. In response to the gesture instruction of the user in the smart drawing chart mode of the known chart type, the writing track information of the display area of the display screen can be recognized to obtain a data recognition result, and the chart can be drawn according to the data recognition result, and the chart can be displayed.

[0112] In some embodiments, the gesture instruction includes, but is not limited to, a gesture instruction representing a direction, such as an arrow gesture instruction, including at least one of a single arrow gesture instruction and a double arrow gesture instruction.

[0113] Optionally, according to the arrow direction in the received gesture instruction, the table data corresponding to the X axis is determined; or, according to the arrow direction in the received gesture instruction, the table data corresponding to the Y axis is determined.

[0114] Optionally, if the gesture instruction is a single arrow gesture instruction, the table data corresponding to the X axis or the table data corresponding to the Y axis is determined according to the direction of the single arrow. In an implementation, for example, the data content in the first column of the table data is determined as the table data corresponding to the X axis, and the data content in the second column of the table data is determined as the table data corresponding to the Y axis.

[0115] Optionally, if the gesture instruction is a double arrow gesture instruction, the double arrow gesture instruction includes a first arrow instruction and a second arrow instruction drawn in sequence, wherein the receiving time of the first arrow instruction is earlier than the receiving time of the second arrow instruction, and the second direction of the second arrow instruction is different from the first direction; and the table data of the X axis and the Y axis is set by the following manner:

[0116] According to the first direction of the first arrow instruction, the corresponding table data of the X axis is determined, and according to the second direction of the second arrow instruction, the corresponding table data of the Y axis is determined; or,

[0117] According to the first direction of the first arrow instruction, the corresponding table data of the Y axis is determined, and according to the second direction of the second arrow instruction, the corresponding table data of the X axis is determined.

[0118] The data recognition result of the embodiment includes, but is not limited to, table data, data group data, and the like representing data capable of being drawn into a chart.

[0119] It should be noted that the table data described above can refer to data having row information or column information, or data having both row information and column information, and is not limited to data containing complete row or column division lines. In computer data, as long as the data storage form can represent the row or column information of the data, it can be referred to as table data.

[0120] The table data in the embodiment includes a plurality of cells, which can be arranged uniformly, for example, arranged as 3 rows and 2 columns of cells. The cells can further include user writing track information. After recognizing the writing track information in the cells, the data content of the cells is obtained, so as to draw a chart by using the data content in each cell.

[0121] In the embodiment, the data groups can be determined according to the data with column information or row information in the table data. For example, the data content in each cell in the first column of the table data can be taken as the content of the first data group, and the data content in each cell in the second column of the table data can be taken as the content of the second data group. The arrangement order of the content in the data group is determined according to the arrangement order of the cells. The data content in each cell in the first row of the table data can be taken as the content of the first data group, and the data content in each cell in the second row of the table data can be taken as the content of the second data group. For example, the data content in each cell in the first column of the table data is 10, 20 and 30 respectively, and the content in the first data group is [10, 20, 30].

[0122] The embodiment provides a schematic diagram of a display area of a display screen of an electronic whiteboard, as shown in Figure 2A 、 Figure 2B 、 Figure 2C 、 Figure 2D After the user writes on one side of the display area of the electronic whiteboard, a chart drawing instruction is triggered, and the corresponding chart is displayed on the other side of the display area. In the implementation, after the user selects a chart type, in the intelligent drawing chart mode of the known chart type, the writing is stopped and a preset time is waited, and then the corresponding chart is drawn and displayed on the other side of the display area.

[0123] In some examples, the display manner of the chart includes but is not limited to simultaneous display of the coordinate axis and the table data; or, display of the table data after the display of the coordinate axis; or, display of the coordinate axis after the display of the table data. If it is a line chart, the table data is understood as each coordinate point on the line, if it is a histogram, the table data is understood as each rectangle in the histogram, and if it is a pie chart, the table data is understood as different size blocks. In some examples, the embodiment can display the title of each coordinate axis, or can not display the title of each coordinate axis, which can be determined according to actual needs, and is not limited here.

[0124] In some examples, the embodiment can acquire the writing track information of the display region after receiving the chart drawing instruction of the user; or acquire the writing track information of the display region after determining that the user has finished writing. The embodiment does not make too many limitations on the timing of acquiring the writing track information. Specifically, the determination that the user has finished writing includes: determining that the user has finished writing according to the fact that no writing track information is received within a preset time period after the last received writing track information; or determining that the user has finished writing according to the received completion button instruction triggered by the user. It should be noted that the button or key in the embodiment includes a virtual button or a physical button, which is not limited here.

[0125] In some embodiments, the embodiment provides a method for identifying writing track information, which is mainly divided into the following three kinds according to different writing scenarios:

[0126] The first kind is the writing scenario with table lines.

[0127] This writing scenario mainly identifies the writing track information based on the data content in the writing prompt table displayed in the display region. In this scenario, the position (region size) of each cell in the writing prompt table is known. Even if the writing prompt table can be dynamically expanded during user writing, the position (region size) of each cell in the expanded writing prompt table is still known. The writing prompt table can be fixed and displayed in the display region before user writing, or the reference position of the writing prompt table can be dynamically determined according to the position of the initial writing of the user. The user only needs to write the corresponding content in each cell of the writing prompt table, and the identification process only needs to identify the writing track information. Since the position of each cell in each writing prompt table is known, only the data identification result needs to be divided into each cell of the writing prompt table, so as to obtain a table containing the content written by the user, and generate and display a chart according to the data content in the table.

[0128] In some embodiments, before identifying the writing track information of the display region of the display screen and acquiring the data identification result, the processor is specifically configured to perform:

[0129] Displaying a writing prompt table in the display region, wherein the writing prompt table is used to prompt the user to write in each cell of the writing prompt table;

[0130] Receiving the writing track information of the user writing in the writing prompt table.

[0131] In some embodiments, the processor is specifically configured to perform:

[0132] determining a reference position of the writing prompt table according to a position of the writing track information of the first writing of the user in the display area;

[0133] displaying the writing prompt table with a fixed number of rows and columns in the display area according to the reference position of the writing prompt table, wherein the writing track information of the first writing of the user is located in a cell of the writing prompt table.

[0134] For example, the position of the content of the first writing of the user in the display area is taken as the position of the cell in the first row and the first column of the writing prompt table, or as the position of the cell in the second row and the second column of the writing prompt table, and the position is taken as the reference position of the writing prompt table, and the writing prompt table with a fixed number of rows and columns is displayed.

[0135] In some embodiments, after displaying the writing prompt table, the processor is specifically further configured to perform any one of the following methods for increasing the number of rows and columns of the writing prompt table:

[0136] Method 1) If the writing track information of the continuous writing of the user exceeds the range contained in the writing prompt table, the number of rows of the writing prompt table is increased according to the position of the writing track information of the continuous writing of the user.

[0137] Method 2) If the writing track information of the continuous writing of the user exceeds the range contained in the writing prompt table, the number of columns of the writing prompt table is increased according to the position of the writing track information of the continuous writing of the user.

[0138] Method 3) If the writing track information of the continuous writing of the user exceeds the range contained in the writing prompt table, the number of rows and columns of the writing prompt table is increased according to the position of the writing track information of the continuous writing of the user.

[0139] Method 4) If the writing track information of the continuous writing of the user is located in a critical row of the writing prompt table, the number of rows of the writing prompt table is increased.

[0140] Method 5) If the writing track information of the continuous writing of the user is located in a critical column of the writing prompt table, the number of columns of the writing prompt table is increased.

[0141] Method 6) If the writing track information of the continuous writing of the user is located in a cell of a critical row and a critical column of the writing prompt table, the number of rows and columns of the writing prompt table is increased.

[0142] In the present embodiment, the critical row means the last row of the writing prompt table, for example, the second last row of the writing prompt table, or the last row of the writing prompt table.

[0143] The writing prompt table in the embodiment can dynamically determine the reference position according to the position of the initial writing of the user, and can also automatically dynamically expand the writing prompt table when the user is about to fill each cell in the writing prompt table or the writing content has exceeded the range contained in the writing prompt table, so as to ensure that the content written by the user is within the range of the writing prompt table.

[0144] In some embodiments, the processor is specifically further configured to perform:

[0145] In response to the editing instruction of the user in the intelligent drawing chart mode of the known chart type, the writing prompt table is displayed in the display area, wherein the number of rows and the number of columns of the writing prompt table are fixed or determined according to the input parameter of the user.

[0146] In the implementation, the timing of displaying the writing prompt table can be in response to the editing instruction of the user in the intelligent drawing chart mode of the known chart type. After the writing prompt table is displayed, the user can further set the rows and columns of the writing prompt table by inputting the row parameter and the column parameter, for example, the user inputs the row parameter as 3 and the column parameter as 5, and then a writing prompt table with 3 rows and 5 columns is generated and displayed.

[0147] In some embodiments, the size of the cell in the writing prompt table in the embodiment is predefined, or can be determined according to the input cell parameter of the user, or the size of the cell can be determined according to the writing track information of the initial writing of the user, for example, the size of the cell can be determined by the positions of the track points in the writing track information of the initial writing of the user, and the embodiment does not make too many limitations on this.

[0148] In some embodiments, in the writing scene with a table line, the data recognition result includes a plurality of data groups, and any one data group includes the content written by the user in any one column of the writing prompt table, or the content written by the user in any one row of the writing prompt table.

[0149] In the implementation, the plurality of data groups can be determined by the following manner:

[0150] If the writing prompt table is displayed in the display area, the content written by the user in the writing prompt table is divided by column or by row to obtain a plurality of data groups; or,

[0151] If the writing prompt table is not displayed in the display area, the data content of each cell is divided by column or by row to obtain a plurality of data groups after each cell is determined.

[0152] It should be noted that the elements contained in any one data group correspond to the content of any one column, and the order of arrangement of the elements in the data group is the same as the order of arrangement of the cells in the column. For example, if the user writes 4 rows and 3 columns of content in the writing prompt table, the writing prompt table is divided by column to obtain 3 columns, which correspond to 3 data groups respectively, and the first data group corresponds to the data content in the 4 cells in the first column, that is, each data group contains 4 elements.

[0153] In some embodiments, in the writing scenario with table lines, the processor is specifically configured to determine the data recognition result by any one of the following methods:

[0154] Method 1: first determine the trajectory points of the cells, and then recognize the trajectory points of each cell.

[0155] According to the position relationship between each trajectory point in the writing trajectory information and the cells in the writing prompt table, determine the writing trajectory information contained in each cell;

[0156] Recognize the writing trajectory information contained in each cell to obtain the data content of each cell;

[0157] Method 2: first recognize the writing trajectory information, and then determine the data content in the cells.

[0158] Recognize the writing trajectory information to obtain the content written by the user and the position of the content in the display area;

[0159] According to the position of the content and the position of the cells in the writing prompt table, determine the data content of each cell.

[0160] In the writing scenario with table lines, the position and size of each cell in the writing prompt table are known, and in the recognition process, only the position relationship between each trajectory point in the writing trajectory information and the cells needs to be determined to determine which cell each trajectory point is located in, thereby determining the trajectory points (i.e. writing trajectory information) contained in each cell. Recognize the trajectory points in each cell to obtain the data content of each cell, divide the data content of each cell by column to obtain multiple data groups, or divide the data content of each cell by row to obtain multiple data groups. Draw a chart according to each data group and display it.

[0161] The second is a writing scenario without table lines.

[0162] The writing scene not only needs to identify the writing track information, but also needs to identify the content written by the user using a clustering algorithm. In this scenario, the display area does not display a writing prompt table, and the user only needs to write the data content in the table. The identification process not only needs to use a handwriting recognition algorithm, but also needs to use a table line-free clustering algorithm, i.e., dividing the writing track information into different cells, identifying the writing track information in each cell, obtaining the data content in each cell, and finally generating a chart based on the data content in each cell and displaying the chart.

[0163] In some examples, in this scenario, the data recognition result in the embodiment includes multiple cells, and the data recognition result further includes the position of each cell and the data content in each cell. In implementation, the embodiment obtains the content actually written by the user by identifying the writing track information, and based on the drawing requirement of the user, the embodiment regards the content written by the user as the data content, draws a chart of a chart type corresponding to the chart drawing instruction based on each data content in the table, and displays the drawn chart in the display area.

[0164] In this scenario, in some embodiments, after receiving the chart drawing instruction of the user, the embodiment determines the writing track information that needs to be displayed in a chart. The specific determination method includes but is not limited to any one of the following:

[0165] Method 1): determining all writing track information in the display area as writing track information that needs to be displayed in a chart.

[0166] In specific implementation, if the user needs to draw a chart during the use of the electronic whiteboard, the display screen of the electronic whiteboard is set to receive writing track information for chart drawing and an area for chart display according to the user's needs. The content written by the user before the setting is hidden in the display screen.

[0167] Method 2): determining all writing track information located in a preset frame in the display area as writing track information that needs to be displayed in a chart.

[0168] This method can not hide the original content written by the user in the display screen. When the user has a chart display requirement, the preset frame is displayed in the display area of the display screen. The user can write the content that needs to be drawn in the chart in the preset frame, and the corresponding chart is displayed in other areas of the display area.

[0169] The use mode 2) is to identify all writing track information in the display area after receiving the chart drawing instruction of the user, to obtain table data corresponding to all writing track information. The writing track information includes but is not limited to writing order and coordinates of each track point, that is, the writing track information contains each track point with writing order.

[0170] In some embodiments, in the writing scenario, the data recognition result includes a plurality of cells, and the data recognition result further includes cell positions and data contents in the cells.

[0171] In some examples, the algorithm for writing track recognition specifically includes but is not limited to a clustering algorithm and a handwriting recognition algorithm. The clustering algorithm is used to cluster all received writing track information according to similarity between each track point, so as to divide all track points into cells. The track points in each cell are of one type, which can be understood as data contents in a cell written by the user. The handwriting recognition algorithm is used to recognize the track points in each cell to obtain final contents, that is, data contents. According to the cell positions and the data contents in the cells, each data content in the table written by the user can be finally determined.

[0172] In implementation, after obtaining the writing track information, the obtained writing track information is identified to obtain position information of each cell in the table and data contents corresponding to each cell. For example, in a 2*4 table, the position of the first cell is (1, 1), the data content in the first cell is "income", the position of the second cell is (1, 2), and the data content in the second cell is "100".

[0173] In some examples, the writing track information of the display area of the display screen is identified by the following steps to obtain table data:

[0174] Step 1, determine each cell, and divide the writing track information into each cell.

[0175] The cells are used to correspond to each cell in the table, and the writing track information contained in the cells is used to correspond to data contents in each cell.

[0176] In implementation, each cell is determined based on the writing track information according to the clustering algorithm, and then the writing track information is divided into each cell. Each cell contains data contents.

[0177] In some examples, the clustering algorithm in the embodiment can adopt a self-adaptive class clustering algorithm, such as K-Means (K-means clustering algorithm). Trajectory points with consistent writing order and close coordinate distance are clustered into a class, and trajectory information of the same class is divided into the same cell, thereby dividing all writing trajectory information into various cells.

[0178] The embodiment can determine various cells by a clustering algorithm, and can also divide user writing trajectory information into various cells.

[0179] In implementation, the number of clusters of the K-Means algorithm can be preset, that is, the total number of cells obtained by final division, and an improved K-Means algorithm for automatically determining the number of clusters can be used to automatically determine the final number of clusters, that is, the K-Means algorithm can automatically determine the total number of cells obtained by final division. The data set of the K-Means algorithm includes N sample points, each sample point includes two features, that is, writing order of a trajectory point and coordinate of the trajectory point, and the design idea is to calculate the distance between sample points in each class by a preset loss function, so that the distance between sample points in each class is small and the error between sample points of different clusters is large. The idea of the K-Means algorithm is to first select L mean points, cluster sample points according to the L mean points, remove sample points with small clusters, randomly select a mean point from the remaining L1 sample points after removing the sample points, and find the mean point farthest from the mean point, and iterate in turn until K mean points are selected, where L, L1 and K are positive integers, and L>L1.

[0180] The specific process of the K-Means algorithm is as follows:

[0181] Step 1, initialization, select K mean points;

[0182] Step 2, divide sample points into the class of the nearest mean point to determine the clustering result;

[0183] Among them, the optimal clustering result is obtained by calculating the minimum value of the loss function.

[0184] Step 3, update the mean point according to the clustering result;

[0185] Step 4, repeat steps 2 and 3 until the mean point no longer changes;

[0186] Step 5, output the clustering result.

[0187] In some examples, the embodiment provides the following two ways of dividing the writing trajectory information into various cells.

[0188] The implementation steps of the first mode are as follows:

[0189] Step 1a, obtaining the writing order and coordinates of each trajectory point in the writing trajectory information;

[0190] Step 1b, determining the similarity between each trajectory point according to the writing order and coordinates of each trajectory point;

[0191] Step 1c, dividing the trajectory points with the similarity satisfying a preset threshold into each cell.

[0192] In implementation, after obtaining the writing order and coordinates of each trajectory point in the writing trajectory information, each trajectory point can be clustered according to a clustering algorithm, the trajectory points with the similarity satisfying a preset threshold are divided into a class, and each cell corresponding to each class of trajectory points is generated.

[0193] The implementation steps of the second mode are as follows:

[0194] Step 2a, converting the writing trajectory information into strokes, and determining the barycenter of the stroke according to the average coordinate value of the trajectory points in the stroke;

[0195] In some embodiments, the writing trajectory information is obtained after a resampling operation is performed on the trajectory points in the writing trajectory information; the resampling is used to increase the trajectory points in the corresponding stroke according to the length of each stroke. In implementation, the writing trajectory information can be resampled, the number of points in the stroke is increased according to the stroke length, and each cell is determined by using the resampled writing trajectory information.

[0196] Step 2b, dividing the stroke into each cell according to the position relationship between the barycenter of the stroke and each cell.

[0197] In some embodiments, each cell is determined by any one or more of the following modes:

[0198] Mode 1) determining the column separation line according to the valley position in the first projection histogram of the writing trajectory information on the first coordinate axis, determining the row separation line of any column according to the valley position in the second projection histogram of the writing trajectory information contained in any column on the second coordinate axis, and determining each cell according to the column separation line and the row separation line;

[0199] It should be noted that the first coordinate axis and the second coordinate axis in the present embodiment have a perpendicular relationship.

[0200] In implementation, the column separation line is determined by the following mode:

[0201] The column separation line is determined according to the valley position with the width of the valley in the first projection histogram being greater than a threshold.

[0202] In an implementation, the row separation line is determined in the following manner:

[0203] The row separation line is determined according to the position of a trough in the second projection histogram whose width is greater than a threshold value.

[0204] In an implementation, the individual cells are determined according to the column separation line and the row separation line, specifically including:

[0205] The writing track information is divided into multiple columns according to the column separation line, and each column of writing track information is divided into multiple rows according to the row separation line. Finally, the frame line of the table is determined according to the minimum and maximum values of the track points in the first coordinate axis and the second coordinate axis in the entire writing track information. The table and the data content in the table are determined according to the column separation line and the row separation line, the frame line, and the writing track information. It should be noted that in the manner of determining the cells in this embodiment, the column division is performed first, and then the row division is performed on each column. This can solve the problem that the content of each row in different columns is not aligned due to non-standard user writing. Even if the content of each row in different columns is not on the same horizontal line, the data content in each cell can still be accurately divided by using the method in this embodiment, and the row and column division is accurately implemented. This implementation can solve the problem that the handwritten column in the vertical table is misaligned, thereby affecting recognition.

[0206] Manner 2) The row separation line is determined according to the position of a trough in the second projection histogram of the writing track information in the second coordinate axis. The column separation line of an arbitrary row is determined according to the position of a trough in the first projection histogram of the writing track information contained in the arbitrary row in the first coordinate axis. The individual cells are determined according to the row separation line and the column separation line.

[0207] In an implementation, the column separation line is determined in the following manner:

[0208] The column separation line is determined according to the position of a trough in the first projection histogram whose width is greater than a threshold value.

[0209] The row separation line is determined in the following manner:

[0210] The row separation line is determined according to the position of a trough in the second projection histogram whose width is greater than a threshold value.

[0211] In an implementation, the individual cells are determined according to the column separation line and the row separation line, specifically including:

[0212] The writing track information is divided into multiple rows according to the row division lines, each row of writing track information is divided into multiple columns according to the column division lines, and finally the border line of the table is determined according to the minimum and maximum values of the track points in the first coordinate axis and the second coordinate axis in the entire writing track information. The table and the data content in the table are determined according to the column division lines and the row division lines, the border line, and the writing track information. It should be noted that in the manner of determining the cells in the embodiment, the row division is first implemented, and then the column division is implemented for each row, which can solve the problem that the user's writing is not standardized, resulting in empty rows in the table. By using the method in the embodiment, the empty rows can be determined, the data content in each cell is accurately divided, and the row and column division is accurately implemented.

[0213] In mode 3), the column division line is determined according to the valley position in the first projection histogram of the first coordinate axis of the writing track information, the row division line is determined according to the valley position in the second projection histogram of the second coordinate axis of the writing track information, and each cell is determined according to the row division line and the column division line.

[0214] In the implementation, the column division line is determined in the following manner:

[0215] The column division line is determined according to the valley position of the valley with a width greater than a threshold in the first projection histogram.

[0216] The row division line is determined in the following manner:

[0217] The row division line is determined according to the valley position of the valley with a width greater than a threshold in the second projection histogram.

[0218] In the implementation, each cell is determined according to the column division line and the row division line, and specifically includes:

[0219] The writing track information is divided into multiple columns according to the column division lines, the writing track information is divided into multiple rows according to the row division lines, and finally the border line of the table is determined according to the minimum and maximum values of the track points in the first coordinate axis and the second coordinate axis in the entire writing track information. The table and the data content in the table are determined according to the column division lines and the row division lines, the border line, and the writing track information. It should be noted that in the manner of determining the cells in the embodiment, the row division is first implemented, and then the column division is implemented for each row, which can solve the problem that the user's writing is not standardized, resulting in empty rows in the table. By using the method in the embodiment, the empty rows can be determined, the data content in each cell is accurately divided, and the row and column division is accurately implemented.

[0220] In some embodiments, the first projection histogram is obtained by performing a down-sampling on a projection histogram obtained by projecting the writing trajectory information onto a first coordinate axis; wherein the down-sampling is configured to reduce a unit interval of the first coordinate axis of the projection histogram to a first preset interval, and sum up the number of trajectory points projected in the first preset interval, and take the sum as the number of trajectory points corresponding to the first preset interval; wherein, taking the first coordinate axis as the X axis as an example, the X axis coordinate of the projection histogram represents the position of the trajectory point in the writing trajectory information in the X direction, and the Y axis coordinate represents the number of trajectory points projected onto different X axis positions; for example, the number of trajectory points in the 0-100 interval of the X axis of the projection histogram is down-sampled to the new 0-10 interval; specifically, the sum of the number of trajectory points in the 0-10 sub-interval of the 0-100 interval is taken as the number of trajectory points corresponding to the 0-1 sub-interval of the new 0-10 interval, the sum of the number of trajectory points in the 10-20 sub-interval of the 0-100 interval is taken as the number of trajectory points corresponding to the 1-2 sub-interval of the new 0-10 interval, and so on. Further, the number of trajectory points in each sub-interval of the 0-10 interval can be normalized; taking the 0-1 sub-interval of the 0-10 interval as an example, the sum of the number of trajectory points corresponding to the 0-1 sub-interval is taken as the number of trajectory points corresponding to the 0-1 sub-interval, wherein the 0-1 sub-interval corresponds to a number of trajectory points, i.e. a value corresponding to the 0-1 sub-interval.

[0221] The second projection histogram is obtained by performing a down-sampling on a projection histogram obtained by projecting the writing trajectory information onto a second coordinate axis; wherein the down-sampling is configured to reduce a unit interval of the second coordinate axis of the projection histogram to a second preset interval, and sum up the number of trajectory points projected in the second preset interval, and take the sum as the number of trajectory points corresponding to the second preset interval; wherein, taking the second coordinate axis as the Y axis as an example, the Y axis coordinate of the projection histogram represents the position of the trajectory point in the writing trajectory information in the Y direction, and the X axis coordinate represents the number of trajectory points mapped onto different Y axis positions; for example, the number of trajectory points in the 0-100 interval of the Y axis of the projection histogram is down-sampled to the new 0-10 interval; the specific implementation principle is described above in the description of the first projection histogram, which will not be repeated here.

[0222] In this embodiment, the projection histogram is used to represent the statistical diagram of the number of trajectory points of the writing trajectory information projected on the preset coordinate axis.

[0223] Step 2, identifying the writing trajectory information in each cell to obtain the data content in each cell;

[0224] The handwriting recognition algorithm is used to identify the writing track information to obtain the data content in each cell. Optionally, the handwriting recognition algorithm in the embodiment includes, but is not limited to, at least one of a character recognition algorithm and a number recognition algorithm.

[0225] In step 3, the data recognition result is determined according to the positions of the cells and the data content in the cells.

[0226] As shown in FIG. 8, the writing track recognition schematic diagram provided by the embodiment divides the writing track information of the user “product, profit, A, B, C, 10000, 20000, 30000” into eight cells, each of which contains all the writing track information of the data content. After the handwriting recognition algorithm is used to identify the writing track information in each cell, the data content in each cell is obtained, and thus the data recognition result is determined. Figure 3

[0227] It should be noted that the table data in the embodiment is composed of cells, and the data content in the table is composed of the data content in the cells. The positions of the cells and the data content obtained by identification (the data content in the cells) can be used to determine the table data. The data content in each column of cells is taken as an array, or the data content in each row of cells is taken as an array, and a chart is drawn and displayed according to each array.

[0228] Third, a writing scenario in which a title prompt is displayed.

[0229] In this writing scenario, the displayed title prompt includes, but is not limited to, a horizontal line or a vertical line. Optionally, the handwriting recognition algorithm is used to identify the writing track information above the horizontal line, and the clustering algorithm and the handwriting recognition algorithm are used to identify the writing track information below the horizontal line. Alternatively, the handwriting recognition algorithm is used to identify the writing track information to the left of the vertical line, and the clustering algorithm and the handwriting recognition algorithm are used to identify the writing track information to the right of the vertical line. In this scenario, the display area only displays the horizontal line or the vertical line, and the horizontal line or the vertical line displays at least one, which can be one long horizontal line, multiple short horizontal lines, one long vertical line, or multiple short vertical lines. The embodiment does not make too many limitations on the style and number of the displayed horizontal line or vertical line. For example, the user can write the title of each coordinate axis above the horizontal line, which can be one or more titles, and write the content under the title below the horizontal line.

[0230] In some embodiments, before the writing track information in the display area of the display screen is identified to obtain the data recognition result, the processor is specifically further configured to perform the following steps:

[0231] ​display a title prompt in the display area, the title prompt being used to prompt a user to write a position of a table title; wherein when a line chart is drawn, the table title is used to represent a title of a coordinate axis; when a column chart is drawn, the table title is used to represent a title of each classification on a preset coordinate axis or a column name; when a radar chart is drawn, the table title is used to represent a title of each vertex or a polar coordinate name; when a pie chart is drawn, the table title is used to represent a title of each partition.

[0232] In the first area corresponding to the title prompt, first writing track information is obtained, and in the second area corresponding to the title prompt, second writing track information is obtained.

[0233] The title prompt in the embodiment can not only be used to prompt a user to write a position, so that the user writes according to the prompt of the title prompt, but also avoid a problem that when a user writes different contents, a gap between the different contents is small, so that when a clustering algorithm is used, automatic cell recognition cannot be accurately performed, and part or all track points in the same content are easily misclassified into other cells, resulting in recognition errors.

[0234] In some embodiments, the title prompt is used to separate a title of each coordinate axis (i.e., a table title) written by a user and content corresponding to the title. In some embodiments, the first area and the second area are separated by the title prompt. In some embodiments, the title prompt includes at least one of a horizontal line, a vertical line, and a symbol.

[0235] In the implementation, two horizontal lines can be displayed, each horizontal line corresponding to a column in a table; for example, first writing track information representing title 1 is obtained in an upper area of a first horizontal line, the first writing track information is recognized as title 1 of an X coordinate axis, second writing track information representing content is obtained in a lower area of the first horizontal line, and the second writing track information is recognized as content corresponding to title 1; second writing track information representing title 2 is obtained in an upper area of a second horizontal line, the second writing track information is recognized as title 2 of a Y coordinate axis, and second writing track information representing content is obtained in a lower area of the second horizontal line, and the second writing track information is recognized as content corresponding to title 2.

[0236] In a writing scenario in which the title prompt is displayed, the data recognition result includes titles of each coordinate axis and a plurality of cells, and the data recognition result further includes positions of each cell and data content in each cell.

[0237] In some embodiments, the data recognition result is determined by the following steps:

[0238] Step 3a) recognizing writing track information of the first area to obtain titles of each coordinate axis;

[0239] Step 3b) dividing the writing track information of the second region into each cell, identifying the writing track information in each cell, and obtaining the data content in each cell of the second region;

[0240] wherein the writing track is divided into each cell by any of the following ways:

[0241] Way one, converting the writing track information into strokes, determining the center of gravity of the stroke according to the average coordinate value of the track points in the stroke, and dividing the stroke into each cell according to the position relationship between the center of gravity of the stroke and each cell.

[0242] Way two, obtaining the writing order and coordinates of each track point in the writing track information, determining the similarity between each track point according to the writing order and coordinates of each track point, and dividing the track points satisfying a preset threshold value into each cell.

[0243] Each cell is determined by any of the following ways:

[0244] Way 1, determining column separation lines according to the valley positions of the first projection histogram of the writing track information in the first coordinate axis, determining row separation lines of any column according to the valley positions of the second projection histogram of the writing track information contained in any column, and determining each cell according to the column separation lines and the row separation lines.

[0245] Way 2, determining row separation lines according to the valley positions of the second projection histogram of the writing track information in the second coordinate axis, determining column separation lines of any row according to the valley positions of the first projection histogram of the writing track information contained in any row, and determining each cell according to the row separation lines and the column separation lines.

[0246] Way 3, determining column separation lines according to the valley positions of the first projection histogram of the writing track information in the first coordinate axis, determining row separation lines according to the valley positions of the second projection histogram of the writing track information in the second coordinate axis, and determining each cell according to the row separation lines and the column separation lines.

[0247] wherein the column separation lines are determined by the following way:

[0248] determining the column separation lines according to the valley positions of the first projection histogram whose width is greater than a threshold value; and / or,

[0249] The row separation lines are determined by the following way:

[0250] determining the row separation lines according to the valley positions of the second projection histogram whose width is greater than a threshold value.

[0251] The writing track information in the modes 1-3 is obtained by resampling the track points in the writing track information written by the user; the resampling is used to increase the track points in the corresponding stroke according to the length of each stroke in the writing track information written by the user.

[0252] The first projection histogram is obtained by reducing the mapping of the projection histogram obtained by projecting the writing track information to the first coordinate axis; wherein the reducing mapping is used to reduce the unit interval of the first coordinate axis of the projection histogram to a first preset interval, and sum the number of track points projected in the first preset interval;

[0253] The second projection histogram is obtained by reducing the mapping of the projection histogram obtained by projecting the writing track information to the second coordinate axis; wherein the reducing mapping is used to reduce the unit interval of the second coordinate axis of the projection histogram to a second preset interval, and sum the number of track points projected in the second preset interval.

[0254] Step 3c) determines the data recognition result according to the title, the data content in each cell of the second area, and the positional relationship between the title and each cell.

[0255] In this scenario, in addition to the recognition of the writing track information in the first area corresponding to the title prompt, the recognition method in the second area can be according to the above-mentioned second recognition method without table lines in the writing scenario. Since the user writes the title in the first area and the content in the second area in this scenario, only the writing track information in the first area needs to be recognized, and the writing track information in the second area needs to be recognized by the clustering algorithm and the handwriting recognition algorithm. The writing track information is first divided into cells, and then the writing track information in each cell is recognized to determine the data content in each cell corresponding to each title, or to determine the data content in each cell corresponding to each title.

[0256] The data content in each column cell except the title is taken as an array, or the data content in each row cell except the title is taken as an array, and a chart is drawn and displayed according to each array.

[0257] The above-mentioned three different scenarios in this embodiment are slightly different in the way of recognizing and obtaining the recognition result, that is, the recognition method in the scenario with a table is different from the recognition method in the scenario without a table. Based on the above-mentioned three different scenarios, this embodiment can determine the content of the table written by the user in different scenarios, and determine the content of any column or the content of any row written by the user.

[0258] In some embodiments, the content written by the user is divided by columns to determine the plurality of data groups; or, the content written by the user is divided by rows to determine the plurality of data groups. The content of any column written by the user is determined as a data group; or, the content of any row written by the user is determined as a data group.

[0259] In some embodiments, a chart type is determined according to the chart drawing instruction; and a chart corresponding to the chart type is drawn according to the respective data groups corresponding to the content written by the user.

[0260] In some embodiments, each column of content written by the user is determined as a respective data group according to a preset correspondence between each row and the coordinate axis; or, each row of content written by the user is determined as a respective data group according to a preset correspondence between each column and the coordinate axis.

[0261] In some embodiments, the content located at a preset row in the content written by the user is determined as the title of the respective coordinate axis, and the data content in the other respective cells is determined as data content; or, the content located at a preset column in the content written by the user is determined as the title of the respective coordinate axis, and the data content in the other respective cells is determined as data content.

[0262] In some embodiments, the data content in the respective cells is determined as data content.

[0263] In some embodiments, a chart type is determined according to the chart drawing instruction;

[0264] In some embodiments, a chart corresponding to the chart type is drawn according to the respective data groups corresponding to the content written by the user.

[0265] In some embodiments, in the process of drawing a chart, the content written by the user is divided into respective data groups, and a chart corresponding to the chart type is drawn according to the respective data groups corresponding to the content written by the user, regardless of whether the mode is a table mode or a non-table mode.

[0266] In the table mode, each column of content written by the user in the prompt table is taken as a data group, or each row of content written by the user in the prompt table is taken as a data group.

[0267] In the non-table mode, after the content written by the user is divided into respective cells, the data content in each column of cells is taken as a data group, or the data content in each row of cells is taken as a data group.

[0268] In some embodiments, if any one of the data sets includes the content of any one of the columns written by the user, different types of charts can be drawn in the following ways:

[0269] If it is determined that the chart type is a column chart, each classification title on the preset coordinate axis is determined according to the data set corresponding to the preset column, the first content corresponding to the preset index value in the data set corresponding to the remaining columns other than the preset column is determined to be the column name, the column height corresponding to each classification title and the column name is determined according to the content other than the first content in the data set corresponding to the remaining columns, and a column chart is drawn according to each classification title, the column name, and the column height; or,

[0270] If it is determined that the chart type is a radar chart, the title of each vertex is determined according to the data set corresponding to the preset column, the second content corresponding to the preset index value in the data set corresponding to the remaining columns other than the preset column is determined to be the polar coordinate name, the polar coordinate corresponding to each title and the polar coordinate name is determined according to the content other than the second content in the data set corresponding to the remaining columns, and a radar chart is drawn according to each title, the polar coordinate name, and the polar coordinate; or,

[0271] If it is determined that the chart type is a line chart, the title of the coordinate axis is determined according to the content corresponding to the preset index value in the data set, the coordinate point is determined according to the content corresponding to the same index value other than the preset index value in different data sets, and a line chart is drawn according to the title of the coordinate axis and the coordinate point; or,

[0272] If it is determined that the chart type is a pie chart, the title of each partition is determined according to the data set corresponding to the preset column, the proportion of each partition is determined according to the data set corresponding to the column other than the preset column, and a pie chart is drawn according to the title and the proportion of each partition.

[0273] In drawing a column chart, the data set in the present embodiment can be understood as a sequence, and the preset index value in the present embodiment is used to represent the content in the array, for example, if the preset index value is 1, the first content corresponding to the preset index value 1 is the first content in the array.

[0274] In drawing a radar chart, the polar coordinate name in the present embodiment is used to distinguish different instances, for example, the data set corresponding to the first column is mathematics, English, and Chinese, the polar coordinate name corresponding to the preset index value 1 in the data set corresponding to the second column is "Class 1", and the polar coordinate name corresponding to the preset index value 1 in the data set corresponding to the third column is "Class 2", which distinguishes "Class 1" and "Class 2" through different polar coordinate names.

[0275] In the drawing of the line graph, for example, the first content corresponding to the preset index value 1 in the first array is taken as the X-axis title "month", the first content corresponding to the preset index value 1 in the second array is taken as the Y-axis title "income", the second content 12 corresponding to the preset index value 2 in the first array and the second content 100 corresponding to the preset index value 2 in the second array are used to determine the coordinate point (12, 100), indicating that the income in December is 100, and each coordinate point is determined in sequence to draw the line graph.

[0276] It should be noted that, although the above method of drawing different types of graphs is described in the scenario of any one data group including the content of any one column written by the user, the rows and columns in this embodiment can be interchanged, and the above implementation manner is also applicable to the scenario of any one data group including the content of any one row written by the user. Only the column in the above implementation manner is replaced by the row. Based on the above implementation principle, whether the content of the row or the content of the column is taken as the data group, the implementation principle is the same, and it belongs to the protection scope of the present disclosure. Here, no further description is given.

[0277] In some embodiments, taking an example of any one data group including the content written by the user in any one column of the writing prompt table, the data recognition results determined for different graph types are described as follows:

[0278] Case 1: The graph type is determined to be a column graph.

[0279] According to the data group corresponding to the preset column, the classification titles of the preset coordinate axis are determined, according to the data groups corresponding to the columns other than the preset column, the column body height and column body name corresponding to each classification title are determined, and according to the classification titles, the column body height and column body name corresponding to each classification title, a column graph is drawn.

[0280] In some embodiments, if the graph type is determined to be a column graph, according to the data group corresponding to the preset column, the classification titles of the preset coordinate axis are determined, according to the first content corresponding to the preset index value in the data group corresponding to the remaining columns other than the preset column, the column body name is determined, according to the content other than the first content in the data group corresponding to the remaining columns, the column body height corresponding to each classification title and column body name is determined, and according to the classification titles, column body name and column body height, a column graph is drawn.

[0281] In the implementation, as shown in the writing prompt table 1, in the scenario of a known graph type, the user writes content in the writing prompt table 1, and after identifying the content written by the user, the data content in each cell in the writing prompt table is obtained. The data content in the cell is used to draw a column graph, which is specifically as follows:

[0282] Writing prompt table 1

[0283] Shift Shift Language 90 89 Mathematics 95 99 English 94 92

[0284] In the writing prompt table, there can be empty cells.

[0285] For example, the contents in the data group corresponding to the first column are determined as the respective classification titles on the X-axis, i.e., according to the "Chinese, mathematics, English" in the data group of the first column, the respective classification titles on the X-axis are determined as "Chinese, mathematics, English", according to the first content corresponding to the first element in the data group corresponding to the second column, the column name is determined as "Class 1", according to the first content corresponding to the first element in the data group corresponding to the third column, the column name is determined as "Class 2", according to the contents corresponding to the remaining elements (90, 95, 94) in the data group corresponding to the second column, the content corresponding to Chinese and Class 1 is determined as 90, the content corresponding to mathematics and Class 1 is determined as 95, and the content corresponding to English and Class 1 is determined as 94, i.e., the column name is determined as "Class 1", the column height corresponding to the title "Chinese" is 90, the column name is determined as "Class 1", the column height corresponding to the title "mathematics" is 95, the column name is determined as "Class 1", the column height corresponding to the title "English" is 94, and similarly, according to the contents corresponding to the remaining elements (89, 99, 92) in the data group corresponding to the third column, the column name is determined as "Class 2", the column height corresponding to the title "Chinese" is 89, the column name is determined as "Class 2", the column height corresponding to the title "mathematics" is 99, and the column name is determined as "Class 2", the column height corresponding to the title "English" is 92. Thus, according to the determined respective classification titles, column names (Class 1 and Class 2), and respective column heights, a column chart is drawn.

[0286] Case 2: determining that the chart type is a radar chart;

[0287] According to the data group corresponding to the preset column, the title of each vertex is determined, according to the data group corresponding to the column other than the preset column, the polar coordinates and polar coordinate names corresponding to each title are determined, and according to the title of each vertex and the polar coordinates and polar coordinate names corresponding to each title, a radar chart is drawn.

[0288] In some embodiments, if it is determined that the chart type is a radar chart, then according to the data group corresponding to the preset column, the title of each vertex is determined, according to the second content corresponding to the preset index value in the data group corresponding to the remaining column other than the preset column, the polar coordinate name is determined, according to the content other than the second content in the data group corresponding to the remaining column, the polar coordinates corresponding to each title and polar coordinate name are determined, and according to each title, polar coordinate name, and polar coordinates, a radar chart is drawn.

[0289] In implementation, as shown in the writing prompt table 1, in the scenario of known chart type, the user writes content in the writing prompt table 1, after recognizing the content written by the user, the data content in each cell in the writing prompt table is obtained, and the radar chart is drawn by using the data content in the cell, specifically as follows:

[0290] For example, each content contained in the data group corresponding to the first column is determined as the title of each vertex of the radar chart, that is, according to the first content corresponding to the first element contained in the data group corresponding to the first column, the polar coordinate name is determined as "Class 1", according to the first content corresponding to the first element contained in the data group corresponding to the third column, the polar coordinate name is determined as "Class 2", according to the content corresponding to the remaining elements (90, 95, 94) in the data group corresponding to the second column, it is determined that the content corresponding to Chinese and Class 1 is 90; it is determined that the content corresponding to mathematics and Class 1 is 95, and it is determined that the content corresponding to English and Class 1 is 94, that is, it is determined that the polar coordinate corresponding to the title "Chinese" and the polar coordinate name "Class 1" is 90, it is determined that the polar coordinate corresponding to the title "Mathematics" and the polar coordinate name "Class 1" is 95, and it is determined that the polar coordinate corresponding to the title "English" and the polar coordinate name "Class 1" is 94, similarly, according to the content corresponding to the remaining elements (89, 99, 92) in the data group corresponding to the third column, it is determined that the polar coordinate corresponding to the title "Chinese" and the polar coordinate name "Class 2" is 89, it is determined that the polar coordinate corresponding to the title "Mathematics" and the polar coordinate name "Class 2" is 99, and it is determined that the polar coordinate corresponding to the title "English" and the polar coordinate name "Class 2" is 92. Thus, according to the determined title, polar coordinate name (Class 1, Class 2) and each polar coordinate, the radar chart is drawn.

[0291] Case 3, determining that the chart type is a line chart;

[0292] According to the content corresponding to the preset index value in the data group, the title of the coordinate axis is determined, according to the content corresponding to the same index value except the preset index value in different data groups, the coordinate point is determined, and according to the title of the coordinate axis and the coordinate point, the line chart is drawn.

[0293] In implementation, as shown in the writing prompt table 2, in the scenario of known chart type, the user writes content in the writing prompt table 2, after recognizing the content written by the user, the data content in each cell in the writing prompt table is obtained, and the line chart is drawn by using the data content in the cell, specifically as follows:

[0294] Writing prompt table 2

[0295] Month Income 3 32 4 44 5 57 6 14

[0296] For example, the content corresponding to the first element in the data group corresponding to each column is determined as the title of the coordinate axis. Specifically, the first element "month" in the data group corresponding to the first column is determined as the title of the X coordinate axis, and the first element "income" in the data group corresponding to the second column is determined as the title of the Y coordinate axis. According to the second element in the data group corresponding to the first column and the second element in the data group corresponding to the second column, the coordinate point (3, 32) is determined. Similarly, according to the third element in the data group corresponding to the first column and the third element in the data group corresponding to the second column, the coordinate point (4, 44) is determined. According to the fourth element in the data group corresponding to the first column and the fourth element in the data group corresponding to the second column, the coordinate point (5, 57) is determined. According to the fifth element in the data group corresponding to the first column and the fifth element in the data group corresponding to the second column, the coordinate point (6, 14) is determined. According to the title of the coordinate axis and each coordinate point, a line chart is drawn.

[0297] Case 4: The chart type is determined to be a pie chart.

[0298] According to the data group corresponding to the preset column, the title of each partition is determined. According to the data group corresponding to the column other than the preset column, the proportion of each partition is determined. According to the title and proportion of each partition, a pie chart is drawn.

[0299] In implementation, as shown in the writing prompt table 3, in the scenario where the chart type is known, the user writes content in the writing prompt table 3. After recognizing the content written by the user, the data content in each cell in the writing prompt table is obtained. The pie chart is drawn using the data content in the cell. Specifically, as follows:

[0300] Writing prompt table 3

[0301] February 10 March 20 April 30 May 40

[0302] For example, each content in the data group corresponding to the first column is taken as the title of each partition, i.e., the titles of each partition are February, March, April, and May, respectively. According to the data group corresponding to the second column, the proportion of each partition corresponding to the title of each partition is determined, i.e., the proportion of the partition with the title of February is 10%, the proportion of the partition with the title of March is 20%, the proportion of the partition with the title of April is 30%, and the proportion of the partition with the title of April is 40%. According to the title and proportion of each partition, a pie chart is drawn.

[0303] In some embodiments, the chart type can also be determined in any of the following ways:

[0304] (1) The chart drawing instruction includes a chart selection instruction. In response to the chart selection instruction of the user in the intelligent drawing chart mode, the chart type corresponding to the chart selection instruction is determined.

[0305] It should be noted that the intelligent drawing chart mode in this embodiment includes a writing software that can be used by a user to write and draw the written content into a chart through certain operations; or the intelligent drawing chart mode in this embodiment includes an intelligent drawing chart mode that is started in other software, such as starting a mode with a chart drawing function or an electronic interface with a chart drawing function in handwriting software of an electronic whiteboard.

[0306] In implementation, after a user enters the intelligent drawing chart mode in the electronic whiteboard, a plurality of chart type buttons are displayed on the display screen, the user forms a chart selection instruction according to different buttons, for example, after entering the intelligent drawing chart mode, a column chart, a radar chart, a line chart, and a pie chart are displayed in the lower left corner of the display area, after the user clicks the column chart, the display interface enters the intelligent drawing chart editing interface corresponding to the column chart.

[0307] In some embodiments, in response to a chart selection instruction of the user in the intelligent drawing chart mode, a writing prompt table is displayed in the display area, writing track information of the user in the writing prompt table is received; after the user stops writing and waits for a preset time, a chart of a chart type corresponding to the chart selection instruction is drawn and displayed.

[0308] In mode (2), the chart drawing instruction includes a first touch gesture, in response to the first touch gesture of the user in the intelligent drawing chart mode, a first graph generated by the first touch gesture is identified, and a chart type is determined according to the first graph.

[0309] In some embodiments, the chart drawing instruction includes at least one of a drawing instruction of an arrow, a drawing instruction of a circle, a drawing instruction of a polygon, a drawing instruction of a cylinder, and a drawing instruction of a rectangle. The polygon includes a first graph with at least three edges. The drawing instruction of the arrow includes a drawing instruction of a single arrow, a drawing instruction of a double arrow, a drawing instruction of more than two arrows, etc. The user can draw the first graph on the display interface by using the touch component, the processor identifies the first graph type, and determines different types of charts according to different first graph categories.

[0310] In some embodiments, after identifying the first graph corresponding to the chart drawing instruction, before determining the chart type, a selection menu is generated, for example, after identifying a certain first graph, a candidate menu is generated, the candidate menu includes at least one selection icon of a chart type or includes one selection icon of a chart type and at least one selection icon of another operation object, and the chart type is determined according to the selection operation (such as clicking) of the user on the selection icon.

[0311] In some embodiments, the response user receives the writing trajectory information written by the user before the chart drawing instruction in the intelligent chart mode, identifies the writing trajectory information, and obtains a data identification result; then the response user draws and displays a chart of a chart type corresponding to the chart drawing instruction according to the data identification result in response to the chart drawing instruction in the intelligent chart mode.

[0312] Optionally, the first figure generated according to the first touch gesture includes at least one of an arrow figure, a circle figure, a rectangle figure, a cylinder figure, and a polygon figure.

[0313] If the first figure is an arrow figure, the chart type is determined to be a line chart; if the first figure is a circle figure, the chart type is determined to be a pie chart; if the first figure is a rectangle figure, the chart type is determined to be a histogram; if the first figure is a cylinder figure, the chart type is determined to be a column chart; and if the first figure is a polygon figure, the chart type is determined to be a radar chart.

[0314] In this way, the embodiment can determine the chart type in any one or more of the following ways:

[0315] (2a) If the chart drawing instruction includes an arrow drawing instruction, the chart type is determined to be a line chart. In an implementation, if the user draws a double arrow, the chart type is determined to be a line chart, triggering the generation of a line chart.

[0316] In some examples, the arrow drawing instruction in the embodiment includes a drawing instruction of two arrows in different directions, for example, two arrows drawn by the user with perpendicular directions; or a drawing instruction of a double arrow, for example, a double arrow drawn by the user.

[0317] In some examples, if the double arrow drawing instruction includes a first arrow instruction “→” and a second arrow instruction “↑”, the direction of the X axis of the drawn chart is determined according to the first direction pointed by the first arrow instruction, and the direction of the Y axis of the chart is determined according to the second direction pointed by the second arrow instruction; or the double arrow drawing instruction includes a first arrow instruction “↑” and a second arrow instruction “→”, the direction of the X axis of the drawn chart is determined according to the first direction pointed by the first arrow instruction, and the direction of the Y axis of the chart is determined according to the second direction pointed by the second arrow instruction; it should be noted that the arrow drawing instruction is not only understood as an arrow drawn by the user, but also includes an instruction that a figure drawn by the user is identified as an arrow, that is, a line segment drawn by the user is identified as an arrow by using a pre-set program in the product.

[0318] In the implementation, the directions of the X axis and the Y axis in the chart can be determined according to the correspondence between the X axis, the Y axis and the columns of cells, and then the chart is drawn. For example, the left column of cells corresponds to the X axis, and the data content in the left column of cells is the data on the X axis. Similarly, the right column of cells corresponds to the X axis, and the data content in the right column of cells is the data on the Y axis. According to the different directions of the X axis and the Y axis, the displayed chart is different. In this embodiment, the direction of the X axis can be determined as the horizontal direction according to the first arrow instruction received first for drawing the horizontal direction, or the direction of the X axis can be determined as the vertical direction according to the first arrow instruction received first for drawing the vertical direction, that is, the direction of the X axis can be determined according to the direction of the first arrow received, and then the direction of the Y axis is determined, so that the coordinate axis direction of the chart is adjusted to provide more drawing requirements of the user.

[0319] Method (2b), if the chart drawing instruction includes a drawing instruction of a circle, it is determined that the chart type is a pie chart. In the implementation, if the user draws a circle or a double arrow and a circle, it is determined that the chart type is a pie chart, and a pie chart is triggered to be generated.

[0320] Method (2c), if the chart drawing instruction includes a drawing instruction of a rectangle, it is determined that the chart type is a histogram. In the implementation, if the user draws a rectangle or a double arrow and a rectangle, it is determined that the chart type is a histogram, and a histogram is triggered to be generated.

[0321] Method (2d), if the chart drawing instruction includes a drawing instruction of a cylinder, it is determined that the chart type is a column chart. In the implementation, if the user draws a cylinder, it is determined that the chart type is a column chart, and a column chart is triggered to be generated.

[0322] Method (2e), if the chart drawing instruction includes a drawing instruction of a polygon, it is determined that the chart type is a radar chart. In the implementation, if the user draws a polygon, it is determined that the chart type is a radar chart, and a radar chart is triggered to be generated.

[0323] The data group in this embodiment can be one data content or a plurality of data contents, which is determined according to the table content written by the user in the writing area.

[0324] In some examples, if the data group is two data contents, the same column data content can be taken as the same data group, or the same row data content can be taken as the same data group, which can be determined according to actual needs, and the embodiment does not make too many limitations. For example, if the type of the chart drawn is a line chart, the data group includes two data, one of which is used to represent the X-axis coordinate value, and the other is used to represent the Y-axis coordinate value; if the type of the chart drawn is a pie chart, the data group includes two data, one of which is used to represent the category name, and the other is used to represent the data corresponding to the category name; if the type of the chart drawn is a histogram, the data group includes two data, one of which is used to represent the X-axis coordinate value, and the other is used to represent the Y-axis coordinate value.

[0325] The embodiment can also determine the data group through any of the following implementation manners:

[0326] 2-1. According to the preset correspondence relationship between each row and the coordinate axis, the data content of each column is determined as each data group.

[0327] In the implementation, if the user writes two rows of data, the number of rows represents the coordinate axis X-Y, and the number of columns represents the number of data groups. The uppermost row corresponds to the X-axis, and the lowermost row corresponds to the Y-axis. The data content of each column is determined in turn as each data group (X, Y) in the order from top to bottom. Alternatively, the uppermost row corresponds to the Y-axis, and the lowermost row corresponds to the X-axis. The data content of each column is determined in turn as each data group (X, Y) in the order from bottom to top.

[0328] 2-2. According to the preset correspondence relationship between each column and the coordinate axis, the data content of each row is determined as each data group.

[0329] In the implementation, if the user writes two columns of data, the number of rows represents the number of data groups, and the number of columns represents the coordinate axis X-Y. The leftmost column corresponds to the X-axis, and the rightmost column corresponds to the Y-axis. The data content of each row is determined in turn as each data group (X, Y) in the order from left to right. Alternatively, the leftmost column corresponds to the Y-axis, and the rightmost column corresponds to the X-axis. The data content of each row is determined in turn as each data group (X, Y) in the order from right to left.

[0330] In some examples, the title of each coordinate axis and the following are determined in the following manner:

[0331] According to the preset correspondence relationship between each column and the coordinate axis, the data content of each row cell is determined as each data group; wherein the content located in the preset row in the content written by the user is determined as the title of each coordinate axis, and the data content in each row cell is determined as each data group; or,

[0332] According to the preset correspondence between each row and the coordinate axis, the content written by the user in each column is determined as each data group; wherein the content located in the preset column in the content written by the user is determined as the title of each coordinate axis, and the data content in each cell of other columns is determined as each data group.

[0333] In some examples, the embodiment can also determine which column of the two column cells is the X-axis data and which column is the Y-axis data according to the order of the drawn arrows, which is implemented as follows:

[0334] The data recognition result includes two column cells, the drawing instruction of the double arrow includes a first arrow instruction and a second arrow instruction drawn in sequence, the first arrow instruction corresponds to a first column cell in the two column cells, and the second arrow instruction corresponds to a second column cell in the two column cells;

[0335] If the first direction of the first arrow instruction is the X-axis direction, the first column cell is determined as the X-axis data of the chart, and the second column cell is determined as the Y-axis data of the chart;

[0336] If the first direction of the first arrow instruction is the Y-axis direction, the first column cell is determined as the Y-axis data of the chart, and the second column cell is determined as the X-axis data of the chart;

[0337] The receiving time of the first arrow instruction is earlier than the receiving time of the second arrow instruction, and the second direction of the second arrow instruction is different from the first direction. It is easy to understand that if the first direction of the first arrow instruction is the X-axis direction, the second direction of the second arrow instruction can be the Y-axis direction, and if the first direction of the first arrow instruction is the Y-axis direction, the second direction of the second arrow instruction can be the X-axis direction, wherein the X-axis direction and the Y-axis direction are predefined, and the X-axis and the Y-axis direction are perpendicular. Since the user usually draws the first direction of the first arrow instruction and the second direction of the second arrow instruction not completely perpendicular when drawing the first arrow instruction and the second arrow instruction, the first direction and the X-axis direction allow a certain error, and the second direction and the Y-axis direction also allow a certain error. Within the error allowed range, the first arrow instruction and the second arrow instruction drawn can be identified as the first direction of the first arrow instruction and the second direction of the second arrow instruction, so as to finally determine whether the first column data is the X-axis data or the Y-axis data according to whether the identified first direction is the X-axis direction or the Y-axis direction.

[0338] In the chart display method in the writing scenario without table lines, the principle of drawing the chart in the embodiment is to obtain divided cells by performing cell processing on all writing track information of the user, each cell contains writing track information, the data content in each cell is obtained by using a handwriting recognition algorithm to recognize the writing track information in each cell, and after recognizing the data content in each cell, i.e., each data content, each data group is determined according to the data contents, and each data group is drawn according to the chart type. It should be noted that the table data contains the positions of the cells and the data contents in the cells, wherein the cell positions are used to determine which cells are used as a data group, and the connection order or arrangement order of the data group, and the data contents are used to determine the position of the specific data group in the coordinate axis or the size of the data group in the chart or the height of the data group in the chart.

[0339] In some embodiments, in the writing scenario without table lines, the table data written by the user includes the titles of the coordinate axes and / or data groups; the table generated in the embodiment can determine whether to add and display the titles of the coordinate axes in the generated table according to whether the table data contains the titles of the coordinate axes. It should be noted that the embodiment determines whether the table data contains the titles of the coordinate axes by a preset manner, for example, the embodiment presets the data in the top row of the table as the titles of the coordinate axes, or presets the data in the leftmost column as the titles of the coordinate axes, and the user writes the titles of the coordinate axes in the top row or the leftmost column in the case of knowing in advance the manner of setting the titles of the coordinate axes by the electronic whiteboard. In the implementation, the titles of the coordinate axes and the data contents in the table data are determined by any of the following implementation manners:

[0340] Manner 1: the content in the preset row in the content written by the user is determined as the title of the coordinate axis, and the data content in each other cell is determined as the data content;

[0341] In the implementation, when drawing the title of each coordinate axis, the data content in the first row of each cell can be used as the title of each coordinate axis, and the data content in the other cells can be used as the data content.

[0342] Manner 2: the content in the preset column in the content written by the user is determined as the title of the coordinate axis, and the data content in each other cell is determined as the data content;

[0343] In the implementation, when drawing the title of each coordinate axis, the data content in the first column of each cell can be used as the title of each coordinate axis, and the data content in the other cells can be used as the data content.

[0344] Option 3, determine the data content in each cell as the data content.

[0345] In an implementation, the title and the data content of each coordinate axis can not be distinguished, and the data content in the cell is uniformly determined as the data content to draw the chart.

[0346] In some examples, the chart is drawn according to the table data through the following process:

[0347] Process 1, determine the chart type according to the chart drawing instruction.

[0348] In an implementation, the chart drawing instruction and the chart type are in a one-to-one correspondence.

[0349] Optionally, the chart type in the embodiment includes, but is not limited to, at least one of a line chart, a pie chart, a histogram, a column chart, and a bar chart.

[0350] Optionally, the chart drawing instruction in the embodiment includes, but is not limited to, at least one of a touch gesture and a touch instruction. The touch gesture includes at least one of a drawing gesture and a multi-finger touch gesture, and the touch instruction includes a click instruction.

[0351] In some examples, the touch gesture includes, but is not limited to, at least one of a double-arrow drawing instruction, a circle drawing instruction, a polygon drawing instruction, a cylindrical drawing instruction, and a rectangular drawing instruction. It can be easily understood that the user can draw a double arrow on the display interface or the chart interface to trigger the generation of a line chart, or the user can draw a circle on the display interface or the chart interface to trigger the generation of a pie chart, or the user can draw a rectangle on the display interface or the chart interface to trigger the generation of a histogram, and a drawing button can also be clicked on the display interface or the chart interface or the writing interface to trigger the corresponding chart drawing.

[0352] In some examples, the chart drawing instruction includes an instruction triggered by the user after stopping writing and waiting for a preset time in a smart chart mode of a known chart type.

[0353] In some examples, the chart drawing instruction includes at least one of a double-arrow drawing instruction, a circle drawing instruction, a polygon drawing instruction, a cylindrical drawing instruction, and a rectangular drawing instruction.

[0354] Process 3, draw a chart corresponding to the chart type according to each data group corresponding to the content written by the user.

[0355] Optionally, the content written by the user is divided by column to determine a plurality of data groups, or the content written by the user is divided by row to determine a plurality of data groups.

[0356] The content of any column written by the user is determined as a data group; or the content of any row written by the user is determined as a data group.

[0357] Optionally, according to a preset corresponding relationship between each row and the coordinate axis, the content of each column written by the user is determined as each data group; or according to a preset corresponding relationship between each column and the coordinate axis, the content of each row written by the user is determined as each data group.

[0358] Optionally, the content located at a preset row in the content written by the user is determined as the title of each coordinate axis, and the data content in each cell is determined as data content; or the content located at a preset column in the content written by the user is determined as the title of each coordinate axis, and the data content in each cell is determined as data content.

[0359] Optionally, the data content in each cell is determined as data content.

[0360] In some examples, if there is a title of each coordinate axis, the chart can be drawn according to the chart type and the data groups, and the title of each coordinate axis is added at the position of the corresponding coordinate axis. If there is no title of each coordinate axis, the chart is directly drawn according to the data groups. The embodiment can draw one or more types of charts, and different types of charts can be determined according to different received chart drawing instructions of the user.

[0361] It should be noted that if a line chart is drawn, each data group determined can be understood as each coordinate point, and each coordinate point is connected according to the order of the X-axis or the Y-axis to draw a line chart. If a histogram is drawn, each data group determined can be understood as each coordinate point, and the height of each coordinate point is determined according to the coordinate value of the Y-axis in each coordinate point to draw a histogram. If a pie chart is drawn, each data in each data group determined corresponds to each object, and the pie chart is drawn by using the proportion of each data in the total sum of all data.

[0362] As shown in FIG. 8, Figure 4 In some examples, if the chart type is a line chart, an X-Y coordinate axis is drawn, and each data group is marked on the drawn X-Y coordinate axis. At this time, each data group can be regarded as a coordinate point, and each coordinate point is connected in order of the coordinate of the X-axis from small to large, or each coordinate point is connected in order of the coordinate of the Y-axis from small to large, and finally a line chart is obtained.

[0363] As shown in FIG. 9, Figure 5As shown in some examples, if the chart type is a histogram, an X-Y coordinate axis is drawn, and each coordinate point is marked on the drawn X-Y coordinate axis. At this time, each data group can be taken as a coordinate point, and a rectangle can be drawn according to the distance of each coordinate point to the X axis or the distance of each coordinate point to the Y axis. The height of the rectangle is the distance of the coordinate point to the X axis or the distance of the coordinate point to the Y axis, and the width of the rectangle is a preset value.

[0364] As shown in some examples, if the chart type is a pie chart, each data group contains one data content, the size of each data content is determined in the proportion of the sum of all data contents, and a pie chart is drawn according to the proportion of each data content. Figure 6

[0365] In some embodiments, the chart drawing instruction includes an instruction triggered by the user in the intelligent drawing chart mode of the known chart type after stopping writing and waiting for a preset time.

[0366] In some embodiments, in response to the user's editing instruction in the intelligent drawing chart mode of the known chart type, a preset chart is displayed in the display area, wherein the display style of the preset chart is determined according to the known chart type.

[0367] In some embodiments, when the user selects a chart type, in the intelligent drawing chart mode of the known chart type, if the user stops writing and waits for a preset time, it is considered that the user has written the required content in the writing prompt table. The content written by the user can be recognized and a chart can be drawn, and then the drawn chart is displayed.

[0368] In some embodiments, the present embodiment can also provide a user with a guide template, and the user can fill in the table content according to the content of the guide template, so as to standardize the user's table content filling and improve the recognition accuracy. In some embodiments, after determining the chart type, a guide template corresponding to the chart type is displayed in the display area of the display screen, and the guide template is used to guide the user to write table content according to the writing specification corresponding to the chart type.

[0369] In some embodiments, a table template is displayed in a first partition of the guide template, and a chart template is displayed in a second partition of the guide template. The table template contains preset content, and the chart template includes a chart corresponding to the preset content.

[0370] In some embodiments, if it is determined that the user stops writing and still does not write after waiting for a preset time, the writing track information of the display area of the display screen is recognized to obtain a data recognition result.

[0371] ​In some embodiments, the writing track information of the display area of the display screen is identified, and the data recognition result is obtained.

[0372] In some embodiments, in response to a smart drawing chart starting instruction triggered by a user in the first display interface of the writing software, a second display interface in a smart drawing chart mode is displayed in the display area.

[0373] After drawing a chart in the second display interface and displaying the chart, in response to a plug-in instruction of a user, the chart of the second display interface is inserted into the first display interface of the writing software for display.

[0374] The writing software in the embodiment is used to represent that a user can write in a display interface through a stylus or a finger, and the content written by the user is displayed in real time. The writing software includes but is not limited to writing function, recognition function of touch signal, recognition function of stylus and other additional functions. The writing function includes but is not limited to writing, erasing, marking, annotating, clearing and the like. The writing software in the embodiment includes a software entity with basic writing function. The functions of the writing software in the embodiment other than the basic writing function are not limited.

[0375] If the user adds annotation information related to the chart in the area where the chart is located after the chart is displayed, in response to a plug-in instruction of a user, the chart and the annotation information are inserted into the first display interface for display.

[0376] In some embodiments, the smart drawing chart starting instruction in the embodiment includes but is not limited to at least one of a touch instruction and a touch gesture. The touch instruction includes but is not limited to at least one of clicking, single clicking and double clicking. The touch gesture includes but is not limited to at least one of a writing instruction and a drawing instruction formed by a finger or a stylus of a user.

[0377] In some embodiments, when the smart drawing chart starting instruction is a second touch gesture, a second display interface in a smart drawing chart mode is displayed in the display area, including:

[0378] A second graph drawn by a user in the first display interface of the writing software is received. The second graph is a second graph generated according to the second touch gesture.

[0379] The second graph triggers the display of the second display interface in the smart drawing chart mode in the display area.

[0380] In the embodiment, after a user draws a second graph in the first display interface of the writing software, the second display interface in the smart drawing chart mode is triggered to enter.

[0381] In some embodiments, after receiving the user drawing the second figure on the first display interface of the writing software, the processor identifies the non-standard second figure drawn by the user as a standard second figure, for example, a rectangle with edges that are not absolutely straight. After the processor performs the identification, if it is determined to be a rectangle, the processor controls the display screen to display a standard rectangle. Meanwhile, the processor can also generate a candidate menu on the first display interface, for example, beside the standard rectangle. The candidate menu contains a first start icon corresponding to the second figure. In response to the user's touch operation on the first start icon, the processor triggers the display of a second display interface of a chart type corresponding to the second figure on the display area.

[0382] In some embodiments, after the user draws the second figure on the first display interface of the writing software, the processor generates a candidate menu on the first display interface. The candidate menu contains a first start icon. The first start icon is used to start a second display interface of a chart type corresponding to the second figure. Meanwhile, different second figures drawn by the user are identified by the processor. Different first start icons are generated for the different second figures. Clicking the first start icon enters the second display interface. The chart type displayed in the second display interface corresponding to the different first start icons is also different. The clicking selection instruction of the user on the first start icon can also be understood as a chart drawing instruction.

[0383] In some embodiments, in the present embodiment, the second figure drawn by the user on the first display interface has different shapes. The corresponding chart type is determined. The first start icon in the candidate menu is also different according to the shape drawn by the user. The icon corresponding to the chart type of the second figure is displayed in the candidate menu. When the touch operation of the user on the icon is received, the second display interface of the corresponding chart type is entered. Specific embodiments are shown as follows:

[0384] If the second figure is a cylinder, the first start icon is a column icon. In response to the touch operation of the user on the column icon, the second display interface corresponding to the column chart is triggered to be displayed.

[0385] If the second figure is a rectangle, the first start icon is a histogram icon. In response to the touch operation of the user on the histogram icon, the second display interface corresponding to the histogram chart is triggered to be displayed.

[0386] If the second figure is a circle, the first start icon is a pie icon. In response to the touch operation of the user on the pie icon, the second display interface corresponding to the pie chart is triggered to be displayed.

[0387] If the second figure is a polygon, the first start icon is a radar icon. In response to the touch operation of the user on the radar icon, the second display interface corresponding to the radar chart is triggered to be displayed.

[0388] If the second graphic is an arrow, the first start icon is a polyline icon, and in response to a touch operation of the polyline icon by the user, a second display interface corresponding to the polyline icon is triggered to be displayed.

[0389] In some embodiments, the candidate menu further includes a second start icon, and the second start icon includes an analysis template icon. The analysis template icon includes, but is not limited to, a SWOT (enterprise strategy analysis) icon, a KANO (KANO model, a useful tool for classifying and prioritizing user needs, based on analyzing the impact of user needs on user satisfaction, reflecting the nonlinear relationship between product performance and user satisfaction) icon, and the like. After the second start icon is displayed in the candidate menu, the following implementation steps are further performed:

[0390] In response to a touch operation of the analysis template icon by the user, an analysis template corresponding to the analysis template icon is inserted into the first display interface.

[0391] In implementation, a SWOT icon is displayed in the candidate menu of the first display interface, and after the SWOT icon is clicked by the user, a corresponding analysis template is inserted into the first display interface. The user can perform editing operations on the analysis template and add corresponding content.

[0392] In some implementations, for example, the user draws a circle on the first display interface, a candidate menu is displayed on the first display interface, and a pie chart icon and a KANO icon are displayed in the candidate menu. If the user clicks the pie chart icon, a second display interface corresponding to the pie chart in the intelligent chart drawing mode is entered, and the user can draw the pie chart on the second display interface. If the user clicks the KANO icon, a corresponding analysis template is inserted into the first display interface, and the user can perform writing and editing operations on the analysis template. Based on the same principle, other graphic implementations also belong to the protection scope of the present disclosure, and will not be described here.

[0393] In some examples, the present embodiment can also provide a method for partitioning a display area to distinguish a writing area for receiving writing trajectory information of a user and a chart area for displaying a chart in response to a chart drawing instruction of the user. The specific implementation of the method is as follows:

[0394] A writing area and a chart area in a display area of the display screen are determined, wherein the writing area is configured to receive writing trajectory information of a user, and the chart area is configured to display a chart corresponding to the writing trajectory information.

[0395] It is easy to understand that the writing area is used to receive the writing trajectory information and other touch operations of the user, and the user can perform normal writing, clicking and other control operations in the writing area. The chart area is used to display the chart. When the user writes the chart content to be drawn in the writing area, the chart corresponding to the chart content is displayed in the chart area. By partitioning the display area, the writing trajectory information received by the writing area can be better distinguished and displayed, and the drawn chart can be displayed in the chart area which is different from the writing area. Thus, the user experience is improved.

[0396] In order to display the chart in the chart area, after receiving the touch gesture (writing trajectory information) of the user in the chart area and waiting for a preset time, the drawn chart is triggered to be displayed in the chart area. In the writing area, in order to ensure the normal writing function of the writing area, other functions (such as chart display function) are not triggered after receiving the writing trajectory information of the user in the writing area and waiting for a preset time, but the next writing trajectory information of the user is continued to be received. Thus, the functions of the writing area and the chart area are effectively distinguished.

[0397] In some examples, the writing trajectory information of the writing area is identified; in response to a chart drawing instruction of the user, a chart of a chart type corresponding to the chart drawing instruction is drawn according to a data identification result, and the drawn chart is displayed in a chart area.

[0398] The embodiment can display at least one of a writing prompt table and a preset chart in the display area of the display screen. The data content in the writing prompt table is empty, and the user can write the table content in each cell of the writing prompt table. In an optional implementation, a writing area and a chart area in the display area of the display screen are determined, wherein the writing area is configured to receive the writing trajectory information of the user, and the chart area is configured to display a chart corresponding to the writing trajectory information. The writing prompt table corresponding to the chart type is displayed in the writing area of the display area, and / or the preset chart corresponding to the chart type is displayed in the chart area of the display area. The content in the preset chart is also empty, that is, only the chart style is displayed without displaying the chart content. For example, the preset chart of the pie chart type can be a pie chart without partitioning.

[0399] In some embodiments, after determining the chart type corresponding to the chart selection instruction of the user in the intelligent drawing chart mode, or after displaying the guide template corresponding to the chart type in the display area of the display screen, the processor is specifically further configured to perform:

[0400] In response to an editing instruction of a user in the intelligent drawing chart mode of the known chart type, a writing prompt table and a preset chart are displayed in the display area; and writing track information written by the user in the writing prompt table is received.

[0401] It should be noted that the writing prompt table and the preset chart are both empty at this time. The writing prompt table is used to provide an empty table for the user to input table content, and the preset chart is used to provide a chart style for the user to draw content on the preset chart according to the table content input by the user. The number of rows and the number of columns of the writing prompt table are fixed, or the number of rows and the number of columns of the writing prompt table are set according to the parameters input by the user, and the display style of the preset chart is determined according to the chart type corresponding to the guide template.

[0402] In some examples, the chart area is further configured to receive a chart drawing instruction of the user. In some examples, after receiving the chart drawing instruction of the user in the chart area and waiting for a preset time, the writing track information of the writing area is identified in response to the chart drawing instruction of the user; a chart of a chart type corresponding to the chart drawing instruction is drawn according to the data identification result, and the drawn chart is displayed in the chart area.

[0403] In implementation, after determining the writing area and the chart area in the display area of the display screen, a chart drawing instruction of the user is received, where the chart drawing instruction can be a chart drawing instruction triggered by the user in the chart area or a chart drawing instruction triggered by the user in the writing area.

[0404] It should be noted that if the chart drawing instruction is a touch gesture and the user triggers the chart drawing instruction in the chart area, for example, the user draws a double arrow in the chart area, the electronic whiteboard in the embodiment is configured to have the functions of character recognition and figure recognition. In order to distinguish the writing track information of the user in the writing area from the writing track information of the user in the chart area, when the writing track information is identified, the writing track information of the writing area is subjected to character recognition and / or digital recognition, and the writing track information of the chart area is subjected to figure recognition, which is mainly configured to recognize at least one of an arrow, a circle and a rectangle. Different identification methods can be used to more quickly and accurately identify the writing track information in the writing area, and can quickly identify the chart drawing instruction of the user in the chart area and quickly determine the type of the drawn chart.

[0405] In some embodiments, the display area can also be divided into the writing area and the chart area in the following manner:

[0406] In response to an editing instruction of a user in the intelligent drawing chart mode of the known chart type, the display area is divided into a writing area and a chart area, where the chart area is used to display a chart corresponding to the chart type.

[0407] In some embodiments, if the user has selected a chart type and is in the chart mode of the known chart type, an editing instruction can be triggered directly to divide the display area into a writing area and a chart area, so as to facilitate the user to edit, write, etc. in the writing area, and display the writing track information of the writing area in the chart area.

[0408] In some embodiments, a writing area and a chart area in the display area of the display screen are determined, wherein the writing area is configured to receive the writing track information of the user, and the chart area is configured to display the chart corresponding to the writing track information; a writing prompt table corresponding to the chart type is displayed in the writing area of the display area, and / or a preset chart corresponding to the chart type is displayed in the chart area of the display area. In some embodiments, the user can write content in each cell of the writing prompt table, and draw the content on the preset chart according to the written content.

[0409] In some embodiments, the user can also drag the content of the writing area to change the position of the content of the writing area, and can also drag the content of the chart area to change the position of the content of the chart area.

[0410] In some embodiments, in response to the user's dragging instruction on the writing area, the content of the writing area is moved in a corresponding direction; or, in response to the user's dragging instruction on the chart area, the content of the chart area is moved in a corresponding direction.

[0411] In some embodiments, the writing prompt table in the writing area in the present embodiment is draggable, and in response to the user's dragging instruction on the writing area, the writing prompt table is moved in a corresponding direction; or, the preset chart in the chart area is also draggable, and in response to the user's dragging instruction on the chart area, the preset chart is moved in a corresponding direction.

[0412] In some embodiments, after receiving the writing track information written by the user in the writing prompt table, if it is determined that the user stops writing in the writing area and waits for a preset time, the writing track information in the writing prompt table is identified to obtain a data recognition result; the data recognition result is drawn on the preset chart to obtain a chart corresponding to the data recognition result.

[0413] In some embodiments, after obtaining the chart corresponding to the data recognition result, the following any one of the embodiments is further included:

[0414] (1) in response to the user's modification instruction, the corresponding writing track information is modified, and the chart is updated according to the modified writing track information;

[0415] In implementation, if the user has partially modified the existing content in the writing area, the existing content in the writing area will be replaced by the modified writing track information according to the modified writing track information, and the chart will be redrawn using the modified content in the writing area, and the existing chart in the chart area will be updated using the redrawn chart.

[0416] (2) in response to a content addition instruction of the user, adding corresponding writing track information, updating the chart according to the added writing track information;

[0417] In implementation, if the user has added new content on the basis of the existing content in the writing area, the new content will be displayed in the writing area, and the chart will be redrawn according to the writing track information of the new writing area, and the redrawn chart will be updated and displayed in the chart area. The new content includes but is not limited to reverse insertion content, that is, inserting new content before or in the middle of the original content, for example, inserting 0 in the middle of the original 1 2, then the new content becomes 1 0 2, or inserting 3 before 12, then the new content becomes 3 1 2.

[0418] (3) in response to a stroke addition instruction of the user, adding strokes of corresponding writing track information, updating the chart according to the writing track information after adding strokes;

[0419] In implementation, strokes can be added to the original text or number, the content written by the user can be recognized according to the added strokes, the chart can be redrawn according to the writing track information after adding strokes, and the original chart can be updated using the redrawn chart.

[0420] In some embodiments, the position of the newly added writing track information and the overlapping area with the existing writing track information can be used to determine whether the newly added writing track information is a modification of the original content, an addition to the original content, or an addition to the original stroke. In implementation, for example, if the position of the newly added writing track information overlaps with the position of the existing writing track information, and the overlapping area is greater than a threshold, it is determined that the newly added writing track information is a modification of the original content; if the position of the newly added writing track information overlaps with the position of the existing writing track information, and the overlapping area is not greater than a threshold, it is determined that the newly added writing track information is an addition to the original stroke; if the position of the newly added writing track information does not overlap with the position of the existing writing track information, and the position of the newly added writing track information is before or in the middle of the position of the existing writing track information, it is determined that the newly added writing track information is new content inserted before or in the middle of the original content.

[0421] (4) in response to an erasing instruction of the user, erasing corresponding writing track information, updating the chart according to the erased writing track information;

[0422] In some embodiments, the user's erasing instruction includes, but is not limited to, a palm erasing instruction or an eraser instruction; wherein the palm erasing instruction refers to an instruction triggered by the user when simulating the eraser erasing the corresponding content in the writing area by the palm, and the eraser instruction refers to an instruction triggered by the user clicking the eraser option in the menu bar.

[0423] (5) In response to the user's clear screen instruction, all writing track information is cleared.

[0424] In some embodiments, a one-key clear screen can also be provided, and by triggering the clear screen instruction, all writing track information in the writing area is cleared, and the chart in the chart area can also be retained.

[0425] In some embodiments, after the display area is divided into the writing area and the chart area, the user can also execute any of the following instructions on the chart area:

[0426] In response to the user's full screen preview instruction, the chart area is displayed in full screen; or,

[0427] In response to the user's annotation operation in the chart area, the content corresponding to the annotation operation is displayed; or,

[0428] In response to the user's erasing operation in the chart area, the content corresponding to the erasing operation in the chart area is cleared; or,

[0429] In response to the user's clear screen operation in the chart area, the content in the chart area is cleared; or,

[0430] In response to the user's saving operation in the chart area, the content in the chart area is saved; or,

[0431] In response to the user's switching instruction on the chart type, the current chart type is switched; or,

[0432] In response to the user's insert back instruction on the chart area, the content of the chart area of the current display interface is inserted into the previous display interface.

[0433] In some examples, after determining the writing area and the chart area in the display area of the display screen, the user's writing track information is received in the writing area, in response to the user's chart drawing instruction in the chart area, the writing track information in the writing area is identified, a chart of a corresponding type is drawn according to the table data determined according to the data identification result, and the chart is displayed in the chart area.

[0434] The generated chart area is a partial area or the entire area of the display area of the electronic whiteboard. If the generated chart area is a partial area of the display area, the remaining area of the display area is a writing area for receiving writing track information and touch operations of the user. The chart area is used to receive chart drawing instructions of the user, and perform chart display, wherein the chart drawing instructions include at least one of a touch gesture and a touch instruction, which are not limited by the present disclosure.

[0435] In some examples, the present embodiment can divide the display area into a writing area and a chart area in any of the following ways:

[0436] Method 1: The display area is divided into a writing area and a chart area in advance.

[0437] In this way, the device directly displays the writing area and the chart area in the display area after starting.

[0438] The preset program directly displays the writing area and the chart area in the display area after starting.

[0439] In implementation, for example, in the intelligent chart drawing mode of the electronic whiteboard, the display area is divided into a writing area and a chart area in response to the intelligent chart drawing mode triggered by the user, or the display area is divided into a writing area and a chart area in response to the editing instructions of the user in the intelligent chart drawing mode of the known chart type.

[0440] Method 2: The display area is divided into a writing area and a chart area after receiving a partition button triggered by the user.

[0441] In this way, before receiving the partition button triggered by the user, the user can normally write in all areas of the electronic whiteboard, and when the user triggers the partition button, a new display area is generated, which is divided into a writing area and a chart area.

[0442] Method 3: The display area is divided into a writing area and a chart area after determining that the user has finished writing.

[0443] In this way, the writing area includes writing track information obtained by the user.

[0444] Meanwhile, in any of the above methods, a partition label can be displayed in each partition of the display area by labeling, so as to distinguish the partitions for the user, for example, “writing area” can be displayed in the writing area, and “chart area” can be displayed in the chart area.

[0445] In some examples, the present embodiment divides the display area into a writing area and a chart area, and the relationship between the writing area and the chart area includes but is not limited to any or multiple of the following:

[0446] 1. AsFigure 7A As shown in the figure, the positions of the writing area and the chart area do not overlap;

[0447] In the second aspect, the writing area and the chart area have a same shape. Figure 7B As shown in the figure, the chart area is above the writing area and does not block the content in the writing area.

[0448] In the third aspect, the writing area and the chart area have an axial symmetry relationship.

[0449] In the fourth aspect, the writing area and the chart area have a central symmetry relationship. Figure 7C

[0450] In the fifth aspect, the writing area and the chart area have different shapes; or, the writing area and the chart area have a same shape. Figure 7D

[0451] In the sixth aspect, the writing area and the chart area have different backgrounds; or, the writing area and the chart area have a same background. Figure 7E

[0452] In the seventh aspect, the writing area and the chart area have different sizes; or, the writing area and the chart area have a same size.

[0453] It should be noted that the relationship between the writing area and the chart area is only an example, and other relationships between the writing area and the chart area also belong to the protection scope of the present disclosure based on the same inventive concept, which is not limited here.

[0454] In some examples, the display area is divided into a writing area and a chart area in the embodiment, and each of the writing area and the chart area occupies half of the display area, i.e., the display area is evenly divided into the writing area and the chart area. Alternatively, the display area is divided into the writing area and the chart area according to a preset proportional relationship between the area of the writing area and the area of the chart area. The shape and size of the writing area and the chart area can be the same or different, which is not limited here.

[0455] In some examples, the chart area in the embodiment can be determined in any of the following ways:

[0456] In the first way, the chart area in the display area of the display screen is determined according to predefined position information.

[0457] In the implementation, in this way, after the electronic whiteboard is started or a preset program is started, the display area is divided into the writing area and the chart area, and the chart area can be placed on the right side, the left side, the upper side or the lower side of the writing area.

[0458] In the second way, the chart area corresponding to a first partition instruction of a user in the display area is determined in response to the first partition instruction.​​​

[0459] Optionally, one way is to pre-set different first partition instruction corresponding chart area, according to the received first partition instruction to determine the corresponding chart area of the first partition instruction; in this way, when the user sends the first partition instruction in the display area, the display area will be divided into writing area and chart area, and the position of the chart area is corresponding to the first partition instruction, if no user's first partition instruction is received, the display area is regarded as the writing area for normal writing. Wherein, different first partition instruction can be triggered by different keys, which is not limited here. Another way is to pre-set chart area, after receiving the first partition instruction, directly display the pre-set chart area. In this way, when the user sends the first partition instruction in the display area, the display area will be divided into writing area and chart area, and the position of the chart area is fixed.

[0460] In the implementation, when the user does not have the need of drawing, the user can normally use the function of the electronic whiteboard for normal writing interaction, when the user needs to draw a chart, the user can trigger the keys on the current display area or trigger the electronic whiteboard by other ways such as the keys of the stylus to divide the display area. After the partition, the user can still normally write in the writing area, if the chart drawing instruction is triggered in the chart area and the preset time is waited, the chart will be displayed in the chart area.

[0461] In some examples, the user can also divide the display area again after partitioning, after displaying the chart in the chart area, the writing area and the chart area are processed again by the following way, so as to convert the table content written by the user again into corresponding chart for display, at this time, the writing area includes two table contents written by the user, and the corresponding chart area includes two charts corresponding to the two table contents written by the user. The specific process is as follows:

[0462] In response to the second partition instruction of the user, the writing area is divided into a first writing area and a second writing area, and the chart area is divided into a first chart area and a second chart area;

[0463] It should be noted that the positional relationship of the first writing area and the second writing area obtained by the division in this embodiment can be adjacent, or can be separated by a chart area. Similarly, the positional relationship of the first chart area and the second chart area can be adjacent, or can be separated by a writing area. For example, taking the case of dividing both the writing area and the chart area as an example, the first writing area, the second writing area, the first chart area and the second chart area obtained are in the order of first writing area, second writing area, first chart area and second chart area from left to right in the display area; or in the order of first writing area, first chart area, second writing area and second chart area from left to right; or in the order of first writing area, first chart area, second chart area and second writing area from left to right; or in the order of first chart area, first writing area, second writing area and second chart area from left to right. The positional relationship of the writing area and the chart area obtained by the division is not limited too much in this embodiment.

[0464] The first writing area is configured to display writing track information received before the division, the second writing area is configured to display writing track information received in the second writing area after the division, the first chart area is configured to display a chart corresponding to the writing track information of the first writing area, and the second chart area is configured to display a chart corresponding to the writing track information of the second writing area.

[0465] In a specific implementation, after the writing area is divided into the first writing area and the second writing area, the second writing area can receive writing track information of a user, the user can input content of a table to be generated in the second writing area, and the first writing area still retains content written by the user before the division. Optionally, the first writing area can also receive writing track information of the user; the first chart area still displays a chart corresponding to the content written by the user before the division, and the second chart area displays a chart corresponding to the newly written table content of the user. Thus, the user of the conference can simultaneously watch twice table data and corresponding charts, so as to facilitate comparison and improve the conference interaction experience of the user.

[0466] It should be noted that before the writing area is divided into the first writing area and the second writing area after receiving the second partition instruction of the user, the track information in the writing area can be subjected to scaling, translation and the like. After responding to the second partition instruction of the user, the original track information in the writing area is moved to the first writing area, and the original track information can be scaled according to the size of the first writing area.

[0467] In some examples, the embodiment also provides a method for modifying writing track information and performing chart comparison display. The design idea of the method is to obtain modified writing track information, determine data content in a corresponding modified table, and then redraw a chart according to all modified data content, so as to display the redrawn chart and an original chart before modification in the same coordinate axis or different pie charts, compare data content in the table before modification and data content in the table after modification, and visually compare through the chart form, thereby effectively improving the conference interaction experience of a user.

[0468] In some examples, in response to a modification instruction of the user, the modified writing track information is obtained and stored in a first storage area, wherein the first storage area is different from a storage area in which the writing track information before modification is located.

[0469] In implementation, by storing the original writing track information and the modified writing track information in different storage areas, when identifying the writing track information, the writing track information can be quickly obtained from different storage areas, so that the modified writing track information and the writing track information before modification are distinguished during identification.

[0470] In some examples, the modification instruction of the user in the embodiment includes, but is not limited to, at least one of an instruction triggered by a different pen head of a stylus, an instruction triggered by a different key of the stylus, and an instruction triggered by a switching button of a display area.

[0471] In implementation, when the user modifies the original writing content in the writing area, the embodiment determines whether the writing track is modified through the following manner:

[0472] Manner 1: determining that the writing track information is modified according to a received writing switching instruction of the stylus;

[0473] The received writing switching instruction of the stylus is determined through the following manner:

[0474] Manner 1-1: determining the received writing switching instruction of the stylus according to a received writing instruction of a different pen head of the stylus;

[0475] In implementation, if a double-head stylus is used, the writing instructions triggered by different pen heads of the double-head stylus are different. If the first pen head is used when writing in the writing area for the first time, and the second pen head is used when modifying the writing content, after the electronic whiteboard receives the writing instruction triggered by the second pen head, it is determined that the writing switching instruction of the stylus is received, and it is determined that the writing track information is modified at this time. The writing track information generated by the second pen head is stored in the first storage area for use when the chart is drawn later.

[0476] The second content is displayed in a manner different from the first content.

[0477] In an implementation, if the first stylus corresponding to the first button is used to perform writing in the writing area and the second stylus corresponding to the second button is used to modify the content of the writing, after the electronic whiteboard receives the writing instruction triggered by the second stylus, it is determined that the writing switching instruction of the stylus is received, and it is determined that the writing track information is modified. The writing track information generated by the second stylus is stored in the first storage area for use in drawing a chart later.

[0478] The second content is displayed in a manner different from the first content.

[0479] In some examples, the writing track information is determined to be modified according to a switching instruction received by the user triggering the switching button of the display area. In an implementation, the switching button is arranged in the chart area. When the user opens the switching button (for example, clicks the switching button once), the writing track information is stored in the first storage area. When the user closes the switching button (for example, clicks the switching button twice), the writing track information is stored in a storage area other than the first storage area.

[0480] In some examples, after responding to the modification instruction of the user, the embodiment can also display the content modified by the user in a distinguished manner. Specifically, the embodiment comprises the following steps:

[0481] determining first content before the modification and second content after the modification corresponding to the modification instruction;

[0482] displaying the first content and the second content simultaneously, wherein the display format of the first content and the second content is different.

[0483] The first content and the second content are displayed in different colors, or in different font styles, or in different font sizes, or the first content is marked as deleted and the second content is displayed in bold, or the first content and the second content are displayed in the manners as shown in Figure 8A 、 Figure 8B

[0484] ​In some examples, after obtaining the modified writing track information and storing it into the first storage area, if the user's chart drawing instruction is received again, all the modified writing track information is recognized and a chart is drawn, wherein the coordinate axes used by the chart are the same as those used by the chart drawn by the original all writing track information before modification, and on the basis of retaining the original displayed chart, the chart corresponding to the modified writing track information is drawn again in the coordinate axes of the chart to provide the user with data comparison and improve the conference interaction experience.

[0485] In some examples, after obtaining the modified writing track information and storing it into the first storage area, the apparatus is further configured to perform the following steps:

[0486] Step 1, obtaining the modified writing track information from the first storage area, and drawing a first chart according to the writing track information before modification and the modified writing track information.

[0487] In some examples, after obtaining the modified writing track information, if the user's chart drawing instruction is received again, the first chart is generated again in response to the user's chart drawing instruction, wherein the first chart includes first table data corresponding to the writing track information before modification and second table data corresponding to the modified writing track information.

[0488] In some examples, the first chart is drawn by the following steps:

[0489] Step 1-1, determining a first cell corresponding to the modified writing track information from each cell divided from the writing track information before modification.

[0490] Step 1-2, replacing the writing track information in the first cell before modification with the modified writing track information.

[0491] Step 1-3, recognizing the writing track information in each cell after replacement to obtain data content in each cell. In some examples, the writing track information can be recognized by a handwriting recognition algorithm to obtain the data content in each cell.

[0492] Step 1-4, determining the second table data according to the data content in each cell.

[0493] Step 2, displaying the first table data corresponding to the writing track information before modification and the second table data in the first chart at the same time, wherein the display styles of the first table data and the second table data are different.

[0494] In some examples, as Figure 9AAs shown, if the chart type corresponding to the chart drawing instruction is a line chart, the first table data and the second table data are displayed simultaneously on the same coordinate axis.

[0495] As shown, if the chart type corresponding to the chart drawing instruction is a line chart, the first table data and the second table data are displayed simultaneously on the same coordinate axis. Figure 9B As shown, if the chart type corresponding to the chart drawing instruction is a histogram, the first table data and the second table data are displayed simultaneously on the same coordinate axis.

[0496] In some examples, after obtaining the modified writing track information and storing it in the first storage area, the second chart and the third chart can also be drawn, which is implemented as follows:

[0497] Obtaining the modified writing track information from the first storage area, drawing a second chart according to the writing track information before modification, and drawing a third chart according to the modified writing track information;

[0498] Displaying the second chart and the third chart simultaneously.

[0499] As shown, if the chart type corresponding to the chart drawing instruction is a line chart, the first table data and the second table data are displayed simultaneously on the same coordinate axis. Figure 9C As shown, if the chart type corresponding to the chart drawing instruction is a histogram, the first table data and the second table data are displayed simultaneously on the same coordinate axis.

[0500] The display styles of the second chart and the third chart are different. In some examples, the display styles include, but are not limited to, at least one of color, shape, and line thickness. In implementation, in order to distinguish the display of the second chart and the third chart, different colors of lines can be used for drawing, or different shapes of lines can be used for drawing, or different thicknesses of lines can be used for drawing, and the present embodiment does not make too many limitations on this.

[0501] In some examples, the recognition of writing track information (including numbers, graphics, titles of various coordinate axes, etc.) in the present embodiment can be implemented by using neural networks such as Convolutional Neural Networks (CNN) and Recurrent Neural Network (RNN), for example, Long Short-Term Memory (LSTM) model, etc.

[0502] In some embodiments, the present embodiment also provides a text recognition model for recognizing writing track information, and the specific recognition process is as shown below:

[0503] inputting the writing track information into a text recognition model for recognition, and outputting data content corresponding to the writing track information; wherein the text recognition model comprises a plurality of BiLSTM network layers and a full connection layer, and each BiLSTM network layer after the first two BiLSTM network layers is connected with at least two outputs, and the full connection layer is connected with at least three outputs.

[0504] The at least two outputs comprise outputs of any two BiLSTM network layers before the arbitrary BiLSTM network layer, and the at least three outputs comprise outputs of any three BiLSTM network layers before the full connection layer.

[0505] In some embodiments, the output of any BiLSTM network layer before the last BiLSTM network layer is used as the input of at least two BiLSTM network layers after the last BiLSTM network layer.

[0506] In some embodiments, the arbitrary BiLSTM network layer is obtained by using a Dropout layer to prune network parameters in a model training process, and the arbitrary BiLSTM network layer comprises a number of hidden layers less than a preset value.

[0507] In some embodiments, the text recognition model comprises four BiLSTM network layers and a full connection layer, the first BiLSTM network layer comprises a first input and a first output, the second BiLSTM network layer comprises a second input and a second output, the third BiLSTM network layer comprises a third input and a third output, and the fourth BiLSTM network layer comprises a fourth input and a fourth output.

[0508] The first input is used to input the writing track information, the second input is connected with the first output, the third input is connected with the first output and the second output, the fourth input is connected with the first output, the second output and the third output, the fourth output is connected with the input of the full connection layer, and the output of the full connection layer is used to output the data content corresponding to the writing track information.

[0509] In some examples, as shown in FIG. 10, a graph drawing method provided by an embodiment of the present disclosure is described in detail in a writing scenario without table lines. Figure 10

[0510] Step 1000, determining a writing area and a graph area of a display area of an electronic whiteboard;

[0511] Step 1001, receiving writing track information of a user in the writing area, determining all writing track information of the writing area after writing is completed, and storing the writing track information in a storage area; ​

[0512] Step 1002, in response to a chart drawing instruction triggered by a user in the chart area, dividing the writing track information in the storage area into individual cells according to a clustering algorithm, and identifying the writing track information in each cell according to a handwriting recognition algorithm to obtain first table data;

[0513] Step 1003, drawing a chart of a chart type corresponding to the chart drawing instruction according to the first table data;

[0514] Step 1004, displaying the drawn chart in the chart area;

[0515] Step 1005, in response to a modification instruction triggered by a user in the writing area, obtaining modified writing track information and storing it in the first storage area;

[0516] Step 1006, again in response to a chart drawing instruction triggered by a user in the chart area, obtaining the modified writing track information from the first storage area, and drawing a first chart according to the writing track information before modification and the modified writing track information, wherein the first chart includes first table data and second table data corresponding to the modified writing track information.

[0517] The display modes of the first table data and the second table data are different. For example, the display colors and line formats are different.

[0518] In some examples, as shown in Figure 11 In a writing scenario without table lines, the embodiment of the present disclosure provides an implementation process for drawing a line chart, as shown below:

[0519] Step 1100, determining a writing area and a chart area of a display area of an electronic whiteboard;

[0520] Step 1101, receiving writing track information of a user in the writing area, and determining to obtain all writing track information of the writing area and store it in a storage area after writing is completed;

[0521] Step 1102, in response to a double-arrow drawing instruction triggered by a user in the chart area, dividing the writing track information in the storage area into individual cells according to an automatic cell algorithm, and identifying the writing track information in each cell according to a handwriting recognition algorithm to obtain first table data;

[0522] Step 1103, drawing a line chart according to the first table data;

[0523] Step 1104, displaying the drawn line chart in the chart area;

[0524] Step 1105, in response to a modification instruction triggered by a user in the writing area, obtaining modified writing track information and storing it in the first storage area;

[0525] In response to the user's instruction of drawing a double arrow in the chart area, the modified writing track information is obtained from the first storage area, and a first line chart is drawn according to the writing track information before modification and the modified writing track information, wherein the first line chart includes first table data and second table data corresponding to the modified writing track information.

[0526] The first table data and the second table data are displayed in different manners.

[0527] In some examples, as shown in FIG. 12, in the writing scenario without table lines, the embodiment of the present disclosure provides an implementation process of drawing a histogram, which is specifically as follows: Figure 12

[0528] Step 1200, determining a writing area and a chart area of a display area of an electronic whiteboard;

[0529] Step 1201, receiving writing track information of a user in the writing area, and determining to obtain all the writing track information of the writing area after the writing is completed and store the writing track information in a storage area;

[0530] Step 1202, in response to a user's instruction of drawing a rectangle in the chart area, dividing the writing track information in the storage area into each cell according to an automatic cell algorithm, and identifying the writing track information in each cell according to a handwriting recognition algorithm to obtain first table data;

[0531] Step 1203, drawing a histogram according to the first table data;

[0532] Step 1204, displaying the drawn histogram in the chart area;

[0533] Step 1205, in response to a user's instruction of modification in the writing area, obtaining modified writing track information and storing the modified writing track information in the first storage area;

[0534] Step 1206, in response to the user's instruction of drawing a rectangle in the chart area again, obtaining the modified writing track information from the first storage area, and drawing a first histogram according to the writing track information before modification and the modified writing track information, wherein the first histogram includes the first table data and second table data corresponding to the modified writing track information.

[0535] The first table data and the second table data are displayed in different manners.

[0536] In some examples, as shown in FIG. 12, in the writing scenario without table lines, the embodiment of the present disclosure provides an implementation process of drawing a histogram, which is specifically as follows: Figure 13

[0537] ​​Step 1300: Determine the writing area and chart area of ​​the electronic whiteboard display area;

[0538] Step 1301: Receive the writing trajectory information of the user in the writing area, determine that writing is completed, obtain all the writing trajectory information in the writing area and store it in the storage area;

[0539] Step 1302: Respond to the user's circular drawing command triggered in the chart area, divide the writing trajectory information in the storage area into each cell according to the clustering algorithm, and recognize the writing trajectory information of each cell according to the handwriting recognition algorithm to obtain the data content in each cell;

[0540] Step 1303: Draw the first pie chart based on the data content in each cell;

[0541] Step 1304: Display the first pie chart in the chart area;

[0542] Step 1305: Respond to the modification command triggered by the user in the writing area, obtain the modified writing trajectory information and store it in the first storage area;

[0543] Step 1306: Respond again to the user's circular drawing command triggered in the chart area, retrieve the modified writing trajectory information from the first storage area, and draw the second pie chart based on the writing trajectory information before and after modification.

[0544] Step 1307: Display the first pie chart and the second pie chart simultaneously, with the first pie chart and the second pie chart displayed in different ways.

[0545] In some embodiments, such as Figure 14 As shown, this embodiment provides a method for displaying charts in a writing scenario with table lines. The specific implementation steps of this method are as follows:

[0546] Step 1400: Respond to the user's chart selection instruction in the intelligent chart mode and determine the chart type corresponding to the chart selection instruction;

[0547] Step 1401: Display the guide template corresponding to the chart type in the display area of ​​the screen. Display the table template in the first section of the guide template and the chart template in the second section.

[0548] Step 1402: In response to the user's editing command in the intelligent charting mode with a known chart type, the display area is divided into a writing area and a chart area. A writing prompt table is displayed in the writing area, and a preset chart is displayed in the chart area.

[0549] Step 1403: Receive the writing trajectory information of the user in the writing prompt table;

[0550] In step 1404, the user stops writing in the intelligent drawing chart mode of the known chart type, waits for a preset time, identifies the writing track information in the writing prompt table, obtains a data recognition result, and draws and displays a chart of the corresponding chart type on the preset chart according to the data recognition result.

[0551] In some embodiments, the data recognition result includes a plurality of data groups, and any one data group includes content written by the user in any column of the writing prompt table or content written by the user in any row of the writing prompt table. In an implementation, the writing track information contained in each cell is determined according to the positional relationship between each track point in the writing track information and the cell in the writing prompt table; the writing track information contained in each cell is identified to obtain the data content of each cell; and the data content of each cell is divided by column to obtain a plurality of data groups, or the data content of each cell is divided by row to obtain a plurality of data groups.

[0552] As shown in FIG. 13, in the writing scenario with table lines, taking a column chart as an example, the following is explained for different interfaces displayed on the electronic whiteboard during the chart display process. Figures 15A-15E

[0553] As shown in FIG. 13, in the writing scenario with table lines, taking a column chart as an example, the following is explained for different interfaces displayed on the electronic whiteboard during the chart display process. Figure 15A As shown in FIG. 13, in the writing scenario with table lines, taking a column chart as an example, the following is explained for different interfaces displayed on the electronic whiteboard during the chart display process.

[0554] As shown in FIG. 13, in the writing scenario with table lines, taking a column chart as an example, the following is explained for different interfaces displayed on the electronic whiteboard during the chart display process. Figure 15B ​As shown, the user triggers an editing instruction in the display interface of the bar chart guide template, and in response to the user's editing instruction in the bar chart intelligent drawing chart mode, the display area is divided into a writing area and a chart area, a writing prompt table is displayed in the writing area, and a preset chart is displayed in the chart area. The data content in the writing prompt table is empty, and the cell in the first row and the first column is not editable. The number of rows and columns of the writing prompt table is fixed, for example, a 3-row and 12-column table can be constructed by 4*13 table lines. The writing prompt table is composed of table lines, and the style of the preset chart is determined according to the preset UI style.

[0555] Optionally, the writing prompt table in the writing area can be dragged, for example, the initial position of the writing prompt table is set, and the writing prompt table can be dragged downward until it cannot be dragged downward when the critical row table can be completely displayed. Wherein, the user can move the writing prompt table by multi-finger touch, for example, the writing prompt table can be moved by 2-4 finger touch.

[0556] As shown, Figure 15C At this time, the user can write content in the writing prompt table, and the content written by the user in the writing prompt table can be drawn into a chart in real time and displayed in the preset chart. Wherein, the basic functions of writing can be set to include hard pen 6.5px, erasing, one-key clearing, exiting, and inserting back instructions, etc., wherein the inserting back instruction is used to insert the content of the chart area of the current display interface into the previous display interface. If the user triggers the inserting back instruction, the chart inserted back is selected by default in the display interface at this time, and operations such as moving, zooming, deleting, copying, and rotating can be performed on the chart.

[0557] The writing rules of the bar chart include but are not limited to: (1) At least 1 grid of legal content is written before the data is generated on the bar chart, and the cell in the first row and the first column cannot be written; (2) The first row writes title 1, corresponding to the legend, if the user does not write the legend, the legend is not presented, wherein the legend in the bar chart represents the column body name; different column bodies can be distinguished by different colors, filling contents, etc.; (3) The first column writes title 2, corresponding to the title on the horizontal coordinate axis, if the user does not write content in the first column, the title 2 is not presented on the horizontal coordinate axis. (4) Write data from the second row and the second column, the data format only supports integer and decimal, the user must write data to generate the corresponding chart, if non-data content is written in the corresponding cell, the corresponding column body is not displayed. (5) The content written in each column is a data group, and after 1s of pen stop, the corresponding chart is generated according to each data group. (6) The drawing of the bar chart is based on the cell with writing content in the lower right corner of the left writing prompt table, and on this basis, if there is a vacancy in the previous cell, 0 is filled, if title 1 is vacant, title 1 is not displayed, and if title 2 is vacant, title 2 is not displayed.

[0558] The user writes and stops for 1s, and then the writing track information is recognized. At this time, the handwriting font written by the user in the writing prompt table is still retained. If the user adds or modifies the data content in the writing prompt table, the writing track information in the writing prompt table is re-recognized after the user stops for 1s. It should be noted that if the writing content in the writing prompt table after recognition does not meet the writing requirement, the column chart remains in the state of not being updated.

[0559] Optionally, after writing, the user can also drag the writing prompt table. At this time, the writing prompt table and the content written in the writing prompt table can be dragged simultaneously. According to the moving position of the writing prompt table, the positions of the writing track information in each cell in the writing prompt table are correspondingly moved, so as to ensure that the position of the content written by the user in the writing prompt table is unchanged.

[0560] Optionally, the display interface can also display switching buttons of different functions. For example, the user can click a formula button to switch the current display interface to a display interface of a formula function. The user can click a line chart button to switch the current display interface to a display interface of a line chart function. Optionally, the display interface can also display editing graphics, such as a writing graphic, an erasing graphic, a quit graphic, a recall graphic, and the like. The user can switch the current writing function through the editing graphics in the process of writing in the writing area, for example, the user clicks the erasing graphic after writing to erase the corresponding content. If the user clicks the quit graphic, a dialog box for querying whether to confirm the exit can be popped up.

[0561] As shown in Figure 15D , the full-screen button of the display interface can also be clicked to preview and display the column chart in full screen, for example, an arrow button can be arranged at the split line between the writing area and the chart area. After the arrow button is triggered, the full-screen mode is entered. The display interface of the column chart in the full-screen mode is as shown in Figure 15E . In the full-screen mode, the chart in the original chart area is displayed in the center, and the size and proportion are consistent with the preset UI design. In the full-screen mode, the user can write in the chart area to mark or annotate. The basic writing functions include a red hard pen, a regular eraser size, one-key screen cleaning, palm erasing, and the like. The content of the current chart area can also be saved, for example, the chart after annotating the chart displayed in the chart area. In the full-screen mode, the right swipe button can also be clicked to exit the full-screen mode and return to the previous mode, that is, return to the editing mode. When the full-screen mode is exited, the content in the chart area is retained. If the smart drawing chart mode is switched to the smart drawing chart mode of other chart types, the content of the chart area in the full-screen mode is still retained.

[0562] As shown in Figures 16A-16EAs shown in the writing scenario with table lines, taking a radar chart as an example, the following is explained for different interfaces displayed by the electronic whiteboard during the chart display process:

[0563] As shown in the writing scenario with table lines, taking a radar chart as an example, the following is explained for different interfaces displayed by the electronic whiteboard during the chart display process: Figure 16A As shown in the writing scenario with table lines, taking a radar chart as an example, the following is explained for different interfaces displayed by the electronic whiteboard during the chart display process:

[0564] As shown in the writing scenario with table lines, taking a radar chart as an example, the following is explained for different interfaces displayed by the electronic whiteboard during the chart display process: Figures 16B-16D As shown in the writing scenario with table lines, taking a radar chart as an example, the following is explained for different interfaces displayed by the electronic whiteboard during the chart display process:

[0565] As shown in the writing scenario with table lines, taking a radar chart as an example, the following is explained for different interfaces displayed by the electronic whiteboard during the chart display process:

[0566] As shown in the writing scenario with table lines, taking a radar chart as an example, the following is explained for different interfaces displayed by the electronic whiteboard during the chart display process: Figure 16EAs shown, at this time, the user can write content in the writing prompt table, and the content written by the user in the writing prompt table can be drawn into a chart in real time in the preset chart and then displayed. The basic functions of writing can include hard pen 6.5px, erasing, one-key clearing, exiting, and inserting back instructions, wherein the inserting back instruction is used to insert the content of the chart area of the current display interface into the previous display interface. If the user triggers the inserting back instruction, at this time, the chart inserted back is selected by default in the display interface, and operations such as moving, zooming, deleting, copying, and rotating can be performed on the chart.

[0567] The writing rules of the radar chart include but are not limited to: (1) After writing at least 1 grid of legal content, the data is generated to the radar chart, and the cell in the first row and the first column cannot be written; (2) The first row writes title 1, corresponding to the legend, if the user does not write the legend, the legend is not presented, wherein the legend in the radar chart represents the polar coordinate name; (3) The first column writes title 2, corresponding to the title of each vertex, if the user does not write content in the first column, the title 2 is not presented on the vertex of the radar chart. (4) The data is written from the second row and the second column, and the data format only supports integers and decimals. The user must write the data to generate the corresponding chart. If non-data content is written in the corresponding cell, the corresponding polar coordinate is not displayed. (5) The content written in each column is a data group. After stopping writing for 1s, each polar coordinate, polar coordinate name, and vertex title of the radar chart are generated according to each data group. (6) The drawing of the radar chart is based on the cell in the lower right corner of the writing prompt table on the left side with writing content. On this basis, if there is a vacancy in the previous cell, 0 is filled. If title 1 is vacant, title 1 is not displayed. If title 2 is vacant, title 2 is not displayed. It should be noted that the vertex of the radar chart is at least 3, the radar chart is at least a polygon, and at most a 12-sided polygon. If the user writes less than or equal to 3 rows of data in the writing prompt table, a 3-row table is used to draw a polygon radar chart, and 0 is filled in the vacant cells in the 3 rows.

[0568] After the user stops writing for 1s, the writing trajectory information is identified, and the handwriting font written by the user in the writing prompt table is still retained. If the user adds or modifies the data content in the writing prompt table, the writing trajectory information in the writing prompt table is re-identified after the user stops writing for 1s. It should be noted that if the writing content in the writing prompt table after identification does not meet the writing requirements, the radar chart remains in the state of not being updated.

[0569] Optionally, after writing, the user can also drag the writing prompt table, at this time, the writing prompt table and the content written in the writing prompt table can be dragged simultaneously, the positions of the writing trajectory information in each cell in the writing prompt table are moved correspondingly according to the moving position of the writing prompt table, and the position of the content written by the user in the writing prompt table is unchanged.

[0570] Optionally, the display interface can also display switching buttons of different functions, for example, the user clicks the formula button to switch the current display interface to the display interface of the formula function, and the user clicks the line chart button to switch the current display interface to the display interface of the line chart function. Optionally, the display interface can also display editing graphics, such as writing graphics, erasing graphics, exit graphics, and undo graphics, so that the user can switch the current writing function through the editing graphics during the writing process in the writing area, for example, the user clicks the erasing graphics after writing to erase the corresponding content. If the user clicks the exit graphics, a dialog box can be popped up to ask the user to confirm the exit.

[0571] The full-screen button of the display interface can also be clicked to preview the radar chart in full screen, for example, arrow buttons can be set at the dividing line between the writing area and the chart area, and after the arrow buttons are triggered, the full-screen mode can be entered. The display interface of the radar chart in the full-screen mode is shown in Figures 17A-17E In the full-screen mode, the chart in the original chart area is displayed in the center, and the size and proportion are consistent with the preset UI design. In the full-screen mode, the user can write in the chart area for marking or annotation, wherein the writing basic functions include red hard pen, regular eraser size erasing, one-key screen clearing, palm erasing, etc. The current chart area content can also be saved, for example, the chart after annotating the chart displayed in the chart area. In the full-screen mode, the right swipe button can also be clicked to exit the full-screen mode and return to the previous mode, that is, return to the editing mode. When exiting the full-screen mode, the content in the chart area is retained, and if the smart drawing chart mode is switched to other smart drawing chart modes in the smart drawing chart mode, the content of the chart area in the full-screen mode is still retained.

[0572] As shown in Figure 17A In the writing scenario with table lines, taking a pie chart as an example, the following describes different interfaces displayed on the electronic whiteboard during chart display:

[0573] As shown in Figure 17BAs shown, the user triggers a chart selection instruction-pie chart in the intelligent drawing chart mode, determines the chart type corresponding to the chart selection instruction as a pie chart in response to the chart selection instruction, and displays a guide template corresponding to the pie chart in the display area. The guide template includes a first partition and a second partition. The first partition is an editing area for displaying a table template. The second partition is a chart preview area for displaying a chart template. The first column in the table template is used to write the title of each partition (i.e., the legend). The second column is used to write the data corresponding to each title. Different legends are represented by sectors with different fillings. The data corresponding to different titles is used to represent the proportion of the sector. An edit button can also be displayed on the display interface, or a close button in the display interface can be clicked to trigger an edit instruction by the user. It should be noted that after the user switches to another table and returns to the pie chart after editing, the edited content is directly displayed, and the guide template of the pie chart is no longer entered. The guide template is only displayed when the intelligent drawing chart function of a known chart type is initially opened.

[0574] As shown in Figure 17C , the user triggers an edit instruction in the display interface of the guide template of the pie chart. In response to the edit instruction of the user in the intelligent drawing chart mode of the pie chart, the display area is divided into a writing area and a chart area. A writing prompt table is displayed in the writing area. A preset chart is displayed in the chart area. The data content in the writing prompt table is empty. The number of rows and columns of the writing prompt table is fixed. For example, the writing prompt table is a 2*13 table. The writing prompt table is composed of table lines. The style of the preset chart is determined according to the preset UI style.

[0575] Optionally, the writing prompt table in the writing area can be dragged. For example, the initial position of the writing prompt table is set. The writing prompt table can be dragged downward until it cannot be dragged downward when the critical row table can be completely displayed. The user can move the writing prompt table by multi-finger touch, for example, by 2-4 finger touch.

[0576] As shown in Figure 17D , the user can write content in the writing prompt table at this time. The content written by the user in the writing prompt table can be displayed in real time after being drawn into a chart in the preset chart. The basic functions of writing can be set, including hard pen 6.5px, erasing, one-key clearing, exiting, and inserting back instructions. The inserting back instruction is used to insert the content of the chart area of the current display interface into the previous display interface. If the user triggers the inserting back instruction, the inserted chart is selected by default in the display interface at this time. The chart can be operated, such as moving, zooming, deleting, copying, and rotating.

[0577] The writing rules of the pie chart include but are not limited to: (1) after writing at least 1 grid of legal content, the data is generated on the pie chart; (2) the first column writes the title (including at least one of Chinese characters, English, numbers, symbols), and the corresponding legend, if the user does not write the legend, the legend is not displayed, wherein the legend in the pie chart represents the title of each partition; (3) the second column writes the data, corresponding to the proportion of each partition, the data format supports integers and decimals, and the user must write the data to generate the corresponding chart, if non-data content is written in the corresponding cell, the corresponding partition is not displayed; (4) the partitions of the pie chart are arranged in the order of the rows in the writing prompt table from the 12 o'clock position clockwise; (5) the content written in each column is a data group, and after the user stops writing for 1s, the title and proportion of each partition are generated according to each data group; (6) the drawing of the pie chart is based on the cell in the lower right corner of the left writing prompt table with writing content, and if there is a vacancy in the previous cell, 0 is filled, and if the title is empty, the title of each partition is not displayed.

[0578] After the user stops writing for 1s, the writing trajectory information is recognized, and the handwriting font written by the user in the writing prompt table is still retained. Figure 17E As shown in FIG. 6B, if the user adds or modifies the data content in the writing prompt table, the writing trajectory information in the writing prompt table is re-recognized after the user stops writing for 1s, and the displayed pie chart is updated. It should be noted that if the writing content in the writing prompt table after recognition does not meet the writing requirements, the pie chart remains unchanged.

[0579] Optionally, after writing, the user can also drag the writing prompt table, at this time the writing prompt table and the content written in the writing prompt table can be dragged simultaneously, and the positions of the writing trajectory information in each cell in the writing prompt table are moved correspondingly according to the moving position of the writing prompt table, so that the position of the content written by the user in the writing prompt table remains unchanged.

[0580] Optionally, the display interface can also display switching buttons of different functions, for example, the user can click the formula button to switch the current display interface to the display interface of the formula function, and the user can click the line chart button to switch the current display interface to the display interface of the line chart function. Optionally, the display interface can also display editing graphics, such as writing graphics, erasing graphics, exit graphics, and undo graphics, so that the user can switch the current writing function through the editing graphics during the writing process in the writing area, for example, the user can click the erasing graphics after writing to erase the corresponding content. If the user clicks the exit graphics, a dialog box can be popped up to ask the user whether to confirm the exit.

[0581] You can also click the full-screen button on the display interface to preview the pie chart in full screen. For example, you can set arrow buttons on the dividing line between the writing area and the chart area. Triggering the arrow button will enter full-screen mode. The pie chart display interface in full-screen mode is as follows: Figures 18A-18D As shown. In full-screen mode, the charts in the original chart area are displayed in the center, with the size and proportions consistent with the preset UI design. In full-screen mode, users can write in the chart area for marking or annotation. Basic writing functions include: red pen, regular eraser size, one-click screen clear, palm erase, etc. Users can also save the current chart area content, such as saving annotated charts. In full-screen mode, users can also swipe right to exit full-screen mode and return to the previous mode, i.e., return to edit mode. Exiting full-screen mode retains the content in the chart area. If switching to other chart types within the Smart Chart mode, the content in the full-screen mode chart area is also retained.

[0582] like Figure 18A As shown, in a writing scenario with table lines, taking a line chart as an example, the different interfaces displayed on the electronic whiteboard during the chart display process are explained as follows:

[0583] like Figure 18B As shown, when a user triggers a chart selection command – line chart – in the Smart Chart mode, the system responds to the command, confirming that the chart type is a line chart. A guide template for the line chart is then displayed in the display area. This guide template includes a first section and a second section. The first section is the editing area, used to display the table template, and the second section is the chart preview area, used to display the chart template. The first row of the table template is used to write the titles (legends) of each axis, and the remaining rows are used to write the data corresponding to each title. Different legends are represented by different axis titles, and the data corresponding to different titles represents the coordinate points. An edit button can also be displayed on this interface, or a close button can be clicked to allow the user to trigger an edit command. It should be noted that if a user edits a line chart, switches to another table, and then returns to the line chart, the edited content is displayed directly, and the guide template is not accessed again. The guide template is only displayed when the Smart Chart function with a known chart type is first opened. Optionally, an arrow button can be displayed on the dividing line between the first and second sections of the guide template. Users can trigger the arrow button to display the chart template in the second section in full screen.

[0584] like Figure 18CAs shown, the user triggers an editing instruction in the display interface of the guide template of the line chart. In response to the user's editing instruction in the intelligent drawing chart mode of the line chart, the display area is divided into a writing area and a chart area. The writing area displays a writing prompt table, and the chart area displays a preset chart. The data content in the writing prompt table is empty. The number of rows and columns of the writing prompt table is fixed. For example, the writing prompt table is a 2*13 table. The writing prompt table is composed of table lines. The style of the preset chart is determined according to a preset UI style.

[0585] Optionally, the writing prompt table in the writing area can be dragged. For example, the initial position of the writing prompt table is set. The writing prompt table can be dragged downward until it cannot be dragged downward any more when the critical row table can be completely displayed. The user can move the writing prompt table by using a multi-finger touch mode. For example, the user can move the writing prompt table by using a 2-4 finger touch mode.

[0586] As shown in FIG. 6, at this time, the user can write content in the writing prompt table. The content written by the user in the writing prompt table can be displayed in real time after being drawn into a chart in the preset chart. Figure 18D The basic functions of writing include a hard pen 6.5px, erasing, one-key screen clearing, exiting, and a back insertion instruction. The back insertion instruction is used to insert the content of the chart area of the current display interface into the previous display interface. If the user triggers the back insertion instruction, the chart inserted back is selected by default in the display interface. The user can perform operations such as moving, zooming, deleting, copying, and rotating on the chart.

[0587] The writing rules of the line chart include but are not limited to the following: (1) After writing at least 1 grid of legal content, the data is generated on the line chart; (2) The first row writes a title (including at least one of a word, English, a number, and a symbol), which corresponds to a legend. If the user does not write a legend, the legend is not displayed. The legend in the line chart represents the title of each coordinate axis; (3) The remaining rows write data, which correspond to each coordinate point. The data format supports integers and decimals. The user must write data to generate the corresponding chart. If non-data content is written in a corresponding cell, the corresponding coordinate point is not displayed. (4) The content written in each column is a data group. After the pen is stopped for 1s, each coordinate point and the title of the coordinate axis are generated according to each data group. (5) The drawing of the line chart is based on the cell at the lower right corner of the writing prompt table on the left side, which has written content. On this basis, if there is a vacancy in the previous cell, 0 is filled. If the title is vacant, the title of the coordinate axis is not displayed.

[0588] The user writes and stops for 1s, and then the writing track information is recognized. At this time, the handwriting font written by the user in the writing prompt table is still retained. If the user adds or modifies the data content in the writing prompt table, the writing track information in the writing prompt table is re-recognized after the user stops for 1s, and the displayed line chart is updated. It should be noted that if the writing content in the writing prompt table after recognition does not meet the writing requirements, the line chart remains unchanged.

[0589] Optionally, after writing, the user can also drag the writing prompt table. At this time, the writing prompt table and the content written in the writing prompt table can be dragged simultaneously. According to the moving position of the writing prompt table, the positions of the writing track information in each cell in the writing prompt table are moved correspondingly, so that the position of the content written by the user in the writing prompt table remains unchanged.

[0590] Optionally, the display interface can also display switching buttons of different functions. For example, the user can click a formula button to switch the current display interface to a display interface of a formula function, and the user can click a column chart button to switch the current display interface to a display interface of a column chart function. Optionally, the display interface can also display editing graphics, such as a writing graphic, an erasing graphic, a quit graphic, a recall graphic, and the like. The user can switch the current writing function through the editing graphics during the writing process in the writing area. For example, the user can click the erasing graphic after writing to erase the corresponding content. If the user clicks the quit graphic, a dialog box for querying whether to confirm the exit can be popped up.

[0591] The full-screen button of the display interface can also be clicked to preview and display the line chart in full screen. For example, arrow buttons can be arranged at the dividing line between the writing area and the chart area. After the arrow buttons are triggered, the full-screen mode can be entered. The display interface of the line chart in the full-screen mode is shown in FIG. 8. Figure 19 In the full-screen mode, the chart in the original chart area is displayed in the center, and the size and proportion are consistent with the preset UI design. In the full-screen mode, the user can write in the chart area to mark or annotate. The basic writing functions include a red hard pen, a regular eraser size, one-key screen cleaning, palm erasing, and the like. The content of the chart area can also be saved, for example, the chart after annotation of the chart displayed in the chart area. In the full-screen mode, the right swipe button can be clicked to exit the full-screen mode and return to the previous mode, that is, return to the editing mode. When the full-screen mode is exited, the content in the chart area is retained. If the chart type of the smart drawing chart mode is switched to other chart types in the smart drawing chart mode, the content of the chart area in the full-screen mode is still retained.

[0592] Optionally, if the content written by the user in the writing prompt table exceeds the preset number of rows, the content contained in the preset number of rows in the writing prompt table is recognized, and the remaining rows are discarded; or, if the content written by the user in the writing prompt table exceeds the preset number of columns, the content contained in the preset number of columns in the writing prompt table is recognized, and the remaining columns are discarded.

[0593] Optionally, if the number of digits of the integer part of the number recognized in the writing prompt table is greater than the first digit threshold, it is expressed in scientific notation, and if the number of digits of the decimal part of the recognized number exceeds the second digit threshold, the digits after the decimal point are retained to a preset number of digits.

[0594] Optionally, if the pixel value of a single trajectory point in the writing trajectory information is less than the pixel threshold, the trajectory point is removed. Which cell the writing trajectory information belongs to is determined according to the starting point of the coordinates after recognizing the standard font.

[0595] In some embodiments, as shown in FIG. 13A, the present embodiment provides a chart display method in a writing scenario of displaying a title promptor, and the specific implementation steps of the method are as follows: Figure 20

[0596] Step 1900, in response to the user's editing instruction in the intelligent drawing chart mode of the known chart type, dividing the display area into a writing area and a chart area, and displaying a title promptor in the writing area;

[0597] Step 1901, obtaining first writing trajectory information representing a title in a first area corresponding to the title promptor, and obtaining second writing trajectory information representing content in a second area corresponding to the title promptor;

[0598] The first area and the second area are separated by the title promptor.

[0599] Step 1902, the user stops writing in the intelligent drawing chart mode of the known chart type and waits for a preset time, then recognizes the writing trajectory information in the writing area to obtain a data recognition result, and draws and displays a chart of the corresponding chart type in the chart area according to the data recognition result.

[0600] In some embodiments, the data recognition result includes the title of each coordinate axis and a plurality of cells, and the data recognition result further includes the position of each cell and the data content in each cell.

[0601] The processor is specifically configured to determine the data recognition result by:

[0602] ​The writing track information of the first area is recognized to obtain a title of each coordinate axis; the writing track information of the second area is divided into each cell, and the writing track information in each cell is recognized to obtain data content in each cell of the second area; and the data recognition result is determined according to the title, the data content in each cell of the second area, and a position relationship between the title and each cell.

[0603] As shown in FIG. 1 1, in the writing scenario of displaying the title promptor, taking the line chart as an example, the following is explained for different interfaces displayed by the electronic whiteboard during the chart display process: Figure 20

[0604] As shown in FIG. 1 1, in the writing scenario of displaying the title promptor, taking the line chart as an example, the following is explained for different interfaces displayed by the electronic whiteboard during the chart display process: Figure 21

[0605] The display area can also display switching buttons of different functions, such as different chart types, formula graphs, etc. The display area can also display basic writing function buttons, such as at least one of a display writing graph, an erasing graph, a undo graph, and a redo graph. The line chart can be displayed through multi-finger touch control to realize full-screen display of the line chart. At least one of a complete button, a save button, and a quit button can be displayed to perform corresponding functions on the generated chart. Optionally, the undo / redo button is used to realize one step forward / backward, and data changed due to the undo / redo is not updated to the coordinate axis in real time. In implementation, after the complete button is clicked, the current coordinate axis content is inserted back to the whiteboard canvas (the electronic whiteboard in non-chart mode or the previous display interface) in the proportion of the large window, and cannot be edited again. At most, six charts can be inserted back to one canvas (excluding copies, which can be copied infinitely). If the chart area has no content, the complete button is grayed out, and the whiteboard canvas cannot be inserted. If the chart area has only the coordinate axis but no data, the whiteboard canvas can also be inserted. In implementation, if the user clicks the formula graph in the current display interface to switch to the formula mode, the content in the current display area is retained.

[0606] ​​The writing rules include: hard pen shape, thickness 6.5px, white; (1) write two columns of data in the left writing area, the format of each column of data is title (content above the horizontal line) + data (numbers below the horizontal line), stop writing for 1s and start recognition after writing each time; the first column of data is the x coordinate, and the second column of data is the y coordinate. The horizontal coordinate scale is consistent with the user's written data and is equidistant, and the vertical coordinate scale data increases proportionally.

[0607] If the user only writes table data in the writing area in the intelligent drawing chart mode, the user can also draw horizontal and vertical lines by hand in the chart area (without arrow recognition algorithm, the user can form the coordinate axis by drawing two lines by hand) to generate the coordinate axis. The left two columns of recognized data are brought into the coordinate axis to generate the line chart, and the content above the horizontal line is the title of the horizontal and vertical coordinate axes.

[0608] Optionally, the content of the writing area can be erased by an eraser, and the area crossed is the erasing area. After the user erases or modifies the content, the chart is regenerated and the original chart is updated. The user can also clear all the contents in the chart area, including the coordinate axis, by pressing a one-key clear button.

[0609] In implementation, if the left two rows of data are not the same number, the empty part is not displayed when it is first generated to the coordinate axis. According to the writing habit, a suitable preset interval is set between every two columns, and if the distance between two numbers exceeds the preset interval, it is judged as two columns of data. A coordinate axis of fixed position and fixed size can also be generated. The coordinate points are updated in real time according to the change of the left writing content, and the line chart is generated according to the writing order of the user in the writing area (from left to right). Optionally, the chart area can be moved by dragging the chart area with a single finger (the single finger needs to fall within the chart area), the window size of the chart area can be changed, and the chart displayed in the chart area can be scaled proportionally.

[0610] In some embodiments, as shown in Figure 21A In the writing scenario without table lines and in the writing scenario with title prompt, the strategy for dividing the content written by the user into rows and columns is as follows:

[0611] Step 2100, converting the writing trajectory information into strokes, and determining the center of gravity of the stroke according to the average coordinate value of the trajectory points in the stroke;

[0612] Step 2101, resampling the trajectory points in the stroke according to the length of the stroke to increase the number of trajectory points in the stroke;

[0613] The resampling is to increase the number of trajectory points in the stroke according to the length of the stroke. The purpose is to prevent the problem that the separation position cannot be determined due to too sparse trajectory points when the projection method is used.

[0614] Step 2102: Project the resampled trajectory points onto the X-axis to obtain the projection histogram of the X-axis. Then, perform a scaling-down mapping on the projection histogram of the X-axis to obtain the first projection histogram.

[0615] Optionally, after scaling down the projection histogram of the X-axis, normalization can be performed to obtain a normalized first projection histogram. The following steps are then performed on the normalized first projection histogram.

[0616] Step 2103: Determine the column separator line based on the trough positions in the first projection histogram;

[0617] Step 2104: Project the writing trajectory information contained in any column onto the Y-axis to obtain the projection histogram of the Y-axis. Then, perform a reduction mapping on the projection histogram of the Y-axis to obtain the second projection histogram.

[0618] Optionally, after scaling down the projection histogram of the Y-axis, normalization can be performed to obtain a normalized second projection histogram. The following steps are then performed on the normalized second projection histogram.

[0619] Step 2105: Determine the row separator line of any column based on the trough position in the second projection histogram of any column;

[0620] Step 2106: Determine each cell based on the column separator and row separator;

[0621] Step 2107: Divide the stroke into each cell according to the relationship between the center of gravity of the stroke and the position of each cell.

[0622] Step 2108: Identify the writing trajectory information in each cell to obtain the data content in each cell;

[0623] Step 2109: Determine the data recognition result based on the position of each cell and the data content in each cell.

[0624] Taking a user-written content of 5 rows and 2 columns as an example, this embodiment provides an example of row and column division.

[0625] like Figure 21B As shown, the X-axis projection histogram is obtained by projecting the resampled trajectory points onto the X-axis; as... Figure 21C As shown, after scaling down the X-axis projection histogram, a first projection histogram is obtained. The midpoint of the X-coordinate range (width of the trough) where the Y-coordinate value is 0 in the first projection histogram is used as the position of the column separator. Based on the determined column separator, the writing trajectory information is divided into two columns.

[0626] likeFigure 21D As shown, this is the Y-axis projection histogram obtained by projecting the writing trajectory information contained in the first column onto the Y-axis; as... Figure 21E As shown, the second projection histogram of the first column is obtained by scaling down the Y-axis projection histogram. The middle Y-coordinate value of the Y-coordinate range (width of the trough) where the X-coordinate value is 0 in the second projection histogram is used as the position of the row separator line of the first column, thus dividing the first column into multiple rows.

[0627] Similarly, such as Figure 21F As shown, this is the Y-axis projection histogram obtained by projecting the writing trajectory information contained in the second column onto the Y-axis; as... Figure 21G As shown, the second projection histogram of the second column is obtained by scaling down the Y-axis projection histogram. The middle Y-coordinate value of the Y-coordinate range (width of the trough) where the X-coordinate value is 0 in the second projection histogram is used as the position of the row separator line of the second column, thus dividing the second column into multiple rows.

[0628] It should be noted that in this embodiment, the method for determining cells first divides the data into columns, and then divides each column into rows. This solves the problem of misalignment of content in different columns within a row due to users' non-standard handwriting. Even if the content belonging to different columns in each row is not on the same horizontal line, the method in this embodiment can still accurately divide the data content in each cell, accurately achieving row and column division. This implementation method can also solve the problem of misaligned handwritten columns affecting recognition in vertical tables. Figure 21H , Figure 22 As shown in the diagram, this embodiment provides several schematic diagrams of the division.

[0629] In some embodiments, such as Figure 23 As shown in the figure, the strategy for row and column segmentation of user-written content without tables in this embodiment, both in writing scenarios without table lines and in writing scenarios with title prompts, is as follows:

[0630] Step 2200: Convert the writing trajectory information into strokes, and determine the centroid of the strokes based on the average coordinate values ​​of the trajectory points in the strokes;

[0631] Step 2201: Based on the length of the stroke, resample the trajectory points in the stroke to increase the number of trajectory points in the stroke;

[0632] Step 2202: Project the resampled trajectory points onto the Y-axis to obtain the projection histogram of the Y-axis. Then, perform a scaling-down mapping on the projection histogram of the Y-axis to obtain the second projection histogram.

[0633] Optionally, after the projection histogram of the Y-axis is reduced and mapped, normalization processing can be further performed to obtain a normalized second projection histogram, and the following steps are performed on the normalized second projection histogram.

[0634] Step 2203, determining a row separation line according to a valley position in the second projection histogram;

[0635] Step 2204, projecting writing track information contained in any row to the X-axis to obtain a projection histogram of the X-axis, and performing reduced and mapped processing on the projection histogram of the X-axis to obtain a first projection histogram;

[0636] Optionally, after the projection histogram of the X-axis is reduced and mapped, normalization processing can be further performed to obtain a normalized first projection histogram, and the following steps are performed on the normalized first projection histogram.

[0637] Step 2205, determining a column separation line of any row according to a valley position in the first projection histogram of the row;

[0638] Step 2206, determining each cell according to the column separation line and the row separation line;

[0639] Step 2207, dividing the strokes into each cell according to a position relationship between the gravity center of the strokes and each cell.

[0640] Step 2208, recognizing writing track information in each cell to obtain data content in each cell;

[0641] Step 2209, determining the data recognition result according to positions of the cells and the data content in the cells.

[0642] It should be noted that in the manner of determining the cells in the embodiment, the row division is first implemented, and then the column division is performed on each row, which can solve the problem that the user's writing is not standardized and causes empty rows in the table. By using the method in the embodiment, the empty rows can be determined, the data content in each cell can be accurately divided, and the row and column division can be accurately implemented.

[0643] In some embodiments, as shown in FIG. 23A, the strategy of the row and column division of the content without a table in the writing scene without a table line and in the writing scene with a title prompt is as follows: Figure 24

[0644] Step 2300, converting the writing track information into strokes, and determining a gravity center of the strokes according to average coordinate values of track points in the strokes;

[0645] ​In step 2301, the trajectory points in the stroke are resampled according to the length of the stroke, so as to increase the number of trajectory points in the stroke.

[0646] In step 2302, the resampled trajectory points are projected to the X axis and the Y axis at the same time to obtain a projection histogram of the X axis and a projection histogram of the Y axis, and the projection histogram of the X axis and the projection histogram of the Y axis are respectively reduced and mapped to obtain a first projection histogram and a second projection histogram.

[0647] Optionally, after the projection histogram of the Y axis is reduced and mapped, normalization processing can be further performed to obtain a normalized second projection histogram; or after the projection histogram of the X axis is reduced and mapped, normalization processing can be further performed to obtain a normalized first projection histogram, and the normalized first projection histogram and the second projection histogram are executed as follows.

[0648] In step 2303, the trough positions in the first projection histogram are used to determine column separation lines, and the trough positions in the second projection histogram are used to determine row separation lines.

[0649] In step 2304, each cell is determined according to the column separation lines and the row separation lines.

[0650] In step 2305, the stroke is divided into each cell according to the position relationship between the barycenter of the stroke and each cell.

[0651] In step 2306, the writing trajectory information in each cell is recognized to obtain the data content in each cell.

[0652] In step 2307, the data recognition result is determined according to the positions of the cells and the data content in the cells.

[0653] It should be noted that in the method for determining the cells in the embodiment, the division of the rows and columns is simultaneously implemented, which can solve the problem that the user's writing is not standard, resulting in empty cells in the table. By using the method in the embodiment, the empty cells, i.e., the cells without writing trajectory information, can be determined, and the data content in each cell can be accurately divided, and the division of the rows and columns can be accurately implemented.

[0654] In some embodiments, the embodiment also provides a text recognition model, which comprises: a plurality of recurrent neural network (RNN) network layers, and the input of any one RNN network layer after the first two RNN network layers is connected with at least two outputs.

[0655] The at least two outputs comprise the outputs of any two RNN network layers before the any one RNN network layer.

[0656] In some embodiments, the text recognition model further comprises a fully connected layer, an input of the fully connected layer is connected with at least three outputs, the at least three outputs comprise outputs of any three RNN network layers before the fully connected layer. Except for an output of any RNN network layer before a last RNN network layer, as an input of at least two RNN network layers after the last RNN network layer.

[0657] Optionally, the RNN network layer can be a BiLSTM network layer or a GRU (Gate Recurrent Unit) network layer, which can be selected according to actual needs of a user, and is not limited here.

[0658] If taking the BiLSTM as an example, the embodiment further provides a text recognition model, comprising: a plurality of BiLSTM network layers, an input of any one BiLSTM network layer after the first two BiLSTM network layers is connected with at least two outputs; wherein the at least two outputs comprise outputs of any two BiLSTM network layers before the any one BiLSTM network layer.

[0659] The text recognition model provided by the embodiment further comprises a fully connected layer, an input of the fully connected layer is connected with at least three outputs, the at least three outputs comprise outputs of any three BiLSTM network layers before the fully connected layer.

[0660] In some embodiments, except for an output of any BiLSTM network layer before a last BiLSTM network layer, as an input of at least two BiLSTM network layers after the last BiLSTM network layer.

[0661] In the implementation, an output of each BiLSTM network layer is a one-dimensional matrix, if an input of a BiLSTM network layer is two outputs, the BiLSTM network layer actually performs an addition operation on the one-dimensional matrices of the outputs of the first two BiLSTM network layers, that is, values in corresponding positions are added to obtain a new one-dimensional matrix, and the new one-dimensional matrix is processed by using the BiLSTM network layer.

[0662] In some embodiments, a specific connection relationship of the text recognition model provided by the embodiment is as shown in Figure 25 The text recognition model comprises four BiLSTM network layers and a fully connected layer, the first BiLSTM network layer comprises a first input and a first output, the second BiLSTM network layer comprises a second input and a second output, the third BiLSTM network layer comprises a third input and a third output, and the fourth BiLSTM network layer comprises a fourth input and a fourth output.

[0663] The first input is used to input the writing track information, the second input is connected to the first output, the third input is connected to the first output and the second output, the fourth input is connected to the first output, the second output and the third output, the fourth output is connected to the input of the full connection layer, and the output of the full connection layer is used to output the data content corresponding to the writing track information.

[0664] Specifically, the input of the first layer BiLSTM is the writing track information, and the output is out1; the input of the second layer BiLSTM is out1, and the output is out2; the input of the third layer BiLSTM is out1+out2, and the output is out3; the input of the fourth layer BiLSTM is out1+out2+out3, and the output is out4; and the input of the full connection layer is out2+out3+out4, and the output is the data content corresponding to the writing track information.

[0665] In the implementation, each BiLSTM network layer contains 64 hidden layers, and the full connection layer contains 3816 neurons, wherein 3816 is the final classification category, including 3755 Chinese character first-level libraries, 26 English letters, 10 Arabic numerals and 25 commonly used punctuation marks.

[0666] The BiLSTM network layer is obtained by deleting network parameters using a Dropout layer in the model training process, and a Dropout layer with a probability of 0.5 is used after each BiLSTM in the model training process. In the data transmission of the text recognition model, 50% of the parameters in the transmission process are randomly set to 0, that is, part of the connection is randomly deleted, which is used to reduce model overfitting and accelerate model convergence.

[0667] Compared with the current text recognition model, the text recognition model in the embodiment reduces the number of hidden layers, not only reduces the size of the text recognition model, but also compresses the size of the model by several times, improves the network degradation phenomenon by changing the connection relationship, and guarantees the accuracy of the text recognition model. In the implementation, the model size is compressed from 5.1MB to 1.3MB, which is helpful for deployment on terminal devices (the original model uses 128 hidden layers for each of the four BiLSTM network layers, and the text recognition model in the embodiment changes the 128 hidden layers of each BiLSTM to 64, so it is reduced by about four times).

[0668] In some embodiments, the present embodiments also provide an automatic cell projection method for automatically dividing the content written by a user into individual cells so as to automatically recognize the writing track information in each cell by using a track recognition algorithm. The core idea of the automatic cell projection method provided in the present embodiments is to obtain the row and column separation lines by using the projection of the writing track information on the X-axis and Y-axis, so as to determine the individual cells. The specific implementation process of the method is as follows:

[0669] obtaining writing track information of a display area of a display screen;

[0670] determining individual row separation lines and individual column separation lines according to a first projection histogram of the writing track information on a first coordinate axis and a second projection histogram of the writing track information on a second coordinate axis;

[0671] determining individual cells according to the individual row separation lines and the individual column separation lines.

[0672] wherein the first coordinate axis and the second coordinate axis are perpendicular to each other.

[0673] In some embodiments, the writing track information is divided into multiple rows according to the row separation lines, and divided into multiple columns according to the column separation lines, the border line of the table is determined according to the minimum value and the maximum value of the track points in the entire writing track information on the first coordinate axis and the second coordinate axis, and the individual cells are determined according to the column separation lines, the row separation lines, and the border line.

[0674] In some embodiments, the individual row separation lines and the individual column separation lines are determined in the following manner:

[0675] the column separation lines are determined according to the trough positions in the first projection histogram of the writing track information on the first coordinate axis, and the row separation lines of any row are determined according to the trough positions in the second projection histogram of the writing track information contained in the row on the second coordinate axis; or

[0676] the row separation lines are determined according to the trough positions in the second projection histogram of the writing track information on the second coordinate axis, and the column separation lines of any column are determined according to the trough positions in the first projection histogram of the writing track information contained in the column on the first coordinate axis; or

[0677] the column separation lines are determined according to the trough positions in the first projection histogram of the writing track information on the first coordinate axis, and the row separation lines are determined according to the trough positions in the second projection histogram of the writing track information on the second coordinate axis.

[0678] In some embodiments, the column separation lines are determined in the following manner:

[0679] The column separation line is determined according to a position of a trough in the first projection histogram, where a width of the trough is greater than a threshold value.

[0680] In some embodiments, the row separation line is determined by:

[0681] The row separation line is determined according to a position of a trough in the second projection histogram, where a width of the trough is greater than a threshold value.

[0682] It should be noted that in the manner of determining the cell in the embodiment, if the division of the column is performed first, and then the division of the row is performed on each column, the problem that the content of each row in different columns is not aligned due to non-standard writing of the user can be solved, and the problem that the handwritten column in the vertical table is misaligned to affect the recognition can be solved. If the division of the row is performed first, and then the division of the column is performed on each row, the problem that an empty row appears in the table due to non-standard writing of the user can be solved. If the division of the row and the column is performed simultaneously, the problem that an empty cell appears in the table due to non-standard writing of the user can be solved.

[0683] Embodiment 2, based on the same inventive concept, the disclosure embodiment also provides a chart display method. Since the method is the method used by the electronic whiteboard in the disclosure embodiment, and the problem solving principle of the method is similar to that of the electronic whiteboard, the implementation of the method can be referred to the implementation of the electronic whiteboard, and the repeated parts will not be described herein.

[0684] As shown in FIG. 2, the implementation process of the method is as follows: Figure 26

[0685] Step 2500, recognizing the writing trajectory information of the display area of the display screen to obtain a data recognition result.

[0686] Step 2501, in response to a chart drawing instruction of a user, determining a chart type corresponding to the chart drawing instruction.

[0687] Step 2502, in response to the chart drawing instruction of the user, drawing a chart of the chart type corresponding to the chart drawing instruction according to the data recognition result, and displaying the drawn chart in the display area.

[0688] As an optional implementation, before the recognizing the writing trajectory information of the display area of the display screen to obtain a data recognition result, the method further includes:

[0689] displaying a writing prompt table in the display area, where the writing prompt table is used to prompt the user to write in each cell of the writing prompt table.

[0690] receiving writing trajectory information written by the user in the writing prompt table.

[0691] ​As an optional implementation, the displaying the writing prompt table in the display area comprises:

[0692] According to the position of the writing track information initially written by the user in the display area, a reference position of the writing prompt table is determined;

[0693] According to the reference position of the writing prompt table, a writing prompt table with fixed number of rows and columns is displayed in the display area, wherein the writing track information initially written by the user is located in a cell of the writing prompt table.

[0694] As an optional implementation, after the displaying the writing prompt table, the method further comprises:

[0695] If the writing track information continuously written by the user is beyond the range contained by the writing prompt table, according to the position of the writing track information continuously written by the user, the number of rows and / or columns of the writing prompt table is increased; or,

[0696] If the writing track information continuously written by the user is located in a critical row of the writing prompt table, the number of rows of the writing prompt table is increased; and / or, if the writing track information continuously written by the user is located in a critical column of the writing prompt table, the number of columns of the writing prompt table is increased.

[0697] As an optional implementation, the number of rows and columns of the writing prompt table is fixed, or determined according to a parameter input by the user.

[0698] As an optional implementation, the data recognition result is determined by any of the following ways:

[0699] Way 1, according to the position relationship between each track point in the writing track information and each cell in the writing prompt table, the writing track information contained by each cell is determined; the writing track information contained by each cell is recognized to obtain the data content of each cell;

[0700] Way 2, the writing track information is recognized to obtain the content written by the user and the position of the content in the display area; according to the position of the content and the position of each cell in the writing prompt table, the data content of each cell is determined.

[0701] As an optional implementation, the data recognition result comprises a plurality of cells, and the data recognition result further comprises the position of each cell and the data content in each cell.

[0702] As an optional implementation, the data recognition result is determined by the following way:

[0703] determining respective cells, and dividing the writing track information into the respective cells, wherein the respective cells correspond to respective cells in the table, and the writing track information contained in the respective cells corresponds to data content in the respective cells;

[0704] recognizing the writing track information in the respective cells to obtain the data content in the respective cells;

[0705] determining the data recognition result according to the positions of the respective cells and the data content in the respective cells.

[0706] As an optional implementation, the writing track is divided into respective cells in the following manner:

[0707] converting the writing track information into strokes, and determining the barycenter of the strokes according to average coordinate values of track points in the strokes;

[0708] dividing the strokes into respective cells according to the position relationship between the barycenter of the strokes and the respective cells.

[0709] As an optional implementation, the writing track is divided into respective cells in the following manner:

[0710] obtaining the writing order and coordinates of respective track points in the writing track information;

[0711] determining the similarity between respective track points according to the writing order and coordinates of the respective track points;

[0712] dividing the track points satisfying a preset threshold value in the similarity into respective cells.

[0713] As an optional implementation, the respective cells are determined in the following manner:

[0714] determining column separation lines according to valley positions of the writing track information in a first projection histogram of a first coordinate axis, determining row separation lines of an arbitrary column according to valley positions of the writing track information contained in the arbitrary column in a second projection histogram of a second coordinate axis, and determining the respective cells according to the column separation lines and the row separation lines; or

[0715] determining row separation lines according to valley positions of the writing track information in a second projection histogram of a second coordinate axis, determining column separation lines of an arbitrary row according to valley positions of the writing track information contained in the arbitrary row in a first projection histogram of a first coordinate axis, and determining the respective cells according to the row separation lines and the column separation lines; or

[0716] The column separation line is determined according to a valley position of the writing track information in a first projection histogram of a first coordinate axis, and the row separation line is determined according to a valley position of the writing track information in a second projection histogram of a second coordinate axis, and each cell is determined according to the row separation line and the column separation line.

[0717] As an optional implementation, each cell is determined by the following manner:

[0718] Each cell is determined by a clustering algorithm.

[0719] As an optional implementation, the column separation line is determined by the following manner:

[0720] The column separation line is determined according to a valley position of the first projection histogram, at which a width of the valley is greater than a threshold; and / or,

[0721] The row separation line is determined by the following manner:

[0722] The row separation line is determined according to a valley position of the second projection histogram, at which a width of the valley is greater than a threshold.

[0723] As an optional implementation, the writing track information is obtained by resampling operation on track points in the writing track information; the resampling is used to increase the track points in each stroke according to a length of the stroke.

[0724] As an optional implementation, the first projection histogram is obtained by reducing mapping on a projection histogram obtained by projecting the writing track information onto a first coordinate axis;

[0725] The second projection histogram is obtained by reducing mapping on a projection histogram obtained by projecting the writing track information onto a second coordinate axis.

[0726] As an optional implementation, before the writing track information of the display area of the display screen is identified to obtain the data recognition result, the method further includes:

[0727] Displaying a title prompt in the display area, the title prompt being used to prompt a writing position of a table title;

[0728] Obtaining first writing track information in a first area corresponding to the title prompt, and obtaining second writing track information in a second area corresponding to the title prompt.

[0729] As an optional implementation, the data recognition result is determined by the following manner:

[0730] Identifying the writing track information of the first area to obtain a title of each coordinate axis.

[0731] divide the writing track information of the second region into each cell, identify the writing track information in each cell, and obtain the data content in each cell of the second region;

[0732] determine the data recognition result according to the title, the data content in each cell of the second region, and the positional relationship between the title and each cell.

[0733] As an optional implementation, the chart drawing instruction comprises a chart selection instruction, and the chart type is determined in the following manner:

[0734] In response to a chart selection instruction of a user in the intelligent chart drawing mode, the chart type corresponding to the chart selection instruction is determined.

[0735] As an optional implementation, the chart drawing instruction comprises a first touch gesture, and the chart type is determined in the following manner:

[0736] In response to a first touch gesture of a user in the intelligent chart drawing mode, a first figure generated by the first touch gesture is identified, and the chart type is determined according to the first figure.

[0737] As an optional implementation, the chart drawing instruction comprises at least one of a drawing instruction of an arrow, a drawing instruction of a circle, a drawing instruction of a polygon, a drawing instruction of a cylinder, and a drawing instruction of a rectangle.

[0738] As an optional implementation, the chart drawing instruction comprises at least one of a touch gesture and a touch instruction.

[0739] As an optional implementation, the identification of the figure corresponding to the chart drawing instruction and the determination of the chart type according to the figure comprise:

[0740] if the chart drawing instruction comprises a drawing instruction of an arrow, the chart type is determined to be a line chart; or,

[0741] if the chart drawing instruction comprises a drawing instruction of a circle, the chart type is determined to be a pie chart; or,

[0742] if the chart drawing instruction comprises a drawing instruction of a rectangle, the chart type is determined to be a histogram; or,

[0743] if the chart drawing instruction comprises a drawing instruction of a cylinder, the chart type is determined to be a column chart; or,

[0744] if the chart drawing instruction comprises a drawing instruction of a polygon, the chart type is determined to be a radar chart.

[0745] As an optional implementation, further comprising:

[0746] The data recognition result comprises two columns of cells, and the drawing instruction of the arrow comprises a first arrow instruction and a second arrow instruction drawn in sequence, the first arrow instruction corresponds to a first column of cells in the two columns of cells, and the second arrow instruction corresponds to a second column of cells in the two columns of cells;

[0747] If the first direction of the first arrow instruction is the X-axis direction, it is determined that the first column of cells is X-axis data of the chart, and the second column of cells is Y-axis data of the chart;

[0748] If the first direction of the first arrow instruction is the Y-axis direction, it is determined that the first column of cells is Y-axis data of the chart, and the second column of cells is X-axis data of the chart;

[0749] Wherein, the receiving time of the first arrow instruction is earlier than the receiving time of the second arrow instruction, and the second direction of the second arrow instruction is different from the first direction.

[0750] As an optional implementation, further comprising:

[0751] In response to a smart chart starting instruction triggered by a user in a first display interface of a writing software, a second display interface in a smart chart mode is displayed in the display area;

[0752] After drawing a chart in the second display interface and displaying the chart, in response to a user's plug-in instruction, the chart of the second display interface is inserted into the first display interface of the writing software for display.

[0753] As an optional implementation, the smart chart starting instruction comprises a second touch gesture, and the second display interface in the smart chart mode displayed in the display area comprises:

[0754] Receiving a second graph drawn by a user in a first display interface of a writing software, the second graph being a second graph generated according to the second touch gesture;

[0755] According to the second graph, a second display interface in a smart chart mode is triggered to be displayed in the display area.

[0756] As an optional implementation, after receiving a second graph drawn by a user in a first display interface of a writing software, further comprising:

[0757] Generating a candidate menu in the first display interface, the candidate menu containing a first starting icon corresponding to the second graph;

[0758] In response to a touch operation of the first start icon by the user, a second display interface of a chart type corresponding to the second graph is triggered to be displayed on the display area.

[0759] As an optional implementation, the generating of the candidate menu on the first display interface comprises:

[0760] If the second graph is a cylinder, the first start icon is a column icon, and in response to a touch operation of the column icon by the user, a second display interface of a column chart is triggered to be displayed;

[0761] If the second graph is a rectangle, the first start icon is a histogram icon, and in response to a touch operation of the histogram icon by the user, a second display interface of a histogram chart is triggered to be displayed;

[0762] If the second graph is a circle, the first start icon is a pie icon, and in response to a touch operation of the pie icon by the user, a second display interface of a pie chart is triggered to be displayed;

[0763] If the second graph is a polygon, the first start icon is a radar icon, and in response to a touch operation of the radar icon by the user, a second display interface of a radar chart is triggered to be displayed;

[0764] If the second graph is an arrow, the first start icon is a line icon, and in response to a touch operation of the line icon by the user, a second display interface of a line chart is triggered to be displayed.

[0765] As an optional implementation, the candidate menu further comprises a second start icon, and the second start icon comprises an analysis template icon.

[0766] In response to a touch operation of the analysis template icon by the user, an analysis template corresponding to the analysis template icon is inserted into the first display interface.

[0767] As an optional implementation, before the response to the chart drawing instruction by the user, the method further comprises:

[0768] determining a writing area and a chart area in a display area of the display screen, wherein the writing area is configured to receive writing track information of the user, and the chart area is configured to display a chart corresponding to the writing track information.

[0769] As an optional implementation, the method further comprises:

[0770] determining a writing area and a chart area in a display area of the display screen, wherein the writing area is configured to receive writing track information of the user, and the chart area is configured to display a chart corresponding to the writing track information.

[0771] In the writing area of the display area, a writing prompt table corresponding to the chart type is displayed; and / or,

[0772] In the chart area of the display area, a preset chart corresponding to the chart type is displayed.

[0773] As an optional implementation, the chart area is further configured to receive a chart drawing instruction of the user.

[0774] As an optional implementation, the determination of the writing area and the chart area in the display area of the display screen comprises:

[0775] In response to an editing instruction of the user in the intelligent chart drawing mode of the known chart type, the display area is divided into the writing area and the chart area, wherein the chart area is used to display a chart corresponding to the chart type.

[0776] As an optional implementation, the method further comprises:

[0777] In response to a drag instruction of the user to the writing area, the content of the writing area is moved in a corresponding direction; or,

[0778] In response to a drag instruction of the user to the chart area, the content of the chart area is moved in a corresponding direction.

[0779] As an optional implementation, the method further comprises:

[0780] In response to a full-screen preview instruction of the user, the chart area is displayed in full screen; or,

[0781] In response to a comment operation of the user in the chart area, content corresponding to the comment operation is displayed; or,

[0782] In response to an erasing operation of the user in the chart area, content corresponding to the erasing operation in the chart area is cleared; or,

[0783] In response to a screen clearing operation of the user in the chart area, the content of the chart area is cleared; or,

[0784] In response to a saving operation of the user in the chart area, the content of the chart area is saved; or,

[0785] In response to a switching instruction of the user to the chart type, the current chart type is switched.

[0786] As an optional implementation, the writing area and the chart area are not overlapped; or

[0787] The chart area is floated above the writing area and does not block the content in the writing area.

[0788] As an optional implementation, the determining the chart area in the display area of the display screen comprises:

[0789] According to the predefined position information, determining the chart area in the display area of the display screen; or,

[0790] In response to a first partition instruction of a user in the display area, determining a chart area in the display area corresponding to the first partition instruction.

[0791] As an optional implementation, after displaying the drawn chart in the chart area, the method further comprises:

[0792] In response to a second partition instruction of a user, dividing the writing area into a first writing area and a second writing area, and dividing the chart area into a first chart area and a second chart area;

[0793] The first writing area is configured to display writing trajectory information received before the division, the second writing area is configured to display writing trajectory information received by the second writing area after the division, the first chart area is configured to display a chart corresponding to the writing trajectory information of the first writing area, and the second chart area is configured to display a chart corresponding to the writing trajectory information of the second writing area.

[0794] As an optional implementation, the writing trajectory information is identified by:

[0795] The writing trajectory information is input into a text recognition model for identification, and data content corresponding to the writing trajectory information is output; wherein the text recognition model comprises a plurality of BiLSTM network layers, and any one BiLSTM network layer after the first two BiLSTM network layers is connected with at least two outputs.

[0796] The at least two outputs comprise outputs of any two BiLSTM network layers before the any one BiLSTM network layer.

[0797] As an optional implementation, the text recognition model further comprises a fully connected layer, and the fully connected layer is connected with at least three outputs, and the at least three outputs comprise outputs of any three BiLSTM network layers before the fully connected layer.

[0798] As an optional implementation, the output of any one BiLSTM network layer before the last BiLSTM network layer is connected as the input of at least two BiLSTM network layers.

[0799] As an optional implementation, the text recognition model comprises 4 BiLSTM network layers and a full connection layer, the first BiLSTM network layer comprises a first input and a first output, the second BiLSTM network layer comprises a second input and a second output, the third BiLSTM network layer comprises a third input and a third output, and the fourth BiLSTM network layer comprises a fourth input and a fourth output.

[0800] The first input is used for inputting the writing track information, the second input is connected to the first output, the third input is connected to the first output and the second output, the fourth input is connected to the first output, the second output and the third output, the fourth output is connected to the input of the full connection layer, and the output of the full connection layer is used for outputting the data content corresponding to the writing track information.

[0801] As an optional implementation, the method further comprises, in response to the chart selection instruction of the user in the intelligent chart drawing mode:

[0802] displaying a writing prompt table in the display area, and receiving writing track information written by the user in the writing prompt table;

[0803] drawing and displaying a chart of a chart type corresponding to the chart selection instruction when the user stops writing and waits for a preset time.

[0804] As an optional implementation, the method further comprises, in response to the chart drawing instruction of the user in the intelligent chart drawing mode:

[0805] receiving writing track information written by the user, recognizing the writing track information, and obtaining a data recognition result;

[0806] In response to the chart drawing instruction of the user in the intelligent chart drawing mode, the processor is specifically configured to perform:

[0807] drawing and displaying a chart of a chart type corresponding to the chart drawing instruction according to the data recognition result.

[0808] As an optional implementation, the method further comprises, in response to the chart drawing instruction of the user in the intelligent chart drawing mode:

[0809] dividing the content written by the user according to columns to determine a plurality of data groups; or

[0810] dividing the content written by the user according to rows to determine a plurality of data groups.

[0811] As an optional implementation, the data recognition result comprises a plurality of data groups, and the plurality of data groups are determined by the following method:

[0812] If the writing prompt table is displayed in the display area, the content written by the user in the writing prompt table is divided by column or by row to obtain a plurality of data groups; or

[0813] If the writing prompt table is not displayed in the display area, after determining each cell, the data content of each cell is divided by column or by row to obtain a plurality of data groups.

[0814] As an optional implementation, the determining a plurality of data groups comprises:

[0815] According to a preset correspondence between each row and a coordinate axis, the content of each column written by the user is determined as each data group; or

[0816] According to a preset correspondence between each column and a coordinate axis, the content of each row written by the user is determined as each data group.

[0817] As an optional implementation, the determining a plurality of data groups comprises:

[0818] The content in the content written by the user and located in a preset row is determined as a title of each coordinate axis, and other content is determined as data content; or

[0819] The content in the content written by the user and located in a preset column is determined as a title of each coordinate axis, and other content is determined as data content.

[0820] As an optional implementation, the drawing a chart of a chart type corresponding to the chart drawing instruction according to the data recognition result in response to the chart drawing instruction comprises:

[0821] Determining a chart type according to the chart drawing instruction;

[0822] Drawing a chart of the chart type corresponding to the chart type according to each data group corresponding to the content written by the user.

[0823] As an optional implementation, if any one data group comprises the content of any one column written by the user, the chart is drawn by the following manner:

[0824] If it is determined that the chart type is a column chart, each classification title on a preset coordinate axis is determined according to a data group corresponding to a preset column, a first content corresponding to a preset index value in a data group corresponding to a remaining column except the preset column is determined as a column name, a column height corresponding to each classification title and the column name is determined according to content except the first content in the data group corresponding to the remaining column, and the column chart is drawn according to each classification title, the column name and the column height; or

[0825] If it is determined that the chart type is a radar chart, titles of each vertex are determined according to data groups corresponding to preset columns, polar coordinate names are determined according to second contents in data groups corresponding to remaining columns and corresponding to preset index values, polar coordinates corresponding to each title and polar coordinate name are determined according to contents in data groups corresponding to the remaining columns and except the second contents, and the radar chart is drawn according to each title, polar coordinate name and polar coordinate; or,

[0826] If it is determined that the chart type is a line chart, a title of a coordinate axis is determined according to contents in the data groups and corresponding to preset index values, coordinate points are determined according to contents in different data groups and corresponding to same index values and except the preset index values, and the line chart is drawn according to the title of the coordinate axis and the coordinate points; or,

[0827] If it is determined that the chart type is a pie chart, titles of each partition are determined according to data groups corresponding to preset columns, proportions of each partition are determined according to data groups corresponding to columns except the preset columns, and the pie chart is drawn according to the titles of each partition and the proportions.

[0828] As an optional implementation, the drawing of the chart of the chart type corresponding to the chart drawing instruction according to the data recognition result comprises:

[0829] In the intelligent chart drawing mode with a known chart type, after it is determined that the user stops writing and waits for a preset time, the drawing of the chart is triggered.

[0830] As an optional implementation, the method further comprises:

[0831] In response to an editing instruction of the user in the intelligent chart drawing mode with a known chart type, a preset chart is displayed in the display area, wherein a display style of the preset chart is determined according to the known chart type.

[0832] As an optional implementation, the method further comprises:

[0833] After the chart type is determined, a guide template corresponding to the chart type is displayed in a display area of the display screen, and the guide template is used to guide the user to write table contents according to a writing specification corresponding to the chart type.

[0834] As an optional implementation, the display of the guide template corresponding to the chart type in the display area of the display screen comprises:

[0835] A table template is displayed in a first partition of the guide template, and a chart template is displayed in a second partition of the guide template, the table template contains preset contents, and the chart template comprises a chart corresponding to the preset contents.

[0836] As an optional implementation, the obtaining the data recognition result comprises:

[0837] If it is determined that the user stops writing and still does not write after waiting for a preset time, the writing track information of the display area of the display screen is recognized to obtain the data recognition result.

[0838] As an optional implementation, the recognizing the writing track information of the display area of the display screen to obtain the data recognition result comprises:

[0839] The track points in the writing track information of the display area of the display screen are recognized, and the track points with pixel values greater than a pixel threshold value are obtained as the data recognition result.

[0840] As an optional implementation, after the drawing of the chart is displayed on the display area, the method further comprises:

[0841] In response to a content increase instruction of the user, corresponding writing track information is added, and the chart is updated according to the added writing track information; or,

[0842] In response to a stroke increase instruction of the user, strokes of corresponding writing track information are added, and the chart is updated according to the added strokes of the writing track information; or,

[0843] In response to an erasing instruction of the user, corresponding writing track information is erased, and the chart is updated according to the erased writing track information; or,

[0844] In response to a screen clearing instruction of the user, all writing track information is cleared.

[0845] As an optional implementation, after the drawing of the chart is displayed on the display area, the method further comprises:

[0846] In response to a modification instruction of the user, corresponding writing track information is modified, and the chart is updated according to the modified writing track information.

[0847] As an optional implementation, the response to the modification instruction of the user further comprises:

[0848] The modified writing track information is obtained and stored in a first storage area, wherein the first storage area is different from a storage area in which the writing track information before the modification is located.

[0849] As an optional implementation, the modification instruction comprises at least one of an instruction triggered by a different stylus tip of a stylus, an instruction triggered by a different key of a stylus, and an instruction triggered by a switching button of the display area.

[0850] As an optional implementation, after the response to the modification instruction of the user, the method further includes:

[0851] determining the first content before the modification and the second content after the modification corresponding to the modification instruction;

[0852] displaying the first content and the second content simultaneously, wherein the display formats of the first content and the second content are different.

[0853] As an optional implementation, after the obtaining of the modified writing track information and the storing into the first storage area, the method further includes:

[0854] obtaining the modified writing track information from the first storage area, and drawing a first chart according to the writing track information before the modification and the modified writing track information;

[0855] the first chart includes first table data corresponding to the writing track information before the modification and second table data corresponding to the modified writing track information.

[0856] As an optional implementation, after the obtaining of the modified writing track information and the storing into the first storage area, the method further includes:

[0857] obtaining the modified writing track information from the first storage area, drawing a second chart according to the writing track information before the modification, and drawing a third chart according to the modified writing track information;

[0858] displaying the second chart and the third chart simultaneously.

[0859] Embodiment 3, based on the same inventive concept, the present disclosure also provides a chart display device. Since the device is the device in the method in the present disclosure, and the principle of solving the problem of the device is similar to that of the method, the implementation of the device can be referred to the implementation of the method, and the repeated parts will not be described here.

[0860] As shown in Figure 27 , the device includes:

[0861] a recognition unit 2600, configured to recognize writing track information of a display area of the display screen, and obtain a data recognition result;

[0862] a determination unit 2601, configured to respond to a chart drawing instruction of a user, and determine a chart type corresponding to the chart drawing instruction;

[0863] a drawing unit 2602, configured to respond to a chart drawing instruction of a user, draw a chart of a chart type corresponding to the chart drawing instruction according to a data recognition result, and display the drawn chart in the display area.

[0864] As an optional implementation, before the recognizing the writing track information of the display area of the display screen and obtaining the data recognition result, the method further comprises a table prompting unit configured to:

[0865] displaying a writing prompt table in the display area, wherein the writing prompt table is configured to prompt the user to write in each cell of the writing prompt table;

[0866] receiving the writing track information written by the user in the writing prompt table.

[0867] As an optional implementation, the table prompting unit is specifically configured to:

[0868] determining a reference position of the writing prompt table according to the position of the writing track information initially written by the user in the display area;

[0869] displaying the writing prompt table with a fixed number of rows and columns in the display area according to the reference position of the writing prompt table, wherein the writing track information initially written by the user is located in a cell of the writing prompt table.

[0870] As an optional implementation, the table prompting unit is specifically further configured to:

[0871] if the writing track information continuously written by the user exceeds the range contained by the writing prompt table, increasing the number of rows and / or columns of the writing prompt table according to the position of the writing track information continuously written by the user; or,

[0872] if the writing track information continuously written by the user is located in a critical row of the writing prompt table, increasing the number of rows of the writing prompt table; and / or, if the writing track information continuously written by the user is located in a critical column of the writing prompt table, increasing the number of columns of the writing prompt table.

[0873] As an optional implementation, the number of rows and columns of the writing prompt table is fixed, or determined according to a user input parameter.

[0874] As an optional implementation, the recognizing unit 2600 is specifically configured to determine the data recognition result by any of the following ways:

[0875] way 1, determining the writing track information contained by each cell according to the position relationship between each track point in the writing track information and the cell in the writing prompt table; recognizing the writing track information contained by each cell to obtain the data content of each cell;

[0876] Optionally, the data recognition result includes a plurality of cells, and the data recognition result further includes a position of each cell and data content in each cell.

[0877] Optionally, the data recognition result includes a plurality of cells, and the data recognition result further includes a position of each cell and data content in each cell.

[0878] Optionally, the recognition unit 2600 is specifically configured to determine the data recognition result by the following manner:

[0879] determining each cell, and dividing the writing track information into each cell, wherein the each cell corresponds to each cell in the table, and the writing track information contained in the each cell corresponds to data content in the each cell;

[0880] recognizing the writing track information in each cell to obtain data content in each cell;

[0881] determining the data recognition result according to the position of each cell and the data content in each cell.

[0882] Optionally, the recognition unit 2600 is specifically configured to divide the writing track into each cell by the following manner:

[0883] converting the writing track information into strokes, and determining a gravity center of the strokes according to average coordinate values of track points in the strokes;

[0884] dividing the strokes into each cell according to a position relationship between the gravity center of the strokes and each cell.

[0885] Optionally, the recognition unit 2600 is specifically configured to divide the writing track into each cell by the following manner:

[0886] obtaining a writing order and a coordinate of each track point in the writing track information;

[0887] determining a similarity between each track point according to the writing order and the coordinate of each track point;

[0888] dividing the track points satisfying a preset threshold value in the similarity into each cell.

[0889] Optionally, the recognition unit 2600 is specifically configured to determine each cell by the following manner:

[0890] determining column separation lines according to the valley positions of the writing trajectory information in the first projection histogram of the first coordinate axis; determining row separation lines of any one row according to the valley positions of the writing trajectory information contained in the row in the second projection histogram of the second coordinate axis, and determining the cells according to the column separation lines and the row separation lines; or

[0891] determining row separation lines according to the valley positions of the writing trajectory information in the second projection histogram of the second coordinate axis; determining column separation lines of any one row according to the valley positions of the writing trajectory information contained in the row in the first projection histogram of the first coordinate axis, and determining the cells according to the column separation lines and the row separation lines; or

[0892] determining column separation lines according to the valley positions of the writing trajectory information in the first projection histogram of the first coordinate axis, and determining row separation lines according to the valley positions of the writing trajectory information in the second projection histogram of the second coordinate axis, and determining the cells according to the column separation lines and the row separation lines.

[0893] As an optional implementation, the identifying unit 2600 is specifically configured to determine the cells by the following manner:

[0894] determining the cells by a clustering algorithm.

[0895] As an optional implementation, the identifying unit 2600 is specifically configured to determine the column separation lines by the following manner:

[0896] determining the column separation lines according to the valley positions of the valleys with a width greater than a threshold in the first projection histogram; and / or,

[0897] determining the row separation lines by the following manner:

[0898] determining the row separation lines according to the valley positions of the valleys with a width greater than a threshold in the second projection histogram.

[0899] As an optional implementation, the writing trajectory information is obtained by resampling the trajectory points in the writing trajectory information; the resampling is used to increase the trajectory points in a corresponding stroke according to the length of each stroke in the writing trajectory information.

[0900] As an optional implementation, the first projection histogram is obtained by projecting the writing trajectory information to the first coordinate axis and then performing a down-sampling mapping;

[0901] the second projection histogram is obtained by projecting the writing trajectory information to the second coordinate axis and then performing a down-sampling mapping.

[0902] As an optional implementation, before the identifying the writing track information of the display area of the display screen and obtaining the data recognition result, the display prompt unit is further used for:

[0903] displaying a title prompt in the display area, the title prompt being used for prompting a writing position of a table title;

[0904] obtaining first writing track information in a first area corresponding to the title prompt, and obtaining second writing track information in a second area corresponding to the title prompt.

[0905] As an optional implementation, the display prompt unit is further used for determining the data recognition result by:

[0906] identifying the writing track information of the first area to obtain a title of each coordinate axis;

[0907] dividing the writing track information of the second area into each cell, identifying the writing track information in each cell to obtain data content in each cell of the second area;

[0908] determining the data recognition result according to the title, the data content in each cell of the second area, and a position relationship between the title and each cell.

[0909] As an optional implementation, the chart drawing instruction includes a chart selection instruction, and the drawing unit 2602 is specifically used for determining a chart type by:

[0910] determining a chart type corresponding to the chart selection instruction in response to the chart selection instruction of the user in the intelligent chart drawing mode.

[0911] As an optional implementation, the chart drawing instruction includes a first touch gesture, and the drawing unit 2602 is specifically used for determining a chart type by:

[0912] identifying a first graph generated by the first touch gesture in response to the first touch gesture of the user in the intelligent chart drawing mode, and determining a chart type according to the first graph.

[0913] As an optional implementation, the chart drawing instruction includes at least one of a drawing instruction of an arrow, a drawing instruction of a circle, a drawing instruction of a polygon, a drawing instruction of a cylinder, and a drawing instruction of a rectangle.

[0914] As an optional implementation, the chart drawing instruction includes at least one of a touch gesture and a touch instruction.

[0915] As an optional implementation, the drawing unit 2602 is specifically configured to:

[0916] if the chart drawing instruction includes an arrow drawing instruction, determining that the chart type is a line chart; or,

[0917] if the chart drawing instruction includes a circle drawing instruction, determining that the chart type is a pie chart; or,

[0918] if the chart drawing instruction includes a rectangle drawing instruction, determining that the chart type is a histogram; or,

[0919] if the chart drawing instruction includes a cylindrical drawing instruction, determining that the chart type is a column chart; or,

[0920] if the chart drawing instruction includes a polygon drawing instruction, determining that the chart type is a radar chart.

[0921] As an optional implementation, the drawing unit 2602 is specifically further configured to:

[0922] The data recognition result includes two columns of cells, the arrow drawing instruction includes a first arrow instruction and a second arrow instruction drawn in sequence, the first arrow instruction corresponds to a first column of cells in the two columns of cells, and the second arrow instruction corresponds to a second column of cells in the two columns of cells;

[0923] if the first direction of the first arrow instruction is the X-axis direction, determining that the first column of cells is the X-axis data of the chart, and the second column of cells is the Y-axis data of the chart;

[0924] if the first direction of the first arrow instruction is the Y-axis direction, determining that the first column of cells is the Y-axis data of the chart, and the second column of cells is the X-axis data of the chart;

[0925] wherein the receiving time of the first arrow instruction is earlier than the receiving time of the second arrow instruction, and the second direction of the second arrow instruction is different from the first direction.

[0926] As an optional implementation, it further includes a plug-back function unit for:

[0927] in response to a smart chart starting instruction triggered by a user in a first display interface of a writing software, displaying a second display interface in a smart chart mode in the display area;

[0928] after drawing a chart in the second display interface and displaying the chart, in response to a plug-back instruction of the user, inserting the chart of the second display interface into the first display interface of the writing software for display.

[0929] As an optional implementation, the chart starting instruction comprises a second touch gesture, and the plug-in function unit is specifically configured to:

[0930] receive a second graph drawn by the user on the first display interface of the writing software, the second graph being a second graph generated according to the second touch gesture;

[0931] trigger display of a second display interface in a chart mode on the display area according to the second graph.

[0932] As an optional implementation, after receiving the second graph drawn by the user on the first display interface of the writing software, the method further comprises starting a function unit for:

[0933] generating a candidate menu on the first display interface, the candidate menu comprising a first starting icon corresponding to the second graph;

[0934] triggering display of a second display interface of a chart type corresponding to the second graph on the display area in response to a touch operation of the user on the first starting icon.

[0935] As an optional implementation, the starting function unit is configured to:

[0936] if the second graph is a cylindrical shape, the first starting icon is a column icon, and display of a second display interface corresponding to a column chart is triggered in response to a touch operation of the user on the column icon;

[0937] if the second graph is a rectangle, the first starting icon is a histogram icon, and display of a second display interface corresponding to a histogram is triggered in response to a touch operation of the user on the histogram icon;

[0938] if the second graph is a circle, the first starting icon is a pie icon, and display of a second display interface corresponding to a pie chart is triggered in response to a touch operation of the user on the pie icon;

[0939] if the second graph is a polygon, the first starting icon is a radar icon, and display of a second display interface corresponding to a radar chart is triggered in response to a touch operation of the user on the radar icon;

[0940] if the second graph is an arrow, the first starting icon is a line icon, and display of a second display interface corresponding to a line chart is triggered in response to a touch operation of the user on the line icon.

[0941] As an optional implementation, the candidate menu further comprises a second starting icon, the second starting icon comprising an analysis template icon, and the starting function unit is specifically configured to:

[0942] In response to a touch operation of the user on the analysis template icon, an analysis template corresponding to the analysis template icon is inserted into the first display interface.

[0943] As an optional implementation, before the response to the chart drawing instruction of the user, the first partition unit is further configured to:

[0944] determine a writing area and a chart area in a display area of the display screen, wherein the writing area is configured to receive writing trajectory information of the user, and the chart area is configured to display a chart corresponding to the writing trajectory information.

[0945] As an optional implementation, the second partition unit is further configured to:

[0946] determine a writing area and a chart area in a display area of the display screen, wherein the writing area is configured to receive writing trajectory information of the user, and the chart area is configured to display a chart corresponding to the writing trajectory information.

[0947] display a writing prompt table corresponding to the chart type in the writing area of the display area; and / or,

[0948] display a preset chart corresponding to the chart type in the chart area of the display area.

[0949] As an optional implementation, the chart area is further configured to receive a chart drawing instruction of the user.

[0950] As an optional implementation, the first partition unit is specifically configured to:

[0951] in response to an editing instruction of the user in the intelligent drawing chart mode of the known chart type, divide the display area into a writing area and a chart area, wherein the chart area is used to display a chart corresponding to the chart type.

[0952] As an optional implementation, the first partition unit is specifically further configured to:

[0953] in response to a drag instruction of the user on the writing area, move the content of the writing area in a corresponding direction; or,

[0954] in response to a drag instruction of the user on the chart area, move the content of the chart area in a corresponding direction.

[0955] As an optional implementation, the first partition unit is specifically further configured to:

[0956] in response to a full-screen preview instruction of the user, display the chart area in full screen; or,

[0957] display content corresponding to the annotation operation of the user in the chart area; or

[0958] clear content corresponding to the erasing operation of the user in the chart area; or

[0959] clear content in the chart area in response to a screen clearing operation of the user in the chart area; or

[0960] save content in the chart area in response to a saving operation of the user in the chart area; or

[0961] switch the current chart type in response to a switching instruction of the user on the chart type.

[0962] As an optional implementation, the writing area and the chart area do not overlap; or

[0963] The chart area floats above the writing area and does not block content in the writing area.

[0964] As an optional implementation, the first partition unit is specifically configured to:

[0965] determine a chart area in the display area of the display screen according to predefined position information; or

[0966] determine a chart area corresponding to a first partition instruction of the user in the display area in response to the first partition instruction of the user in the display area.

[0967] As an optional implementation, after displaying the drawn chart in the chart area, the method further includes a re-partition unit configured to:

[0968] divide the writing area into a first writing area and a second writing area, and divide the chart area into a first chart area and a second chart area in response to a second partition instruction of the user;

[0969] The first writing area is configured to display writing trajectory information received before the division, the second writing area is configured to display writing trajectory information received after the division by the second writing area, the first chart area is configured to display a chart corresponding to the writing trajectory information of the first writing area, and the second chart area is configured to display a chart corresponding to the writing trajectory information of the second writing area.

[0970] As an optional implementation, the identification unit 2600 is specifically configured to identify the writing trajectory information by:

[0971] inputting the writing trajectory information into a text recognition model for recognition, and outputting data content corresponding to the writing trajectory information; wherein the text recognition model comprises a plurality of BiLSTM network layers, and any one BiLSTM network layer after the first two BiLSTM network layers is connected with at least two outputs;

[0972] The at least two outputs comprise outputs of any two BiLSTM network layers before the any one BiLSTM network layer.

[0973] As an optional implementation, the text recognition model further comprises a full connection layer, an input of the full connection layer is connected with at least three outputs, and the at least three outputs comprise outputs of any three BiLSTM network layers before the full connection layer.

[0974] As an optional implementation, an output of any one BiLSTM network layer before the last BiLSTM network layer is used as an input of at least two BiLSTM network layers after the any one BiLSTM network layer.

[0975] As an optional implementation, the text recognition model comprises four BiLSTM network layers and a full connection layer, a first BiLSTM network layer comprises a first input and a first output, a second BiLSTM network layer comprises a second input and a second output, a third BiLSTM network layer comprises a third input and a third output, and a fourth BiLSTM network layer comprises a fourth input and a fourth output.

[0976] The first input is used for inputting the writing trajectory information, the second input is connected with the first output, the third input is connected with the first output and the second output, the fourth input is connected with the first output, the second output and the third output, the fourth output is connected with an input of the full connection layer, and an output of the full connection layer is used for outputting the data content corresponding to the writing trajectory information.

[0977] As an optional implementation, after the chart selection instruction in the intelligent chart drawing mode, the drawing unit 2602 is specifically further used for:

[0978] displaying a writing prompt table in the display area, and receiving writing trajectory information written by the user in the writing prompt table;

[0979] when the user stops writing and waits for a preset time, drawing and displaying a chart of a chart type corresponding to the chart selection instruction.

[0980] As an optional implementation, before the chart drawing instruction in the intelligent chart drawing mode, the recognition unit 2600 is specifically further used for:

[0981] receiving writing trajectory information written by a user, identifying the writing trajectory information, and obtaining a data recognition result;

[0982] After the chart drawing unit 2602 receives a chart drawing instruction from the user in the intelligent drawing chart mode, the drawing unit 2602 is specifically configured to:

[0983] According to the data recognition result, a chart of a chart type corresponding to the chart drawing instruction is drawn and displayed.

[0984] As an optional implementation, the identification unit 2600 is specifically configured to:

[0985] The content written by the user is divided by columns to determine a plurality of data groups; or,

[0986] The content written by the user is divided by rows to determine a plurality of data groups.

[0987] As an optional implementation, the data recognition result includes a plurality of data groups; the plurality of data groups are determined by:

[0988] If a writing prompt table is displayed in the display area, the content written by the user in the writing prompt table is divided by columns or by rows to obtain a plurality of data groups; or,

[0989] If no writing prompt table is displayed in the display area, after each cell is determined, the data content of each cell is divided by columns or by rows to obtain a plurality of data groups.

[0990] As an optional implementation, the identification unit 2600 is specifically configured to:

[0991] According to a preset correspondence between each row and a coordinate axis, each column of content written by the user is determined as each data group; or,

[0992] According to a preset correspondence between each column and a coordinate axis, each row of content written by the user is determined as each data group.

[0993] As an optional implementation, the identification unit 2600 is specifically configured to:

[0994] The content in the content written by the user located in a preset row is determined as the title of each coordinate axis, and other content is determined as data content; or,

[0995] The content in the content written by the user located in a preset column is determined as the title of each coordinate axis, and other content is determined as data content.

[0996] As an optional implementation, the drawing unit 2602 is specifically configured to:

[0997] determine a chart type according to the chart drawing instruction;

[0998] draw a chart corresponding to the chart type according to each data group corresponding to the content written by the user.

[0999] As an optional implementation, if any one data group includes the content of any one column written by the user, the drawing unit 2602 is specifically configured to draw a chart by the following manner:

[1000] If it is determined that the chart type is a column chart, each classification title on a preset coordinate axis is determined according to the data group corresponding to the preset column, a column name is determined according to first content corresponding to a preset index value in the data group corresponding to the remaining columns except the preset column, a column height corresponding to each classification title and the column name is determined according to content other than the first content in the data group corresponding to the remaining columns, and a column chart is drawn according to each classification title, the column name and the column height; or,

[1001] If it is determined that the chart type is a radar chart, a title of each vertex is determined according to the data group corresponding to the preset column, a polar coordinate name is determined according to second content corresponding to a preset index value in the data group corresponding to the remaining columns except the preset column, a polar coordinate corresponding to each title and the polar coordinate name is determined according to content other than the second content in the data group corresponding to the remaining columns, and a radar chart is drawn according to each title, the polar coordinate name and the polar coordinate; or,

[1002] If it is determined that the chart type is a line chart, a title of a coordinate axis is determined according to content corresponding to a preset index value in the data group, a coordinate point is determined according to content corresponding to the same index value other than the preset index value in different data groups, and a line chart is drawn according to the title of the coordinate axis and the coordinate point; or,

[1003] If it is determined that the chart type is a pie chart, a title of each partition is determined according to the data group corresponding to the preset column, a proportion of each partition is determined according to the data group correspo...

Claims

1. A display device, wherein, The application relates to an electronic whiteboard comprising a display screen, a control circuit and an electronic whiteboard, wherein the display screen is used for displaying content; the electronic whiteboard comprises a touch component used for acquiring handwriting track information; the control circuit comprises a processor and a memory used for storing programs executable by the processor; the processor is used for reading the programs in the memory and performing the following steps: displaying a writing prompt table in a display area, wherein the writing prompt table is used for prompting a user to write in each cell of the writing prompt table; receiving writing track information of the user in the writing prompt table; identifying the writing track information of the display area of the display screen to obtain a data recognition result; responding to a chart drawing instruction of the user, determining a chart type corresponding to the chart drawing instruction; and drawing a chart of the chart type corresponding to the chart drawing instruction according to the data recognition result and displaying the drawn chart in the display area. The processor is specifically configured to perform the following steps: determining a reference position of the writing prompt table according to the position of the writing track information of the initial writing of the user in the display area; and displaying a writing prompt table with a fixed number of rows and columns in the display area according to the reference position of the writing prompt table, wherein the writing track information of the initial writing of the user is located in a cell of the writing prompt table. After the writing prompt table is displayed, the processor is specifically further configured to perform the following steps: if the writing track information of the continuous writing of the user exceeds the range contained by the writing prompt table, increasing the number of rows and / or columns of the writing prompt table according to the position of the writing track information of the continuous writing of the user; or if the writing track information of the continuous writing of the user is located in a critical row of the writing prompt table, increasing the number of rows of the writing prompt table; and / or if the writing track information of the continuous writing of the user is located in a critical column of the writing prompt table, increasing the number of columns of the writing prompt table. The processor is specifically further configured to perform the following steps: the number of rows and the number of columns of the writing prompt table are fixed or determined according to a user input parameter. The processor is specifically configured to determine the data recognition result by any one of the following ways: way 1, determining writing track information contained by each cell according to the position relationship between each track point in the writing track information and the cells in the writing prompt table; and identifying the writing track information contained by each cell to obtain data content of each cell; way 2, identifying the writing track information to obtain content written by the user and the position of the content in the display area; and determining data content of each cell according to the position of the content and the position of the cells in the writing prompt table. The data recognition result comprises a plurality of cells, and the data recognition result further comprises the position of each cell and the data content in each cell. The processor is specifically configured to determine the data recognition result by the following way: ​ ​ 2. The display device according to claim 1, wherein ​ ​ ​ 3. The display device according to claim 1 or 2, wherein ​ ​ ​ 4. The display device according to claim 1, wherein ​ ​ 5. The display device according to claim 1 or 2, wherein ​ ​ ​ 6. The display device according to claim 1, wherein ​ 7. The display device of claim 6, wherein, ​ determining a plurality of cells, and dividing the writing track information into the plurality of cells, wherein the plurality of cells correspond to cells in the table, and the writing track information contained in the plurality of cells corresponds to data content in the corresponding cells; recognizing the writing track information in the plurality of cells to obtain the data content in the plurality of cells; determining the data recognition result according to positions of the plurality of cells and the data content in the plurality of cells.

8. The display device of claim 7, wherein, The processor is specifically configured to divide the writing track into the plurality of cells by the following manner: converting the writing track information into strokes, and determining a gravity center of the strokes according to average coordinate values of track points in the strokes; dividing the strokes into the plurality of cells according to a position relationship between the gravity center of the strokes and the plurality of cells.

9. The display device according to claim 7, wherein The processor is specifically configured to divide the writing track into the plurality of cells by the following manner: obtaining writing orders and coordinates of the track points in the writing track information; determining similarities between the track points according to the writing orders and the coordinates of the track points; dividing the track points satisfying a preset threshold value in the similarities into the plurality of cells.

10. A display device according to any of claims 6 to 9, wherein the display device is a liquid crystal display device. The processor is specifically configured to determine the plurality of cells by the following manner: determining column separation lines according to valley positions of the writing track information in a first projection histogram of a first coordinate axis, determining row separation lines of any column according to valley positions of writing track information contained in the any column in a second projection histogram of a second coordinate axis, and determining the plurality of cells according to the column separation lines and the row separation lines; or determining row separation lines according to valley positions of the writing track information in the second projection histogram of the second coordinate axis, determining column separation lines of any row according to valley positions of writing track information contained in the any row in the first projection histogram of the first coordinate axis, and determining the plurality of cells according to the row separation lines and the column separation lines; or determining column separation lines according to valley positions of the writing track information in the first projection histogram of the first coordinate axis, determining row separation lines according to valley positions of the writing track information in the second projection histogram of the second coordinate axis, and determining the plurality of cells according to the row separation lines and the column separation lines.

11. The display device of claim 10, wherein, The processor is specifically configured to determine the column separation lines by the following manner: determining the column separation lines according to valley positions of valleys in the first projection histogram whose width is greater than a threshold value; and / or The processor is specifically configured to determine the row separation lines by the following manner: determining the row separation lines according to valley positions of valleys in the second projection histogram whose width is greater than a threshold value.

12. The display device of claim 10, wherein, The writing track information is obtained by resampling the track points in the writing track information, and the resampling is used to increase the track points in the corresponding strokes according to lengths of the strokes in the writing track information.

13. The display device of claim 10, wherein, The first projection histogram is obtained by projecting the writing track information to the first coordinate axis and then performing a reduction mapping; The second projection histogram is obtained by projecting the writing track information to the second coordinate axis and then performing a reduction mapping.

14. The display device according to any one of claims 6 to 9, wherein The processor is specifically configured to determine the individual cells by: determining the individual cells through a clustering algorithm.

15. The display device according to any one of claims 1 to 2, 4, 6 to 9, 11 to 13, wherein Before the processor specifically further configures to perform: displaying a title prompt in the display region, the title prompt being used to prompt a writing position of a table title; acquiring first writing track information in a first region corresponding to the title prompt, and acquiring second writing track information in a second region corresponding to the title prompt.

16. The display device of claim 15, wherein, The processor is specifically configured to determine the data recognition result by: recognizing the writing track information in the first region to obtain a title of each coordinate axis; dividing the writing track information in the second region into individual cells, recognizing the writing track information in each individual cell to obtain data content in each individual cell in the second region; determining the data recognition result according to the title, the data content in each individual cell in the second region, and a positional relationship between the title and each individual cell.

17. The display device according to any one of claims 1 to 2, 4, 6 to 9, 11 to 13, 16, wherein The chart drawing instruction includes at least one of a touch gesture and a touch control instruction.

18. The display device according to any one of claims 1 to 2, 4, 6 to 9, 11 to 13, 16, wherein The chart drawing instruction includes a chart selection instruction, and the processor is specifically configured to determine the chart type by: determining a chart type corresponding to the chart selection instruction in response to a chart selection instruction of a user in the intelligent chart drawing mode.

19. The display device according to any one of claims 1 to 2, 4, 6 to 9, 11 to 13, 16, wherein The chart drawing instruction includes a first touch gesture, and the processor is specifically configured to determine the chart type by: recognizing a first graph generated by the first touch gesture in response to a first touch gesture of a user in the intelligent chart drawing mode, and determining the chart type according to the first graph.

20. The display device of any of claims 1-2, 4, 6-9, 11-13, 16, wherein the chart drawing instruction includes at least one of a drawing instruction of an arrow, a drawing instruction of a circle, a drawing instruction of a polygon, a drawing instruction of a cylinder, and a drawing instruction of a rectangle.

21. The display device of claim 19, wherein, The processor is specifically configured to perform: if the chart drawing instruction includes the drawing instruction of the arrow, determining that the chart type is a line chart; or if the chart drawing instruction includes the drawing instruction of the circle, determining that the chart type is a pie chart; or if the chart drawing instruction includes the drawing instruction of the rectangle, determining that the chart type is a histogram; or if the chart drawing instruction includes the drawing instruction of the cylinder, determining that the chart type is a column chart; or if the chart drawing instruction includes the drawing instruction of the polygon, determining that the chart type is a radar chart.

22. The display device of claim 20, wherein, The processor is specifically further configured to perform: the data recognition result includes two column cells, the drawing instruction of the arrow includes a first arrow instruction and a second arrow instruction drawn in sequence, the first arrow instruction corresponds to a first column cell in the two column cells, and the second arrow instruction corresponds to a second column cell in the two column cells. If the first direction of the first arrow instruction is the X-axis direction, the first column of cells is determined as the X-axis data of the chart, and the second column of cells is determined as the Y-axis data of the chart. If the first direction of the first arrow instruction is the Y-axis direction, the first column of cells is determined as the Y-axis data of the chart, and the second column of cells is determined as the X-axis data of the chart. The first arrow instruction is received earlier than the second arrow instruction, and the second direction of the second arrow instruction is different from the first direction.

23. The display device according to any one of claims 1 to 2, 4, 6 to 9, 11 to 13, 16, 21 to 22, wherein The processor is specifically further configured to execute: In response to a smart chart starting instruction triggered by a user on a first display interface of the writing software, a second display interface in a smart chart mode is displayed on the display region.

24. The display device of claim 23, wherein, The smart chart starting instruction includes a second touch gesture, and the processor is specifically configured to execute: Receiving a second graph drawn by a user on a first display interface of the writing software, the second graph being a second graph generated according to the second touch gesture; According to the second graph, a second display interface in a smart chart mode is displayed on the display region.

25. The display device of claim 24, wherein, After receiving the second graph drawn by the user on the first display interface of the writing software, the processor is specifically further configured to execute: A candidate menu is generated on the first display interface, and the candidate menu includes a first starting icon corresponding to the graph; In response to a touch operation of the user on the first starting icon, a second display interface of a chart type corresponding to the graph is triggered to be displayed on the display region.

26. The display device of claim 25, wherein, The processor is specifically configured to execute: If the second graph is a cylinder, the first starting icon is a column icon, and in response to a touch operation of the user on the column icon, a second display interface corresponding to a column chart is triggered to be displayed; If the second graph is a rectangle, the first starting icon is a histogram icon, and in response to a touch operation of the user on the histogram icon, a second display interface corresponding to a histogram chart is triggered to be displayed; If the second graph is a circle, the first starting icon is a pie icon, and in response to a touch operation of the user on the pie icon, a second display interface corresponding to a pie chart is triggered to be displayed; If the second graph is a polygon, the first starting icon is a radar icon, and in response to a touch operation of the user on the radar icon, a second display interface corresponding to a radar chart is triggered to be displayed; If the second graph is an arrow, the first starting icon is a line icon, and in response to a touch operation of the user on the line icon, a second display interface corresponding to a line chart is triggered to be displayed.

27. The display device of claim 25, wherein, The candidate menu further includes a second starting icon, and the second starting icon includes an analysis template icon; the processor is specifically further configured to execute: In response to a touch operation of the user on the analysis template icon, an analysis template corresponding to the analysis template icon is inserted into the first display interface.

28. The display device of claim 23, wherein, The processor is specifically further configured to execute: After drawing a chart on the second display interface and displaying the chart, in response to an insertion instruction of the user, the chart of the second display interface is inserted into the first display interface of the writing software for display.

29. The display device according to any one of claims 1 through 2, 4, 6 through 9, 11 through 13, 16, 21 through 22, 24 through 28, wherein, Before responding to the chart drawing instruction of the user, the processor is specifically further configured to execute: determine a writing area and a chart area in a display area of the display screen, wherein the writing area is configured to receive writing track information of a user, and the chart area is configured to display a chart corresponding to the writing track information.

30. The display device according to any one of claims 1 to 2, 5, wherein The processor is specifically further configured to perform: determine a writing area and a chart area in a display area of the display screen, wherein the writing area is configured to receive writing track information of a user, and the chart area is configured to display a chart corresponding to the writing track information; display a writing prompt table corresponding to the chart type in the writing area of the display area.

31. The display device of claim 29, wherein, The chart area is further configured to receive chart drawing instructions of the user.

32. The display device of claim 29, wherein, The processor is specifically configured to perform: in response to editing instructions of the user in a smart drawing chart mode of a known chart type, divide the display area into a writing area and a chart area, wherein the chart area is used to display a chart corresponding to the chart type.

33. The display device of claim 29, wherein, The processor is specifically further configured to perform: in response to a drag instruction of the user on the writing area, move the content of the writing area in a corresponding direction; or, in response to a drag instruction of the user on the chart area, move the content of the chart area in a corresponding direction.

34. The display device of claim 29, wherein, The processor is specifically further configured to perform: in response to a full-screen preview instruction of the user, display the chart area in full screen; or, in response to a comment operation of the user on the chart area, display content corresponding to the comment operation; or, in response to an erasing operation of the user on the chart area, clear content in the chart area corresponding to the erasing operation; or, in response to a screen clearing operation of the user on the chart area, clear the content of the chart area; or, in response to a saving operation of the user on the chart area, save the content of the chart area; or, in response to a switching instruction of the user on the chart type, switch the current chart type.

35. The display device of claim 29, wherein, The positions of the writing area and the chart area do not overlap; or The chart area floats above the writing area and does not block the content in the writing area.

36. The display device of claim 29, wherein, After displaying the drawn chart in the chart area, the processor is specifically further configured to perform: in response to a second partition instruction of the user, divide the writing area into a first writing area and a second writing area, and divide the chart area into a first chart area and a second chart area; wherein the first writing area is configured to display writing track information received before the division, the second writing area is configured to display writing track information received after the division, the first chart area is configured to display a chart corresponding to the writing track information of the first writing area, and the second chart area is configured to display a chart corresponding to the writing track information of the second writing area.

37. The display apparatus according to any one of claims 1-2, 4, 6-9, 11-13, 16, 21-22, 24-28, 31-36, wherein The processor is specifically configured to identify the writing track information by: inputting the writing track information into a text recognition model for identification, and outputting data content corresponding to the writing track information; wherein the text recognition model includes multiple BiLSTM network layers, and at least two outputs of any BiLSTM network layer after the first two BiLSTM network layers are connected. The at least two outputs comprise outputs of any two BiLSTM network layers before the any one BiLSTM network layer.

38. A display device according to claim 37, wherein, The text recognition model further comprises a full connection layer, an input of the full connection layer is connected with at least three outputs, the at least three outputs comprise outputs of any three BiLSTM network layers before the full connection layer.

39. The display device of claim 37, wherein, The outputs of any one BiLSTM network layer before the last BiLSTM network layer are used as inputs of at least two BiLSTM network layers after the last BiLSTM network layer.

40. The display device of claim 37, wherein, The text recognition model comprises four BiLSTM network layers and a full connection layer, a first BiLSTM network layer comprises a first input and a first output, a second BiLSTM network layer comprises a second input and a second output, a third BiLSTM network layer comprises a third input and a third output, and a fourth BiLSTM network layer comprises a fourth input and a fourth output. The first input is used for inputting the writing track information, the second input is connected with the first output, the third input is connected with the first output and the second output, the fourth input is connected with the first output, the second output and the third output, the fourth output is connected with an input of the full connection layer, and an output of the full connection layer is used for outputting data content corresponding to the writing track information.

41. The display apparatus according to any of claims 18, 24-27, wherein, After the processor receives the chart selection instruction in the intelligent drawing chart mode, the processor is specifically configured to perform: displaying a writing prompt table in the display area, and receiving writing track information written by the user in the writing prompt table; after the user stops writing and waits for a preset time, drawing and displaying a chart of a chart type corresponding to the chart selection instruction.

42. The display apparatus according to any one of claims 1-2, 4, 6-9, 11-13, 16, 21-22, 24-28, 31-36, 38-40, wherein After the processor receives the chart drawing instruction in the intelligent drawing chart mode, the processor is specifically configured to perform: receiving writing track information written by the user, recognizing the writing track information, and obtaining a data recognition result; 43. The display device of claim 19, wherein, After the processor receives the chart drawing instruction in the intelligent drawing chart mode, the processor is specifically configured to perform: drawing and displaying a chart of a chart type corresponding to the chart drawing instruction according to the data recognition result. After the processor receives the chart drawing instruction in the intelligent drawing chart mode, the processor is specifically configured to perform: drawing and displaying a chart of a chart type corresponding to the chart drawing instruction according to the data recognition result.

44. The display apparatus according to any one of claims 1-2, 4, 6-9, 11-13, 16, 21-22, 24-28, 31-36, 38-40, wherein After the processor receives the chart drawing instruction in the intelligent drawing chart mode, the processor is specifically configured to perform: drawing and displaying a chart of a chart type corresponding to the chart drawing instruction according to the data recognition result.

45. A display device according to claim 44, wherein, If the gesture instruction is an arrow gesture instruction, the processor is specifically further configured to perform: determining table data corresponding to an X axis according to an arrow direction in the received gesture instruction; or determining table data corresponding to a Y axis according to the arrow direction in the received gesture instruction.

46. The display apparatus according to any one of claims 1-2, 4, 6-9, 11-13, 16, 21-22, 24-28, 31-36, 38-40, wherein The processor is specifically configured to perform: dividing content written by the user according to columns to determine a plurality of data groups; or dividing content written by the user according to rows to determine a plurality of data groups.

47. A display device according to claim 46, wherein, The data recognition result comprises a plurality of data groups, and the processor is specifically configured to determine the plurality of data groups by the following manner: If the writing prompt table is displayed in the display area, content written by the user in the writing prompt table is divided by column or by row to obtain a plurality of data groups; Or, If the writing prompt table is not displayed in the display area, after each cell is determined, data content of each cell is divided by column or by row to obtain a plurality of data groups.

48. The display device of claim 46, wherein, The processor is specifically configured to perform: According to a preset correspondence between each row and a coordinate axis, each column of content written by the user is determined as each data group; or According to a preset correspondence between each column and a coordinate axis, each row of content written by the user is determined as each data group.

49. The display device of claim 46, wherein, The processor is specifically configured to perform: According to the chart drawing instruction, a chart type is determined; According to each data group corresponding to content written by the user, a chart corresponding to the chart type is drawn.

50. The display device of claim 46, wherein, If any one data group includes content of any one column written by the user, the processor is specifically configured to perform: If it is determined that the chart type is a column chart, according to a data group corresponding to a preset column, each classification title on a preset coordinate axis is determined, according to a first content corresponding to a preset index value in a data group corresponding to a remaining column except the preset column, a column body name is determined, according to content except the first content in the data group corresponding to the remaining column, a column body height corresponding to each classification title and the column body name is determined, and a column chart is drawn according to each classification title, the column body name and the column body height; or If it is determined that the chart type is a radar chart, according to a data group corresponding to a preset column, a title of each vertex is determined, according to a second content corresponding to a preset index value in a data group corresponding to a remaining column except the preset column, a polar coordinate name is determined, according to content except the second content in the data group corresponding to the remaining column, a polar coordinate corresponding to each title and the polar coordinate name is determined, and a radar chart is drawn according to each title, the polar coordinate name and the polar coordinate; Or If it is determined that the chart type is a line chart, according to content corresponding to a preset index value in the data group, a title of a coordinate axis is determined, according to content corresponding to a same index value except the preset index value in different data groups, a coordinate point is determined, and a line chart is drawn according to the title of the coordinate axis and the coordinate point; Or If it is determined that the chart type is a pie chart, according to a data group corresponding to a preset column, a title of each partition is determined, according to a data group corresponding to a column except the preset column, a proportion of each partition is determined, and a pie chart is drawn according to each title and proportion of the partition.

51. The display apparatus according to any one of claims 1-2, 4, 6-9, 11-13, 16, 21-22, 24-28, 31-36, 38-40, wherein The processor is specifically further configured to perform: In response to an editing instruction of the user in a smart chart mode of a known chart type, a preset chart is displayed in the display area, wherein a display style of the preset chart is determined according to the known chart type.

52. The display apparatus according to any one of claims 1-2, 4, 6-9, 11-13, 16, 21-22, 24-28, 31-36, 38-40, wherein The processor is specifically further configured to perform: After the chart type is determined, a guide template corresponding to the chart type is displayed in the display area of the display screen, and the guide template is used to guide the user to write table content according to a writing specification corresponding to the chart type.

53. A display device according to claim 52, wherein, The processor is specifically configured to perform: The first sub-area of the guide template displays a table template, and the second sub-area of the guide template displays a chart template, the table template contains preset content, and the chart template includes a chart corresponding to the preset content.

54. The display apparatus according to any one of claims 1-2, 4, 6-9, 11-13, 16, 21-22, 24-28, 31-36, 38-40, wherein After displaying the drawn chart in the display area, the processor is specifically further configured to perform: In response to a modification instruction of the user, modifying corresponding writing track information, and updating the chart according to the modified writing track information.

55. A display device according to claim 54, wherein, In response to the modification instruction of the user, the processor is specifically further configured to perform: Obtaining the modified writing track information and storing the modified writing track information into a first storage area, wherein the first storage area is different from a storage area where the writing track information before modification is located.

56. The display device of claim 54, wherein, The modification instruction includes at least one of an instruction triggered by a different pen head of a stylus, an instruction triggered by a different key of the stylus, and an instruction triggered by a switching button of the display area.

57. The display device of claim 54, wherein, After responding to the modification instruction of the user, the processor is further configured to perform: Determining first content before modification and second content after modification corresponding to the modification instruction; Displaying the first content and the second content simultaneously, wherein display formats of the first content and the second content are different.

58. The display device of claim 56, wherein, After obtaining the modified writing track information and storing the modified writing track information into the first storage area, the processor is specifically further configured to perform: Obtaining the modified writing track information from the first storage area, and drawing a first chart according to the writing track information before modification and the modified writing track information; The first chart includes first table data corresponding to the writing track information before modification and second table data corresponding to the modified writing track information.

59. The display device of claim 56, wherein, After obtaining the modified writing track information and storing the modified writing track information into the first storage area, the processor is specifically further configured to perform: Obtaining the modified writing track information from the first storage area, drawing a second chart according to the writing track information before modification, and drawing a third chart according to the modified writing track information; Displaying the second chart and the third chart simultaneously.

60. A method of charting, wherein, The method comprises: Displaying a writing prompt table in a display area, wherein the writing prompt table is used to prompt the user to write in each cell of the writing prompt table; and receiving writing track information written by the user in the writing prompt table; Identifying the writing track information of the display area of the display screen to obtain a data identification result; In response to a chart drawing instruction of the user, determining a chart type corresponding to the chart drawing instruction; In response to the chart drawing instruction of the user, drawing a chart of the chart type corresponding to the chart drawing instruction according to the data identification result, and displaying the drawn chart in the display area.

61. The method of claim 60, wherein, The displaying of the writing prompt table in the display area comprises: Determining a reference position of the writing prompt table according to a position of writing track information initially written by the user in the display area; Displaying a writing prompt table with a fixed number of rows and columns in the display area according to the reference position of the writing prompt table, wherein the writing track information initially written by the user is located in a cell of the writing prompt table.

62. The method of claim 60, wherein, The display of the writing prompt table further comprises: If the writing trajectory information of the user's continuous writing is beyond the range contained in the writing prompt table, the number of rows and / or columns of the writing prompt table is increased according to the position of the writing trajectory information of the user's continuous writing; or, If the writing trajectory information of the user's continuous writing is located at the critical row of the writing prompt table, the number of rows of the writing prompt table is increased; and / or, if the writing trajectory information of the user's continuous writing is located at the critical column of the writing prompt table, the number of columns of the writing prompt table is increased.

63. The method of claim 60, wherein, The number of rows and columns of the writing prompt table is fixed or determined according to the user input parameter.

64. The method of claim 60 or 61, wherein, The data recognition result is determined by any of the following ways: Way 1: According to the position relationship between each trajectory point in the writing trajectory information and the cells in the writing prompt table, the writing trajectory information contained in each cell is determined; the writing trajectory information contained in each cell is recognized to obtain the data content of each cell; Way 2: The writing trajectory information is recognized to obtain the content written by the user and the position of the content in the display area; according to the position of the content and the position of the cells in the writing prompt table, the data content of each cell is determined.

65. The method of claim 60, wherein, The data recognition result includes multiple cells, and the data recognition result further includes the position of each cell and the data content in each cell.

66. The method of claim 65, wherein, The data recognition result is determined by the following way: Determine each cell, and divide the writing trajectory information into each cell, wherein the cells correspond to the cells in the table, and the writing trajectory information contained in the cells corresponds to the data content in the cells; The writing trajectory information in each cell is recognized to obtain the data content in each cell; According to the position of each cell and the data content in each cell, the data recognition result is determined.

67. The method of claim 66, wherein, The writing trajectory is divided into each cell by the following way: The writing trajectory information is converted into strokes, and the center of gravity of the strokes is determined according to the average coordinate value of the trajectory points in the strokes; According to the position relationship between the center of gravity of the strokes and each cell, the strokes are divided into each cell.

68. The method of claim 66, wherein, The writing trajectory is divided into each cell by the following way: The writing order and coordinates of each trajectory point in the writing trajectory information are obtained; According to the writing order and coordinates of each trajectory point, the similarity between each trajectory point is determined; The trajectory points whose similarity meets the preset threshold are divided into each cell.

69. The method of any one of claims 65-68, wherein, Each cell is determined by the following way: According to the valley position of the writing trajectory information in the first projection histogram of the first coordinate axis, the column separation line is determined; according to the valley position of the writing trajectory information contained in any column in the second projection histogram of the second coordinate axis, the row separation line of any column is determined, and each cell is determined according to the column separation line and the row separation line; or, determine the column separation line according to the valley position of the writing track information in the first projection histogram of the first coordinate axis; determine the row separation line according to the valley position of the writing track information in the second projection histogram of the second coordinate axis; and determine each cell according to the row separation line and the column separation line. determine the column separation line according to the valley position of the writing track information in the first projection histogram of the first coordinate axis; determine the row separation line according to the valley position of the writing track information in the second projection histogram of the second coordinate axis; and determine each cell according to the row separation line and the column separation line.

70. The method of claim 69, wherein, The column separation line is determined in the following manner: determine the column separation line according to the valley position of the valley in the first projection histogram whose width is greater than a threshold value; and / or The row separation line is determined in the following manner: determine the row separation line according to the valley position of the valley in the second projection histogram whose width is greater than a threshold value.

71. The method of claim 69, wherein, The writing track information is obtained after a resampling operation is performed on the writing track information; and the resampling is used to increase the track points in each stroke according to the length of the stroke in the writing track information.

72. The method of claim 69, wherein The first projection histogram is a projection histogram obtained after the writing track information is projected to the first coordinate axis, and is obtained after a reduction mapping is performed on the projection histogram; The second projection histogram is a projection histogram obtained after the writing track information is projected to the second coordinate axis, and is obtained after a reduction mapping is performed on the projection histogram.

73. The method of any one of claims 65-68, wherein, Each cell is determined in the following manner: Each cell is determined by an automatic grid division algorithm.

74. The method of any one of claims 60-61, 63, 65-68, 70-72, wherein, Before the writing track information of the display area of the display screen is identified to obtain a data recognition result, the method further includes the following steps: display a title prompt in the display area, the title prompt being used to prompt a writing position of a table title; obtain first writing track information in a first area corresponding to the title prompt, and obtain second writing track information in a second area corresponding to the title prompt.

75. The method of claim 74, wherein, The data recognition result is determined in the following manner: identify the writing track information of the first area to obtain a title of each coordinate axis; divide the writing track information of the second area into each cell, identify the writing track information in each cell to obtain data content in each cell of the second area; and determine the data recognition result according to the title, the data content in each cell of the second area, and a positional relationship between the title and each cell.

76. The method of any one of claims 60-61, 63, 65-68, 70-72, 75, wherein, The chart drawing instruction includes at least one of a touch gesture and a touch control instruction.

77. The method of any one of claims 60-61, 63, 65-68, 70-72, 75, wherein, The chart drawing instruction includes a chart selection instruction, and the chart type is determined in the following manner: determine a chart type corresponding to the chart selection instruction in response to the chart selection instruction of the user in the intelligent chart drawing mode.

78. The method of any one of claims 60-61, 63, 65-68, 70-72, 75, wherein, The chart drawing instruction includes a first touch gesture, and the chart type is determined in the following manner: identify a first graph generated by the first touch gesture in response to the first touch gesture of the user in the intelligent chart drawing mode, and determine the chart type according to the first graph.

79. The method of any of claims 60-61, 63, 65-68, 70-72, 75, wherein the chart drawing instruction comprises at least one of an arrow drawing instruction, a circle drawing instruction, a polygon drawing instruction, a cylinder drawing instruction, and a rectangle drawing instruction.

80. The method of claim 79, wherein, The identifying the graph corresponding to the chart drawing instruction comprises: if the chart drawing instruction comprises the arrow drawing instruction, determining that the chart type is a line chart; or, if the chart drawing instruction comprises the circle drawing instruction, determining that the chart type is a pie chart; or, if the chart drawing instruction comprises the rectangle drawing instruction, determining that the chart type is a histogram; or, if the chart drawing instruction comprises the cylinder drawing instruction, determining that the chart type is a column chart; or, if the chart drawing instruction comprises the polygon drawing instruction, determining that the chart type is a radar chart.

81. The method of claim 79, wherein, Further comprising: the data recognition result comprises two column cells, the arrow drawing instruction comprises a first arrow instruction and a second arrow instruction drawn in sequence, the first arrow instruction corresponds to a first column cell in the two column cells, and the second arrow instruction corresponds to a second column cell in the two column cells; if a first direction of the first arrow instruction is an X-axis direction, determining that the first column cell is X-axis data of a chart and the second column cell is Y-axis data of the chart; if the first direction of the first arrow instruction is a Y-axis direction, determining that the first column cell is Y-axis data of a chart and the second column cell is X-axis data of the chart; wherein a receiving time of the first arrow instruction is earlier than a receiving time of the second arrow instruction, and a second direction of the second arrow instruction is different from the first direction.

82. The method of any one of claims 60-61, 63, 65-68, 70-72, 75, 80-81, wherein, Further comprising: in response to a smart chart starting instruction triggered by a user in a first display interface of a writing software, displaying a second display interface in a smart chart mode in the display area; after drawing a chart in the second display interface and displaying the chart, in response to a plug-in instruction of the user, inserting the chart of the second display interface into the first display interface of the writing software for display.

83. The method of any one of claims 60-61, 63, 65-68, 70-72, 75, 80-81, wherein, Before responding to the chart drawing instruction of the user, further comprising: determining a writing area and a chart area in a display area of the display screen, wherein the writing area is configured to receive writing trajectory information of the user, and the chart area is configured to display a chart corresponding to the writing trajectory information.

84. The method of any one of claims 60-61, 63, wherein, Further comprising: determining a writing area and a chart area in a display area of the display screen, wherein the writing area is configured to receive writing trajectory information of the user, and the chart area is configured to display a chart corresponding to the writing trajectory information; in the writing area of the display area, displaying a writing prompt table corresponding to the chart type.

85. An electronic device, comprising: The electronic device comprises a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read the programs in the memory and execute the steps of the method of any of claims 60-84.

86. A computer storage medium having stored thereon a computer program, wherein, The procedures, when executed by the processor, implement the steps of the method as claimed in any one of claims 60 to 84.

Images