Note processing method, computing device and storage medium

By partitioning the screen display area of ​​the e-book reader and dividing the note area, the problem that the prior art cannot take notes on multiple documents is solved, and the notes on multiple documents are realized, satisfying the user's multiple documents Notes requirements, optimized notes processing methods.

CN111783387BActive Publication Date: 2024-11-19ZHANGYUE TECH CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202010611264.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-06-30
Publication Date
2024-11-19
Estimated Expiration
2040-06-30

AI Technical Summary

Technical Problem

Existing e-book readers cannot take notes on multiple documents displayed at the same time, and cannot meet the needs of users to read multiple documents and add notes at the same time.

Method used

By partitioning the screen display area of ​​the e-book reader, dividing the note area according to the screen partition layout information, and superimposing the document pictures and note pictures of the document to generate a note page to realize the notes processing of multiple documents.

Benefits of technology

It realizes the simultaneous display and note processing of multiple documents, meets the user's need to add notes to multiple documents separately, optimizes the note processing method, and improves efficiency and convenience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111783387B_ABST
    Figure CN111783387B_ABST
Patent Text Reader

Abstract

The present invention discloses a note processing method, a computing device and a storage medium, wherein the note processing method is used to add notes to multiple documents displayed simultaneously in a reading page layer, and the method includes: in response to a note saving instruction, generating document images of multiple documents according to the current page content of multiple documents in the reading page layer; obtaining screen partition layout information, dividing the note layer into note areas corresponding to multiple documents according to the screen partition layout information; processing multiple note areas to generate note images of multiple note areas; for each document, superimposing the note image of the note area corresponding to the document on the document image of the document to generate a note page of the document. According to the technical solution provided by the present invention, according to the screen partition layout information, the corresponding relationship between the document and the note area can be accurately determined, and the note processing of multiple documents displayed simultaneously is conveniently realized, and the note processing method is optimized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a note processing method, a computing device and a storage medium. Background Art

[0002] With the continuous development of e-book readers, more and more users like to read documents through e-book readers. The common document display method of existing e-book readers is to display the page content of a single document in the entire screen display area. During the reading process, users can add handwritten notes to the document at any time to annotate their reading experience, opinions, etc. According to the existing note processing method, users can write their own notes in the entire screen display area, and the notes in the entire screen display area will be saved as the notes of the current page content of the document.

[0003] In order to meet the needs of users to read multiple documents at the same time, some e-book readers also provide display modes such as dual-opening of documents, so that users can open and display multiple documents at the same time in the screen display area. However, the existing note processing method is only applicable to the display scenario of displaying a single document in the screen display area, and cannot perform note processing on multiple documents displayed simultaneously in the screen display area. Summary of the invention

[0004] In view of the above problems, the present invention is proposed to provide a note processing method, a computing device and a storage medium that overcome the above problems or at least partially solve the above problems.

[0005] According to one aspect of the present invention, a note processing method is provided, the method being used to add notes to a plurality of documents displayed simultaneously in a reading page layer, the method comprising:

[0006] In response to the note saving instruction, generating document images of the multiple documents according to the current page contents of the multiple documents in the reading page layer;

[0007] Obtain screen partition layout information, and divide the note layer into note areas corresponding to multiple documents according to the screen partition layout information;

[0008] Processing multiple note areas to generate note images for the multiple note areas;

[0009] For each document, the note image of the note area corresponding to the document is superimposed on the document image of the document to generate the note page of the document.

[0010] According to another aspect of the present invention, there is provided a computing device, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus;

[0011] The memory is used to store at least one executable instruction, the executable instruction is used to add notes to multiple documents displayed simultaneously in the reading page layer, and the executable instruction enables the processor to perform the following operations:

[0012] In response to the note saving instruction, generating document images of the multiple documents according to the current page contents of the multiple documents in the reading page layer;

[0013] Obtain screen partition layout information, and divide the note layer into note areas corresponding to multiple documents according to the screen partition layout information;

[0014] Processing multiple note areas to generate note images for the multiple note areas;

[0015] For each document, the note image of the note area corresponding to the document is superimposed on the document image of the document to generate the note page of the document.

[0016] According to another aspect of the present invention, a storage medium is provided, wherein at least one executable instruction is stored in the storage medium, and the executable instruction is used to add notes to multiple documents displayed simultaneously in a reading page layer, and the executable instruction enables a processor to perform the following operations:

[0017] In response to the note saving instruction, generating document images of the multiple documents according to the current page contents of the multiple documents in the reading page layer;

[0018] Obtain screen partition layout information, and divide the note layer into note areas corresponding to multiple documents according to the screen partition layout information;

[0019] Processing multiple note areas to generate note images for the multiple note areas;

[0020] For each document, the note image of the note area corresponding to the document is superimposed on the document image of the document to generate the note page of the document.

[0021] According to the technical solution provided by the present invention, the simultaneous display of multiple documents is achieved by partitioning the screen display area of ​​the e-book reader, and the note layer can be conveniently divided according to the screen partition layout information to obtain the note areas corresponding to the multiple documents, thereby realizing the accurate determination of the correspondence between the documents and the note areas; and by superimposing the document image of the document and the corresponding note image, a note page can be quickly generated, thereby conveniently realizing the note processing of multiple documents displayed at the same time, thus well satisfying the user's needs for adding notes to multiple documents displayed at the same time respectively, and optimizing the note processing method.

[0022] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0024] Figure 1a A schematic diagram of a flow chart of a note processing method according to Embodiment 1 of the present invention is shown;

[0025] Figure 1b A schematic diagram showing a screen display area;

[0026] Figure 1c Another schematic diagram showing a screen display area;

[0027] Figure 2 A schematic flow chart of a note processing method according to Embodiment 2 of the present invention is shown;

[0028] Figure 3 A schematic diagram of the structure of a computing device according to a fourth embodiment of the present invention is shown. DETAILED DESCRIPTION

[0029] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0030] Embodiment 1

[0031] Figure 1a FIG. 4 is a flow chart showing a method for processing notes according to the first embodiment of the present invention. Figure 1a As shown, the method comprises the following steps:

[0032] Step S101, in response to a note saving instruction, generates document images of multiple documents according to the current page contents of multiple documents in a reading page layer.

[0033] Users can use e-book readers to read e-books and other documents. In some cases, users need to read multiple documents at the same time. In order to meet the needs of users to read multiple documents at the same time, the screen display area of ​​the e-book reader can be divided into partitions to achieve simultaneous display of multiple documents, wherein each area can open and display an independent document for users to browse and view. Figure 1b As shown, the screen display area can be divided into two areas, the left area displays the page content of document 1, and the right area displays the page content of document 2. Figure 1c As shown, the screen display area can be divided into three areas, wherein the upper area on the left side displays the page content of document 1, the lower area on the left side displays the page content of document 3, and the right area displays the page content of document 2. Those skilled in the art can set the number of partitions and the specific partitioning method according to actual needs, which is not limited here.

[0034] Among them, the e-book reader is provided with a reading page layer for displaying documents, and the method is used to add notes to multiple documents displayed simultaneously in the reading page layer. Specifically, in order to facilitate users to add notes, the e-book reader can generate a note layer on the reading page layer, and the user can input the note content they want to write on the note layer through a finger or an electromagnetic pen, and the e-book reader will refresh and display the note content input by the user in real time. When it is necessary to save the notes, the note saving instruction is triggered, then in step S101, the e-book reader will respond to the note saving instruction and generate document images of multiple documents according to the current page content of multiple documents in the reading page layer, wherein the document image of each document contains the current page content of the document.

[0035] Step S102, obtaining screen partition layout information, and dividing the note layer into note areas corresponding to multiple documents according to the screen partition layout information.

[0036] Considering that multiple documents are arranged according to the screen partition layout information, in order to distinguish the note content in the note layer according to the document, it is necessary to obtain the screen partition layout information, which records the number of areas obtained by dividing the screen display area, the size of each area, the position and other information. The note layer is divided into multiple note areas according to the screen partition layout information, and a corresponding relationship between the note area and the document is established. The division of the note area can be visible to the user, such as displaying the range of the note area through lines, or it can be invisible.

[0037] like Figure 1bAs shown, the screen display area is divided into two areas, and the two areas display the page contents of document 1 and document 2 respectively. Then, according to the screen partition layout information, the note layer is divided into two note areas, and the two note areas are note area 1 and note area 2, wherein note area 1 is the note area corresponding to document 1, and note area 2 is the note area corresponding to document 2. Figure 1b The range of the note area is displayed by a dotted line so that users can intuitively and clearly understand the range of each note area.

[0038] Step S103, processing the multiple note areas to generate note images of the multiple note areas.

[0039] Among them, the note layer can be screenshotted according to the regional location information of multiple note areas to generate note images of multiple note areas, and the note image of each note area contains the note content in the note area. Considering that the user may write note lines that cross multiple note areas when writing note content on the note layer, it is necessary to delete or screenshot the note lines that cross multiple note areas in step S103, and then finally determine the note images of multiple note areas.

[0040] Step S104, for each document, superimpose the note image of the note area corresponding to the document on the document image of the document to generate the note page of the document.

[0041] Usually, one document may correspond to one notebook, and the notebook stores all the note pages of the corresponding document. After generating document images of multiple documents and note images of multiple note areas, for each document, a note page may be generated by superimposing the document image of the document and the corresponding note image. Specifically, the note image is superimposed on the document image to generate a composite image, and the composite image is used as the note page of the document. The page content of the document and the note content in the corresponding note area may be displayed on the note page at the same time, so that the user can easily know which note content has been added to which page content of the document by viewing the note page.

[0042] Utilizing the note processing method provided in this embodiment, the simultaneous display of multiple documents is achieved by partitioning the screen display area of ​​the e-book reader, and the note layer can be conveniently divided according to the screen partition layout information to obtain the note areas corresponding to the multiple documents, thereby achieving accurate determination of the correspondence between the documents and the note areas; and by superimposing the document image of the document and the corresponding note image, a note page can be quickly generated, thereby conveniently achieving note processing for multiple documents displayed simultaneously, thus satisfying the user's need to add notes separately to multiple documents displayed simultaneously, and optimizing the note processing method.

[0043] Embodiment 2

[0044] Figure 2 FIG. 4 is a flow chart showing a method for processing notes according to Embodiment 2 of the present invention. Figure 2 As shown, the method is used to add notes to multiple documents displayed simultaneously in the reading page layer, and the method includes the following steps:

[0045] Step S201, in response to the note saving instruction, generates document images of multiple documents according to the current page contents of multiple documents in the reading page layer.

[0046] In this embodiment, the screen display area of ​​the e-book reader can be partitioned according to the screen partition layout information to realize the simultaneous display of multiple documents. Among them, the screen of the e-book reader can be an electronic ink screen, a liquid crystal touch screen, or other touch screens, which are not limited here. The e-book reader is provided with a reading page layer for displaying documents, and a note layer is also provided above the reading page layer. The user can input the note content he wants to write on the note layer by finger or electromagnetic pen. When the note needs to be saved, for example, when the user chooses to exit the document, or turns the page of the document, the e-book reader will automatically trigger the note saving instruction. In addition, the user can also trigger the note saving instruction by clicking the note saving control on the screen, long pressing, etc. Then in step S201, the e-book reader will respond to the note saving instruction and generate document images of multiple documents according to the current page content of multiple documents in the reading page layer, wherein the document image of each document contains the current page content of the document.

[0047] In an optional implementation, for each document in the reading page layer, a background image and a text image corresponding to the current page content of the document may be obtained, and then the background image is set in the bottom layer, and the text image is set in the top layer, and the background image and the text image are synthesized to generate a document image of the document. Among them, the background image refers to an image that only contains the background content of the current page of the document but does not contain the text content, and the text image refers to an image that only contains the text content of the current page of the document and has a transparent background color.

[0048] In another optional implementation, considering that multiple documents are arranged according to screen partition layout information, the screen partition layout information can be obtained, and the reading page layer can be screenshotted according to the screen partition layout information to generate document images of multiple documents.

[0049] Step S202, obtaining screen partition layout information, and dividing the note layer into note areas corresponding to multiple documents according to the screen partition layout information.

[0050] The screen partition layout information records the number of regions obtained by dividing the screen display area, the size and position of each region, etc. The note layer is divided into multiple note regions according to the screen partition layout information, and a correspondence between the note regions and documents is established, thereby obtaining note regions corresponding to multiple documents.

[0051] Step S203, performing line recognition on the note content in the note layer.

[0052] Considering that users may write note lines that span two or even more note areas when writing note content on the note layer, such note lines need to be processed separately in order to effectively process the note content. After determining the note areas corresponding to multiple documents, OpenCV and other tools can be used to perform line recognition on the note content in the note layer to identify the note lines contained in the note content.

[0053] Step S204, determine whether there is a note line that spans multiple note areas in the note layer; if so, execute step S205; if not, execute step S207.

[0054] If it is determined that there are no note lines that cross multiple note areas in the note layer, it means that the note areas corresponding to all note lines in the note layer can be clearly determined, and step S207 is executed. If it is determined that there are note lines that cross multiple note areas in the note layer, it means that it is impossible to determine which note area the note line actually corresponds to. In order to effectively save the note line during the note saving process, the note line can be first screenshotted, and when the note images of multiple note areas are saved separately, the screenshots are added to the note images of the note areas spanned by the note line, so as to achieve the maximum retention of the note line for the user to view. Specifically, this processing process can be implemented through steps S205 and S206.

[0055] Optionally, if it is determined that there is a note line that spans multiple note areas in the note layer, it means that it is impossible to determine which note area the note line actually corresponds to, and the note line that spans multiple note areas can be directly deleted from the note layer, and then step S207 is performed. This processing method is simple and efficient, and helps to quickly complete note saving.

[0056] Step S205, determining the note area corresponding to the note line, and obtaining a line image of the note line from the note layer.

[0057] Among them, for a note line that spans multiple note areas, the note area corresponding to the note line can be determined from multiple note areas based on the position information of the note line in the note layer. For example, all the note areas spanned by the note line can be determined as its corresponding note area. Assuming that a note line spans note area 1 and note area 2, both note area 1 and note area 2 can be determined as the note areas corresponding to the note line. For the processing of the line image, the existing image processing method can be used to identify the bounding rectangle of the note line. The bounding rectangle can be the smallest bounding rectangle that can enclose the note line, and then the note layer is screenshotted according to the bounding rectangle to obtain a line image of the note line.

[0058] Step S206, screenshot processing is performed on the note layer according to the area position information of the multiple note areas, note images of the multiple note areas are generated, and the line images are added to the note images of the note areas corresponding to the note lines.

[0059] Among them, the regional location information of the note area records the location information of the note area in the note layer. Then, for each note area, according to the regional location information of the note area, the note layer is screenshotted to generate a note picture containing the note content in the note area, and the generated note picture is used as the note picture of the note area. Since the note line spanning multiple note areas has been screenshotted before the note pictures of multiple note areas are generated, the note layer may no longer contain the note line, and the note pictures of multiple note areas generated by screenshotting the note layer do not contain any line part of the note line. After the note pictures of multiple note areas are generated, in order to achieve the maximum retention of the note line spanning multiple note areas, the line picture can be added to the note picture of the note area corresponding to the note line. Specifically, the line picture can be added to the position of the note picture close to the original position of the note line, so as to retain the original position of the note line to the maximum extent, so as to facilitate user viewing. Assuming that a note line spans from the upper right side of note area 1 to the upper left side of note area 2, after generating the note image of note area 1 and the note image of note area 2, the line image of the note line can be added to the upper right position of the note image of note area 1, and the line image of the note line can be added to the upper left position of the note image of note area 2.

[0060] Step S207, screenshot processing is performed on the note layer according to the area position information of the multiple note areas to generate note images of the multiple note areas.

[0061] When it is determined that there are no note lines that span multiple note areas in the note layer, it means that the note areas corresponding to all note lines in the note layer can be clearly determined. Then, for each note area, the note layer is screenshoted according to the area location information of the note area to generate a note image of the note area, which contains the note content in the note area.

[0062] Step S208, for each document, superimpose the note image of the note area corresponding to the document on the document image of the document to generate the note page of the document.

[0063] Among them, the document corresponds to the notebook, and the notebook stores all the note pages of the corresponding document. For the generation of the note page, for each document, the note image corresponding to the document can be superimposed on the document image of the document to generate a composite image as the note page of the document. The page content of the document and the note content in the corresponding note area can be displayed on the note page at the same time for the user to view. After the note page is generated, an association relationship can also be established between the page of the document and the note page, so that the user can easily jump to view the note page of the corresponding page while reading the document.

[0064] Step S209, recording the document page association relationship according to the current page contents of multiple documents in the reading page layer.

[0065] Considering that in a scenario where multiple documents are displayed on the screen at the same time, there is a need for associated browsing between the multiple documents, and there may also be an associated viewing need between the note pages of these multiple documents. In order to realize the associated viewing of the note pages of multiple documents, the document page association relationship can be recorded according to the current page content of multiple documents in the reading page layer. The document page association relationship includes the association relationship between the pages of multiple documents. Specifically, when storing the note page, the document page association relationship can be recorded in the notebook of these multiple documents. Those skilled in the art can set the specific content of the document page association relationship according to actual needs.

[0066] by Figure 1b Taking the example of displaying document 1 and document 2 in the screen display area at the same time, the document page association relationship can be "document ID of document 1 + page ID of document 1 + document ID of document 2 + page ID of document 2", where the page ID of document 1 and the page ID of document 2 refer to the IDs corresponding to the page contents displayed in document 1 and document 2 respectively when adding notes. Figure 1bWhat is displayed is the page content corresponding to the page identifier page4 of document 1 and the page content corresponding to the page identifier page9 of document 2. In this display state, the user adds a note, then the recorded document page association relationship is "document identifier of document 1 + page4 + document identifier of document 2 + page9", where the page corresponding to page4 of document 1 and the page corresponding to page9 of document 2 have an association relationship.

[0067] Step S210, in response to a note viewing instruction for any target document, displaying the note page of the target document.

[0068] When the user wants to view the note page of any target document among the multiple documents, a note viewing instruction for the target document may be triggered, for example, by clicking a note control in the display interface of the target document. Then in step S210, the e-book reader will respond to the note viewing instruction for the target document and display the note page of the target document for the user to view.

[0069] Step S211, in response to the note association viewing instruction, the note pages of other documents associated with the note page of the target document are searched according to the document page association relationship, and the note page of the target document and the associated note pages of other documents are displayed simultaneously.

[0070] Specifically, a note association viewing control may be provided in the notebook interface, and the user may trigger the note association viewing instruction by clicking the note association viewing control. Then in step S211, the e-book reader will respond to the note association viewing instruction and search for the note pages of other documents associated with the currently displayed note page of the target document according to the document page association relationship stored in the notebook of the target document. Assuming that the note page corresponding to page 4 of document 1 is currently displayed, according to the document page association relationship, the page associated with page 4 of document 1 is the page corresponding to page 9 of document 2, that is, the note page corresponding to page 4 of document 1 is associated with the note page corresponding to page 9 of document 2, then while displaying the note page corresponding to page 4 of document 1, the note page corresponding to page 9 of document 2 is also displayed. For example, the notebook interface may be switched to a partition display mode, thereby simultaneously displaying the note page of the target document and the associated note pages of other documents.

[0071] When multiple documents are displayed on the screen at the same time, the size of the note area corresponding to a single document may not be enough to write all the notes for the document. In order to facilitate users to write notes for documents, the e-book reader also provides users with a note area selection function. Usually, the note areas corresponding to multiple documents are determined during the process of dividing the note area in step S202. Figure 1b As shown, the note area corresponding to the default document 1 is note area 1, and the note area of ​​document 2 is note area 2. The user can further trigger the note area selection instruction through the note area selection function, for example, to select whether note area 2 is the note area corresponding to document 1 or the note area corresponding to document 2. Then, after step S202, the method may also include: in response to the note area selection instruction, updating the note areas corresponding to multiple documents. Specifically, the note areas corresponding to multiple documents are updated according to the correspondence between the documents and the note areas carried in the note area selection instruction.

[0072] For a document, after the above update, the number of its corresponding note areas may be one, multiple, or even zero, so in step S208, it is necessary to determine for each document whether the document corresponds to multiple note areas. In an optional implementation, if the document corresponds to multiple note areas, the note images of the multiple note areas corresponding to the document can be superimposed on the document image of the document respectively to generate multiple composite images as the note pages of the document. Assuming that there are two note areas corresponding to document 1, namely note area 1 and note area 2, the note image of note area 1 is superimposed on the document image of document 1 to generate a note page, and the note image of note area 2 is superimposed on the document image of document 1 to generate another note page. Both note pages are associated with the current page of document 1. Then, when the user is viewing the notebook of document 1, when he turns to the note page corresponding to that page, what is displayed is the page content of that page and the note content in note area 1 superimposed on the page content. When the user uses two fingers or other methods to turn the pages, it will switch to displaying the note content in note area 2. At this time, the previous page content is still displayed under the note content, making it convenient for the user to view all note content for the page content.

[0073] In another optional implementation, if there are multiple note areas corresponding to the document, the note images of the multiple note areas corresponding to the document can be spliced, such as splicing up and down or left and right, to form a note image, and then the spliced ​​note image is superimposed on the document image of the document to generate a composite image as the note page of the document. When the user views the note page generated in this way, all the note content for the document page can be fully displayed through one note page, and the user does not need to turn the page to view the note content for the page in other note areas, which greatly facilitates user use and simplifies user operations.

[0074] In addition, in this embodiment, the e-book reader also provides users with a note moving function, so that users can easily move the entire note content in one note area to another note area. Optionally, the method also includes: receiving a trigger event for any note area, determining the touch center coordinates of the trigger event, and intercepting the note image of the note area corresponding to the touch center coordinates from the note layer as the note image to be moved; detecting a moving event, determining the target note area of ​​the note image to be moved according to the moving trajectory of the moving event, and moving the note image to be moved according to the moving trajectory, and adding the note image to be moved to the target note area.

[0075] For example, the user can trigger the note moving function by long pressing in the note area. Specifically, when the note needs to be moved, the user can trigger it by long pressing in the note area, and then the e-book reader receives the trigger event for the note area, determines the touch center coordinates of the trigger event, and uses the note area where the touch center coordinates are located as the note area corresponding to the touch center coordinates, and intercepts the note image of the note area corresponding to the touch center coordinates from the note layer as the note image to be moved. When a moving event is detected, the target note area of ​​the note image to be moved is determined according to the moving trajectory of the moving event, and the note image to be moved is moved according to the moving trajectory, so that the note image to be moved can move with the movement of the user's finger or electromagnetic pen, and finally the note image to be moved is added to the target note area. If the target note area does not originally contain note content, the note image to be moved can be directly covered in the target note area. If the target note area originally contains note content, the note image to be moved can be used to replace the original note content of the target note area, or the note image to be moved can be spliced ​​with the original note content of the target note area, and the spliced ​​note content can be used as the note content of the target note area. The above-mentioned note movement processing method not only facilitates users to edit note contents, but also provides users with animation effects of moving note contents following gestures, which helps to improve user experience and increase fun.

[0076] Taking into account that when moving notes, the size of the note area to which the moved note content originally belongs may be inconsistent with the size of the target note area, in order to better display the moved note content, the size of the note image to be moved can also be automatically adjusted according to the size of the target note area so that it can match the size of the target note area.

[0077] By utilizing the note processing method provided in this embodiment, note layers are divided according to screen partition layout information, which can achieve effective distinction of note content according to documents. For note lines that span multiple note areas, the captured line image is added to the note image of the note area corresponding to the note line, thereby retaining the note lines that span multiple note areas to the greatest extent during the note processing process, thereby avoiding incomplete or missing note lines in the generated note page. In addition, functions such as note association viewing, note area selection, and note movement are also provided, which greatly enriches the note processing function, well meets the user's personalized needs for note processing, and facilitates user use.

[0078] Embodiment 3

[0079] Embodiment 3 of the present invention provides a non-volatile storage medium storing at least one executable instruction, which can execute the note processing method in any of the above-mentioned method embodiments, and is used to add notes to multiple documents displayed simultaneously in a reading page layer.

[0080] The executable instructions can specifically be used to enable the processor to perform the following operations: in response to a note save instruction, generate document images of multiple documents based on the current page content of multiple documents in the reading page layer; obtain screen partition layout information, and divide the note layer into note areas corresponding to multiple documents according to the screen partition layout information; process multiple note areas to generate note images for multiple note areas; for each document, superimpose the note image of the note area corresponding to the document on the document image of the document to generate a note page for the document.

[0081] In an optional embodiment, the executable instructions further cause the processor to perform the following operations: perform line recognition on the note content in the note layer, and determine whether there are note lines that span multiple note areas in the note layer; if there are no note lines that span multiple note areas, then take screenshots of the note layer according to the area location information of the multiple note areas, and generate note images for the multiple note areas.

[0082] In an optional implementation, the executable instructions further cause the processor to perform the following operations: if there is a note line spanning multiple note areas, delete the note line from the note layer.

[0083] In an optional embodiment, the executable instructions further cause the processor to perform the following operations: if there is a note line that spans multiple note areas, determine the note area corresponding to the note line, and obtain a line image of the note line from the note layer; according to the area location information of the multiple note areas, take a screenshot of the note layer, generate note images of the multiple note areas, and add the line image to the note image of the note area corresponding to the note line.

[0084] In an optional embodiment, the executable instructions further cause the processor to perform the following operations: determine the note area corresponding to the note line from multiple note areas based on the position information of the note line in the note layer; identify the circumscribed rectangle of the note line, and take a screenshot of the note layer according to the circumscribed rectangle to obtain a line image of the note line.

[0085] In an optional embodiment, the executable instructions further cause the processor to perform the following operations: record document page association relationships based on the current page contents of multiple documents in the reading page layer; display the note page of the target document in response to a note viewing instruction for any target document; in response to a note association viewing instruction, search for note pages of other documents associated with the note page of the target document based on the document page association relationships, and simultaneously display the note page of the target document and the associated note pages of other documents.

[0086] In an optional embodiment, the executable instructions further cause the processor to perform the following operations: in response to a note area selection instruction, update the note areas corresponding to multiple documents; if there are multiple note areas corresponding to the document, superimpose the note images of the multiple note areas corresponding to the document on the document image of the document respectively, to generate multiple composite images as the note pages of the document; or, splice the note images of the multiple note areas corresponding to the document, superimpose the spliced ​​note images on the document image of the document, to generate a composite image as the note page of the document.

[0087] In an optional embodiment, the executable instructions further cause the processor to perform the following operations: receive a trigger event for any note area, determine the touch center coordinates of the trigger event, and capture a note image of the note area corresponding to the touch center coordinates from the note layer as the note image to be moved; detect a moving event, determine a target note area for the note image to be moved according to the moving trajectory of the moving event, move the note image to be moved according to the moving trajectory, and add the note image to be moved to the target note area.

[0088] Embodiment 4

[0089] Figure 3A schematic diagram of the structure of a computing device according to Embodiment 4 of the present invention is shown. The specific embodiment of the present invention does not limit the specific implementation of the computing device.

[0090] like Figure 3 As shown, the computing device may include: a processor (processor) 302 , a communication interface (Communications Interface) 304 , a memory (memory) 306 , and a communication bus 308 .

[0091] in:

[0092] The processor 302 , the communication interface 304 , and the memory 306 communicate with each other via the communication bus 308 .

[0093] The communication interface 304 is used to communicate with other devices such as clients or other servers.

[0094] The processor 302 is used to execute the program 310, and specifically can execute the relevant steps in the above-mentioned note processing method embodiment.

[0095] Specifically, the program 310 may include program codes, which include computer operation instructions.

[0096] The processor 302 may be a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention. The one or more processors included in the computing device may be processors of the same type, such as one or more CPUs; or processors of different types, such as one or more CPUs and one or more ASICs.

[0097] The memory 306 is used to store the program 310. The memory 306 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0098] Program 310 is used to add notes to multiple documents displayed simultaneously in the reading page layer, and can specifically be used to enable the processor 302 to perform the following operations: in response to a note save instruction, generate document images of multiple documents according to the current page content of the multiple documents in the reading page layer; obtain screen partition layout information, and divide the note layer into note areas corresponding to multiple documents according to the screen partition layout information; process multiple note areas to generate note images of multiple note areas; for each document, superimpose the note image of the note area corresponding to the document on the document image of the document to generate a note page for the document.

[0099] In an optional embodiment, the program 310 further enables the processor 302 to perform the following operations: perform line recognition on the note content in the note layer, and determine whether there are note lines that span multiple note areas in the note layer; if there are no note lines that span multiple note areas, then take screenshots of the note layer according to the area location information of the multiple note areas, and generate note images for the multiple note areas.

[0100] In an optional implementation, the program 310 further enables the processor 302 to perform the following operations: if there is a note line that spans across multiple note areas, delete the note line from the note layer.

[0101] In an optional embodiment, the program 310 further enables the processor 302 to perform the following operations: if there is a note line that spans multiple note areas, determine the note area to which the note line corresponds, and capture a line image of the note line from the note layer; according to the area location information of the multiple note areas, perform screenshot processing on the note layer, generate note images of the multiple note areas, and add the line image to the note image of the note area corresponding to the note line.

[0102] In an optional embodiment, the program 310 further enables the processor 302 to perform the following operations: determine the note area corresponding to the note line from multiple note areas based on the position information of the note line in the note layer; identify the circumscribed rectangle of the note line, and take a screenshot of the note layer according to the circumscribed rectangle to obtain a line image of the note line.

[0103] In an optional embodiment, the program 310 further enables the processor 302 to perform the following operations: record document page association relationships based on the current page content of multiple documents in the reading page layer; display the note page of the target document in response to a note viewing instruction for any target document; in response to a note association viewing instruction, search for note pages of other documents associated with the note page of the target document based on the document page association relationships, and simultaneously display the note page of the target document and the associated note pages of other documents.

[0104] In an optional embodiment, the program 310 further enables the processor 302 to perform the following operations: in response to a note area selection instruction, update the note areas corresponding to multiple documents; if there are multiple note areas corresponding to the document, superimpose the note images of the multiple note areas corresponding to the document on the document image of the document respectively to generate multiple composite images as the note pages of the document; or, splice the note images of the multiple note areas corresponding to the document, superimpose the spliced ​​note images on the document image of the document, and generate a composite image as the note page of the document.

[0105] In an optional embodiment, the program 310 further enables the processor 302 to perform the following operations: receive a trigger event for any note area, determine the touch center coordinates of the trigger event, and capture a note image of the note area corresponding to the touch center coordinates from the note layer as the note image to be moved; detect a move event, determine a target note area for the note image to be moved according to the moving trajectory of the move event, move the note image to be moved according to the moving trajectory, and add the note image to be moved to the target note area.

[0106] The specific implementation of each step in program 310 can refer to the description of the corresponding steps in the above-mentioned note processing embodiment, which will not be repeated here. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the above-described device can refer to the corresponding process description in the above-mentioned method embodiment, which will not be repeated here.

[0107] Through the solution provided in this embodiment, the simultaneous display of multiple documents is achieved by partitioning the screen display area of ​​the e-book reader, and the correspondence between the document and the note area can be accurately determined based on the screen partition layout information, thereby conveniently implementing note processing for multiple documents displayed simultaneously, and well meeting the user's needs for adding notes to multiple documents displayed simultaneously, respectively, and optimizing the note processing method.

[0108] The algorithm and display provided herein are not inherently related to any particular computer, virtual system or other device. Various general purpose systems can also be used together with the teachings based on this. According to the above description, it is obvious that the structure required for constructing such systems. In addition, the present invention is not directed to any specific programming language either. It should be understood that various programming languages ​​can be utilized to realize the content of the present invention described herein, and the description of the above specific languages ​​is for disclosing the best mode of the present invention.

[0109] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0110] Similarly, it should be understood that in order to streamline the present disclosure and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, various features of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed method should not be interpreted as reflecting the intention that the claimed invention requires more features than those expressly recited in each claim. Rather, as reflected in the claims, inventive aspects lie in less than all of the features of the individual embodiments previously disclosed. Therefore, the claims that follow the detailed description are hereby expressly incorporated into the detailed description, with each claim itself serving as a separate embodiment of the present invention.

[0111] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0112] In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present invention and form different embodiments. For example, in the claims, any one of the claimed embodiments may be used in any combination.

[0113] It should be noted that the above embodiments illustrate the present invention rather than limit it, and that those skilled in the art may design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets should not be constructed as a limitation to the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention can be implemented by means of hardware including a number of different elements and by means of a suitably programmed computer. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.

Claims

1. A note processing method, the method is used to add notes to multiple documents displayed simultaneously in a reading page layer of an e-book reader, the method comprising: In response to the note saving instruction, generating document images of the multiple documents according to the current page contents of the multiple documents in the reading page layer; Acquire screen partition layout information, divide the note layer into note areas corresponding to multiple documents according to the screen partition layout information, and establish a correspondence between the note areas and the documents; wherein the note layer is generated on the reading page layer, and the screen partition layout information records the number of areas obtained by dividing the screen display area, the size and position of each area; Processing multiple note areas to generate note images for the multiple note areas; For each document, superimposing a note image of a note area corresponding to the document on a document image of the document to generate a note page for the document; The processing of the multiple note areas to generate the note images of the multiple note areas specifically includes: Performing line recognition on the note content in the note layer to determine whether there is a note line that spans multiple note areas in the note layer; If there is no note line that crosses multiple note areas, screenshot the note layer according to the area position information of the multiple note areas to generate note images of the multiple note areas; If there is a note line that spans multiple note areas, determine the note area corresponding to the note line from multiple note areas according to the position information of the note line in the note layer, identify the circumscribed rectangle of the note line, and take a screenshot of the note layer according to the circumscribed rectangle to obtain a line image of the note line; According to the area position information of the multiple note areas, the note layer is screenshotted to generate note images of the multiple note areas, and the line image is added to the note image of the note area corresponding to the note line.

2. The method according to claim 1, further comprising: Recording document page association relationships according to current page contents of multiple documents in the reading page layer; In response to a note viewing instruction for any target document, displaying a note page of the target document; In response to the note association viewing instruction, the note pages of other documents associated with the note page of the target document are searched according to the document page association relationship, and the note page of the target document and the associated note pages of other documents are displayed simultaneously.

3. According to the method of claim 1, after obtaining the screen partition layout information and dividing the note layer into note areas corresponding to multiple documents according to the screen partition layout information, the method further comprises: In response to the note area selection instruction, updating the note areas corresponding to the plurality of documents; For each document, the note image of the note area corresponding to the document is superimposed on the document image of the document to generate the note page of the document as follows: If there are multiple note areas corresponding to the document, the note images of the multiple note areas corresponding to the document are respectively superimposed on the document image of the document to generate multiple composite images as the note pages of the document; Alternatively, the note images of multiple note areas corresponding to the document are spliced ​​together, and the spliced ​​note images are superimposed on the document image of the document to generate a composite image as the note page of the document.

4. The method according to any one of claims 1 to 3, further comprising: receiving a trigger event for any note area, determining the touch center coordinates of the trigger event, and capturing a note image of the note area corresponding to the touch center coordinates from the note layer as the note image to be moved; Detect a moving event, determine a target note area of ​​the note image to be moved according to a moving trajectory of the moving event, move the note image to be moved according to the moving trajectory, and add the note image to be moved to the target note area.

5. A computing device comprising: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, the executable instruction is used to add notes to multiple documents displayed simultaneously in a reading page layer of the e-book reader, and the executable instruction enables the processor to perform the following operations: In response to the note saving instruction, generating document images of the multiple documents according to the current page contents of the multiple documents in the reading page layer; Acquire screen partition layout information, divide the note layer into note areas corresponding to multiple documents according to the screen partition layout information, and establish a correspondence between the note areas and the documents; wherein the note layer is generated on the reading page layer, and the screen partition layout information records the number of areas obtained by dividing the screen display area, the size and position of each area; Processing multiple note areas to generate note images for the multiple note areas; For each document, superimposing a note image of a note area corresponding to the document on a document image of the document to generate a note page for the document; The executable instructions specifically cause the processor to perform the following operations: Performing line recognition on the note content in the note layer to determine whether there is a note line that spans multiple note areas in the note layer; If there is no note line that crosses multiple note areas, screenshot the note layer according to the area position information of the multiple note areas to generate note images of the multiple note areas; If there is a note line that spans multiple note areas, determine the note area corresponding to the note line from multiple note areas according to the position information of the note line in the note layer, identify the circumscribed rectangle of the note line, and take a screenshot of the note layer according to the circumscribed rectangle to obtain a line image of the note line; According to the area position information of the multiple note areas, the note layer is screenshotted to generate note images of the multiple note areas, and the line image is added to the note image of the note area corresponding to the note line.

6. The computing device of claim 5, wherein the executable instructions further cause the processor to: Recording document page association relationships according to current page contents of multiple documents in the reading page layer; In response to a note viewing instruction for any target document, displaying a note page of the target document; In response to the note association viewing instruction, the note pages of other documents associated with the note page of the target document are searched according to the document page association relationship, and the note page of the target document and the associated note pages of other documents are displayed simultaneously.

7. The computing device of claim 5, wherein the executable instructions further cause the processor to: In response to the note area selection instruction, updating the note areas corresponding to the plurality of documents; If there are multiple note areas corresponding to the document, the note images of the multiple note areas corresponding to the document are respectively superimposed on the document image of the document to generate multiple composite images as the note pages of the document; or, the note images of the multiple note areas corresponding to the document are spliced, and the spliced ​​note images are superimposed on the document image of the document to generate a composite image as the note page of the document.

8. The computing device according to any one of claims 5 to 7, wherein the executable instructions further cause the processor to perform the following operations: receiving a trigger event for any note area, determining the touch center coordinates of the trigger event, and capturing a note image of the note area corresponding to the touch center coordinates from the note layer as the note image to be moved; Detect a moving event, determine a target note area of ​​the note image to be moved according to a moving trajectory of the moving event, move the note image to be moved according to the moving trajectory, and add the note image to be moved to the target note area.

9. A storage medium, wherein at least one executable instruction is stored in the storage medium, wherein the executable instruction is used to add notes to multiple documents displayed simultaneously in a reading page layer of an e-book reader, wherein the executable instruction causes a processor to perform the following operations: In response to the note saving instruction, generating document images of the multiple documents according to the current page contents of the multiple documents in the reading page layer; Acquire screen partition layout information, divide the note layer into note areas corresponding to multiple documents according to the screen partition layout information, and establish a correspondence between the note areas and the documents; wherein, The note layer is generated on the reading page layer, and the screen partition layout information records the number of regions obtained by dividing the screen display area, the size and position of each region; Processing multiple note areas to generate note images for the multiple note areas; For each document, superimposing a note image of a note area corresponding to the document on a document image of the document to generate a note page for the document; The executable instructions specifically cause the processor to perform the following operations: Performing line recognition on the note content in the note layer to determine whether there is a note line that spans multiple note areas in the note layer; If there is no note line that crosses multiple note areas, screenshot the note layer according to the area position information of the multiple note areas to generate note images of the multiple note areas; If there is a note line that spans multiple note areas, determine the note area corresponding to the note line from multiple note areas according to the position information of the note line in the note layer, identify the circumscribed rectangle of the note line, and take a screenshot of the note layer according to the circumscribed rectangle to obtain a line image of the note line; According to the area position information of the multiple note areas, the note layer is screenshotted to generate note images of the multiple note areas, and the line image is added to the note image of the note area corresponding to the note line.

10. The storage medium of claim 9, wherein the executable instructions further cause the processor to perform the following operations: Recording document page association relationships according to current page contents of multiple documents in the reading page layer; In response to a note viewing instruction for any target document, displaying a note page of the target document; In response to the note association viewing instruction, the note pages of other documents associated with the note page of the target document are searched according to the document page association relationship, and the note page of the target document and the associated note pages of other documents are displayed simultaneously.

11. The storage medium of claim 9, wherein the executable instructions further cause the processor to perform the following operations: In response to the note area selection instruction, updating the note areas corresponding to the plurality of documents; If there are multiple note areas corresponding to the document, the note images of the multiple note areas corresponding to the document are respectively superimposed on the document image of the document to generate multiple composite images as the note pages of the document; or, the note images of the multiple note areas corresponding to the document are spliced, and the spliced ​​note images are superimposed on the document image of the document to generate a composite image as the note page of the document.

12. The storage medium according to any one of claims 9 to 11, wherein the executable instructions further cause the processor to perform the following operations: receiving a trigger event for any note area, determining the touch center coordinates of the trigger event, and capturing a note image of the note area corresponding to the touch center coordinates from the note layer as the note image to be moved; Detect a moving event, determine a target note area of ​​the note image to be moved according to a moving trajectory of the moving event, move the note image to be moved according to the moving trajectory, and add the note image to be moved to the target note area.