User annotation information processing method and device, electronic equipment and storage medium
By recording and converting user touch point information, the display differences of e-book annotations under different screen sizes and resolutions are solved, and the accurate display of the annotated content is achieved and user experience is improved.
Patent Information
- Application Number
- CN202411699402.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-26
- Publication Date
- 2024-12-27
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In e-book reading, user annotation information cannot flexibly adapt to reading screens of different resolutions and sizes, resulting in large differences in display effects and affecting user experience.
By recording the user's touch point coordinates and timestamp information in electronic devices, and performing coordinate conversion and scaling according to the page size of the device, using a linear interpolation algorithm to display the drawn content to ensure that the annotated content remains accurate under different screen sizes and resolutions Sex and consistency.
It realizes accurate reproduction and good display effect of the annotated content, enhances the user experience, especially when the screen zoom and direction changes, avoids drawing distortion and provides the satisfaction of personalized annotation needs.
Smart Images

Figure CN119200946A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of information processing technology, and in particular to a method, device, electronic device and storage medium for processing user annotation information. Background Art
[0002] With the development of mobile Internet and terminal technology, people's reading methods have changed. Digital mobile reading has become popular due to its convenience and interactivity. In the process of e-book reading, it is usually necessary to mark information or add notes. Compared with random marking and note-taking on paper books, e-book marking cannot flexibly adapt to reading screens of different resolutions and sizes, resulting in large differences in the display effects of the same data on different reading screens. Summary of the invention
[0003] Based on the problems existing in the prior art, this solution proposes a user annotation information processing method, electronic device and storage medium, which can draw annotation content according to the page size ratio, can flexibly adapt to screen changes, and meet users' personalized annotation needs.
[0004] According to a first aspect of the present invention, a method for processing user annotation information is provided, which is suitable for execution in an electronic device, including: customizing a user-drawn view on a document reading page of the electronic device; monitoring touch events of a user pressing, sliding and lifting on the user-drawn view, recording and storing the coordinates and timestamp information of the touch points; displaying the drawn content in the user-drawn view according to the coordinates and timestamp information of the touch points and the page size of the electronic device, including: obtaining the aspect ratio of the current electronic device, calculating the display ratio of the document page; converting the coordinates of the user's touch points into coordinates in the current document page according to the display ratio; constructing line segments for all touch points after the coordinate conversion is completed, and displaying the constructed line segments in the user-drawn view using a linear interpolation algorithm.
[0005] According to the above technical solution, by recording the coordinates and timestamp information of the touch point, the reproduction of the marked content is more accurate. By obtaining the aspect ratio of the current electronic device, the touch point coordinates can be accurately converted according to different screen sizes and resolutions. The recorded coordinates are scaled according to the page size of the electronic device and the drawn content is displayed. This can ensure good display effects on devices of different sizes, avoid drawing distortion caused by screen differences, and enhance the user experience.
[0006] Optionally, in the user annotation information processing method provided by the present invention, a custom view is created for drawing and displaying drawing content, and multiple custom views are superimposed and layered using a container, and the functions of the multiple custom views include brushes, highlighting, retrieval, and handwritten notes; the onTouchEvent method is rewritten in the custom view to capture user touch events; a Bitmap is maintained for caching drawing content, and the onDraw method is rewritten, and the cached drawing content is drawn on the page through a Canvas object in onDraw.
[0007] By adopting the above technical solution and using Bitmap as a cache for drawing content, the number of times drawing directly on the Canvas can be reduced, reducing the burden on electronic devices. By superimposing multiple custom Views, hierarchical management of different functions can be achieved, and different drawing functions can be modified and optimized without affecting other functions.
[0008] Optionally, in the user annotation information processing method provided by the present invention, multiple brush thickness modes are defined in a custom view; the brush thickness mode is switched according to the user's input status, and when it is detected that the user has completed a complete drawing operation, the drawing content is converted to a thin brush mode and redrawn.
[0009] By adopting the above technical solution, after completing the annotation and redrawing it using the fine pen mode, the information is conveyed more clearly, especially in the expression of complex information, which can reduce visual confusion.
[0010] Optionally, in the user annotation information processing method provided by the present invention, the user's press event on the user drawing view is monitored, and the initial touch point coordinates and timestamp are recorded; the user's sliding event on the user drawing view is monitored, and the coordinate points and timestamps during the movement of the finger are continuously recorded; when the user's lift event on the user drawing view is monitored, the current drawing operation is ended, and the end touch point coordinates and timestamp are recorded; during the completion of a user drawing operation, the recorded coordinate points are stored in the local database of the electronic device in the time order of the timestamps or uploaded to the server synchronously.
[0011] By adopting the above technical solution, by monitoring the pressing, sliding and lifting events, the user's drawing trajectory can be accurately recorded to ensure the integrity and accuracy of the data. The recorded data can be stored in the local database or uploaded to the server synchronously, which can facilitate subsequent analysis, editing and sharing, allowing users to access and manage their drawing content at any time.
[0012] Optionally, in the user annotation information processing method provided by the present invention, the user's manual zoom or move operation is captured, and the user's touch coordinates are recalculated and converted into coordinate positions in the current document page; the screen direction changes are monitored, and the user's touch coordinates are recalculated and converted into coordinate positions in the current document page.
[0013] By adopting the above technical solution, by capturing the user's zooming and moving operations in real time, it is possible to ensure that the user's drawing behavior is always consistent with the current view, avoiding drawing position deviation caused by page changes, thereby improving the user experience.
[0014] Optionally, in the user annotation information processing method provided by the present invention, a rectangular area is calculated based on the starting coordinates of the user's press event and the ending coordinates of the lift event, and the user's click event is monitored to determine whether the user's click coordinates are within the rectangular area. If they are within the rectangular area, a rectangular border is drawn and an operation menu pops up for the user to operate.
[0015] By adopting the above technical solution, a rectangular border is drawn when the user presses the finger, which can ensure that the user's click operation can get accurate feedback. Especially in complex documents or applications, users can more easily find interactive elements, thereby improving usability.
[0016] According to a second aspect of the present invention, a user annotation information processing device is provided, comprising: a custom module, a recording module and a drawing module.
[0017] Among them, the customization module is used to customize the user drawing view on the document reading page of the electronic device; the recording module is used to monitor the touch events of the user pressing, sliding and lifting on the user drawing view, and record and store the coordinates and timestamp information of the touch point; the drawing module is used to display the drawing content in the user drawing view according to the coordinates and timestamp information of the touch point and the page size of the electronic device.
[0018] According to a third aspect of the present invention, there is provided an electronic device comprising: at least one processor; and a memory storing program instructions, wherein the program instructions are configured to be suitable for execution by at least one processor, and the program instructions include instructions for executing the above-mentioned user annotation information processing method.
[0019] According to a fourth aspect of the present invention, a readable storage medium storing program instructions is provided. When the program instructions are read and executed by an electronic device, the electronic device executes the above-mentioned user annotation information processing method.
[0020] In summary, the user annotation information processing method and device provided by the present invention can at least achieve the following technical effects: 1. By recording the user's touch points on the screen (press, slide and lift), the system can accurately capture and reproduce the user's handwriting trajectory, and can draw annotation information according to the size and resolution of the document page to achieve adaptation to mobile terminals of various sizes; 2. The annotation content can be flexibly displayed according to screen zooming, horizontal and vertical screen conversion, etc., so that the drawn content is always displayed in the same position of the document content; 3. Use brushes of different thicknesses when the user is writing and drawing, and use a thinner brush to present the content after the operation is completed. This can not only enhance the visual effect, but also make full use of the screen space, increase the information density of the content, and provide a good user experience.
[0021] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] Figure 1 shows a structural diagram of an electronic device 100 according to an embodiment of the present invention; Figure 2 A schematic diagram showing a flow chart of a method 200 for processing user annotation information according to an embodiment of the present invention; Figure 3 A schematic diagram of a touch point recording process according to an embodiment of the present invention is shown; Figure 4 A schematic structural diagram of a user annotation information processing device 400 according to an embodiment of the present invention is shown. DETAILED DESCRIPTION
[0023] In order to adapt to mobile terminal reading screens of different resolutions and sizes, this solution provides a user annotation information processing method, electronic device and storage medium, which can draw according to the page ratio to meet the user's personalized drawing needs.
[0024] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.
[0025] Figure 1 FIG. 1 is a schematic diagram showing the structure of an electronic device 100 according to an embodiment of the present invention. Figure 1As shown, in a basic configuration 102, the electronic device 100 includes a system memory 106 and one or more processors 104. A memory bus 108 may be used for communication between the processor 104 and the system memory 106.
[0026] The processor 104 may be any type of processor, including but not limited to a microprocessor (µP), a microcontroller (µC), a digital signal processor (DSP), or any combination thereof. The processor 104 may include one or more levels of cache, such as a level 1 cache 110 and a level 2 cache 112, a processor core 114, and registers 116. An example processor core 114 may include an arithmetic logic unit (ALU), a floating point unit (FPU), a digital signal processing core (DSP core), or any combination thereof. An example memory controller 118 may be used with the processor 104, or in some implementations, the memory controller 118 may be an internal part of the processor 104.
[0027] The system memory 106 may be any type of memory, including but not limited to: volatile memory (such as RAM), non-volatile memory (such as ROM, flash memory, etc.) or any combination thereof. The physical memory in the electronic device generally refers to the volatile memory RAM, and the data in the disk needs to be loaded into the physical memory before it can be read by the processor 104. The system memory 106 may include an operating system 120, one or more applications 122, and program data 124. In some embodiments, the application 122 may be arranged to execute instructions on the operating system by one or more processors 104 using the program data 124. The operating system 120 may be, for example, Linux, Windows, etc., which includes program instructions for processing basic system services and performing tasks that depend on hardware. The application 122 includes program instructions for implementing various user-desired functions, and the application 122 may be, for example, a browser, instant messaging software, a software development tool (such as an integrated development environment IDE, a compiler, etc.), etc., but is not limited thereto. When the application 122 is installed in the electronic device 100, a driver module may be added to the operating system 120.
[0028] When the electronic device 100 starts running, the processor 104 reads and executes the program instructions of the operating system 120 from the memory 106. The application 122 runs on the operating system 120, and uses the interface provided by the operating system 120 and the underlying hardware to implement various functions desired by the user. When the user starts the application 122, the application 122 is loaded into the memory 106, and the processor 104 reads and executes the program instructions of the application 122 from the memory 106.
[0029] The electronic device 100 further includes a storage device 132 , which includes a removable storage 136 and a non-removable storage 138 . Both the removable storage 136 and the non-removable storage 138 are connected to the storage interface bus 134 .
[0030] The electronic device 100 may also include an interface bus 140 that facilitates communication from various interface devices (e.g., output devices 142, peripheral interfaces 144, and communication devices 146) to the basic configuration 102 via the bus / interface controller 130. Example output devices 142 include a graphics processing unit 148 and an audio processing unit 150. They can be configured to facilitate communication with various external devices such as a display or a speaker via one or more A / V ports 152. Example peripheral interfaces 144 may include a serial interface controller 154 and a parallel interface controller 156, which may be configured to facilitate communication with external devices such as input devices (e.g., keyboards, mice, pens, voice input devices, touch input devices) or other peripherals (e.g., printers, scanners, etc.) via one or more I / O ports 158. Example communication devices 146 may include a network controller 160, which may be arranged to facilitate communication with one or more other computing devices 162 via a network communication link via one or more communication ports 164.
[0031] A network communication link may be an example of a communication medium. The communication medium may generally be embodied as a computer-readable instruction, data structure, program module in a modulated data signal such as a carrier wave or other transmission mechanism, and may include any information delivery medium. A "modulated data signal" may be a signal in which one or more of its data sets or its changes may be performed in a manner that encodes information in the signal. As a non-limiting example, the communication medium may include a wired medium such as a wired network or a dedicated line network, and various wireless media such as sound, radio frequency (RF), microwave, infrared (IR) or other wireless media. The term computer-readable medium used herein may include both storage media and communication media. In the electronic device 100 according to the present invention, the application 122 includes instructions for executing the user annotation information processing method 200 of the present invention.
[0032] Figure 2 FIG. 2 is a flow chart showing a method 200 for processing user annotation information according to an embodiment of the present invention. Figure 2 As shown, the method 200 begins at step S210, customizing a user-drawn view on a document reading page of an electronic device.
[0033] The document reading page may be any one of a Word document, a PDF document, an Excel document, a PowerPoint document, etc., and this solution does not limit this.
[0034] First, create a custom view (inherited from view) to draw and display the drawn content. Use a container to overlay multiple custom views. The functions of multiple custom views include brushes, highlighting, retrieval, handwritten notes, etc. You can manage multiple custom views in a hierarchical manner to ensure that different types of user interactions reach the appropriate view. For example, you can use ViewGroup to manage the hierarchy of these views. For the highlight function, draw the highlight area by adding a Rect or Path variable in the onDraw method. For the retrieval function, maintain a list to record all highlight and annotation locations, and search and display them when clicked.
[0035] Rewrite the onTouchEvent method in the custom view to capture the user's touch events, so as to record the coordinates or coordinate tracks based on these events. Maintain a Bitmap to cache the drawing content, rewrite the onDraw method, and draw the cached drawing content on the page through the Canvas object in onDraw.
[0036] In order to optimize the use of screen space while ensuring the intuitiveness of user operations and the readability of content presentation, in one embodiment of the present invention, multiple brush thickness modes can be defined in a custom view, and the brush thickness mode can be switched according to the user's input status. When it is detected that the user has completed a complete drawing operation, the drawn content is converted to a thin brush mode and redrawn. For example, the system has built-in multiple brush thickness options, and the user can choose to use a thick pen (such as 5px) for fast writing and drawing, and a thin pen (such as 1px or 2px) for the final presentation. When the user writes quickly, the system can automatically use a thick pen, and after pausing or completing writing, switch to a thin pen for content display, so that more content can be displayed on the screen without appearing crowded or overlapping.
[0037] In step S220, the touch events of the user pressing, sliding and lifting on the user drawing view are monitored, and the coordinates and timestamp information of the touch points are recorded and stored.
[0038] Users can use their fingers or a stylus to trigger interactive events. Figure 3 FIG. 2 shows a schematic diagram of a touch point recording process according to an embodiment of the present invention. Figure 3As shown, after the user turns on the editing mode, the user's press event on the user drawing view is monitored, and the initial touch point coordinates and timestamp are recorded. If the user quickly lifts up after pressing, it indicates an invalid operation and no record is made. The user's sliding event on the user drawing view is monitored. The sliding operation is uninterrupted, and the coordinate points and timestamps of the finger movement are continuously recorded. When the user's lift event on the user drawing view is monitored, the current drawing operation is ended, and the end touch point coordinates and timestamp are recorded. During the completion of a user drawing operation, the recorded coordinate points are stored in the local database of the electronic device in the time order of the timestamps or uploaded to the server synchronously. For example, use an appropriate data structure (such as ArrayList) to save each coordinate point, including the coordinates of each press, slide, and lift, as shown in the following table: A drawing operation is completed according to the three action events of pressing, sliding, and lifting. After the drawing is completed, all the recorded coordinates and timestamp information are combined into a set, and combined with user data, e-book data, etc. to form a complete set of drawing data. For example, all drawing information (including coordinate points, user ID, e-book ID, page number, and timestamp, etc.) are combined into a set of data for storage. The example structure is as follows: json { "userId": "user123", "bookId": "book456", "page": 1, "drawings": [{"points":[(x0,y0)...(xn,yn)],"timestamp":"2024-10-24T12:00:00Z"}]} Finally, in step S230, the drawing content is displayed in the user drawing view according to the coordinates and timestamp information of the touch point and the page size of the electronic device, including: obtaining the aspect ratio of the current electronic device and calculating the display ratio of the document page; converting the coordinates of the user's touch point into coordinates in the current document page according to the display ratio; constructing line segments for all touch points after the coordinate conversion, and using a linear interpolation algorithm to display the constructed line segments in the user drawing view.
[0039] In order to adapt to different devices and page zoom operations, you can get the aspect ratio of the current electronic device and calculate the display ratio of the document page. Convert the coordinates of the user's touch point to the coordinates in the current document page according to the display ratio. For example, use the Canvas.scale() and Canvas.translate() methods to scale and translate the drawn content, so as to display the screen of appropriate proportions on different devices, and scale the drawn content according to the resolution of different devices, so that the drawn content remains stable in relative position. Construct line segments for all touch points after the coordinate conversion, and use the linear interpolation algorithm to display the constructed line segments in the user's drawing view.
[0040] In one embodiment of the present invention, the user's manual zooming operation can be captured, and the user's touch coordinates can be recalculated and converted into coordinate positions in the current document page, so that more content can be displayed in a limited screen space to prevent overlap after filling the entire drawing area. For example, a Matrix is used for zooming adjustment to ensure that each stroke of the user is accurately mapped to a suitable screen position when drawing.
[0041] By monitoring the screen orientation changes, such as the onConfigurationChanged method, the user's touch coordinates are recalculated and converted into the coordinate position in the current document page. This ensures that the drawn content will not be distorted or truncated due to the change in screen orientation.
[0042] The brush path is represented as a sequence of coordinate points (starting point and ending point), through which a minimum covering rectangle can be calculated, which is the click response area of the brush content. That is, a rectangular area can be calculated based on the starting coordinates of the user's press event and the ending coordinates of the lift event. Listen to the user's click event to determine whether the user's click coordinates are within the rectangular area. If they are within the rectangular area, a rectangular border is drawn and an operation menu pops up for the user to operate. This menu may include various options, such as deleting the brush content, editing, changing the color or thickness, etc. The user can make a selection through the pop-up menu and perform the corresponding operation.
[0043] Figure 4 FIG. 4 is a schematic diagram showing the structure of a user annotation information processing device 400 according to an embodiment of the present invention. Figure 4 As shown, the device 400 includes: a customization module 410 , a recording module 420 and a drawing module 430 .
[0044] Among them, the custom module 410 can customize the user-drawn view on the document reading page of the electronic device. The custom module 410 can create a custom view (inherited view) for drawing and displaying drawn content, and use a container to overlay multiple custom views. The functions of multiple custom views include brushes, highlighting, retrieval, handwritten notes, etc. Multiple custom views can be managed hierarchically to ensure that different types of user interactions reach the appropriate view. For example, ViewGroup can be used to manage the hierarchy of these views. For the highlight function, the highlight area is drawn by adding a Rect or Path variable in the onDraw method. For the retrieval function, a list is maintained to record all highlight and annotation locations, and search and display them when clicked.
[0045] Rewrite the onTouchEvent method in the custom view to capture the user's touch events, so as to record the coordinates or coordinate tracks based on these events. Maintain a Bitmap to cache the drawing content, rewrite the onDraw method, and draw the cached drawing content on the page through the Canvas object in onDraw.
[0046] In order to optimize the use of screen space while ensuring the intuitiveness of user operations and the readability of content presentation, in one embodiment of the present invention, the custom module 410 can define multiple brush thickness modes in the custom view, switch the brush thickness mode according to the user's input status, and when it is detected that the user has completed a complete drawing operation, convert the drawn content to the thin brush mode and redraw it. For example, the system has multiple built-in brush thickness options, and the user can choose to use a thick pen (such as 5px) for fast writing and drawing, and a thin pen (such as 1px or 2px) for the final presentation. When the user writes quickly, the system can automatically use a thick pen, and after pausing or completing writing, switch to a thin pen for content display, so that more content can be displayed on the screen without appearing crowded or overlapping.
[0047] The recording module 420 can monitor the touch events of the user pressing, sliding and lifting on the user drawing view, and record and store the coordinates and timestamp information of the touch point. Specifically, the recording module 420 can monitor the user's pressing event on the user drawing view, and record the initial touch point coordinates and timestamp. If the user presses and then lifts up quickly, it means an invalid operation and no record is made. Monitor the user's sliding event on the user drawing view, the sliding operation is uninterrupted, and the coordinate points and timestamps of the finger movement are continuously recorded. When the user's lifting event on the user drawing view is monitored, the current drawing operation is terminated, and the end touch point coordinates and timestamp are recorded. During the completion of a user drawing operation, the recorded coordinate points are stored in the local database of the electronic device in the time order of the timestamps or uploaded to the server synchronously. A drawing operation is completed according to the three action events of pressing, sliding, and lifting. After the drawing is completed, all recorded coordinates and timestamp information are combined into a set, and combined with user data, e-book data, etc. to form a complete set of drawing data.
[0048] The drawing module 430 can display the drawing content in the user drawing view according to the coordinates and timestamp information of the touch point and the page size of the electronic device. In order to adapt to different devices and page zoom operations, the drawing module 430 can obtain the aspect ratio of the current electronic device and calculate the display ratio of the document page. Convert the coordinates of the user's touch point to the coordinates in the current document page according to the display ratio. Construct line segments for all touch points after the coordinate conversion, and use a linear interpolation algorithm to display the constructed line segments in the user drawing view. It is also possible to capture the user's manual zoom operation and recalculate the user's touch coordinates to the coordinate position in the current document page so as to display more content in a limited screen space and prevent overlap after filling the entire drawing area. By monitoring the change in screen direction, the user's touch coordinates are recalculated to the coordinate position in the current document page, so that the drawing content will not be distorted or truncated due to changes in the screen direction.
[0049] In summary, the user annotation information processing method and device provided by the present invention can at least achieve the following technical effects: 1. By recording the user's touch points on the screen (press, slide and lift), the system can accurately capture and reproduce the user's handwriting trajectory, and can draw annotation information according to the size and resolution of the document page to achieve adaptation to mobile terminals of various sizes; 2. The annotation content can be flexibly displayed according to screen zooming, horizontal and vertical screen conversion, etc., so that the drawn content is always displayed in the same position of the document content; 3. Use brushes of different thicknesses when the user is writing and drawing, and use a thinner brush to present the content after the operation is completed. This can not only enhance the visual effect, but also make full use of the screen space, increase the information density of the content, and provide a good user experience.
[0050] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.
[0051] Although the present invention has been described according to a limited number of embodiments, it will be apparent to those skilled in the art, with the benefit of the above description, that other embodiments may be envisioned within the scope of the invention thus described. In addition, it should be noted that the language used in this specification is selected primarily for readability and teaching purposes, rather than for explaining or defining the subject matter of the present invention. Therefore, many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the appended claims. The disclosure of the present invention is illustrative and not restrictive with respect to the scope of the present invention, and the scope of the present invention is defined by the appended claims.
Claims
1. A method for processing user annotation information, suitable for execution in an electronic device, characterized in that: include: Customize user-drawn views on document reading pages on electronic devices; Monitor the touch events of the user pressing, sliding and lifting on the user drawn view, and record and store the coordinates and timestamp information of the touch point; The drawing content is displayed in the user drawing view according to the coordinates and timestamp information of the touch point and the page size of the electronic device, including: obtaining the aspect ratio of the current electronic device and calculating the display ratio of the document page; converting the coordinates of the user's touch point into coordinates in the current document page according to the display ratio; constructing line segments for all touch points after the coordinate conversion, and using a linear interpolation algorithm to display the constructed line segments in the user drawing view.
2. The method for processing user annotation information according to claim 1, characterized in that: The step of customizing a user-drawn view on a document reading page of an electronic device comprises: Create a custom view for drawing and displaying drawing content, and use a container to overlay multiple custom views. The functions of the multiple custom views include brushes, highlighting, retrieval, and handwritten notes. Rewrite the onTouchEvent method in the custom view to capture the user's touch events; A Bitmap is maintained for caching drawing content, and the onDraw method is rewritten. In the onDraw method, the cached drawing content is drawn on the page through the Canvas object.
3. The method for processing user annotation information according to claim 2, characterized in that: The step of customizing the user-drawn view on the document reading page of the electronic device also includes: Define multiple brush thickness modes in the custom view; The brush thickness mode is switched according to the user's input status. When it is detected that the user has completed a complete drawing operation, the drawing content is converted to the thin brush mode and redrawn.
4. The method for processing user annotation information according to claim 1, characterized in that: The step of monitoring the touch events of the user pressing, sliding and lifting on the user drawn view, and recording and storing the coordinates and timestamp information of the touch points comprises: Listen for user press events on the user-drawn view, and record the initial touch point coordinates and timestamp; Listen to the sliding events of the user on the user drawing view, and continuously record the coordinate points and timestamps of the finger movement; When a lift event of the user drawing view is detected, the current drawing operation is terminated, and the coordinates and timestamp of the end touch point are recorded; During the completion of a user drawing operation, the recorded coordinate points are stored in the local database of the electronic device in the time sequence of the timestamps or are synchronously uploaded to the server.
5. The method for processing user annotation information according to claim 1, characterized in that: The step of displaying the drawing content in the user drawing view according to the coordinates and timestamp information of the touch point and the page size of the electronic device also includes: Capture the user's manual zoom or move operation, and recalculate the user's touch coordinates to convert them into coordinate positions in the current document page; Monitor screen orientation changes and recalculate the user's touch coordinates into coordinate positions in the current document page.
6. The method for processing user annotation information according to claim 1, characterized in that: The method further comprises: A rectangular area is calculated based on the starting coordinates of the user's press event and the ending coordinates of the lift event; the user's click event is monitored to determine whether the user's click coordinates are within the rectangular area. If they are within the rectangular area, a rectangular border is drawn and an operation menu is popped up for the user to operate.
7. A user annotation information processing device, characterized in that: include: A custom module for customizing user-drawn views on a document reading page of an electronic device; A recording module, used to monitor the touch events of the user pressing, sliding and lifting on the user drawing view, and record and store the coordinates and timestamp information of the touch point; A drawing module is used to display the drawing content in the user drawing view according to the coordinates and timestamp information of the touch point and the page size of the electronic device, including: obtaining the aspect ratio of the current electronic device and calculating the display ratio of the document page; converting the coordinates of the user's touch point into coordinates in the current document page according to the display ratio; constructing line segments for all touch points after the coordinate conversion, and using a linear interpolation algorithm to display the constructed line segments in the user drawing view.
8. An electronic device, characterized in that: include: At least one processor and a memory storing program instructions, wherein the program instructions are configured to be suitable for being executed by the at least one processor, and the program instructions include instructions for executing the user annotation information processing method according to any one of claims 1-6.
9. A readable storage medium storing program instructions, characterized in that: When the program instructions are read and executed by an electronic device, the electronic device executes the user annotation information processing method as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Embedded multi-format electronic document marking method
CN101539905A
Electronic reading control method and apparatus as well as touch screen device
CN105278758A
E-ink book and reading note implementation method and device thereof
CN105446647A
Remote headnote moving and scaling synchronization method and system
CN105573702A
Webpage content same-screen annotation method based on a mobile terminal and a browser
CN109657171A