Annotation method, device and equipment based on large-screen equipment and storage medium

By detecting the touch action of the large-screen device, the writing action of the smart pen is automatically entered into the annotation mode, and the annotation content is rendered in real time with the smart pen, which solves the complex and inconvenient annotation problem in the existing technology and improves the user experience.

CN118963581APending Publication Date: 2024-11-15GUANGZHOU LANGO ELECTRONICS TECH CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202410975543.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-19
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

Existing large-screen devices are complicated and time-consuming to use when annotating. Users need to manually enter the annotation mode and move to the sidebar to click the button, which affects the user experience.

Method used

By detecting the touch screen's touch action, the smart pen automatically enters the annotation mode when writing action, using the pressure sensor to obtain the coordinates and time of the contact point, render and save the annotation content in real time, build a transparent annotation layer, and on large-screen devices or cloud Save in the server.

Benefits of technology

It realizes separation of work, simple and fast operation, avoids interrupting user rhythm, improves user experience, and facilitates viewing or calling saved annotated content.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118963581A_ABST
    Figure CN118963581A_ABST
Patent Text Reader

Abstract

According to the annotation method, device and equipment based on the large-screen equipment and the storage medium, the touch action of the touch screen of the large-screen equipment is detected, when the touch action is the writing action of an intelligent pen, the annotation mode is entered, operation of a user on the touch screen with fingers is not affected, separation of the hand and the pen is achieved, and the user experience is improved. The comment mode is automatically entered based on writing action detection of the intelligent pen, convenience and rapidness are achieved, operation is easy, the rhythm of a user is prevented from being interrupted, and user experience is improved; and under the condition of entering the annotation mode, detecting the annotation content of the intelligent pen, rendering the annotation content on the constructed annotation layer in real time, and storing the annotation content, so that a user can conveniently check or call the stored annotation content.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of large-screen devices, and in particular to an annotation method, apparatus, device and storage medium based on large-screen devices. Background Art

[0002] In existing large-screen devices, when users need to make annotations, they usually need to manually enter the annotation mode, for example, they need to click the annotation button in the sidebar and perform multiple confirmation operations before entering the annotation mode. This method is complicated and time-consuming, and it is easy to interrupt the user's rhythm. At the same time, if the user is not at the edge of the large-screen device, he or she must move to the sidebar to click the annotation button in the sidebar, which is very inconvenient and the user experience is poor. Summary of the invention

[0003] The embodiment of the present application provides an annotation method, apparatus, device and storage medium based on a large-screen device to solve at least one problem existing in the related art. The technical solution is as follows:

[0004] In a first aspect, an embodiment of the present application provides a method for annotation based on a large-screen device, comprising:

[0005] Detect touch actions on the touch screen of large-screen devices;

[0006] When the touch action is a writing action of the smart pen, entering the annotation mode;

[0007] In the case of entering the annotation mode, detecting the annotation content of the smart pen;

[0008] The annotation content is rendered in real time on the constructed annotation layer, and the annotation content is saved, and the saved annotation content is available for viewing or calling.

[0009] In one implementation, when entering the annotation mode, detecting the annotation content of the smart pen includes:

[0010] When entering the annotation mode, the coordinates of each contact point of the smart pen and the corresponding contact time are obtained through the pressure sensor;

[0011] The annotation content of the smart pen is determined according to the contact point coordinates and the corresponding sequence of the contact times.

[0012] In one implementation, the real-time rendering of the annotation content on the constructed annotation layer and saving the annotation content includes:

[0013] In the case of entering the annotation mode, constructing a topmost and transparent annotation layer in the touch screen;

[0014] The annotation content is rendered in real time on the annotation layer through a drawing engine, and the real-time rendered annotation content is saved in at least one of the large-screen device and the cloud server.

[0015] In one embodiment, the method further comprises:

[0016] Detecting the lower layer display content of the annotation layer;

[0017] When the lower layer display content is a document of a specified type, determining the annotation position of the document of the specified type;

[0018] According to the annotation position, the saved annotation content is inserted.

[0019] In one implementation, when the lower layer displayed content is a document of a specified type, determining the annotation position of the document of the specified type includes:

[0020] When the lower layer display content is a WORD document, a target text in the WORD document is determined according to the coordinate data of the annotation content, an annotation column is generated based on the target text, and the position of the annotation column is determined as the annotation position;

[0021] When the lower layer display content is a PDF document or a PPT document, the target text in the PDF document or the PPT document is determined according to the coordinate data of the annotation content, a comment box of the annotation is generated based on the target text, and the position of the comment box is determined as the annotation position.

[0022] In one embodiment, the method further comprises:

[0023] When the annotation mode entered is the default normal mode, an annotation toolbar is displayed on the touch screen, and the annotation toolbar includes a folding button, a brush button, a finger writing button, a history button, and a snapshot button;

[0024] When the fold button is clicked, the annotation toolbar is folded and displayed as a floating icon, and when the floating icon is clicked, the annotation toolbar is expanded;

[0025] When the finger writing button is clicked, the default brush writing state is entered into the finger writing state;

[0026] When the history button is clicked, the saved annotation content is displayed;

[0027] When the snapshot button is clicked, the snapshot function is triggered.

[0028] In one embodiment, the annotation toolbar further includes a screenshot annotation button, and the real-time rendering of the annotation content on the constructed annotation layer and saving the annotation content further includes:

[0029] When the screenshot annotation button is clicked, the screenshot annotation mode is entered, and a topmost and transparent annotation layer is constructed in the touch screen;

[0030] When the annotation mode entered is the screenshot annotation mode, the screenshot is used as the background, the annotation content is rendered on the background in real time on the annotation layer through the drawing engine, and a save button is displayed on the annotation toolbar;

[0031] When the save button is clicked, the background and the annotation content are saved in at least one of the large-screen device and the cloud server.

[0032] In a second aspect, an embodiment of the present application provides an annotation device based on a large-screen device, including:

[0033] A first detection module, used to detect touch actions of the touch screen of the large-screen device;

[0034] An annotation module, used for entering an annotation mode when the touch action is a writing action of a smart pen;

[0035] A second detection module, used for detecting the annotation content of the smart pen when entering the annotation mode;

[0036] The rendering module is used to render the annotation content in real time on the constructed annotation layer and save the annotation content. The saved annotation content is provided for viewing or calling.

[0037] In one embodiment, the annotation device based on the large-screen device further includes a processing module, and the processing module is used to:

[0038] Detecting the lower layer display content of the annotation layer;

[0039] When the lower layer display content is a document of a specified type, determining the annotation position of the document of the specified type;

[0040] According to the annotation position, the saved annotation content is inserted.

[0041] In one embodiment, the processing module is further configured to:

[0042] When the annotation mode entered is the default normal mode, an annotation toolbar is displayed on the touch screen, and the annotation toolbar includes a folding button, a brush button, a finger writing button, a history button, and a snapshot button;

[0043] When the fold button is clicked, the annotation toolbar is folded and displayed as a floating icon, and when the floating icon is clicked, the annotation toolbar is expanded;

[0044] When the finger writing button is clicked, the default brush writing state is entered into the finger writing state;

[0045] When the history button is clicked, the saved annotation content is displayed;

[0046] When the snapshot button is clicked, the snapshot function is triggered.

[0047] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a processor and a memory, wherein the memory stores instructions, and the instructions are loaded and executed by the processor to implement a method in any one of the above-mentioned embodiments.

[0048] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed, the method in any one of the above-mentioned embodiments is implemented.

[0049] The beneficial effects of the above technical solution include at least:

[0050] By detecting the touch action of the touch screen of the large-screen device, when the touch action is the writing action of the smart pen, the annotation mode is entered, which does not affect the user's operation of the touch screen with fingers, realizes the separation of hand and pen, and automatically enters the annotation mode based on the writing action detection of the smart pen. It is convenient and fast, simple to operate, avoids interrupting the user's rhythm, and improves the user experience; when entering the annotation mode, the annotation content of the smart pen is detected, the annotation content is rendered in real time on the constructed annotation layer, and the annotation content is saved, so that the user can view or call the saved annotation content conveniently.

[0051] The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present application will be readily apparent by reference to the accompanying drawings and the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In the accompanying drawings, unless otherwise specified, the same reference numerals throughout the multiple drawings represent the same or similar parts or elements. These drawings are not necessarily drawn to scale. It should be understood that these drawings only depict some embodiments disclosed in the present application and should not be regarded as limiting the scope of the present application.

[0053] Figure 1 This is a schematic diagram of the steps of an annotation method based on a large-screen device according to an embodiment of the present application;

[0054] Figure 2 A schematic diagram of an annotation toolbar according to an embodiment of the present application;

[0055] Figure 3 This is a structural block diagram of an annotation device based on a large-screen device according to an embodiment of the present application;

[0056] Figure 4 This is a structural block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0057] In the following, only some exemplary embodiments are briefly described. As those skilled in the art will appreciate, the described embodiments may be modified in various ways without departing from the spirit or scope of the present application. Therefore, the drawings and descriptions are considered to be exemplary and non-restrictive in nature.

[0058] Reference Figure 1 , a flowchart of an annotation method based on a large-screen device according to an embodiment of the present application is shown. The annotation method based on a large-screen device may at least include steps S100-S400:

[0059] S100: Detecting a touch action of a touch screen of a large-screen device.

[0060] S200: When the touch action is a writing action of the smart pen, enter the annotation mode.

[0061] S300: When entering the annotation mode, detecting the annotation content of the smart pen.

[0062] It should be noted that the annotation content can be text or graphics, without specific limitation.

[0063] S400, rendering the annotation content in real time on the constructed annotation layer, and saving the annotation content, and the saved annotation content is available for viewing or calling.

[0064] The annotation method based on the large-screen device in the embodiment of the present application can be executed by the control system of the large-screen device. The control system may include a controller and a sensor module. The sensor module is used to detect data for processing by the controller. The sensor module can be set in the touch screen. For example, the coordinates, pressure and angle data of the contact point can be obtained.

[0065] The technical solution of the embodiment of the present application detects the touch action of the touch screen of the large-screen device. When the touch action is the writing action of the smart pen, it enters the annotation mode without affecting the user's operation of the touch screen with fingers, thereby realizing the separation of hand and pen. It automatically enters the annotation mode based on the writing action detection of the smart pen. It is convenient and fast, and the operation is simple. There is no need to confirm the operation multiple times, which avoids interrupting the user's rhythm and improves the user experience. When entering the annotation mode, the annotation content of the smart pen is detected, the annotation content is rendered in real time on the constructed annotation layer, and the annotation content is saved, so that the user can view or call the saved annotation content conveniently.

[0066] In one embodiment, the control system of the large-screen device can sense and detect the touch action of the touch screen of the large-screen device. If the writing action of a smart pen (such as a capacitive smart pen) is detected, it will automatically trigger the entry into the annotation mode. If the smart pen is not detected, the user can use his fingers to perform normal operations such as handwriting, sliding, and zooming in. In some embodiments, a preset track can also be set in advance. When the smart pen is detected and the writing track meets the preset track, the annotation mode is triggered.

[0067] In one implementation, step S300 includes steps S310-S320:

[0068] S310: When entering the annotation mode, the coordinates of each contact point of the smart pen and the corresponding contact time are obtained through the pressure sensor.

[0069] In the embodiment of the present application, when entering the annotation mode, the coordinates of each contact point where the smart pen contacts the touch screen when writing are obtained through the pressure sensor set on the touch screen in the sensor module, and the contact time corresponding to each contact point coordinate is determined.

[0070] S320: Determine the annotation content of the smart pen according to the contact point coordinates and the order of the corresponding contact time.

[0071] In an embodiment of the present application, after determining the coordinates of each contact point and the corresponding contact time, the coordinates of each contact point are arranged in order based on the corresponding contact time, and the annotation content of the smart pen is determined, so that in subsequent rendering, the real-time handwriting display effect can be rendered based on the movement of the smart pen.

[0072] Optionally, after determining the contact point coordinates, corresponding contact time and other data, the control system can perform preprocessing, remove noise and perform data filtering to ensure the accuracy of the data; and the control system can identify whether it is a writing action by judging the pressure, trajectory and angle changes of the touch point. If it is a writing action, it is considered that the writing action of the smart pen is detected.

[0073] In one implementation, step S400 includes steps S410-S420:

[0074] S410: When entering the annotation mode, a topmost and transparent annotation layer is constructed on the touch screen.

[0075] Optionally, when entering the annotation mode, the control system will construct a transparent annotation layer on the top layer of the content displayed on the touch screen.

[0076] S420: Render the annotation content in real time on the annotation layer through a drawing engine, and save the real-time rendered annotation content in at least one of a large-screen device and a cloud server.

[0077] Optionally, the control system of the large-screen device uses a drawing engine (including but not limited to OpenGL) to render the annotation content on the annotation layer in real time, restore the handwriting in real time, ensure that the rendering engine runs at a high frame rate, provide a smooth writing experience, and batch process the data of multiple contact points to reduce rendering delays, ensuring the smoothness and naturalness of the writing experience; and because the annotation layer is transparent, when the annotation content is displayed, it has the display effect of annotating on the original display content, and has strong real-time performance, which is conducive to enhancing the user experience and the effect of the annotation.

[0078] In an embodiment of the present application, the real-time rendered annotation content can be saved in at least one of the large-screen device and the cloud server, and the saved annotation content is available for users to view or call to ensure the security and accessibility of the data.

[0079] In the embodiment of the present application, two annotation modes are supported: the default normal mode and the screenshot annotation mode. When entering the annotation mode, the default mode is the normal mode, in which the smart pen is in the writing state by default. When the annotation mode entered is the default normal mode, the annotation toolbar is displayed on the touch screen, such as Figure 2 As shown, it is a schematic diagram of entering the normal mode when displaying the content of the gray canvas. The annotation toolbar includes but is not limited to a move button 11, a collapse button 12, a brush button, a finger writing button, a history button, a snapshot button, a screenshot annotation button, an eraser button, and a close button.

[0080] In an embodiment of the present application, when the annotation mode entered is the normal mode, the displayed annotation toolbar can provide animation or prompts to guide the user to pay attention to the location of the annotation toolbar; at the same time, the annotation toolbar can be displayed above, below or in the sidebar of the touch screen.

[0081] In the embodiment of the present application, the user moves the position of the annotation toolbar by clicking the move button 11; clicks the collapse button 12 to collapse the annotation toolbar and display it as a floating icon, and reopens the annotation toolbar when clicking the floating icon; when clicking the close button, the annotation toolbar is closed and the annotation mode is exited; when clicking the eraser button, the annotation content can be erased; when clicking the brush button, the smart pen can be used to write, and when clicking the finger writing button, it enters the finger writing state from the default brush writing state; when clicking the history button, the saved annotation content is displayed; when clicking the snapshot button, the snapshot function is triggered.

[0082] In the embodiment of the present application, when the screenshot annotation button is clicked, the screenshot annotation mode is entered, and at this time step S400 may also be:

[0083] 1. Build a topmost and transparent annotation layer in the touch screen.

[0084] 2. When the annotation mode entered is the screenshot annotation mode, the screenshot is used as the background, and the annotation content is rendered in real time on the background on the annotation layer through the drawing engine, and a save button is displayed on the annotation toolbar.

[0085] In the embodiment of the present application, when the annotation mode entered is the screenshot annotation mode, the screenshot is used as the background, and the annotation content is rendered in real time on the background on the annotation layer through the drawing engine. The difference from the annotation mode being the normal mode is that the screenshot can also be used as the background to combine with the annotation content. In this case, the background of the screenshot is also part of the annotation, and the final annotation content includes the screenshot background and the annotation content to meet the needs of users in different situations. Then, a save button can be displayed on the annotation toolbar. When the save button is clicked, the background and the annotation content are saved as the final annotation content on at least one of the large-screen device and the cloud server. Similarly, the saved final annotation content is available for users to view or call.

[0086] It should be noted that if you enter the screenshot annotation mode, if the touch screen is playing content such as a video, the playback will be paused at this time, and will automatically continue to play after exiting the screenshot annotation mode.

[0087] In one embodiment, when entering the annotation mode, when the user is writing, the annotation toolbar is automatically hidden to provide a maximized writing space; and when it is detected that the user stops writing or performs other gesture operations, the annotation toolbar is redisplayed.

[0088] In one implementation, the annotation method based on a large-screen device in the embodiment of the present application may further include steps S510-S530:

[0089] S510, detecting the lower layer display content of the annotation layer.

[0090] Optionally, after establishing a transparent annotation layer at the top layer, the lower display content of the annotation layer is detected. For example, if the touch screen originally displays a document and enters the annotation mode, the lower display content of the annotation layer is the document.

[0091] S520: When the lower layer displayed content is a document of a specified type, determine the annotation position of the document of the specified type.

[0092] Optionally, step S520 includes S5201 or S5202:

[0093] S5201. When the lower layer display content is a WORD document, determine the target text in the WORD document according to the coordinate data of the annotation content, generate an annotation column based on the target text, and determine the position of the annotation column as the annotation position.

[0094] In one embodiment, when the lower layer display content is a WORD document, the target text in the WORD document is determined based on the coordinate data of the annotation content. For example, when a user needs to annotate a text, he or she usually starts writing the annotation content on the text or near the text. Therefore, the earliest coordinate data in the annotation content can be extracted, and then the text closest to the coordinate data in the WORD document can be determined as the target text. Then, the annotation function for the target text is triggered in the WORD document, a annotation column for the target text is generated, and then the position of the annotation column is determined as the annotation position.

[0095] S5202: When the lower-level display content is a PDF document or a PPT document, determine the target text in the PDF document or the PPT document according to the coordinate data of the annotation content, generate a comment box for the annotation based on the target text, and determine the position of the comment box as the annotation position.

[0096] In one embodiment, when the lower-level display content is a PDF document or a PPT document, the target text in the PDF document or PPT document is determined based on the coordinate data of the annotation content. Similarly, when a user needs to annotate a text, he or she usually starts writing the annotation content on or near the text. Therefore, the earliest coordinate data in the annotation content is extracted, and then the text closest to the coordinate data in the PDF document or PPT document is determined as the target text. Then, the annotation function for the target text is triggered in the PDF document or PPT document, a comment box for the target text is generated, and the position of the comment box is determined as the annotation position.

[0097] S530. Insert the saved annotation content according to the annotation position.

[0098] Optionally, after the annotation position is determined, the saved annotation content is inserted. For example, in normal mode, the annotation content is inserted into the annotation position, and in screenshot annotation mode, the final annotation content including the annotation content and the screenshot background is inserted into the annotation position.

[0099] Reference Figure 3 , shows a structural block diagram of an annotation device based on a large-screen device according to an embodiment of the present application, and the device may include:

[0100] A first detection module, used to detect touch actions of the touch screen of the large-screen device;

[0101] An annotation module, used to enter the annotation mode when the touch action is a writing action of the smart pen;

[0102] The second detection module is used to detect the annotation content of the smart pen when entering the annotation mode;

[0103] The rendering module is used to render the annotation content on the constructed annotation layer in real time and save the annotation content. The saved annotation content is available for viewing or calling.

[0104] In one embodiment, the annotation device based on the large-screen device further includes a processing module, which is used to:

[0105] Detect the lower display content of the annotation layer;

[0106] When the lower layer display content is a document of a specified type, determining the annotation position of the document of the specified type;

[0107] Insert the saved annotation content according to the annotation position.

[0108] In one embodiment, the processing module is further configured to:

[0109] When the annotation mode entered is the default normal mode, the annotation toolbar is displayed on the touch screen, and the annotation toolbar includes a folding button, a brush button, a finger writing button, a history button, and a snapshot button;

[0110] When the collapse button is clicked, the annotation toolbar is collapsed and displayed as a floating icon, and when the floating icon is clicked, the annotation toolbar is expanded;

[0111] When the finger writing button is clicked, the default brush writing state is entered into the finger writing state;

[0112] When the history button is clicked, the saved annotation content is displayed;

[0113] When the snapshot button is clicked, the snapshot function is triggered.

[0114] The functions of each module in each device in the embodiments of the present application can be found in the corresponding description in the above method, and will not be repeated here.

[0115] Reference Figure 4 , shows a structural block diagram of an electronic device according to an embodiment of the present application, the electronic device includes: a memory 310 and a processor 320, the memory 310 stores instructions that can be run on the processor 320, and the processor 320 loads and executes the instructions to implement the annotation method based on the large-screen device in the above embodiment. The number of the memory 310 and the processor 320 can be one or more.

[0116] In one embodiment, the electronic device also includes a communication interface 330 for communicating with external devices and performing data exchange transmission. If the memory 310, the processor 320 and the communication interface 330 are implemented independently, the memory 310, the processor 320 and the communication interface 330 can be interconnected through a bus and complete mutual communication. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 4 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0117] Optionally, in a specific implementation, if the memory 310, the processor 320 and the communication interface 330 are integrated on a chip, the memory 310, the processor 320 and the communication interface 330 can communicate with each other through an internal interface.

[0118] An embodiment of the present application provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the annotation method based on a large-screen device provided in the above embodiment.

[0119] An embodiment of the present application also provides a chip, which includes a processor for calling and executing instructions stored in the memory from the memory, so that a communication device equipped with the chip executes the method provided by the embodiment of the present application.

[0120] An embodiment of the present application also provides a chip, including: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected via an internal connection path, and the processor is used to execute the code in the memory. When the code is executed, the processor is used to execute the method provided in the embodiment of the application.

[0121] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. It is worth noting that the processor may be a processor supporting the advanced RISC machines (ARM) architecture.

[0122] Further, optionally, the above-mentioned memory may include a read-only memory and a random access memory, and may also include a non-volatile random access memory. The memory may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may include a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may include a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available. For example, static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct rambus RAM (DR RAM).

[0123] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.

[0124] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example" or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. Moreover, the described specific features, structures, materials or characteristics may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine different embodiments or examples described in this specification and the features of different embodiments or examples, unless they are contradictory.

[0125] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0126] Any process or method description in the flow chart or otherwise described herein can be understood to represent a module, fragment or portion of a code including one or more executable instructions for implementing the steps of a specific logical function or process. And the scope of the preferred embodiment of the present application includes other implementations, in which the functions may not be performed in the order shown or discussed, including in a substantially simultaneous manner or in a reverse order according to the functions involved.

[0127] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, which can be embodied in any computer-readable medium for use by an instruction execution system, apparatus or device (such as a computer-based system, a system including a processor or other system that can fetch instructions from an instruction execution system, apparatus or device and execute instructions), or used in combination with these instruction execution systems, apparatuses or devices.

[0128] It should be understood that the various parts of the present application can be implemented with hardware, software, firmware or a combination thereof. In the above embodiments, multiple steps or methods can be implemented with software or firmware stored in a memory and executed by a suitable instruction execution system. All or part of the steps of the above embodiment method can be completed by instructing the relevant hardware through a program, which can be stored in a computer-readable storage medium, and when the program is executed, it includes one of the steps of the method embodiment or a combination thereof.

[0129] In addition, each functional unit in each embodiment of the present application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. If the above-mentioned integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. The storage medium can be a read-only memory, a disk or an optical disk, etc.

[0130] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for annotation based on a large-screen device, characterized in that: include: Detect touch actions on the touch screen of large-screen devices; When the touch action is a writing action of the smart pen, entering the annotation mode; In the case of entering the annotation mode, detecting the annotation content of the smart pen; The annotation content is rendered in real time on the constructed annotation layer, and the annotation content is saved, and the saved annotation content is available for viewing or calling.

2. The annotation method based on a large-screen device according to claim 1, characterized in that: In the case of entering the annotation mode, detecting the annotation content of the smart pen includes: When entering the annotation mode, the coordinates of each contact point of the smart pen and the corresponding contact time are obtained through the pressure sensor; The annotation content of the smart pen is determined according to the contact point coordinates and the corresponding sequence of the contact times.

3. The annotation method based on a large-screen device according to claim 1, characterized in that: The real-time rendering of the annotation content on the constructed annotation layer and saving the annotation content includes: In the case of entering the annotation mode, constructing a topmost and transparent annotation layer in the touch screen; The annotation content is rendered in real time on the annotation layer through a drawing engine, and the real-time rendered annotation content is saved in at least one of the large-screen device and the cloud server.

4. The annotation method based on a large-screen device according to claim 3 is characterized in that: The method further comprises: Detecting the lower layer display content of the annotation layer; When the lower layer display content is a document of a specified type, determining the annotation position of the document of the specified type; According to the annotation position, the saved annotation content is inserted.

5. The annotation method based on a large-screen device according to claim 4, characterized in that: When the lower layer displayed content is a document of a specified type, determining the annotation position of the document of the specified type includes: When the lower layer display content is a WORD document, a target text in the WORD document is determined according to the coordinate data of the annotation content, an annotation column is generated based on the target text, and the position of the annotation column is determined as the annotation position; When the lower layer display content is a PDF document or a PPT document, the target text in the PDF document or the PPT document is determined according to the coordinate data of the annotation content, a comment box of the annotation is generated based on the target text, and the position of the comment box is determined as the annotation position.

6. The annotation method based on a large-screen device according to any one of claims 1 to 5, characterized in that: The method further comprises: When the annotation mode entered is the default normal mode, an annotation toolbar is displayed on the touch screen, and the annotation toolbar includes a folding button, a brush button, a finger writing button, a history button, and a snapshot button; When the fold button is clicked, the annotation toolbar is folded and displayed as a floating icon, and when the floating icon is clicked, the annotation toolbar is expanded; When the finger writing button is clicked, the default brush writing state is entered into the finger writing state; When the history button is clicked, the saved annotation content is displayed; When the snapshot button is clicked, the snapshot function is triggered.

7. The annotation method based on a large-screen device according to claim 6, characterized in that: The annotation toolbar further includes a screenshot annotation button, and the real-time rendering of the annotation content on the constructed annotation layer and saving the annotation content further includes: When the screenshot annotation button is clicked, the screenshot annotation mode is entered, and a topmost and transparent annotation layer is constructed in the touch screen; When the annotation mode entered is the screenshot annotation mode, the screenshot is used as the background, the annotation content is rendered on the background in real time on the annotation layer through the drawing engine, and a save button is displayed on the annotation toolbar; When the save button is clicked, the background and the annotation content are saved in at least one of the large-screen device and the cloud server.

8. An annotation device based on a large screen device, characterized in that: include: A first detection module, used to detect touch actions of the touch screen of the large-screen device; An annotation module, used for entering an annotation mode when the touch action is a writing action of a smart pen; A second detection module, used for detecting the annotation content of the smart pen when entering the annotation mode; The rendering module is used to render the annotation content in real time on the constructed annotation layer and save the annotation content. The saved annotation content is provided for viewing or calling.

9. An electronic device, characterized in that: include: A processor and a memory, wherein the memory stores instructions, and the instructions are loaded and executed by the processor to implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed, the method according to any one of claims 1 to 7 is implemented.

Citation Information

Cited By

  • Method and device for generating and updating dynamic annotation box

    CN120560556A