Screen projection content annotation method, device and system and computer-readable storage medium

Abstract

Embodiments of the present invention relate to a method, device, system and computer-readable storage medium for annotating projection content. The projection content annotation method includes, for example: displaying projection content in a projection window; responding to a user trigger operation to enter annotation mode, so as to generate a transparent annotation editing window and place it above the projection window for the user to write annotation content in the annotation editing window, wherein the annotation editing window has a scroll bar attribute and establishes a coordinate mapping with the projection window; and responding to a user's sliding touch gesture in the annotation editing window, controlling the projection content in the projection window to move synchronously with the annotation content in the annotation editing window. Embodiments of the present invention can realize the linkage between annotation content and projection content, and even in annotation mode, the projection content can be pulled up and down by sliding touch gestures.

Description

Technical Field

[0001] The present invention relates to the field of information sharing and annotation technology, and in particular to a screen projection content annotation method, a screen projection content annotation device, a screen projection content annotation system and a computer-readable storage medium. Background Art

[0002] In conference screen systems, such as LED conference screen systems, the core requirement is to be able to project user documents and to be able to annotate at any time during a presentation. However, the current implementation method is that you can only choose between operating and annotating the projected content. For example, you cannot annotate when sliding to switch the projected content, and when entering the annotation, the projected content is locked and cannot be operated. However, when exiting the annotation operation, the annotated content will be completely deleted and cannot be returned. This method of only being able to choose between operating and annotating the projected content increases the user's selection operation and is more complicated. Summary of the invention

[0003] In order to overcome the defects and shortcomings in the prior art, embodiments of the present invention provide a screen projection content annotation method, a screen projection content annotation device, a screen projection content annotation system and a computer-readable storage medium to achieve the technical effect of simplifying user operations.

[0004] On the one hand, an embodiment of the present invention provides a method for annotating projected screen content, comprising: displaying the projected screen content in a projected screen window; responding to a user trigger operation to enter an annotation mode to generate a transparent annotation editing window and place it above the projected screen window for the user to write annotation content in the annotation editing window, wherein the annotation editing window has a scroll bar attribute and establishes a coordinate mapping with the projected screen window; and responding to a user's sliding touch gesture in the annotation editing window, controlling the projected screen content in the projected screen window to move synchronously with the annotation content in the annotation editing window.

[0005] Based on the projection content annotation method of the present embodiment, the user can also pull up and down the projection content through sliding touch gestures in the annotation mode, and the annotation content can move synchronously with the projection content; during the entire projection content presentation, the user does not need to add unnecessary operations to switch windows, and the annotation content synchronously follows the projection content, which is more suitable for the user's application habits, the interaction process is more user-friendly, and the user experience will be greatly improved.

[0006] In one embodiment of the present invention, the response to the user triggering operation to enter the annotation mode to generate a transparent annotation editing window and place it above the projection window for the user to write annotation content in the annotation editing window, including: responding to the user clicking the annotation control or a single-point continuous sliding touch operation in the projection window to enter the annotation mode to generate a transparent annotation editing window and place it above the projection window for the user to write annotation content in the annotation editing window.

[0007] In one embodiment of the present invention, the annotation editing window supports downward expansion and page switching by sliding touch gestures due to the scroll bar attribute; and the establishing of coordinate mapping is establishing coordinate mapping based on pixel points.

[0008] In one embodiment of the present invention, the method for annotating projected screen content also includes: responding to a user's page operation on the projected screen content through an input device on a source device, controlling the annotation content in the annotation editing window to follow synchronously, wherein the page operation is page content scrolling or page changing.

[0009] On the other hand, an embodiment of the present invention provides a device for annotating screen content, including: a content display module, used to display the projected screen content in a projection window; a window generation module, used to respond to a user trigger operation to enter the annotation mode, so as to generate a transparent annotation editing window and place it above the projection window for the user to write annotation content in the annotation editing window, wherein the annotation editing window has a scroll bar attribute and a coordinate mapping is established between the projection window and the annotation editing window; and a synchronization control module, used to respond to a user's sliding touch gesture in the annotation editing window, and control the projected screen content in the projection window to move synchronously with the annotation content in the annotation editing window.

[0010] In one embodiment of the present invention, the window generation module includes a module for: responding to a user clicking on an annotation control or a single-point continuous sliding touch operation within the projection window to enter the annotation mode, so as to generate a transparent annotation editing window and place it above the projection window for the user to write annotation content in the annotation editing window.

[0011] In one embodiment of the present invention, the annotation editing window supports downward expansion and page switching by sliding touch gestures due to the scroll bar attribute; and the establishing of coordinate mapping is establishing coordinate mapping based on pixel points.

[0012] In one embodiment of the present invention, the projection content annotation device also includes: a follow-up control module, which is used to respond to the user's page operation on the projection content through an input device on the source device, and control the annotation content in the annotation editing window to follow synchronously, wherein the page operation is page content scrolling or page changing.

[0013] On the other hand, an embodiment of the present invention provides a screen projection content annotation system, including: a processor and a memory, wherein the memory stores instructions executed by the processor, and the instructions enable the processor to perform operations to perform any of the aforementioned screen projection content annotation methods.

[0014] On the other hand, an embodiment of the present invention provides a computer-readable storage medium, which is a non-volatile memory and stores program code, and the program code is executed by one or more processors to implement any of the aforementioned screen projection content annotation methods.

[0015] To sum up, the above technical scheme of the embodiment of the present invention can have the following beneficial effects: based on the projection content annotation method, device and system and computer-readable storage medium of this embodiment, even in the annotation mode, the user can pull up and down the projection content through sliding touch gestures, and the annotation content can move synchronously with the projection content; during the entire projection content presentation, the user does not need to add unnecessary operations to switch windows, and the annotation content synchronously follows the projection content, thereby simplifying the user operation and being more suitable for the user's application habits. The interaction process is more user-friendly, and the user experience will be greatly improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0017] Figure 1 A flowchart of a method for annotating screen projection content provided in an embodiment of the present invention.

[0018] Figure 2 For execution Figure 1 A structural schematic diagram of a conference screen system showing a method for annotating screen content.

[0019] Figure 3A It is a schematic diagram of the decomposed state of a screen projection window and an annotation editing window placed above the screen projection window according to an embodiment of the present invention.

[0020] Figure 3B A schematic diagram of the process state of controlling the synchronous movement of the projection content of the projection window and the annotation content of the annotation editing window in response to a user's sliding touch gesture in the annotation editing window according to an embodiment of the present invention.

[0021] Figure 4 A module schematic diagram of a screen projection content annotation device provided in an embodiment of the present invention.

[0022] Figure 5 A module schematic diagram of another screen projection content annotation device provided in an embodiment of the present invention.

[0023] Figure 6 A structural schematic diagram of a screen projection content annotation system provided in an embodiment of the present invention.

[0024] Figure 7 A schematic diagram of the structure of a computer-readable storage medium provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0026] See also Figure 1 , a method for annotating screen content provided by an embodiment of the present invention, for example, includes the steps of:

[0027] S11: Displaying the projection content in the projection window;

[0028] S13: Responding to a user trigger operation to enter the annotation mode, so as to generate a transparent annotation editing window and place it above the projection window for the user to write annotation content in the annotation editing window, wherein the annotation editing window has a scroll bar attribute and a coordinate mapping is established between the annotation editing window and the projection window; and

[0029] S15: In response to the user's sliding touch gesture in the annotation editing window, control the projection content in the projection window and the annotation content in the annotation editing window to move synchronously.

[0030] In order to more clearly understand the method for annotating screen content in this embodiment, Figure 2 , Figure 3A and Figure 3B An example is given below.

[0031] Specifically, the screen projection content annotation method of this embodiment is suitable for executing Figure 2 The display device 15 in the conference screen system 10 is shown. Figure 2As shown, the conference screen system 10 includes: a source device 11, a wireless screen projector 13 and a display device 15. The source device 11 is, for example, a laptop or other electronic device that is also equipped with a processor, a memory and a display and is installed with an operating system (such as Windows, Mac OS / X, Linux, Android, iOS and other operating systems), which can establish a wireless network communication connection with the display device 15 in a wireless manner based on the wireless screen projector 13. In other embodiments, the source device 11 can also directly project the screen content to the display device 15 in a wireless manner without connecting to the wireless screen projector. Furthermore, the wireless screen projector 13 can be an existing mature screen projector with physical buttons; the display device 15 is, for example, an LCD display with a touch function, an LED display with a touch function, or other display screens with a touch screen.

[0032] Based on the above, the method for annotating the projected screen content in this embodiment is a technical solution based on the linkage between the projected screen content and the annotation content operation. It uses a sliding window design when creating the annotation editing window 153, and binds the sliding, page changing and other operations of the annotation editing window 153 and the projected screen window 151, so that the two windows are synchronously linked to realize the operation. The user does not need to exit the annotation editing window 153 to realize the operation of the projected screen window 151. The specific implementation method is described as follows.

[0033] The projection screen content display and annotation editing functions are respectively realized through the projection window 151 and the annotation editing window 153. When the projection screen content is displayed / demonstrated (corresponding to step S11), the annotation editing window 153 is not created by default, and the annotation editing window 153 is created when entering the annotation mode. The user trigger operation for entering the annotation mode here can be clicking on the annotation control displayed on the screen of the display device 15. This trigger operation is an existing mature technology, so it will not be repeated here; or, the user trigger operation for entering the annotation mode is a single-point continuous sliding touch operation in the projection screen window 151, because the writing operation of the user when making an annotation is usually a single-point continuous sliding touch operation, so it can achieve the beneficial effect of automatically entering the annotation mode to create the annotation editing window 153 once it is detected that the user starts writing, without clicking the annotation control.

[0034] When entering the annotation mode (corresponding to step S13), a transparent annotation editing window 153 with ScrollBar attribute is created for the user to write annotation content in the annotation editing window 153. Because the annotation editing window 153 has a scroll bar attribute, it supports downward expansion and page change by sliding touch gestures.

[0035] Furthermore, a coordinate mapping is established between the annotation editing window 153 and the screen projection window 151, for example, a coordinate mapping based on pixel points is established, so as to correspond the annotation content and the screen projection content one by one according to pixel points.

[0036] In addition, the instruction data of the sliding touch operation on the annotation editing window 153 and the instruction data of the page operation on the projected content in the projection window 151 are shared and bound, and the linkage between the projection window 151 and the annotation editing window 153 is realized by unifying the touch gesture operation processing function and the response function of the page operation on the projected content in the projection window 151 through input devices such as a keyboard or a mouse on the source device 11; in this way, when a sliding touch gesture is executed in the annotation editing window 153, for example Figure 3B As shown, when the multi-point sliding touch is performed simultaneously by multiple fingers (corresponding to step S15), the window object is not eliminated and the window content exists until the window is exited; and when the user performs page operations such as scrolling or changing pages on the projected content through the input device on the source device 11, the annotation content in the annotation editing window 153 can also be controlled to follow synchronously.

[0037] To sum up, based on the projection content annotation method of this embodiment, the user can also pull up and down the projection content through sliding touch gestures in the annotation mode, and the annotation content can move synchronously with the projection content; during the entire projection content presentation, the user does not need to add unnecessary operations to switch windows, and the annotation content synchronously follows the projection content, thereby simplifying the user operation and being more suitable for the user's application habits. The interaction process is more user-friendly, and the user experience will be greatly improved.

[0038] See also Figure 4 , a screen projection content annotation device 40 provided by an embodiment of the present invention includes: a content display module 41, a window generation module 43 and a synchronization control module 45.

[0039] Among them, the content display module 41 is used to display the projected content in the projection window; the window generation module 43 is used to respond to the user's trigger operation to enter the annotation mode, so as to generate a transparent annotation editing window and place it above the projection window for the user to write annotation content in the annotation editing window, wherein the annotation editing window has a scroll bar attribute and establishes a coordinate mapping with the projection window; and the synchronization control module 45 is used to respond to the user's sliding touch gesture in the annotation editing window, and control the projection content in the projection window to move synchronously with the annotation content in the annotation editing window.

[0040] As for the specific functional details of the content display module 41, the window generation module 43 and the synchronization control module 45, reference can be made to the relevant description of the projection content annotation method in the aforementioned embodiment, which will not be repeated here. In addition, it is worth mentioning that the content display module 41, the window generation module 43 and the synchronization control module 45 can be software modules, which are stored in a non-volatile memory and the processor performs relevant operations to perform the projection content annotation method in the aforementioned embodiment.

[0041] In a specific embodiment, the window generation module 43 includes a module for: responding to a user clicking on an annotation control or a single-point continuous sliding touch operation within the projection window to enter the annotation mode, so as to generate a transparent annotation editing window and place it above the projection window for the user to write annotation content in the annotation editing window.

[0042] In another specific implementation, the annotation editing window supports downward expansion and page switching by sliding touch gestures due to the scroll bar attribute; and the establishing of coordinate mapping is establishing a coordinate mapping based on pixel points.

[0043] See also Figure 5 The screen projection content annotation device of this embodiment may further include: a follow-up control module 47, which is used to respond to the page operation of the screen projection content by the user through the input device on the source device, and control the synchronization of the annotation content in the annotation editing window, wherein the page operation is page content scrolling or page change. As for the specific functional details of the synchronization follow-up module 47, please refer to the relevant description of the screen projection content annotation method in the aforementioned embodiment, which will not be repeated here.

[0044] Furthermore, see Figure 6 A screen projection content annotation system 60 provided in an embodiment of the present invention includes: a processor 61 and a memory 63; wherein the memory 63 stores instructions executed by the processor 61, and the instructions, for example, enable the processor 61 to perform operations to perform the screen projection content annotation method described in the aforementioned embodiment.

[0045] Also, see Figure 7 , an embodiment of the present invention provides a computer-readable storage medium 70, which is a non-volatile memory and stores program code. When the program code is executed by one or more processors, for example, the one or more processors execute the screen projection content annotation method described in the aforementioned embodiment.

[0046] In addition, it can be understood that the aforementioned embodiments are only exemplary descriptions of the present invention. Under the premise that the technical features do not conflict, the structures do not contradict, and the purpose of the present invention is not violated, the technical solutions of the various embodiments can be arbitrarily combined and used in combination.

[0047] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and / or methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units / modules is only a logical function division. There may be other division methods in actual implementation, such as multiple units or modules can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0048] The units / modules described as separate components may or may not be physically separated, and the components shown as units / modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units / modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0049] In addition, each functional unit / module in each embodiment of the present invention may be integrated into one processing unit / module, or each unit / module may exist physically separately, or two or more units / modules may be integrated into one unit / module. The above-mentioned integrated unit / module may be implemented in the form of hardware or in the form of hardware plus software functional units / modules.

[0050] The above-mentioned integrated unit / module implemented in the form of a software functional unit / module can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for enabling one or more processors of a computer device (which can be a personal computer, a server, or a network device, etc.) to perform some steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store program codes.

[0051] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for annotating screen content, characterized in that: include: Display the projection content in the projection window; Entering the annotation mode in response to a user trigger operation, so as to generate a transparent annotation editing window and place it above the projection window for the user to write annotation content in the annotation editing window, wherein the annotation editing window has a scroll bar attribute and a coordinate mapping is established between the annotation editing window and the projection window; The annotation editing window supports downward expansion and page change by sliding touch gestures due to the scroll bar attribute; the establishment of coordinate mapping is to establish a coordinate mapping between pixel points based on the annotation content and pixel points of the projection content, and the trigger operation includes a single-point continuous sliding touch operation; In response to a user's sliding touch gesture in the annotation editing window, controlling the projection content in the projection window and the annotation content in the annotation editing window to move synchronously; The step of responding to the user's sliding touch gesture in the annotation editing window and controlling the synchronous movement of the projection content in the projection window and the annotation content in the annotation editing window specifically includes: Receive the sliding touch gesture, and share and bind the instruction data of the sliding touch operation and the instruction data of the page operation of the screen projection content in the screen projection window; wherein the sliding touch gesture is a multi-point sliding touch operation; The projection content in the projection window and the annotation content in the annotation editing window are controlled to move synchronously through sliding touch operations.

2. The method for annotating screen content according to claim 1, characterized in that: The step of responding to the user triggering operation to enter the annotation mode to generate a transparent annotation editing window and place it above the projection window for the user to write annotation content in the annotation editing window includes: In response to the user clicking on the annotation control or a single-point continuous sliding touch operation in the projection window, the annotation mode is entered to generate a transparent annotation editing window and place it above the projection window for the user to write annotation content in the annotation editing window.

3. The method for annotating screen content according to claim 1, characterized in that: Also includes: In response to a user's page operation on the projection content through an input device on the source device, the annotation content in the annotation editing window is controlled to follow synchronously, wherein the page operation is page content scrolling or page changing.

4. A screen projection content annotation device, characterized in that: include: Content display module, used to display the projection content in the projection window; A window generation module, for responding to a user trigger operation to enter the annotation mode, so as to generate a transparent annotation editing window and place it above the projection window for the user to write annotation content in the annotation editing window, wherein the annotation editing window has a scroll bar attribute and establishes a coordinate mapping with the projection window; The annotation editing window supports downward expansion and page change by sliding touch gestures due to the scroll bar attribute; the establishment of coordinate mapping is to establish a coordinate mapping between pixel points based on the annotation content and pixel points of the projection content, and the trigger operation includes a single-point continuous sliding touch operation; A synchronization control module, used to respond to a user's sliding touch gesture in the annotation editing window, and control the synchronous movement of the projection content in the projection window and the annotation content in the annotation editing window; Among them, the synchronization control module is specifically used to receive the sliding touch gesture, share and bind the instruction data of the sliding touch operation and the instruction data of the page operation of the projected content in the projection window; control the synchronous movement of the projected content in the projection window and the annotation content in the annotation editing window through the sliding touch operation; wherein, the sliding touch gesture is a multi-point sliding touch operation.

5. The screen projection content annotation device according to claim 4, characterized in that: The window generation module includes: In response to the user clicking on the annotation control or a single-point continuous sliding touch operation in the projection window, the annotation mode is entered to generate a transparent annotation editing window and place it above the projection window for the user to write annotation content in the annotation editing window.

6. The screen projection content annotation device according to claim 4, characterized in that: Also includes: The following control module is used to respond to the page operation of the projection content by the user through the input device on the source device, and control the annotation content in the annotation editing window to follow synchronously, wherein the page operation is page content scrolling or page changing.

7. A screen projection content annotation system, characterized in that: include: A processor and a memory, wherein the memory stores instructions executed by the processor, and the instructions enable the processor to perform operations to perform the screen projection content annotation method as described in any one of claims 1 to 3.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium is a non-volatile memory and stores program code, and the program code is executed by one or more processors to implement the screen projection content annotation method as described in any one of claims 1 to 3.

Images