Annotation information sharing method, system and device and storage medium

Abstract

The invention provides an annotation information sharing method, system and device and a storage medium, which are applied to a head-mounted display device, and the head-mounted display device shares an annotation picture with at least one terminal device. The sharing method comprises the following steps: acquiring a first resolution of the terminal equipment, first annotation data under the first resolution and first coordinate information of the first annotation data; performing size conversion on the first annotation data according to the first resolution and a second resolution of the head-mounted display device to obtain second annotation data corresponding to the second resolution; performing numerical conversion on the first coordinate information according to the first resolution and the second resolution to obtain second coordinate information of the second annotation data; and displaying the second annotation data on the head-mounted display device according to the second coordinate information. According to the invention, the accuracy of the annotation data of the shared picture displayed by the head-mounted display device can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of annotation information sharing, and in particular to an annotation information sharing method, system, device and storage medium. Background Art

[0002] Screen sharing is conducive to two people in different places watching the same screen through different display devices. In order to increase information exchange during screen sharing, people can annotate the objects displayed on the screen to communicate during screen sharing, or record relevant information by annotating the objects displayed on the screen. With the development of technology, head-mounted display devices can also participate in screen sharing. However, when the head-mounted display device displays the annotation information of the screen sharing, the difference in resolution with the traditional screen display device will cause the annotation information displayed by the head-mounted display device to be misaligned, affecting the display accuracy of the annotation information. Summary of the invention

[0003] The purpose of this application is to overcome the shortcomings and deficiencies in the prior art and to provide a method, system, device and storage medium for sharing annotation information, which can adjust the data size and coordinate information of the annotation data transmitted by the terminal device according to the difference in resolution, thereby improving the accuracy of the annotation data displayed on the shared screen by the head-mounted display device.

[0004] A first aspect of an embodiment of the present application provides an annotation information sharing method, which is applied to a head mounted display device, wherein the head mounted display device shares an annotation screen with at least one terminal device; the method comprises:

[0005] Acquire a first resolution of the terminal device, a first batch of annotation data at the first resolution, and first coordinate information of the first batch of annotation data;

[0006] According to the first resolution and the second resolution of the head mounted display device, the first annotation data is resized to obtain second annotation data corresponding to the second resolution;

[0007] According to the first resolution and the second resolution, the first coordinate information is numerically converted to obtain second coordinate information of the second annotation data;

[0008] The second annotation data is displayed on the head mounted display device according to the second coordinate information.

[0009] A second aspect of an embodiment of the present application provides an annotation information sharing system, comprising: a head-mounted display device and at least one terminal device. When the head-mounted display device shares an annotation screen with the terminal device, the head-mounted display device executes the steps of the annotation information sharing method as described above.

[0010] A third aspect of an embodiment of the present application provides an annotation information sharing device, which is applied to a head-mounted display device, wherein the head-mounted display device shares an annotation screen with at least one terminal device; the device comprises:

[0011] A first batch of annotation data acquisition module, used to acquire a first resolution of the terminal device, a first batch of annotation data at the first resolution, and first coordinate information of the first batch of annotation data;

[0012] A second annotation data acquisition module, configured to perform size conversion on the first annotation data according to the first resolution and a second resolution of the head mounted display device to obtain second annotation data corresponding to the second resolution;

[0013] A coordinate information conversion module, used for performing numerical conversion on the first coordinate information according to the first resolution and the second resolution to obtain second coordinate information of the second annotation data;

[0014] The second annotation data display module is used to display the second annotation data on the head mounted display device according to the second coordinate information.

[0015] A fourth aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the annotation information sharing method as described above are implemented.

[0016] Compared with the related art, when the wearable display device shares an annotation screen with at least one terminal device, the present application obtains the first resolution of the terminal device, the first batch of annotation data at the first resolution and the corresponding first coordinate information, performs size conversion on the first batch of annotation data according to the first resolution and the second resolution of the head-mounted display device, and performs numerical conversion on the first coordinate information to obtain second annotation data corresponding to the second resolution and second coordinate information of the second annotation data, and then displays the second annotation data on the head-mounted display device according to the second coordinate information, thereby improving the accuracy of the annotation data displayed on the shared screen by the head-mounted display device.

[0017] In order to provide a clearer understanding of the present application, the specific implementation of the present application will be described below in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 This is a flowchart of a method for sharing annotation information according to an embodiment of the present application.

[0019] Figure 2 This is a flowchart of steps S21-S24 of the annotation information sharing method according to one embodiment of the present application.

[0020] Figure 3 This is a flowchart of steps S31 - S32 of the annotation information sharing method according to one embodiment of the present application.

[0021] Figure 4 A schematic diagram of the structural connection of an annotation information sharing system according to an embodiment of the present application.

[0022] Figure 5 This is a schematic diagram of module connections of an annotation information sharing device according to an embodiment of the present application.

[0023] 100. Annotation information sharing system; 101. Head mounted display device; 102. Terminal device; 200. Annotation information sharing device; 201. First annotation data acquisition module; 202. Second annotation data acquisition module; 203. Coordinate information conversion module; 204. Second annotation data display module. DETAILED DESCRIPTION

[0024] In order to make the objectives, technical solutions and advantages of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

[0025] It should be clear that the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the embodiments of the present application.

[0026] When the following description relates to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. In the description of the present application, it should be understood that the terms "first", "second", "third", etc. are only used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence, nor can they be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to the specific circumstances. The singular forms of "a", "said" and "the" used in the present application and the appended claims are also intended to include the majority form, unless the context clearly indicates other meanings. The words "if" / "if" used herein can be interpreted as "at the time of" or "when" or "in response to determination".

[0027] In addition, in the description of this application, unless otherwise specified, "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0028] In order to better understand the technical solution of the present application, the relevant application scenarios of the present application are introduced below.

[0029] The present application is applied to head-mounted display devices. Head-mounted display devices are products that utilize a combination of multiple technologies such as simulation technology, computer graphics, human-computer interface technology, multimedia technology, sensor technology, and network technology. They are a new means of human-computer interaction created with the help of computers and the latest sensor technology. It can be worn directly on the user's head, and the image on the ultra-micro display screen is magnified through a set of optical systems (mainly precision optical lenses), the image is projected onto the retina, and the magnified screen image is presented to the viewer's eyes. Common head-mounted display devices include AR glasses, VR glasses, and XR glasses. When the head-mounted display device shares a screen with a terminal device, the head-mounted display device can display the screen shared by the terminal device, wherein the terminal device can be a traditional screen display device.

[0030] Specifically, when the head-mounted display device shares a screen with at least one terminal device, the terminal device shares the content displayed on its screen with the head-mounted display device. When the terminal device annotates the screen displayed on its screen, the terminal device will synchronously share the annotated content and the screen with the head-mounted display device, so as to realize the sharing of the annotated screen between the head-mounted display device and at least one terminal device. However, if the resolution of the head-mounted display device is different from that of the terminal device, the difference in resolution will cause the annotation information to be misaligned in the annotation screen shared by the head-mounted display device, resulting in the inability to correspond to the annotation information and even blocking other objects in the annotation screen, which seriously affects the display accuracy of the annotation information.

[0031] See also Figure 1 , which is a flow chart of the annotation information sharing method of the first embodiment of the present application, the annotation information sharing method includes:

[0032] S1: Acquire a first resolution of the terminal device, a first batch of annotation data at the first resolution, and first coordinate information of the first batch of annotation data.

[0033] The terminal device is an electronic device with screen display function, data transmission function and screen operation function, such as a desktop computer, a laptop computer or a smart phone.

[0034] The first resolution of the terminal device can be obtained by the terminal device actively sending it to the head-mounted display device when the head-mounted display device and the terminal device establish annotation screen sharing, or the head-mounted display device actively requests the terminal device to obtain it, and during the annotation screen sharing process, if the first resolution of the terminal device changes, the terminal device will actively send the changed first resolution to the head-mounted display device.

[0035] When the terminal device shares the annotation screen with the head-mounted display device, the terminal device also shares the annotation information on the screen with the head-mounted display device. The annotation information shared by the terminal device includes the first batch of annotation data and the first coordinate information. Among them, the first batch of annotation data includes data such as the size of the annotation box and the size of the annotation content of the annotation information at the first resolution of the terminal device; the first resolution refers to the real-time resolution of the terminal device when sharing the annotation screen with the head-mounted display device. The first coordinate information refers to the position information of the first batch of annotation data displayed in the screen at the first resolution of the terminal device, which is generally expressed in a two-dimensional coordinate system, such as the x-axis and the y-axis; specifically, the first coordinate information can refer to the coordinate information of an identification point of the first batch of annotation data, such as: the coordinate information of the upper left corner point of the annotation box of the first batch of annotation data, the coordinate information of the upper right corner point of the annotation box of the first batch of annotation data, or the coordinate information of the center point of the annotation box of the first batch of annotation data, etc.

[0036] S2: performing size conversion on the first annotation data according to the first resolution and the second resolution of the head mounted display device to obtain second annotation data corresponding to the second resolution.

[0037] Specifically, the ratio of the size conversion can be obtained according to the ratio of the second resolution to the first resolution, and the first batch of annotation data can be size-converted according to the ratio of the size conversion to obtain the second annotation data corresponding to the second resolution. Among them, the attributes that need to be size-converted in the first batch of annotation data include the size of the annotation box and / or the size of the annotation content. Through size conversion, the annotation can adapt to the new resolution and change its size, so as to avoid the annotation size being too large at high resolution, thereby avoiding large-area occlusion of the screen content.

[0038] S3: Performing numerical conversion on the first coordinate information according to the first resolution and the second resolution to obtain second coordinate information of the second annotation data.

[0039] Specifically, the ratio of numerical conversion can be obtained according to the ratio of the second resolution to the first resolution, and the second coordinate information corresponding to the second resolution can be obtained by numerically converting the first coordinate information according to the ratio of numerical conversion.

[0040] S4: Displaying the second annotation data on the head mounted display device according to the second coordinate information.

[0041] Among them, if the first coordinate information is the coordinate information of the upper left corner point of the annotation box of the first batch of annotation data, the second coordinate information is determined to be the coordinate information of the upper left corner point of the annotation box of the second annotation data, so as to determine the position where the head-mounted display device displays the second annotation data; if the first coordinate information is the coordinate information of the upper right corner point of the annotation box of the first batch of annotation data, the second coordinate information is determined to be the coordinate information of the upper right corner point of the annotation box of the second annotation data, so as to determine the position where the head-mounted display device displays the second annotation data; if the first coordinate information is the coordinate information of the center point of the annotation box of the first batch of annotation data, the second coordinate information is determined to be the coordinate information of the center point of the annotation box of the second annotation data, so as to determine the position where the head-mounted display device displays the second annotation data.

[0042] Compared with the related art, when the wearable display device shares an annotation screen with at least one terminal device, the present application obtains the first resolution of the terminal device, the first batch of annotation data at the first resolution and the corresponding first coordinate information, performs size conversion on the first batch of annotation data according to the first resolution and the second resolution of the head-mounted display device, and performs numerical conversion on the first coordinate information to obtain second annotation data corresponding to the second resolution and second coordinate information of the second annotation data, and then displays the second annotation data on the head-mounted display device according to the second coordinate information, thereby improving the accuracy of the annotation data displayed on the shared screen by the head-mounted display device.

[0043] In a feasible embodiment, S1: the step of obtaining a first resolution of the terminal device, a first batch of annotation data at the first resolution, and first coordinate information of the first batch of annotation data includes:

[0044] S111: When the head mounted display device accepts the screen sharing invitation of the terminal device, a first resolution, a first batch of annotation data, and first coordinate information sent by the terminal device are obtained.

[0045] Among them, the terminal device can send the first resolution, the first batch of annotation data and the first coordinate information to the head-mounted display device when sending the screen sharing invitation, and when the head-mounted display device accepts the screen sharing invitation, it synchronously accepts the first resolution, the first batch of annotation data and the first coordinate information.

[0046] In this embodiment, the head-mounted display device can obtain the first resolution, the first batch of annotation data and the first coordinate information sent by the terminal device when accepting the screen sharing invitation, without having to apply to the terminal device for the first resolution, the first batch of annotation data and the first coordinate information after accepting the screen sharing invitation, thereby reducing the number of data interactions and improving the efficiency of establishing screen sharing.

[0047] In a feasible embodiment, when the head mounted display device joins the screen sharing of the terminal device, the step of obtaining the first resolution of the terminal device, the first batch of annotation data corresponding to the first resolution, and the first coordinate information of the first batch of annotation data includes:

[0048] S121: When the head mounted display device applies to join the screen sharing established by the terminal device, a data acquisition request is sent to the server; the server stores the first resolution, the first batch of annotation data and the first coordinate information uploaded by the terminal device when establishing the screen sharing project.

[0049] When the terminal device establishes screen sharing with other display devices, the terminal device will send the first resolution, the first batch of annotation data and the first coordinate information to the server for storage, and the terminal device and other display devices will perform screen sharing data transmission based on the server.

[0050] S122: Obtain the first resolution, the first batch of annotation data and the first coordinate information sent by the server.

[0051] When the head-mounted display device applies to join the screen sharing established by the terminal device, the head-mounted display device can obtain the first resolution, the first batch of annotation data and the first coordinate information from the server, and join the screen sharing established by the terminal device by interacting with the server, for example: transmitting data with the server, obtaining the terminal device shared screen is the data transmitted to the server, thereby obtaining the screen shared by the terminal device.

[0052] In this embodiment, the head-mounted display device can also obtain the first resolution, the first batch of annotation data and the first coordinate information of the terminal device from the server, so that the terminal device does not need to send the first resolution, the first batch of annotation data and the first coordinate information again each time the head-mounted display device joins screen sharing.

[0053] In a feasible embodiment, the first annotation data includes a first annotation frame size and a first annotation content size; the second annotation data includes a second annotation frame size and a second annotation content size.

[0054] Among them, the first annotation box size refers to the length and width of the annotation box of the first batch of annotation data at the first resolution, and the first annotation content size refers to the font size of the annotation content of the first batch of annotation data at the first resolution; the second annotation box size refers to the length and width of the annotation box of the second annotation data at the second resolution, and the second annotation content size refers to the font size of the annotation content of the second annotation data at the second resolution.

[0055] See also Figure 2S2: According to the first resolution and the second resolution of the head mounted display device, the first batch of annotation data is converted into a second size to obtain second annotation data corresponding to the second resolution, comprising:

[0056] S21: Obtain a resolution ratio between the first resolution and the second resolution.

[0057] The resolution ratio of the first resolution and the second resolution may be expressed in any one of “first resolution: second resolution”, “first resolution / second resolution”, “second resolution: first resolution” or “second resolution / first resolution”.

[0058] S22: Convert the sizes of the first batch of annotation frames according to the resolution ratio to obtain the sizes of the second batch of annotation frames.

[0059] When the resolution ratio of the first resolution and the second resolution is expressed in the form of "first resolution: second resolution" or "first resolution / second resolution", the first annotation frame size is divided by the resolution ratio to obtain the second annotation frame size.

[0060] When the resolution ratio of the first resolution and the second resolution is expressed in the form of "second resolution: first resolution" or "second resolution / first resolution", the first annotation frame size is multiplied by the resolution ratio to obtain the second annotation frame size.

[0061] S23: Convert the size of the first batch of annotation contents according to the resolution ratio to obtain the size of the second batch of annotation contents.

[0062] When the resolution ratio of the first resolution and the second resolution is expressed in the form of "first resolution: second resolution" or "first resolution / second resolution", the first annotation content size is divided by the resolution ratio to obtain the second annotation content size.

[0063] When the resolution ratio of the first resolution and the second resolution is expressed in the form of "second resolution: first resolution" or "second resolution / first resolution", the first annotation content size is multiplied by the resolution ratio to obtain the second annotation content size.

[0064] S24: Obtaining second annotation data according to the second annotation frame size and the second annotation content size.

[0065] Specifically, a display frame corresponding to the second resolution is generated according to the second annotation frame size, and the annotation content is displayed in the display frame corresponding to the second resolution according to the second annotation content size, which becomes the second annotation data obtained by size conversion.

[0066] In this embodiment, according to the resolution ratio between the first resolution and the second resolution, the first batch annotation frame size and the first batch annotation content size are converted to obtain the second annotation frame size and the second annotation content size, so as to accurately obtain the second annotation data corresponding to the second resolution.

[0067] See also Figure 3 In a feasible embodiment, S3: performing numerical conversion on the first coordinate information according to the first resolution and the second resolution to obtain the second coordinate information of the second annotation data includes:

[0068] S31: Obtain a resolution ratio between the first resolution and the second resolution.

[0069] S32: Acquire a coordinate system of the first coordinate information, and perform numerical conversion on the first coordinate information according to the coordinate system and the resolution ratio to obtain second coordinate information.

[0070] The coordinate system of the first coordinate information refers to the screen coordinate system of the terminal device, and is also the coordinate system corresponding to the first coordinate information at the first resolution. The origin of the coordinate system of the first coordinate information can be the midpoint of the screen of the terminal device, or can be a corner point of the screen of the terminal device, such as the upper left corner point, lower left corner point, upper right corner point or lower right corner point of the screen of the terminal device. The first coordinate information indicates the x-axis distance and y-axis distance of the identification point of the first batch of annotation data relative to the origin of the coordinate system of the first coordinate information, and also indicates the position of the first batch of annotation data relative to the origin of the coordinate system of the first coordinate information.

[0071] When the resolution ratio of the first resolution and the second resolution is expressed as "first resolution: second resolution" or "first resolution / second resolution", the axis data of the coordinate system and the first coordinate information are divided by the resolution ratio respectively to obtain the coordinate system and the second coordinate information of the second coordinate information at the second resolution.

[0072] When the resolution ratio of the first resolution and the second resolution is expressed as "second resolution: first resolution" or "second resolution / first resolution", the axis data of the coordinate system and the first coordinate information are multiplied by the resolution ratio respectively to obtain the coordinate system and the second coordinate information of the second coordinate information at the second resolution.

[0073] The position of the origin of the coordinate system of the second coordinate information in the picture displayed by the head mounted display device is the same as the position of the origin of the coordinate system of the first coordinate information in the picture displayed by the terminal device. For example, when the origin of the coordinate system of the first coordinate information is the upper left corner of the picture displayed by the terminal device, the origin of the coordinate system of the second coordinate information is the upper left corner of the picture displayed by the head mounted display device.

[0074] In this embodiment, the first coordinate information is numerically converted according to the coordinate system of the first coordinate information and the resolution ratio between the first resolution and the second resolution, so that the second coordinate information of the second annotation data at the second resolution can be accurately obtained.

[0075] In one possible embodiment, the head mounted display device includes a camera.

[0076] Among them, the camera is used to shoot the spatial environment where the head-mounted display device is located. The head-mounted display device can share the picture taken by the camera to the terminal device. The terminal device can display the picture taken by the camera and add, delete or modify annotations to the objects in the picture taken by the camera. The terminal device will share the annotations added or modified to the picture taken by the camera to the head-mounted display device, so as to realize the sharing of the annotated picture between the head-mounted display device and the terminal device.

[0077] The annotation information sharing method also includes:

[0078] S5: Share the camera image to the terminal device.

[0079] After the camera's captured image is shared to the terminal device, the terminal device displays the camera's captured image at the first resolution. The terminal device can add annotations to objects in the camera's captured image on the displayed shared image, and the annotated objects become annotation objects.

[0080] S6: Acquire object features of the annotation object in the captured image transmitted by the terminal device, third annotation data of the annotation object, and third coordinate information of the third annotation data annotated by the terminal device relative to the annotation object.

[0081] The object features include the shape and color of the annotation object. If there is a reference object in the captured image, the object features may also include the relative position of the annotation object and the reference object.

[0082] The third annotation data includes data such as the size of the annotation frame and the size of the annotation content of the annotation information corresponding to the annotation object in the captured image at the first resolution of the terminal device.

[0083] The third coordinate information refers to the coordinate information of the third annotation data relative to the identification point of the annotation object. Specifically, a two-dimensional coordinate system of the annotation object is constructed with the annotation object in the display screen of the first resolution of the terminal device as the origin of the coordinate system, and the coordinate information of the identification point of the third annotation data in the two-dimensional coordinate system of the annotation object is obtained to obtain the third coordinate information. Among them, the identification point of the annotation object can be set by the user, or it can be the position of the corner point of the annotation object.

[0084] S7: Detect the annotated object in the captured image displayed by the head mounted display device according to the object features, and obtain the real-time coordinate information of the annotated object displayed by the head mounted display device.

[0085] Among them, by extracting features from the captured image displayed by the head-mounted display device, and then comparing the extracted features with the object features of the annotation object, the annotation object in the captured image displayed by the head-mounted display device can be detected and the real-time coordinate information of the annotation object displayed by the head-mounted display device can be obtained.

[0086] S8: performing size conversion on the third annotation data according to the first resolution and the second resolution to obtain fourth annotation data corresponding to the second resolution.

[0087] Specifically, firstly, the resolution ratio of the first resolution and the second resolution is obtained, and then the size of the third annotation data is converted according to the resolution ratio to obtain the fourth annotation data corresponding to the second resolution. The third annotation data and the fourth annotation data have the same annotation content, but the size of the annotation box and the font size of the annotation content are different due to the difference between the first resolution and the second resolution.

[0088] S9: Performing numerical conversion on the third coordinate information according to the first resolution and the second resolution to obtain fourth coordinate information of the fourth annotation data relative to the annotation object detected by the head mounted display device.

[0089] Specifically, first obtain the resolution ratio of the first resolution and the second resolution, and then perform numerical conversion on the third coordinate information according to the resolution ratio to obtain the fourth coordinate information of the fourth annotation data corresponding to the second resolution relative to the annotation object detected by the head-mounted display device.

[0090] S10: Displaying the fourth annotation data on the head mounted display device according to the real-time coordinate information and the fourth coordinate information.

[0091] Among them, since the real-time coordinate information represents the position of the annotation object in the display screen of the second resolution of the head-mounted display device, and the fourth coordinate information represents the position of the fourth annotation data relative to the annotation object at the second resolution, the display position of the fourth annotation data in the display screen of the second resolution of the head-mounted display device can be obtained according to the real-time coordinate information and the fourth coordinate information.

[0092] In this embodiment, the third annotation data added or modified by the terminal device to the annotation object in the captured image can be resized according to the resolution ratio of the first resolution to the second resolution, and the third coordinate information corresponding to the third annotation data can be numerically converted to obtain fourth annotation data and fourth coordinate information. Then, based on the real-time coordinate information and fourth coordinate information of the annotation object displayed by the head-mounted display device, the display position of the fourth annotation data in the display image of the second resolution of the head-mounted display device can be determined, and the fourth annotation data can be accurately displayed corresponding to the annotation object in the display image of the head-mounted display device.

[0093] In a feasible embodiment, S10: the step of displaying the fourth annotation data on the head mounted display device according to the real-time coordinate information and the fourth coordinate information includes:

[0094] S101: Constructing a coordinate system of the annotation object with the real-time coordinate information as the origin.

[0095] The coordinate system of the annotation object constructed in step S101 refers to the coordinate system of the annotation object in the display screen of the second resolution of the head-mounted display device. In the coordinate system of the annotation object constructed in step S101, the coordinate data of the coordinate system can be obtained by numerically converting the coordinate data of the two-dimensional coordinate system of the annotation object constructed with the annotation object in the display screen of the first resolution of the terminal device as the origin of the coordinate system according to the resolution ratio of the first resolution to the second resolution.

[0096] S102: Determine a display position of the fourth annotation data in the coordinate system of the annotation object according to the fourth coordinate information, and display the fourth annotation data at the display position.

[0097] Among them, the coordinate system of the annotation object is the coordinate system of the annotation object in the display screen of the second resolution of the head-mounted display device, and the fourth coordinate information represents the position of the fourth annotation data relative to the origin of the coordinate system of the annotation object at the second resolution. Therefore, according to the fourth coordinate information, the display position of the fourth annotation data in the display screen of the second resolution of the head-mounted display device can be determined from the coordinate system of the annotation object.

[0098] See also Figure 4 The second embodiment of the present application provides an annotation information sharing system 100, including: a head-mounted display device 101 and at least one terminal device 102. When the head-mounted display device 101 shares the annotation screen with the terminal device 102, the head-mounted display device 101 executes the steps of the annotation information sharing method as described above.

[0099] It should be noted that the annotation information sharing system 100 provided in the second embodiment of the present application and the annotation information sharing method of the first embodiment of the present application belong to the same concept, and its implementation process is detailed in the method embodiment, which will not be repeated here.

[0100] See also Figure 5 The third embodiment of the present application provides an annotation information sharing device 200, which is applied to a head mounted display device, and the head mounted display device shares an annotation screen with at least one terminal device; the device includes:

[0101] A first batch of annotation data acquisition module 201 is used to acquire a first resolution of a terminal device, the first batch of annotation data at the first resolution, and first coordinate information of the first batch of annotation data;

[0102] A second annotation data acquisition module 202 is used to convert the size of the first annotation data according to the first resolution and the second resolution of the head mounted display device to obtain second annotation data corresponding to the second resolution;

[0103] A coordinate information conversion module 203, used for performing numerical conversion on the first coordinate information according to the first resolution and the second resolution to obtain second coordinate information of the second annotation data;

[0104] The second annotation data display module 204 is used to display the second annotation data on the head mounted display device according to the second coordinate information.

[0105] It should be noted that the annotation information sharing device 200 provided in the third embodiment of the present application only uses the division of the above-mentioned functional modules as an example when executing the annotation information sharing method. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the annotation information sharing device 200 provided in the third embodiment of the present application and the annotation information sharing method of the first embodiment of the present application belong to the same concept. The implementation process thereof is detailed in the method embodiment and will not be repeated here.

[0106] A fourth embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the annotation information sharing method as described above are implemented.

[0107] The device embodiments described above are merely illustrative, wherein the components described as separate parts may or may not be physically separated, and the parts displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present application. Ordinary technicians in this field can understand and implement it without creative work.

[0108] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0109] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the function selected in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 function selected in a box or multiple boxes.

[0110] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 steps for the function selected in a box or multiple boxes.

[0111] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0112] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0113] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0114] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0115] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A method for sharing annotation information, characterized in that: Applied to a head mounted display device, the head mounted display device shares an annotation screen with at least one terminal device; the method comprises: Acquire a first resolution of the terminal device, a first batch of annotation data at the first resolution, and first coordinate information of the first batch of annotation data; According to the first resolution and the second resolution of the head mounted display device, the first annotation data is resized to obtain second annotation data corresponding to the second resolution; According to the first resolution and the second resolution, the first coordinate information is numerically converted to obtain second coordinate information of the second annotation data; The second annotation data is displayed on the head mounted display device according to the second coordinate information.

2. The annotation information sharing method according to claim 1, characterized in that: The first batch annotation data includes the first batch annotation frame size and the first batch annotation content size; the second annotation data includes the second annotation frame size and the second annotation content size; The step of converting the size of the first annotation data according to the first resolution and the second resolution of the head mounted display device to obtain second annotation data corresponding to the second resolution includes: Obtaining a resolution ratio between the first resolution and the second resolution; According to the resolution ratio, convert the size of the first annotation frame to obtain the size of the second annotation frame; According to the resolution ratio, converting the size of the first batch of annotation content to obtain the size of the second annotation content; The second annotation data is obtained according to the second annotation frame size and the second annotation content size.

3. The annotation information sharing method according to claim 1, characterized in that: The step of performing numerical conversion on the first coordinate information according to the first resolution and the second resolution to obtain second coordinate information of the second annotation data includes: Obtaining a resolution ratio between the first resolution and the second resolution; A coordinate system of the first coordinate information is acquired, and a numerical conversion is performed on the first coordinate information according to the coordinate system and the resolution ratio to obtain the second coordinate information.

4. The annotation information sharing method according to claim 1, characterized in that: The head mounted display device includes a camera, and the annotation information sharing method further includes: Sharing the camera image to the terminal device; Acquire object features of the annotation object in the photographed picture transmitted by the terminal device, third annotation data of the annotation object, and third coordinate information of the third annotation data annotated by the terminal device relative to the annotation object; Detecting the annotated object in the captured image displayed by the head mounted display device according to the object features, and obtaining real-time coordinate information of the annotated object displayed by the head mounted display device; According to the first resolution and the second resolution, the third annotation data is resized to obtain fourth annotation data corresponding to the second resolution; According to the first resolution and the second resolution, the third coordinate information is numerically converted to obtain fourth coordinate information of the fourth annotation data relative to the annotation object detected by the head mounted display device; The fourth annotation data is displayed on the head mounted display device according to the real-time coordinate information and the fourth coordinate information.

5. The annotation information sharing method according to claim 4, characterized in that: The step of displaying the fourth annotation data on the head mounted display device according to the real-time coordinate information and the fourth coordinate information comprises: Taking the real-time coordinate information as the origin, constructing a coordinate system of the annotation object; The display position of the fourth annotation data in the coordinate system of the annotation object is determined according to the fourth coordinate information, and the fourth annotation data is displayed at the display position.

6. The annotation information sharing method according to claim 1, characterized in that: The step of obtaining a first resolution of the terminal device, a first batch of annotation data at the first resolution, and first coordinate information of the first batch of annotation data includes: When the head mounted display device accepts the screen sharing invitation of the terminal device, the first resolution, the first batch of injection data and the first coordinate information sent by the terminal device are acquired.

7. The annotation information sharing method according to claim 1, characterized in that: The step of obtaining a first resolution of the terminal device, a first batch of annotation data corresponding to the first resolution, and first coordinate information of the first batch of annotation data when the head mounted display device joins the screen sharing of the terminal device comprises: When the head mounted display device applies to join the screen sharing established by the terminal device, a data acquisition request is sent to the server; the server stores the first resolution, the first batch of annotation data and the first coordinate information uploaded by the terminal device when establishing the screen sharing project; The first resolution, the first batch of annotation data and the first coordinate information sent by the server are obtained.

8. A system for sharing annotation information, characterized in that: include: A head-mounted display device and at least one terminal device, when the head-mounted display device shares an annotation screen with the terminal device, the head-mounted display device executes the steps of the annotation information sharing method as described in any one of claims 1 to 7.

9. A device for sharing annotation information, characterized in that: Applied to a head mounted display device, the head mounted display device shares an annotation screen with at least one terminal device; the device comprises: A first batch of annotation data acquisition module, used to acquire a first resolution of the terminal device, a first batch of annotation data at the first resolution, and first coordinate information of the first batch of annotation data; A second annotation data acquisition module, configured to perform size conversion on the first annotation data according to the first resolution and a second resolution of the head mounted display device to obtain second annotation data corresponding to the second resolution; A coordinate information conversion module, used for performing numerical conversion on the first coordinate information according to the first resolution and the second resolution to obtain second coordinate information of the second annotation data; The second annotation data display module is used to display the second annotation data on the head mounted display device according to the second coordinate information.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the annotation information sharing method according to any one of claims 1 to 7 are implemented.

Images