Virtual content comment parallel method and system

Abstract

The invention discloses a method and a system for parallel annotation of virtual contents, which realize multi-terminal real-time parallel annotation and allow a user to simultaneously carry out independent annotation operation on mixed reality video contents at different terminals, and the annotations do not interfere with one another. Flexible switching of the annotations is achieved, and the annotations of different terminals and contents can be rapidly switched according to user requirements and can be used in a multi-layer mixed mode in a central control computer. A transparent channel signal layer superposition technology is utilized, the synthesis mode of the annotations and the virtual content is optimized, it is ensured that the annotations are displayed while mixed reality video information is not shielded, the screen position and size of each annotation can be adjusted in real time to achieve the purpose of non-interference, and the demonstration effect is improved. Due to the fact that the system architecture is parallel annotation, annotation and synthesis of other computers cannot be affected when a certain annotation computer has a problem, potential safety hazards caused by a series connection mode are effectively solved, and stability and safety of the system are improved.

Description

Technical Field

[0001] The present invention relates to the field of computer vision and multimedia interaction, and in particular to a method and system for parallel annotation of virtual content. Background Art

[0002] With the continuous development of computer technology, multimedia technology and mixed reality technology, there is an increasing demand for accurate annotation and detailed explanation of video content and virtual content in the fields of live interaction, smart classrooms, etc.

[0003] In actual application scenarios, whether it is the timely explanation of key information during live interaction or the auxiliary explanation of teaching content in smart classrooms, annotation is an important means. However, traditional annotation methods have exposed many limitations when dealing with the increasingly complex interactive scenarios and increasingly diverse annotation needs. For example, traditional annotation methods can often only support a single form of annotation, and are unable to cope with multiple users performing different types of annotation operations at the same time. Moreover, when traditional annotations are integrated with virtual content for display, the existing synthesis method easily causes the annotations to block important virtual information, affecting the overall visual effect and the accuracy of information communication, and seriously affecting the user experience.

[0004] The prior art has the following defects: 1. Limited flexibility in annotation (only supports single-person operation) Once the annotation content is determined, it is difficult to achieve dynamic switching and adjustment, and it is impossible to flexibly change the display content and style of the annotation according to actual needs.

[0005] Most existing annotation methods can only support one person operating at a time, and are unable to cope with the scenario where multiple users are performing different types of annotation operations at the same time.

[0006] 2. Single synthesis method and occlusion problem The synthesis method of annotations and virtual content (including video content) is extremely simple, usually just superimposed directly on the boss's computer. This synthesis method does not fully consider the visual superposition relationship between annotations and virtual content from multiple people and multiple terminals, which directly leads to the fact that annotations are very likely to block important video information when displayed, seriously destroying the integrity of the picture and greatly affecting the viewing experience.

[0007] 3. The series connection mode has potential safety risks In the series mode, the stability and reliability of the system are poor. The annotation content is output to the teacher's computer for synthesis into the final output. Once a problem occurs in this node, it will directly affect the subsequent output, causing the output of the entire system to be seriously affected or even completely interrupted. Summary of the invention

[0008] In view of the problems existing in the prior art, the purpose of the present invention is to provide a method and system for parallel annotation of virtual content, so as to realize real-time parallel annotation on multiple terminals, allowing users to independently annotate mixed reality video content on different terminals at the same time without interfering with each other, effectively solving the safety risks brought by the series mode and improving the stability and security of the system.

[0009] To achieve the above object, the present invention provides a method and system for parallel annotation of virtual content, wherein the method allows users to perform independent annotation operations on video content on different terminals at the same time, and the annotations do not interfere with each other; the method comprises the following steps: S1. Collecting video signals; the camera module collects video signals and transmits the video signals to the virtual content synthesis module; S2. Virtual content synthesis; the virtual content synthesis module synthesizes the camera signal with the virtual content to generate a virtual content synthesis signal; the virtual content includes a virtual background and / or virtual props; S3 generates an annotation signal; the annotation signal generation module captures the user's annotation operation on different terminals, generates a corresponding annotation signal according to the operation, the annotation signal includes the annotation type, location information and / or style information; S4. The annotation signal management module is responsible for managing multiple annotation signals, realizing parallel processing, switching and storage of annotation signals; according to user instructions or preset rules, selecting the annotation signal to be displayed and transmitting it to the signal superposition module; S5. The signal superposition module uses the transparent channel signal layer superposition technology to select a suitable mixing mode for the selected annotation signal and the virtual content synthesis signal to be superimposed at the corresponding position; S6. The signal transmission module transmits the superimposed signal to the display terminal module using a communication protocol.

[0010] Furthermore, in step S4, the management of the annotation signal is specifically as follows: S4.1 Signal hierarchical storage, creating an independent layer for each annotated signal to store the annotated signal and its attributes; S4.2 determining a unique identifier of the annotation signal based on the annotation signal and its attributes; S4.3 presents annotation parameter settings on the user interface, extracts a corresponding annotation signal ID list according to user instructions, and displays the corresponding annotation signal; S4.4 controls the visibility of the annotation layer and displays it accordingly.

[0011] Further, step S4.1 includes the following steps: S4.1.1 Create an independent layer for each annotation signal; in the storage structure, use an array or a linked list to manage the layers, and each element corresponds to an annotation signal layer; S4.1.2 When an annotation signal is generated, its content and related attributes are stored in the corresponding layer so that different annotation signals are logically separated.

[0012] Further, relevant attributes include color, transparency and / or position.

[0013] Further, step S4.2 includes: S4.2.1 Assign a unique identifier to each annotated signal and establish a status record mechanism to track the availability of each annotated signal; use a hash table or database table to store this information, where the key is the ID of the annotated signal and the value is its status, which includes normal or faulty; S4.2.2 When a certain annotation signal fails, the system can quickly find out by querying the status record and skip the annotation signal layer when performing overlay processing to ensure that other normal annotation signals are not affected.

[0014] Further, step S4.3 includes: S4.3.1 Provide a user selection interface on the display terminal, allowing the user to select the annotation signal combination to be displayed by checking or inputting; the user's selection operation will generate the corresponding display instruction; S4.3.2 After receiving the display instruction, the system parses the instruction content and determines the annotation signal ID list that needs to be displayed.

[0015] Further, step S4.4 includes: S4.4.1 According to the ID list obtained by parsing, traverse the layer storage structure, set the visibility of the annotation signal layer in the list to "visible", and set the visibility of the layer not in the list to "invisible"; when setting the visibility, directly operate the layer attributes and set the visibility flag of the layer in the graphics processing library; S4.4.2 When a fault occurs in an annotation signal and the user selects a combination that includes faulty annotations, if the system finds that a certain annotation signal is unavailable during processing, it will ignore the setting operation of the visibility of the annotation signal layer and only set the visibility of other normal annotation signal layers, so that the faulty signal does not affect the overall display.

[0016] Further, in step S5, the signal superposition is specifically implemented as follows: S5.1 Layer overlay based on transparent channel; S5.2 Mixing mode selection: Mixing modes include "normal mode", "multiply mode", "color filter mode" or "overlay mode". Select according to the type of annotation signal and user needs.

[0017] Further, step S5.1 includes: S5.1.1 Use the graphics processing library to set the transparent channel attribute of each annotation signal layer. By setting different transparency values, the annotation signals can be naturally integrated with each other and with the underlying virtual content. For graphic annotations, different transparency values ​​can be set according to their importance and relationship with other elements. S5.1.2 During the overlay process, according to the annotation signal identification list selected by the user, the corresponding annotation signal layers are overlaid on the virtual content layer in a preset order; for the overlay of each layer, the graphics processing library will perform pixel-level calculations based on the properties of the layer and merge multiple layers into a final image.

[0018] On the other hand, the present invention provides a virtual content annotation parallel system, the system includes a camera module, a virtual content synthesis module, an annotation signal generation module, an annotation signal management module, a signal transmission module and a display terminal module.

[0019] 1. Realize multi-terminal real-time parallel annotation, allowing users to independently annotate mixed reality video content on different terminals at the same time without interfering with each other.

[0020] 2. Realize flexible switching of annotations. Annotations of different terminals and contents can be quickly switched according to user needs, and can be mixed and used in multiple layers in the central control computer.

[0021] 3. Utilize the transparent channel signal layer overlay technology to optimize the synthesis method of annotations and virtual content, ensure that the annotations are displayed without blocking the mixed reality video information, and adjust the screen position and size of each annotation in real time to avoid mutual interference and improve the demonstration effect.

[0022] 4. Since the system architecture is parallel annotation, a problem on one of the annotation computers will not affect the annotation and synthesis of other computers, effectively solving the security risks brought by the serial mode and improving the stability and security of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 A schematic diagram of a method flow chart for annotating virtual content in parallel according to the present invention; Figure 2 A schematic diagram showing a process comparison between the virtual content annotation parallel method of the present invention and the traditional annotation synthesis method; Figure 3 Schematic diagram of the application of the present invention. DETAILED DESCRIPTION

[0024] The technical solution of the present invention will be described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0025] In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0026] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0027] The following combination Figure 1-Figure 3 The specific embodiments of the present invention are described in detail. It should be understood that the specific embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0028] According to the method and system for parallel annotation of virtual content of the present invention, the system includes a camera module, a virtual content synthesis module, an annotation signal generation module, an annotation signal management module, a signal transmission module and a display terminal module. Multi-terminal real-time parallel annotation is realized, allowing users to perform independent annotation operations on mixed reality video content at different terminals at the same time, and the annotations do not interfere with each other.

[0029] The camera module is responsible for collecting video signals and transmitting them to the virtual content synthesis module.

[0030] The virtual content synthesis module synthesizes the camera signal with the virtual content to generate a virtual content synthesis signal. The virtual content includes a virtual background and / or virtual props.

[0031] The annotation signal generation module captures the user's annotation operations (such as mouse clicks, touch gestures, etc.) on different terminals, and generates corresponding annotation signals according to the operations. The annotation signals include annotation type (text, lines, graphics, etc.), location information and / or style information, etc.

[0032] The annotation signal management module is responsible for managing multiple annotation signals and realizing parallel processing, switching and storage of annotation signals. It can select the annotation signal to be displayed according to user instructions or preset rules and transmit it to the signal superposition module.

[0033] The signal overlay module uses the transparent channel signal layer overlay technology to select the appropriate mixing mode for the selected annotation signal and overlay it with the virtual content synthesis signal at the corresponding position.

[0034] The signal transmission module uses a suitable communication protocol (such as WebSocket, etc.) to transmit the superimposed signal to the display terminal module for presentation to the audience.

[0035] Accordingly, according to the method for annotating virtual content in parallel of the present invention, as Figure 1 As shown, the following steps are included: S1. Collecting video signals; the camera module collects video signals and transmits the video signals to the virtual content synthesis module.

[0036] S2. Virtual content synthesis: The virtual content synthesis module synthesizes the camera signal with the virtual content to generate a virtual content synthesis signal. The virtual content includes a virtual background and / or virtual props, etc.

[0037] S3. Generate annotation signals; the annotation signal generation module uses the virtual content synthetic signal as the background to capture the user's annotation operations (such as mouse clicks, touch gestures, etc.) on different terminals, and generates corresponding annotation signals according to the operations. The annotation signals include annotation type (text, lines, graphics, etc.), location information and / or style information, etc.

[0038] The following is a method in which the annotation signal generation module in step S3 operates on an independent layer on the display screen based on the virtual content synthesis signal, including the following specific steps: S3.1 uses virtual content synthetic signals as background to update in real time and display on different terminal devices; Before the annotation signal is generated, the system first uses the virtual content synthesis module to synthesize the real video signal collected by the camera with the pre-set or dynamically generated virtual content (such as virtual background, virtual props, etc.) to form a comprehensive virtual content synthesis signal. This synthesis signal will be updated in real time and displayed on various terminal devices as the basic screen for users to perform annotation operations.

[0039] S3.2 different terminals respectively capture annotation operations on the same virtual content synthetic signal; The annotation signal generation module is deployed on different types of terminals, including but not limited to desktop computers, tablet computers, and mobile smart devices. These terminals can run specially designed applications or web applications to capture users' annotation operations. Users' annotation operations can be completed by mouse clicks, touch screen gestures, keyboard input, etc. For example, on a desktop computer, users can draw lines with a mouse; on a tablet computer, users can directly write text or draw graphics on the screen with their fingers or a stylus.

[0040] S3.3 creating an annotation layer according to the annotation operation; Whenever a user makes an annotation operation on a terminal device, the annotation signal generation module creates a new independent layer. This layer is built on the basis of the virtual content synthesis signal, and it does not directly modify or affect the original virtual content synthesis signal. Each new annotation layer has a transparent channel so that the underlying virtual content synthesis signal can be clearly seen, while allowing the newly added annotation information to be covered with it with appropriate transparency and style.

[0041] S3.4 determining annotation attributes according to the user's annotation operation; As the annotation layer is created, the system will record the annotation operation information of the user, which constitutes the core annotation properties of the annotation signal. The annotation properties include: -Annotation type: specifies the form of the annotation, such as text, line, rectangle, arrow, etc.

[0042] -Position information: Accurately mark the position coordinates of the annotation relative to the virtual content synthesis signal to ensure that the annotation can be displayed in the correct position.

[0043] -Style information: covers visual characteristics such as color, font size, line width, transparency, as well as possible animation effects or other interactive elements.

[0044] -Related information: If the annotation involves the labeling of a specific virtual object, the object's identity identifier (ID) needs to be recorded in order to implement more complex interaction logic, such as clicking on the annotation to jump to the associated object details page.

[0045] S3.5 generating an annotation signal according to the annotation attribute; Once all the above annotation attributes are determined, the annotation signal generation module constructs a complete annotation signal based on this information. Each annotation signal contains relevant metadata, which allows it to be recognized, managed and processed by other modules. The annotation signal not only reflects the user's immediate intention, but also provides the necessary information basis for subsequent signal management, superposition and transmission.

[0046] S3.6 combines the virtual content synthesis signal and the annotation signal and provides real-time feedback to the user; In order to allow users to see the effect of their annotations immediately, the system will merge the annotation layer with the current virtual content synthesis signal immediately after it is created, and preview it in real time on the user's local terminal. This process is almost instantaneous, ensuring that users can get instant feedback during the annotation process and adjust their operations until they are satisfied.

[0047] In this way, the annotation signal generation mechanism in step S3 is closely centered around the virtual content synthesis signal, ensuring that the annotation operation is both independent of the original video content and perfectly integrated with it, achieving real-time parallel annotation on multiple terminals without interfering with the original video content.

[0048] S4. The annotation signal management module is responsible for managing the annotation signals from multiple terminals and realizing parallel processing, switching and storage of annotation signals. It can select the annotation signal to be displayed according to user instructions or preset rules and transmit it to the signal superposition module.

[0049] S5. The signal overlay module uses the transparent channel signal layer overlay technology to select a suitable mixing mode for the selected annotation signal and overlay the virtual content synthesis signal at the corresponding position.

[0050] S6. The signal transmission module uses a suitable communication protocol (such as WebSocket, etc.) to transmit the superimposed signal to the display terminal module for presentation to the audience.

[0051] Specifically, in step S4, the management of the annotation signal is as follows: S4.1 Signal hierarchical storage: Create an independent layer for each annotated signal to store the annotated signal and its attributes; including the following steps: S4.1.1 Create independent layers for each annotation signal (A, B, C, D, ...) from different terminals. In the storage structure, use arrays or linked lists to manage these layers, and each element corresponds to an annotation signal layer. For example, create a layer array, where index 0 corresponds to the A annotation signal layer, index 1 corresponds to the B annotation signal layer, and so on.

[0052] In order to optimize the distinction, storage and processing of annotation signals and ensure that the system can efficiently manage annotation operations performed simultaneously on multiple terminals, the present invention adopts the following technical means: recognition and stratification of annotation signals, automatic and manual storage mechanisms, annotation lifecycle management, and technology to prevent annotations from interfering with each other on different terminals. The details are as follows: 1. Identification and stratification of annotation signals Independent layer creation: Whenever a new annotation is detected, the system will create an independent layer for the annotation. For annotations operated on the same terminal at different locations on the same screen, each annotation will be regarded as a separate annotation signal, so two independent layers will be created for annotations at different locations. The advantage of this is that the logical separation between annotations is maintained, which is convenient for subsequent management and editing.

[0053] 2. Automatic and manual storage mechanisms Real-time saving: The system adopts a real-time saving strategy. Every time the user completes an annotation action (for example, releasing the mouse button or leaving the finger on the screen), the annotation is saved immediately. This not only improves the user experience, but also reduces the risk of data loss. Annotation life cycle management: Introducing the concept of "annotation life cycle", that is, each annotation has a clear start time and end time. When the user starts a new annotation, the system records the start time; when the user completes the annotation and releases the input device, the system marks the end time. All content generated during this period is considered to belong to the same annotation.

[0054] Manual save: Although the system supports automatic storage, users can also choose whether to click the "Save" button to manually confirm after the annotation is completed. This method is suitable for situations where review or modification is required, especially when users want to check the annotation content before submission.

[0055] 3. Annotation lifecycle management The trigger conditions for the start and end recognition of annotations are that the start of annotations can be determined by detecting the user's first touch or mouse click, and the end is triggered by the user releasing the touch screen or mouse button. In addition, if the user does not perform further operations within a certain period of time, the system can also assume that the current annotation has ended.

[0056] Undo and Redo Functions: Considering that users may need to modify completed annotations, the system provides Undo and Redo functions. These functions allow users to easily withdraw the most recent one or more annotation operations, or reapply the undone operations.

[0057] 4. Technical implementation of simultaneous annotation on different terminals without interference Whenever a user on a terminal starts a new annotation operation, the system automatically creates an independent layer for the annotation. Each layer has a unique identifier (ID), which not only contains the serial number of the layer itself, but also associates the device number that generated the layer. This means that even if multiple annotations are written by the same device in different locations on the same screen, they will be created as independent layers and given different IDs.

[0058] Since each annotation is performed on its own layer, even if multiple terminals start annotation at almost the same time, there will be no direct conflict. All terminals operate based on the same virtual content synthesis signal source, but only send their own annotation layer to the central server or other fusion terminal devices.

[0059] Real-time data synchronization: By adopting efficient communication protocols (such as WebSocket), the system can achieve real-time data synchronization. After each terminal completes an annotation, it immediately sends the newly created layer information to the server. After receiving the layer information from different terminals, the server will manage and sort these layers according to the preset rules, and can also broadcast the updated layer list to all connected clients to ensure that all terminals can see the latest annotation status in time.

[0060] At the fusion end (such as a central control computer or display terminal), the system uses transparent channel signal layer overlay technology to merge annotation layers from different terminals. Each layer has its own transparency setting to ensure that the annotation content does not obscure the underlying video information.

[0061] The fusion end can select the annotation layer combination to be displayed according to the user's instructions or preset rules. For example, the user can choose to display only the annotations of a specific terminal, or decide which annotations should be displayed first according to factors such as chronological order and importance. This flexibility ensures that the final picture presented to the audience is both clear and meets the needs.

[0062] Since each annotation is made on a separate layer to avoid direct conflicts, even if two terminals add annotations in the same area at almost the same time, they will only appear on their own layers and will not directly cover each other's content. This greatly reduces the conflict problems that may occur in traditional concurrency control methods.

[0063] User experience optimization: To further enhance the user experience, the system also provides Undo and Redo functions, allowing users to easily withdraw the most recent one or more annotation operations, or reapply the undone operations. In addition, for situations where modifications are needed after writing, the system supports real-time saving and post-editing functions, ensuring that users can adjust their annotations at any time.

[0064] Through the above technical means, the system can effectively identify and process annotation signals from different terminals, ensuring that each annotation can be accurately captured, stored and displayed. Whether it is a single terminal or multiple terminals making annotations at the same time, the system can maintain a good user experience and ensure that the annotations do not interfere with each other. This design not only enhances the flexibility and responsiveness of the system, but also provides users with a powerful and intuitive annotation experience.

[0065] S4.1.2 When an annotation signal is generated, its annotation content (such as drawn graphics, text annotations, etc.) and related attributes (color, transparency, position, etc.) are stored in the corresponding layer. In this way, different annotation signals are logically separated, providing a basis for subsequent selective overlay and fault isolation.

[0066] Whenever a user on a terminal starts a new annotation operation, the system automatically creates an independent layer for the annotation. Each layer has a unique identifier (ID), which not only contains the serial number of the layer itself, but also associates the device number that generated the layer. This means that even if multiple annotations are written by the same device in different locations on the same screen, they will be created as independent layers and given different IDs.

[0067] S4.2 Unique identification and status record: Determine the unique identification of the annotation signal based on the annotation signal and its attributes; S4.2.1 Give each annotated signal a unique ID and establish a status record mechanism to track the availability of each annotated signal (whether it is working properly or has a fault). A hash table or database table can be used to store this information, where the key is the ID of the annotated signal and the value is its status (normal or faulty).

[0068] 1. Annotation signal unique identification Generation mechanism: Each annotation signal is given a unique ID, which is generated by combining factors such as timestamp, random number, user information, device number, etc. to ensure global uniqueness. Specifically, the ID can be generated using UUID (Universally Unique Identifier) ​​or a custom algorithm.

[0069] Structure example: UUID: such as 550e8400-e29b-41d4-a716-446655440000 Custom ID: The format can be <timestamp>-<random number>-<user ID>-<device number>, for example, 20241226-123456-USER123-DEVICE456 Storage method: Use a hash table or database table to store this information, with the key being the ID of the annotation signal and the value including its detailed attributes (including but not limited to type, location, style, etc.). This design allows for quick search and access to specific annotation signals.

[0070] 2. Status recording and tracking Status classification: Normal status: indicates that the annotation signal is available and displayed correctly.

[0071] Fault status: When the annotation signal cannot be displayed correctly due to network problems, device abnormalities, etc., it is marked as a fault status.

[0072] Status update mechanism: Real-time monitoring: The system monitors the status of each annotation signal in real time. Once an abnormality is detected (such as connection interruption, data loss, etc.), the status of the annotation signal is immediately updated to fault and the relevant error information is recorded.

[0073] Automatic recovery attempts: For annotated signals marked as failures, the system attempts automatic recovery, such as resending data or requesting a retry.

[0074] State storage: The status information is stored in the form of a hash table or database table, where the key is the ID of the annotation signal and the value is an object or record containing fields such as status (normal / faulty), error description (if any), and last update time.

[0075] 3. Status Impact Processing Overlay processing skip: When performing signal overlay processing, the system will query the status record and automatically skip the annotation signal layer marked as faulty to ensure that other normal annotation signals are not affected.

[0076] User feedback: For fault signals, the system should design a feedback reminder mechanism to notify relevant users or administrators and provide possible solutions, such as prompting to check the network connection or restart the application.

[0077] 4. Annotation lifecycle management Start and end recognition: Introducing the concept of "annotation lifecycle", that is, each annotation has a clear start time and end time. When the user starts a new annotation, the system records the start time; when the user completes the annotation and releases the input device, the system marks the end time. All content generated during this period is considered to belong to the same annotation.

[0078] Undo and Redo Functions: Considering that users may need to modify completed annotations, the system provides Undo and Redo functions. These functions allow users to easily withdraw the most recent one or more annotation operations, or reapply the undone operations.

[0079] S4.2.2 When a certain annotation signal fails (such as annotation B), the system can quickly find out by querying the status record and skip the annotation signal layer when performing overlay processing to ensure that other normal annotation signals are not affected.

[0080] S4.3 User selection interface and instruction processing: presenting annotation parameter settings on the user interface, extracting the corresponding annotation signal ID list according to the user instruction, and displaying the corresponding annotation signal; S4.3.1 Provide a user-friendly selection interface on the display terminal, allowing the user to select the annotation signal combination (such as AB, CD, AC, ABC, etc.) that he wants to display by checking or inputting. The user's selection operation will generate the corresponding display instruction.

[0081] S4.3.2 After receiving the display instruction, the system parses the instruction content and determines the list of annotation signal IDs to be displayed. For example, if the user selects the AB combination, the system will obtain a list containing the A and B annotation signal IDs.

[0082] S4.4 Layer visibility control: Control the visibility of the annotation layer and display it accordingly.

[0083] S4.4.1 According to the ID list obtained by parsing, traverse the layer storage structure, set the visibility of the annotation signal layer in the list to "visible", and set the visibility of the layer not in the list to "invisible". When setting the visibility, directly operate the layer attributes, such as setting the visibility flag of the layer in the graphics processing library.

[0084] S4.4.2 When the B annotation signal fails and the user selects a combination that includes B (such as AB, ABC), the system will find that the B annotation signal is unavailable during processing and will ignore the setting operation of the B annotation signal layer visibility. It will only set the visibility of other normal annotation signal layers, so that the faulty signal does not affect the overall display effect.

[0085] The signal overlay module uses the transparent channel signal layer overlay technology to select the appropriate mixing mode for the selected annotation signal and overlay the virtual content synthesis signal at the corresponding position. Common mixing modes Normal Description: This is the simplest blending mode, the annotation is directly overlaid on top of the virtual content without any special color blending.

[0086] Applicable scenarios: Use when annotations need to be displayed clearly and their relationship with the underlying content is not considered.

[0087] Multiply Description: The color values ​​of the two layers are multiplied and divided by the maximum color value (usually 255). This causes darker colors to become darker, while light colors remain the same or become slightly darker.

[0088] Applicable scenarios: Used to enhance contrast, especially suitable for text or other annotations that need to contrast sharply with a dark background.

[0089] Screen Description: The opposite of Multiply, the color values ​​of the two layers are added and then their product is subtracted divided by the maximum color value. The result is to brighten the image, especially the light parts will become more obvious.

[0090] Applicable scenarios: Applicable to situations where you want annotations to appear brighter and more conspicuous, such as adding highlight annotations against a darker background.

[0091] Overlay Description: Combines the effects of Multiply and Screen, and decides which method to use based on the brightness of the underlying color. The Multiply effect is applied to dark areas, while the Screen effect is applied to light areas.

[0092] Applicable scenarios: Provides a balanced approach that allows annotations to be clearly visible on dark backgrounds while maintaining good readability on light backgrounds.

[0093] Soft Light Description: Similar to Overlay mode, but produces a softer effect that does not change colors as drastically as Overlay.

[0094] Applicable scenarios: Suitable for situations where you want to gently adjust the annotation color without significantly changing the overall visual style.

[0095] Hard Light Description: Similar to Overlay, but the effect is more dramatic, producing stronger contrast changes.

[0096] Applicable scenarios: Use when you need to emphasize the importance of the annotation and want it to be visually eye-catching.

[0097] Difference Description: Computes the color difference between two layers, the result is usually the inverted colors.

[0098] Applicable scenarios: Less used in general annotations, but has special uses in some creative designs.

[0099] Exclusion Description: Similar to Difference mode, but with a slightly softer effect and less chance of full reversals.

[0100] Applicable scenarios: Also mainly used for specific artistic effects rather than general annotations.

[0101] Specific selection strategy for hybrid mode Based on the annotation type: Text annotation: If the annotation is presented in text form, you should choose a mode that ensures the text is clear and easy to read, such as normal mode or soft light mode. For text that needs special emphasis, you can consider using the color screening mode to make it more eye-catching.

[0102] Graphic Annotation: For graphic annotations such as lines and arrows, you can select an appropriate blending mode based on the color of the graphic and the expected effect. For example, using the Multiply mode can make a dark graphic stand out more on a light background.

[0103] Based on user needs: Emphasize display: If users want their annotations to stand out against video or virtual content, they can select Screening or Hard Light mode to increase contrast and brightness.

[0104] Natural integration: If users prefer annotations to coexist harmoniously with the underlying content, they can choose soft light or overlay mode, which can make the annotations blend naturally into the background without affecting the viewing experience.

[0105] Based on underlying content features: Dark background: For dark backgrounds, using Multiply mode can make annotations more visible; for light backgrounds, it is recommended to use Screen or Screen mode.

[0106] Complex textures or patterns: If the underlying content contains complex textures or patterns, choose a blending mode that doesn’t overly distract from the background detail, such as Soft Light or Normal.

[0107] S5.1 Layer overlay based on transparent channel S5.1.1 Use the functions of the graphics processing library (such as OpenGL or DirectX) to set each annotation signal layer to its own transparent channel attribute. By setting different transparency values, the annotation signals can be naturally integrated with each other and with the underlying virtual content. For example, the transparency of text annotations can be set to a higher value (such as 0.8) so that it can be clearly displayed without completely blocking the underlying content; for graphic annotations, different transparency values ​​can be set according to their importance and relationship with other elements. The settings of annotation importance and transparency values ​​are as follows: 1. Materiality Assessment Definition: The importance of an annotation refers to its weight in the overall content or its importance to the audience's understanding of the content. The higher the importance, the more prominent the annotation should be and the easier it is to notice.

[0108] Influencing factors: Content type: Different types of annotations, such as text, lines, and graphics, may have different importance. For example, a text annotation that explains a key concept is usually more important than a line that assists in the explanation.

[0109] Position relationship: Annotations located in the center or focal area of ​​the picture are often considered more important because they are more likely to attract the audience's attention.

[0110] Time sensitivity: Some annotations may only be valid for a specific period of time, such as real-time comments or temporary annotations, and the importance of these annotations may change over time.

[0111] User role: Annotations generated by different users (e.g., lecturers, experts, and general audience) may have different weights. For example, an instructor's annotations are usually considered more authoritative and important.

[0112] Frequency of interaction: Frequently updated or modified comments may indicate a higher level of importance because it reflects ongoing interest or discussion.

[0113] 2. Transparency setting Definition: Transparency determines the visibility ratio between the annotation and the underlying content. A higher transparency makes the annotation look lighter and does not block too much background information; a lower transparency makes the annotation more conspicuous.

[0114] Influencing factors: Visual priority: Annotations with higher importance should be set to a lower transparency to ensure clear visibility; conversely, the transparency of auxiliary annotations can be appropriately increased to reduce the impact on the viewing experience.

[0115] Background complexity: If the underlying content contains complex textures or patterns, the transparency of the annotation needs to be moderate, ensuring that the annotation is clearly readable without excessively interfering with the background details.

[0116] Color contrast: The contrast between the annotation color and the underlying content will also affect the choice of transparency. When the contrast is high, you can reduce the transparency, and when the contrast is low, you need to increase the transparency to enhance readability.

[0117] Dynamic effects: Some annotations may have animation effects (such as fade in and fade out). In this case, the change in transparency should be smooth and natural to avoid abruptness.

[0118] In this step, the transparency value is set and applied as follows: S5.1.1.1 Initialize parameters; according to the application scenario and user needs, set the weight coefficient wi of each factor and the mediation parameters a, b; S5.1.1.2 Collect data; the system automatically or through user input collects relevant information about each annotation, including annotation type, location, time, user role, and number of modifications; S5.1.1.3 Calculate the importance score of the annotations; Calculate the importance score IS of each annotation according to the importance score formula, specifically; Importance Score (IS) of annotations The importance score of the annotation is obtained by weighted summation, and the calculation formula is as follows: IS=w1*C+w2*P+w3*T+w4*R+w5*F in: C is the content type score, which ranges from [0,1] and indicates the basic importance of different types of annotations. The types include text, lines, graphics, etc., where text has a higher weight than other types. [0,1] refers to any value between 0 and 1.

[0119] P is the position relationship score, ranging from [0,1]. The annotation score close to the center of the picture or the focus area is higher. The focus area is automatically identified by image recognition of the head of the person.

[0120] T is the time sensitivity score, which ranges from [0,1]. Annotations that are important in real time or in the short term have higher scores. The time sensitivity score of annotations generated in real time is 1, and the time sensitivity score decreases linearly with time. This makes the score of the latest annotations higher than the annotations generated at an earlier time.

[0121] R is the user role score, which ranges from [0,1]. The score of annotations generated by lecturers or experts is higher. When teachers and students perform annotations at the same time, the teacher's annotations have a higher score in user role than the student's annotations.

[0122] F is the interaction frequency score, which ranges from [0,1]. Frequently updated or modified annotations have higher scores. The interaction frequency score of an annotation increases linearly with the number of updates or modifications.

[0123] w1, w2, w3, w4, and w5 are the weight coefficients of each factor, and the sum of all weight coefficients is 1. Set appropriate weight coefficients according to different scenarios.

[0124] S5.1.1.4 Calculate the transparency value OV (Opacity Value) based on the importance score IS The transparency value OV is adjusted according to the importance score IS and other relevant factors, and the calculation formula is as follows: OV=min(1,max(0,a*(1-IS)+b)) in: a is an adjustment parameter that controls how quickly transparency changes with importance. The recommended initial value is 0.8.

[0125] b is an offset used to adjust the base transparency. The recommended initial value is 0.2 to ensure that even the least important annotations have a certain degree of visibility. The higher the transparency value, the more opaque it is.

[0126] The min and max functions are used to limit transparency to the range [0,1], where 0 means completely transparent and 1 means completely opaque.

[0127] S5.1.1.5 Application settings: Apply the calculated transparency value to the corresponding annotation layer and update the display effect in real time. This makes the newer and more important annotations appear more clearly, and fades the less important and older annotations, which helps to highlight the key points of the display effect.

[0128] In a specific embodiment, it is assumed that the present invention has an annotation system, wherein: Content type weight w1=0.3; Position relationship weight w2=0.2; Time sensitivity weight w3=0.2; User role weight w4=0.2; Interaction frequency weight w5=0.1; For a text annotation generated by the instructor, located in the center of the screen and updated in real time: C=0.9 (text annotation); P = 1.0 (center of the picture); T=1.0 (real-time update); R = 1.0 (lecturer); F=0.8 (more frequent); Substitute into the formula to calculate: IS=0.3×0.9+0.2×1.0+0.2×1.0+0.2×1.0+0.1×0.8=0.75; OV=min(1,max(0,0.8×(1−0.75)+0.2))=min(1,max(0,0.4))=0.4; Therefore, the transparency value of this annotation is set to 0.4, which ensures that it is clear enough without excessively obscuring the background content.

[0129] S5.1.2 During the overlay process, according to the annotation signal identification list selected by the user, the corresponding annotation signal layers are overlaid on the virtual content layer in a preset order (e.g., the order from the bottom layer to the top layer can be determined according to the order selected by the user or the system default logic). For example, if the user selects the ABC combination, the system first overlays the A annotation signal layer on the virtual content layer, then overlays the B annotation signal layer on the A layer, and finally overlays the C annotation signal layer on the top layer. For each overlay of the layers, the graphics processing library will perform pixel-level calculations based on the properties of the layers (including transparency, color, position, etc.) to fuse multiple layers into a final image.

[0130] The following is a detailed description of the specific formulas and process for pixel-level calculations that describe how multiple annotation layers are fused with the underlying virtual content synthesis signal into a final image.

[0131] The specific process of pixel-level calculation is as follows: S5.1.2.1 Input annotation properties, where the annotation properties include background pixel color, annotation layer transparency, annotation layer number, annotation layer color, blending mode, and location coordinates.

[0132] In order to perform pixel-level calculations, the following properties are required: Background pixel color (B): The color value from the underlying virtual content composite signal.

[0133] Annotation layer transparency (alpha_i): The transparency value OV of each annotation layer calculated in the previous step, ranging from 0 to 1.

[0134] Number of annotation layers (N): The number of annotation layers involved in the overlay.

[0135] Annotation layer color (C_i): The color value of each annotation layer, usually expressed as an RGB triplet or RGBA quadruple (including transparency).

[0136] Blending Mode (M_i): The blending mode used for each annotation layer (such as Normal, Multiply, Screen, etc.).

[0137] Position coordinates (x, y): The two-dimensional coordinates of the pixel currently being processed in the image.

[0138] S5.1.2.2 Overlay all annotation layers to obtain the final result pixel color R(x,y), and write it to the corresponding position of the output image, as follows: First: initialize the result pixel color Set the initial result pixel color R(x,y)=B(x,y), that is, start from the background.

[0139] Second: Overlay annotation layers layer by layer For each annotation layer i (from 1 to N), do the following: Adjust color based on transparency: If alpha_i=0, skip this layer.

[0140] If alpha_i=1, the annotation layer color C_i is directly used to overwrite the result color R(x,y).

[0141] Otherwise, the transparency blending formula is applied: R'(x,y)=(1-alpha_i)*R(x,y)+alpha_i*C_i; Apply a blend mode: R'(x,y) is further processed according to the selected blending mode Mi. For example: Normal mode: No additional processing is done, and R'(x,y) is used directly.

[0142] Multiply mode: R''(x,y)=R'(x,y)*C_i / 255; Color filter mode: R''(x,y)=1-(1-R'(x,y))*(1-C_i / 255); Overlay mode: Combines the effects of Multiply and Screen. The specific implementation depends on specific needs.

[0143] Update the result pixel color R(x,y)=R''(x,y); Finally: Output the final result After all annotation layers are superimposed, the final result pixel color R(x,y) is obtained and written into the corresponding position of the output image.

[0144] In a specific embodiment, assume that there are three annotation layers, each with different transparency and blending modes. The specific parameters are as follows: Annotation layer 1: Transparency alpha_1=0.6, color C_1=(255,0,0), blending mode is normal.

[0145] Annotation layer 2: transparency alpha_2=0.8, color C_2=(0,255,0), blending mode is multiply mode.

[0146] Annotation layer 3: Transparency alpha_3=0.4, color C_3=(0,0,255), blending mode is screen mode.

[0147] Background pixel color B(x,y)=(128,128,128).

[0148] According to the above steps, the calculation process is as follows: 1. Initialization: R(x,y)=(128,128,128); 2. Overlay annotation layer 1: R'(x,y)=(1-0.6)*(128,128,128)+0.6*(255,0,0); R'(x,y)=(51.2,51.2,51.2)+(153,0,0)=(204.2,51.2,51.2); Since it is a normal mode, no further processing is required: R(x,y)=(204.2,51.2,51.2); 3. Overlay annotation layer 2: R'(x,y)=(1-0.8)*(204.2,51.2,51.2)+0.8*(0,255,0); R'(x,y)=(40.84,10.24,10.24)+(0,204,0)=(40.84,214.24,10.24); Apply Multiply mode: R''(x,y)=(40.84*0 / 255,214.24*255 / 255,10.24*0 / 255)=(0,214.24,0); Update result: R(x,y)=(0,214.24,0); 4. Overlay annotation layer 3: R'(x,y)=(1-0.4)*(0,214.24,0)+0.4*(0,0,255); R'(x,y)=(0,128.544,0)+(0,0,102)=(0,128.544,102); To apply Screen mode: R''(x,y)=1-(1-0)*(1-128.544 / 255)*(1-102 / 255); R''(x,y)=1-(1-0.504)*(1-0.4); R''(x,y)=1-0.504*0.6; R''(x,y)=1-0.3024; R''(x,y)=0.6976; Convert back to RGB values ​​(assuming the maximum value is 255): R''(x,y)=(0,177.376,177.376); Final result: R(x,y)=(0,177,177); Through the above detailed calculation steps and specific formulas, pixel-level fusion of multiple annotation layers and underlying virtual content synthesis signals can be achieved. This process ensures that each annotation layer can be correctly superimposed on the background according to its transparency and blending mode to generate the final visual effect. This method not only improves the accuracy of image synthesis, but also supports complex visual effects and interactive functions.

[0149] S5.2 Hybrid Mode Selection S5.2.1 Based on the transparency setting, you can also select a suitable blending mode for each annotation signal layer to further optimize the superposition effect. Common blending modes include "Normal", "Multiply", "Color Screen", "Overlay", etc. For example, for annotation signals that are highlighted, you can select the "Color Screen" mode to make them appear brighter and more prominent after superposition; for annotation signals that need to be integrated with the underlying content and highlight the details, you can select the "Multiply" mode to create a blending effect between the annotation and the underlying content colors to enhance the sense of hierarchy. Different blending modes can be flexibly selected according to the type of annotation signal and user needs to achieve the best visual effect.

[0150] The signal transmission module uses a suitable communication protocol (such as WebSocket, etc.) to transmit the superimposed signal to the display terminal module for presentation to the audience.

[0151] Figure 2 A schematic diagram comparing the parallel annotation method of the present invention and the traditional serial method is shown. The present invention can realize multi-end annotation, is switchable, and has a transparent channel signal coating overlay function, while the traditional method is a single annotation without a transparent channel signal coating overlay function.

[0152] The implementation environment construction process of the present invention is: 1. The camera uses Sony A7S III, sets the shooting resolution to 3840×2160 pixels, the frame rate to 60fps, and connects to the control host via an HDMI cable.

[0153] 2. The virtual content synthesis server is configured with an Intel Core i9-10900K processor, 32GB of memory, and an NVIDIA GeForce RTX 3090 graphics card. It runs specially developed virtual content synthesis software and can import various virtual scenes and props as needed.

[0154] 3. The annotation signal generation terminal includes a desktop computer (configured with an Intel Core i7-10700K processor, 16GB of memory, and an NVIDIA GeForce RTX 2060 graphics card) and a mobile tablet (iPad Pro 2021, running a customized annotation application), which are connected to the server via the network.

[0155] 4. The signal transmission adopts the WebSocket protocol, and the network switch uses Huawei S5720-56C-PWR-EI to ensure stable data transmission.

[0156] 5. The display terminals are a large LED screen (Leyard TVF015, with a resolution of 3840×2160 pixels) and multiple desktop monitors (Dell U2720Q), which are connected to the server via an HDMI distributor.

[0157] The operation process of the present invention is: 1. The camera starts recording video (e.g. Figure 3 The video signal is transmitted to the virtual content synthesis server and combined with the preset virtual stage scene (such as Figure 3 The planet and background parts shown in the figure are synthesized to generate a virtual content synthesis signal.

[0158] 2. The user opens the annotation application on the desktop and tablet respectively and logs into the system.

[0159] 3. The user draws lines on the desktop computer with the mouse to mark the important areas in the video; at the same time, the user enters text annotations on the tablet to explain the key content in the video. The annotation signal generation module captures these operations respectively, generates corresponding annotation signals and transmits them to the annotation signal management module.

[0160] 4. The annotation signal management module processes the received annotation signals in parallel and stores them in the memory. When the user clicks the annotation switch button on the desktop computer, the management module selects the text annotation signal on the tablet according to the instruction, processes it using the transparent channel signal layer overlay technology, and sends the virtual content synthesis signal and the processed annotation signal to the display terminal through the signal transmission module.

[0161] 5. The display terminal displays the text annotations in a semi-transparent manner at the appropriate position of the virtual content synthesis signal, and the audience can see the video content with text annotations on the large screen and desktop monitor. The final output effect is as follows Figure 3 As shown (e.g. Figure 3 Annotation 1, Annotation 2 and Annotation 3 from different terminals can be displayed synchronously).

[0162] The technical points of the present invention are: 1. Optimize the annotation overlay method: realize unobstructed annotation of mixed reality content, and use transparent channel signal layer overlay technology to ensure the natural integration of annotation and virtual content to avoid blocking key information.

[0163] 2. Multi-terminal parallel annotation and switching: Multi-terminal annotation switching is realized in a parallel manner, and the display of annotations of different types and contents in mixed reality videos can be quickly switched according to user needs, improving the flexibility and efficiency of annotation operations.

[0164] 3. Multi-mode annotation overlay method: During the overlay process, for each layer, the graphics processing library is used to perform pixel-level calculations based on the layer's properties (including transparency, color, position, etc.) to merge multiple layers into a final image.

[0165] 4. Multiple blending modes: Based on the transparency setting, select the appropriate blending mode for each annotation signal layer to further optimize the superposition effect. Different blending modes can be flexibly selected according to the type of annotation signal and user needs to achieve the best visual effect.

[0166] The technical effects of the present invention are: 1. Improve the flexibility and diversity of annotations: The multi-terminal parallel annotation function allows different users to freely perform annotation operations on their respective terminals, and can quickly switch the display of annotations of different types and contents, which greatly meets the diverse annotation needs and enhances the efficiency of collaboration and interaction between users.

[0167] 2. Optimize visual presentation effects: Transparent channel signal layer overlay technology ensures the perfect integration of annotations and virtual content, avoiding occlusion problems, allowing viewers to clearly see the annotation content without affecting the viewing of the main video content and virtual elements.

[0168] 3. Efficiency: The present invention adopts multi-terminal real-time parallel processing technology, and the multi-terminal annotation content is output in real time, which greatly improves the efficiency of the annotation operation. Multiple annotation devices or terminals can perform annotation operations independently at the same time without interference from other terminals.

[0169] 4. Security: In parallel processing mode, the security performance of the system is effectively guaranteed. Each node has independent processing capabilities and data storage mechanisms. They cooperate with each other but do not affect subsequent output. Even if a node encounters hardware failure, software error or external attack, it will not cause the entire system to crash or data loss. Because other nodes can continue to work normally, the system can automatically adjust task allocation to ensure the continuity of annotation tasks.

[0170] Definitions of English and key terms involved in this invention: OpenGL: Open Graphics Library, a cross-language, cross-platform application programming interface (API) for rendering 2D and 3D vector graphics. It is used in the present invention to implement graphics processing functions such as transparent channel signal layer overlay.

[0171] HDMI: High-Definition Multimedia Interface, is a fully digital video and sound transmission interface that can send uncompressed audio and video signals. In the present invention, it is used for video signal transmission between devices.

[0172] CPU: Central Processing Unit, is the computing and control core of a computer system, responsible for executing instructions and processing data, such as the processor of the control host, server and other devices in the present invention.

[0173] GPU: Graphics Processing Unit, which is specially used to process graphics and image related tasks, and plays an important role in the virtual content synthesis and annotation display processing in the present invention.

[0174] Pixel-level computing: Pixel-level computing is a technical means in the field of graphics processing that performs independent and precise calculations on each pixel in an image to determine the final presentation effect of the image at each pixel position.

[0175] Any process or method description in the flowchart of the present invention or described in other ways herein can be understood as a module, segment or part of a code including one or more executable instructions for implementing the steps of a specific logical function or process, which can be implemented in any computer-readable medium for use by an instruction execution system, device or equipment, and the computer-readable medium can be any medium containing storage, communication, propagation or transmission programs for use by execution systems, devices or equipment, including read-only memories, magnetic disks or optical disks, etc.

[0176] In the description of this specification, the description with reference to the terms "embodiment", "example", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. In addition, those skilled in the art can combine or combine different embodiments or examples described in this specification and the features therein without causing any contradiction.

[0177] Although the above content has shown and described the embodiments of the present invention, it can be understood that the above embodiments are exemplary and cannot be understood as limitations of the present invention. Ordinary technicians in the field can change, modify, replace, modify and other update operations on the above embodiments within the scope of the present invention.

Claims

1. A method for parallel annotation of virtual content, characterized in that: The method allows users to perform independent annotation operations on video content at different terminals at the same time, and the annotations do not interfere with each other; the method includes the following steps: S1. Collecting video signals; the camera module collects video signals and transmits the video signals to the virtual content synthesis module; S2. Virtual content synthesis; the virtual content synthesis module synthesizes the camera signal with the virtual content to generate a virtual content synthesis signal; the virtual content includes a virtual background and / or virtual props; S3 generates an annotation signal; the annotation signal generation module captures the user's annotation operation on different terminals, generates a corresponding annotation signal according to the operation, the annotation signal includes the annotation type, location information and / or style information; S4. The annotation signal management module is responsible for managing multiple annotation signals, realizing parallel processing, switching and storage of annotation signals; according to user instructions or preset rules, selecting the annotation signal to be displayed and transmitting it to the signal superposition module; S5. The signal superposition module uses the transparent channel signal layer superposition technology to select a suitable mixing mode for the selected annotation signal and the virtual content synthesis signal to be superimposed at the corresponding position; S6. The signal transmission module transmits the superimposed signal to the display terminal module using a communication protocol.

2. The method for annotating virtual content in parallel according to claim 1, characterized in that: In step S4, the management of the annotation signal is specifically as follows: S4.1 Signal hierarchical storage, creating an independent layer for each annotated signal to store the annotated signal and its attributes; S4.2 determining a unique identifier of the annotation signal based on the annotation signal and its attributes; S4.3 presents annotation parameter settings on the user interface, extracts a corresponding annotation signal ID list according to user instructions, and displays the corresponding annotation signal; S4.4 controls the visibility of the annotation layer and displays it accordingly.

3. The method for annotating virtual content in parallel according to claim 2, characterized in that: Step S4.1 includes the following steps: S4.1.1 Create an independent layer for each annotation signal; in the storage structure, use an array or a linked list to manage the layers, and each element corresponds to an annotation signal layer; S4.1.2 When an annotation signal is generated, its content and related attributes are stored in the corresponding layer so that different annotation signals are logically separated.

4. The method for annotating virtual content in parallel according to claim 3, characterized in that: Relevant properties include color, transparency and / or position.

5. The method for annotating virtual content in parallel according to claim 2, characterized in that: Step S4.2 includes: S4.2.1 Assign a unique identifier to each annotated signal and establish a status record mechanism to track the availability of each annotated signal; use a hash table or database table to store this information, where the key is the ID of the annotated signal and the value is its status, which includes normal or faulty; S4.2.2 When a certain annotation signal fails, the system will quickly learn about it by querying the status record and skip the annotation signal layer when performing overlay processing to ensure that other normal annotation signals are not affected.

6. The method for annotating virtual content in parallel according to claim 2, characterized in that: Step S4.3 includes: S4.3.1 Provide a user selection interface on the display terminal, allowing the user to select the annotation signal combination to be displayed by checking or inputting; the user's selection operation will generate the corresponding display instruction; S4.3.2 After receiving the display instruction, the system parses the instruction content and determines the annotation signal ID list that needs to be displayed.

7. The method for annotating virtual content in parallel according to claim 2, characterized in that: Step S4.4 includes: S4.4.1 According to the ID list obtained by parsing, traverse the layer storage structure, set the visibility of the annotation signal layer in the list to "visible", and set the visibility of the layer not in the list to "invisible"; when setting the visibility, directly operate the layer properties and set the layer visibility flag in the graphics processing library; S4.4.2 When a fault occurs in an annotation signal and the user selects a combination that includes faulty annotations, if the system finds that a certain annotation signal is unavailable during processing, it will ignore the setting operation of the visibility of the annotation signal layer and only set the visibility of other normal annotation signal layers, so that the faulty signal does not affect the overall display.

8. The method for annotating virtual content in parallel according to claim 1, characterized in that: In step S5, the signal superposition is specifically implemented as follows: S5.1 Layer overlay based on transparent channel; S5.2 Mixing mode selection: Mixing modes include "normal mode", "multiply mode", "color filter mode" or "overlay mode". Select according to the type of annotation signal and user needs.

9. The method for annotating virtual content in parallel according to claim 8, characterized in that: Step S5.1 includes: S5.1.1 Use the graphics processing library to set the transparent channel attribute of each annotation signal layer. By setting different transparency values, the annotation signals can be naturally integrated with each other and with the underlying virtual content. For graphic annotations, different transparency values ​​can be set according to their importance and relationship with other elements. S5.1.2 During the overlay process, according to the annotation signal identification list selected by the user, the corresponding annotation signal layers are overlaid on the virtual content layer in a preset order; for the overlay of each layer, the graphics processing library will perform pixel-level calculations based on the properties of the layer and merge multiple layers into a final image.

10. A system for parallel annotation of virtual content, characterized in that: The system is used to implement the virtual content annotation parallel method according to any one of claims 1-9, and the system includes a camera module, a virtual content synthesis module, an annotation signal generation module, an annotation signal management module, a signal transmission module and a display terminal module.

Images