AR game operator entity digital synchronization method and system based on bidirectional state verification

Abstract

The application relates to the field of AR technology and discloses an AR war game operator entity digital synchronization method and system based on bidirectional state checking. The method is as follows: an AR device obtains digital target states of each entity operator from a server and collects first physical states of each entity operator; the first physical states are compared with the digital target states one by one to obtain a difference task queue; a projection device is controlled to project prompt light effects corresponding to the difference types to the hexagonal grid coordinates of the to-be-synchronized operators in the difference task queue; after the prompt light effects are projected, the second physical states of the to-be-synchronized operators are recognized; when the second physical states are consistent with the digital target states, the projection device is controlled to stop projecting the prompt light effects, and a synchronization confirmation signal is sent to the server. The application solves the defect that the existing AR scheme cannot actively perceive the physical states of the entity operators, and eliminates the problem that the states of the digital situation and the physical situation are inconsistent due to the omission or errors of physical operations in mixed deduction.

Description

Technical Field

[0001] This invention relates to the field of AR technology, and in particular to an AR wargame operator entity digital synchronization method and system based on bidirectional state verification. Background Technology

[0002] In hybrid manual wargaming simulations, numerous double-sided physical operators are deployed on the simulation map, with each operator's front and back corresponding to different combat states. During the simulation, the server independently generates and updates the digital target states of each operator according to the adjudication rules, requiring operators to simultaneously execute corresponding physical operations on the physical chessboard. However, due to the large number of operators and the tight simulation pace, operators are prone to omissions or errors, causing a continuous deviation between the physical chessboard situation and the digital system situation.

[0003] Existing AR-assisted simulation solutions can only overlay digital information unidirectionally within the operator's field of vision. Essentially, this is a static information presentation method, unable to actively perceive the initial physical state of entity operators, unable to determine whether the operator has correctly completed the physical operation, and unable to automatically feed the operation results back to the digital system. The digital system remains in a blind state, unable to perceive updates in the physical world. After the server issues the adjudication command, the only verification method relies on manual visual review by the operator or referee. This is not only inefficient, but a single omission will accumulate errors in subsequent simulation rounds. As the simulation progresses, the deviation between the digital and physical situations continues to amplify, ultimately leading to severely distorted adjudication results. Summary of the Invention

[0004] The main objective of this invention is to provide an AR wargame operator entity digital synchronization method and system based on bidirectional state verification. This invention solves the defect of existing AR schemes that cannot actively perceive the physical state of entity operators, and has the ability to independently judge whether the physical situation and the digital situation are consistent, thereby eliminating the problem of inconsistency between the digital situation and the physical situation caused by omissions or errors in physical operations during hybrid simulation.

[0005] To achieve the above objectives, this invention provides a method for digital synchronization of AR wargame operator entities based on bidirectional state verification, comprising the following steps:

[0006] The AR device obtains the digital target state of each entity operator from the server and collects the first physical state of each entity operator.

[0007] The first physical state is compared with the digital target state one by one to obtain the difference task queue;

[0008] The control projection device projects a prompt light effect corresponding to the difference type onto the hexagonal grid coordinates of the operators to be synchronized in the difference task queue;

[0009] After projecting the prompt light effect, the second physical state of the operator to be synchronized is identified. When the second physical state is consistent with the digital target state, the projection device is controlled to stop projecting the prompt light effect and send a synchronization confirmation signal to the server.

[0010] Optionally, in a first implementation of the first aspect of the present invention, the AR device obtains the digital target state of each entity operator from the server and collects the first physical state of each entity operator, including:

[0011] After each round of adjudication, the server updates the status of all deployed entity operators on the simulation map and generates a digital target status, which includes a unique identifier for the operator, hexagonal grid coordinates, and a description of the target's physical state.

[0012] The set of digital target status information is pushed to the AR device, which then parses it and stores it in a local status buffer.

[0013] The image acquisition device acquires a chessboard image containing the entity operators and performs color recognition and pattern matching to obtain the first physical state of each entity operator.

[0014] Optionally, in a second implementation of the first aspect of the present invention, an image acquisition device acquires a chessboard image containing the entity operators and performs color recognition and pattern matching to obtain the first physical state of each entity operator, including:

[0015] The chessboard image containing the entity operator is acquired by an image acquisition device, and the chessboard image is segmented according to a pre-calibrated hexagonal grid coordinate system to obtain sub-region images that correspond one-to-one with each hexagonal grid of the deduction map.

[0016] Color recognition and pattern matching are performed on each of the sub-region images to obtain the first physical state of each entity operator.

[0017] Optionally, in a third implementation of the first aspect of the present invention, color recognition and pattern matching are performed on each of the sub-region images to obtain the first physical state of each entity operator, including:

[0018] After converting each sub-region image to the HSV color space, the hue component is extracted. The hue component is then matched one by one with the hue range corresponding to each preset orientation state to obtain the orientation state of each entity operator.

[0019] Perform similarity calculation between each sub-region image and the pre-stored operator standard pattern template, take the pattern type corresponding to the operator standard pattern template with the highest similarity as the pattern identifier of each entity operator, and take the orientation state and the pattern identifier as the first physical state of each entity operator.

[0020] Optionally, in a fourth implementation of the first aspect of the present invention, the first physical state is compared one by one with the digital target state to obtain a difference task queue, including:

[0021] Based on the unique operator identifier of each entity operator, the orientation state and pattern identifier in the first physical state of each entity operator are compared with the corresponding digital target state in the local state buffer one by one to determine the operator to be synchronized and record the difference type.

[0022] Write the hexagonal grid coordinates and corresponding difference types of the operator to be synchronized into the difference task queue.

[0023] Optionally, in a fifth implementation of the first aspect of the present invention, controlling the projection device to project a cue light effect corresponding to the difference type onto the hexagonal grid coordinates of the operators to be synchronized in the difference task queue includes:

[0024] Based on the difference type of each operator to be synchronized in the difference task queue, query the light effect parameter combination corresponding to each operator to be synchronized. The light effect parameter combination includes light effect color, flashing frequency and light effect pattern.

[0025] The hexagonal grid coordinates of the operator to be synchronized are converted into the projection pixel area in the coordinate system of the projection device, and the projection device is controlled to project the prompt light effect onto the projection pixel area according to the light effect parameter combination.

[0026] Optionally, in a sixth implementation of the first aspect of the present invention, the hexagonal grid coordinates of the operator to be synchronized are converted into a projection pixel region in the coordinate system of the projection device, and the projection device is controlled to project a prompting light effect onto the projection pixel region according to the light effect parameter combination, including:

[0027] Perform coordinate transformation on the hexagonal grid coordinates of each operator to be synchronized in the difference task queue to obtain the corresponding projection pixel area of ​​each operator to be synchronized in the projection device coordinate system.

[0028] After binding the projection pixel region corresponding to each operator to be synchronized with the light effect parameter combination, the prompt light effect is projected onto the projection pixel region, and the projection device is controlled to perform parallel projection on the operators to be synchronized in the difference task queue.

[0029] Optionally, in the seventh implementation of the first aspect of the present invention, after projecting the cue light effect, the second physical state of the operator to be synchronized is identified. When the second physical state is consistent with the digital target state, the projection device is controlled to stop projecting the cue light effect, and a synchronization confirmation signal is sent to the server, including:

[0030] After projecting the cue light effect, the second physical state of the operator to be synchronized is identified;

[0031] When the second physical state is consistent with the digital target state, the projection device is controlled to stop projecting the prompt light effect onto the projection pixel area of ​​the corresponding operator to be synchronized, and a synchronization confirmation signal containing the operator's unique identifier and operation completion timestamp is sent to the server.

[0032] Optionally, in an eighth implementation of the first aspect of the present invention, when the second physical state is consistent with the digital target state, the projection device is controlled to stop projecting the prompt light effect onto the projection pixel area of ​​the corresponding operator to be synchronized, and a synchronization confirmation signal containing the operator's unique identifier and operation completion timestamp is sent to the server, including:

[0033] When the second physical state is consistent with the digital target state, the projection device is controlled to stop projecting prompt light effects onto the projection pixel area corresponding to the operator to be synchronized, and to project confirmation light effects onto the projection pixel area of ​​the operator to be synchronized.

[0034] The operator's unique identifier and operation completion timestamp of the operator to be synchronized are encapsulated into a synchronization confirmation signal and sent to the server, which then writes the synchronization confirmation signal into the simulation operation audit log.

[0035] This invention also provides an AR wargame operator entity digital synchronization system based on bidirectional state verification, comprising:

[0036] The acquisition module is used by the AR device to obtain the digital target state of each entity operator from the server and to acquire the first physical state of each entity operator.

[0037] The state comparison module is used to compare the first physical state with the digital target state one by one to obtain the difference task queue.

[0038] The light effect projection module is used to control the projection device to project prompt light effects corresponding to the difference type onto the hexagonal grid coordinates of the operators to be synchronized in the difference task queue;

[0039] The synchronization confirmation module is used to identify the second physical state of the operator to be synchronized after the projection of the prompt light effect. When the second physical state is consistent with the state of the digital target, the module controls the projection device to stop projecting the prompt light effect and sends a synchronization confirmation signal to the server.

[0040] In summary, this invention obtains the first physical state of each entity operator by performing color recognition and pattern matching on a chessboard image, and compares it one by one with the digital target state issued by the server to generate a difference task queue. This solves the defect of existing AR solutions that cannot actively perceive the physical state of entity operators, and has the ability to independently judge whether the physical situation and the digital situation are consistent. Based on the difference type of each operator to be synchronized in the difference task queue, this invention queries the corresponding light effect parameter combination from the light effect parameter mapping table, and converts the hexagonal grid coordinates into projection pixel areas based on the coordinate mapping relationship. Then, it controls the projection device to accurately project the prompt light effect corresponding to the difference type to the location of each operator to be synchronized. This transforms the operation guidance method that originally relied on manual list looking up into precise optical positioning guidance based on difference type encoding. Operators can accurately locate the operator to be operated and the corresponding operation type without memorizing or checking any auxiliary materials. After the operator performs a physical operation, this invention continuously performs color recognition and pattern matching on the image of the sub-region where the synchronization operator is located according to the sampling period. It eliminates invalid frame interference during the flipping process through a transition frame filtering mechanism. The operation is confirmed to be completed only when the comparison results of multiple consecutive valid sampled frames are consistent. The synchronization confirmation signal containing the operator's unique identifier and the operation completion timestamp is fed back to the server and written into the audit log. This realizes automated reverse verification of the physical operation results and closed-loop update of the digital system, eliminating the problem of inconsistency between the digital situation and the physical situation caused by omissions or errors in physical operations during hybrid simulation. Attached Figure Description

[0041] Figure 1 This is a schematic diagram of the steps of an AR wargame operator entity digital synchronization method based on bidirectional state verification in one embodiment of the present invention;

[0042] Figure 2 This is a schematic diagram illustrating the color recognition and pattern matching process in an embodiment of the present invention;

[0043] Figure 3 This is a schematic diagram illustrating the comparison of the first physical state with the digital target state one by one in an embodiment of the present invention;

[0044] Figure 4 This is a schematic diagram illustrating the projection of a prompting light effect onto the projection pixel area in an embodiment of the present invention;

[0045] Figure 5 This is a block diagram of the AR wargame operator entity digital synchronization system based on bidirectional state verification in an embodiment of the present invention.

[0046] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0047] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.

[0048] Reference Figure 1 This embodiment provides a method for digital synchronization of AR wargame operator entities based on bidirectional state verification, including the following steps:

[0049] S1, the AR device obtains the digital target state of each entity operator from the server and collects the first physical state of each entity operator;

[0050] S2, compare the first physical state with the digital target state one by one to obtain the difference task queue;

[0051] S3, control the projection device to project the corresponding difference type prompt light effect onto the hexagonal grid coordinates of the operators to be synchronized in the difference task queue;

[0052] S4. After projecting the prompt light effect, identify the second physical state of the operator to be synchronized. When the second physical state is consistent with the digital target state, control the projection device to stop projecting the prompt light effect and send a synchronization confirmation signal to the server.

[0053] In one example, the AR device obtains the digital target state of each entity operator from the server and acquires the first physical state of each entity operator, including:

[0054] After each round of adjudication, the server updates the status of all deployed entity operators on the simulation map and generates digital target status. The digital target status includes the operator's unique identifier, hexagonal grid coordinates, and a description of the target's physical state.

[0055] The set of digital target status information is pushed to the AR device, which then parses it and stores it in the local status buffer.

[0056] The image acquisition device acquires a chessboard image containing entity operators and performs color recognition and pattern matching to obtain the first physical state of each entity operator.

[0057] In this example, after each round of adjudication, the server performs a unified status refresh on all deployed entity operators on the simulation map based on the current simulation rules, operator survival status, combat results, and faction affiliation. A corresponding digital target status entry is generated for each entity operator. This digital target status entry includes at least the operator's unique identifier, hexagonal grid coordinates, and a target physical state description, clearly indicating "which operator," "which hexagonal grid it is located in," and "what entity state it should currently present." The target physical state description specifically states whether it needs to be flipped, whether the red or blue side should be facing up, whether it is damaged, and which combatant it belongs to. This allows the server to form a set of digital target status information oriented towards the entire round of adjudication results. The server status refresh cycle is preset to trigger once per adjudication cycle, the single encapsulation timeout for the digital target status information set is preset to 100 milliseconds, and the number of communication retransmissions is preset to 2. If the first round of transmission is not confirmed, a retransmission is immediately initiated to avoid the loss of baseline status on the AR device side due to link jitter. After the digital target state information set is formed, the server actively pushes the entire data packet to the AR device covering the corresponding chessboard area via a communication link. Upon receiving the data packet, the AR device's communication unit parses each field structure and establishes an index based on the operator's unique identifier. The hexagonal grid coordinates, target physical state description, and reception timestamp are then written into the local state buffer. To improve buffer reading efficiency, the local state buffer capacity is preset to 1024 state records. Each state record retains the most recent valid decision result, and the state buffer expiration time is preset to 10 seconds. When a new round of decision results arrives, the old record is overwritten, ensuring that the AR device always uses the latest target state as the verification benchmark. After completing the digital target state reception and buffering, the AR device's image acquisition device acquires images of the physical chessboard area and inputs the acquired chessboard images into the state recognition link. To ensure the recognition results strictly correspond to the grid information in the simulation map, the processing unit first performs region segmentation on the entire chessboard image based on a pre-calibrated hexagonal grid coordinate system. This divides the complete chessboard image into several sub-region images corresponding to each hexagonal grid, ensuring that each sub-region image corresponds to only one specific grid range. During implementation, the image acquisition resolution is preset to 1920×1080, the acquisition frame rate is preset to 25 frames per second, the side length of a single hexagonal grid sub-region is converted to 80 pixels according to the calibration results, and the region segmentation tolerance is preset to ±3 pixels to balance chessboard edge distortion compensation and real-time processing efficiency. After region segmentation, the processing unit performs color recognition and pattern matching for each sub-region image containing entity operators. The color recognition part uses the hue component of the HSV color space as the primary judgment criterion. After converting the sub-region image to the HSV color space, the hue component is extracted, and the extracted result is matched one by one with the preset hue range corresponding to each facing state to determine whether the current entity operator's facing face is red or blue.The red hue range is preset to 0-10 and 156-180, the blue hue range to 100-124, the effective lower limit of saturation to 60, and the effective lower limit of brightness to 50. Only when the hue, saturation, and brightness thresholds are simultaneously met will a valid orientation result be output, reducing interference from ambient light fluctuations on color recognition. After color recognition, the processing unit performs pattern matching on the same sub-region image to identify the pattern identifier of the entity operator and determine the operator type. The similarity between the pattern features in the current sub-region image and pre-stored standard operator pattern templates is calculated, and the pattern type corresponding to the template with the highest similarity is selected as the recognition result. The number of standard pattern templates is preset to 64 categories, the image size of a single template is preset to 128×128, and the template matching similarity threshold is preset to 0.82. When the highest similarity is below 0.82, the current sub-region is marked as a region to be reviewed, and the final pattern identifier is not directly output. When the highest similarity is greater than or equal to 0.82, the pattern matching is considered successful. The orientation state obtained from color recognition and the pattern identifier obtained from pattern matching are combined in the same operator record and overlaid with orientation information to form the first physical state of the entity operator. The first physical state naturally carries the hexagonal grid position attribute through the sub-region correspondence. The processing unit establishes an association between the first physical state and the digital target state in the local state buffer according to the operator's unique identifier or the hexagonal grid mapping relationship.

[0058] like Figure 2 In one example, an image of a chessboard containing entity operators is acquired using an image acquisition device, and color recognition and pattern matching are performed to obtain the first physical state of each entity operator, including:

[0059] 201. Acquire a chessboard image containing entity operators using an image acquisition device, and perform region segmentation on the chessboard image according to a pre-calibrated hexagonal grid coordinate system to obtain sub-region images that correspond one-to-one with each hexagonal grid of the deduction map.

[0060] 202. Perform color recognition and pattern matching on each sub-region image to obtain the first physical state of each entity operator.

[0061] In this example, the image acquisition device acquires a full image of the chessboard area where the physical operators are placed, and inputs the acquired chessboard image into the state recognition link. Based on a pre-calibrated hexagonal grid coordinate system, the chessboard image is segmented. That is, according to the correspondence between the actual grid layout of the physical chessboard and the grid layout of the digitally generated map, the entire chessboard image is divided into several sub-region images corresponding one-to-one with each hexagonal grid, so that each sub-region image can represent a specific hexagonal grid range. Color recognition and pattern matching are performed on each sub-region image. The color recognition part extracts the hue component after converting the sub-region image to the HSV color space, and then matches the extracted hue component with the preset hue range corresponding to each facing state to determine which state the current facing face of the physical operator belongs to. The recognition result reflects the facing state of the operator, for example, determining whether the operator is currently facing red or blue. Simultaneously, pattern matching processing is performed on the same sub-region image. The similarity between the pattern features in the current sub-region and pre-stored operator standard pattern templates is calculated, and the pattern type corresponding to the operator standard pattern template with the highest similarity is selected as the pattern identifier for the current entity operator. Furthermore, orientation angle calculation is performed on the operator contour in the sub-region to help determine if the current placement orientation is correct. The output first physical state includes the facing state, pattern identifier, and orientation information.

[0062] In one example, color recognition and pattern matching are performed on each sub-region image to obtain the first physical state of each entity operator, including:

[0063] After converting the image of each sub-region to the HSV color space, the hue component is extracted. The hue component is then matched one by one with the hue range corresponding to each preset orientation state to obtain the orientation state of each entity operator.

[0064] Perform similarity calculation between each sub-region image and the pre-stored operator standard pattern template, take the pattern type corresponding to the operator standard pattern template with the highest similarity as the pattern identifier of each entity operator, and take the orientation state and pattern identifier as the first physical state of each entity operator.

[0065] In this example, the state recognition module performs color space conversion processing on each sub-region image, mapping the original acquired red, green, and blue three-channel images to the HSV color space and extracting hue components to represent color categories. Hue components are more direct in distinguishing the face of an entity operator and are more suitable for stable recognition of red, blue, and other facing states in a chessboard environment. After extracting the hue components, the processing unit matches the hue components corresponding to the current sub-region image with the preset hue ranges corresponding to each facing state one by one. When a hue component falls within a certain preset hue range, it is determined that the current entity operator is in the facing state corresponding to that hue range. For example, the hue range for the red facing state is preset to 0 to 10 and 156 to 180, and the hue range for the blue facing state is preset to 100 to 124. At the same time, the effective lower limit of saturation is preset to 60, and the effective lower limit of brightness is preset to 50. Only when hue, saturation, and brightness simultaneously meet the judgment conditions is a valid facing state result output, reducing the adverse effects of ambient light changes, local shadows, and projection interference on color recognition accuracy. The state recognition module performs pattern matching on the same sub-region image to determine the pattern identifier of the current entity operator, i.e., to determine which operator type the entity operator in the current sub-region belongs to. The frontal pattern region in the current sub-region image is cropped and normalized. Then, the processed pattern features are compared with pre-stored standard pattern templates for each type of operator to calculate similarity. The standard pattern template corresponding to the maximum similarity result is selected from all similarity results, and the pattern type corresponding to the standard pattern template is used as the pattern identifier of the current entity operator. The number of pre-stored standard pattern templates is preset to 64 categories, and the template image size is preset to 128×128. The similarity is normalized from the template matching results, and the effective recognition threshold is preset to 0.82. When the highest similarity is greater than or equal to 0.82, the pattern recognition is considered successful; when the highest similarity is less than 0.82, the current sub-region is marked as pending verification, and the final pattern type is not output temporarily to avoid misidentification due to occlusion, dirt, or image blurring. The orientation state recognition and pattern identification results are written into the same entity operator state record, and the orientation state and pattern identification are used together as the first physical state of each entity operator, and the contour direction angle calculation result is superimposed as auxiliary orientation information.

[0066] like Figure 3 In one example, the first physical state is compared one by one with the digital target state to obtain a queue of difference tasks, including:

[0067] 301. Based on the unique operator identifier of each entity operator, compare the orientation state and pattern identifier in the first physical state of each entity operator with the corresponding digital target state in the local state buffer one by one to determine the operator to be synchronized and record the difference type.

[0068] 302. Write the hexagonal grid coordinates of the operator to be synchronized and the corresponding difference type into the difference task queue.

[0069] In this example, the AR device's state comparison module reads the operator's unique identifier from the first physical state record and uses it as the unique retrieval key to query the corresponding digital target state record in the local state buffer, establishing a one-to-one correspondence between the "currently identified entity operator state" and the "target state issued by the server." Since the local state buffer has pre-stored the hexagonal coordinates of each entity operator and the target physical state description, the state comparison module, after completing the unique identifier matching, directly retrieves the target orientation state and target pattern type from the corresponding digital target state and performs a one-to-one comparison with the orientation state and pattern identifier in the first physical state. An independent comparison record is established for each operator, ensuring that each entity operator forms a complete state verification chain, avoiding state misalignment or mismatches caused by multiple operators existing simultaneously on the chessboard. After establishing the correspondence, the state comparison module performs difference determination in two dimensions: orientation state and pattern identifier. It compares the current orientation state in the first physical state with the target orientation state in the digital target state, and simultaneously compares the current pattern identifier in the first physical state with the target pattern identifier in the digital target state. When both dimensions are consistent, it indicates that the physical presentation of the current entity operator has met the requirements of the digital system, and the entity operator is marked as synchronized and no longer used as a light effect prompt object. However, if either dimension is inconsistent, it is determined that the current entity operator has not yet completed synchronization, enters the guidance operation link, and is identified as an operator to be synchronized. While determining that it is an operator to be synchronized, the state comparison module records the specific difference type, i.e., whether the current inconsistency manifests as an inconsistency in orientation state, an inconsistency in pattern identifier, or both. If the orientation state is inconsistent, the difference type is recorded as "needs to be flipped"; if the pattern identifier is inconsistent, the difference type is recorded as "type mismatch" or "entity state and target type inconsistency"; if both the orientation state and pattern identifier are inconsistent, it is recorded as "both orientation and pattern mismatch". For example, the record is "Needs to be flipped: Blue side up → Red side up". The processing unit reads the hexagonal grid coordinates of the operator to be synchronized in the local state buffer, and writes the hexagonal grid coordinates and the difference type into a record of the task to be executed and writes it into the difference task queue, and attaches the operator's unique identifier, the enqueue timestamp and the task priority, so that the system can perform parallel processing or sorting scheduling when multiple operators have differences at the same time.During system initialization, the queue capacity, writing rules, and refresh strategy of the difference task queue are preset. For example, the difference task queue capacity is preset to 256 task records, the queue writing method is preset to write sequentially according to the comparison completion order, and the duplicate writing judgment cycle is preset to 1 adjudication cycle. That is, in the same round of adjudication, if there are already incomplete queue items for the same operator, only the difference type is updated and no new queue items are added, so as to avoid duplicate prompting tasks generated by the same operator due to continuous sampling. At the same time, the retention time of difference task records is preset to 30 seconds. If the synchronization confirmation is not completed within 30 seconds, the record is retained and continues to participate in subsequent projection prompts until the synchronization is completed or the current round of inference is terminated.

[0070] In one example, the control projection device projects a cue light effect corresponding to the difference type onto the hexagonal grid coordinates of the operators to be synchronized in the difference task queue, including:

[0071] Based on the difference type of each operator to be synchronized in the difference task queue, query the light effect parameter combination corresponding to each operator to be synchronized. The light effect parameter combination includes light effect color, flashing frequency and light effect pattern.

[0072] The hexagonal grid coordinates of the operator to be synchronized are converted into the projection pixel area in the coordinate system of the projection device, and the projection device is controlled to project prompt light effects onto the projection pixel area according to the combination of light effect parameters.

[0073] In this example, the light effect projection module in the AR device sequentially reads the task records of each operator to be synchronized in the difference task queue, extracts the difference type field from each task record, and then queries the combination of light effect parameters corresponding to the current difference type based on the pre-established light effect parameter mapping relationship. Using the difference type as the search key, it looks up the corresponding prompt strategy in the preset light effect parameter mapping table, assigning different visual guidance methods to different types of state differences. For example, when the difference type is "State error, immediate flip operation required," the query retrieves a red prompt light effect, a flashing frequency of 3 times per second, and a light effect pattern with a rectangular border and the meaning of flipping. When the difference type is "State awaiting manual confirmation," the query retrieves a yellow prompt light effect, a flashing frequency of 1 time per second, and a relatively gentle prompt pattern, allowing the operator to quickly determine the type of operation to be performed and the processing priority based solely on the light effect projected onto the chessboard surface without reading additional text instructions. The light effect projection module continues to read the hexagonal grid coordinates of the same operator to be synchronized and inputs the hexagonal grid coordinates into the coordinate transformation unit to convert the grid position in the chessboard coordinate system into the projectable area in the projection device coordinate system. Since the projection device actually performs pixel-level projection control, while the difference task queue stores hexagonal grid coordinates, a conversion is needed between the two through a pre-calibrated mapping relationship. This involves using calibration parameters between the projection device and the chessboard coordinate system to accurately convert the hexagonal grid position of a specific operator to be synchronized into the target pixel area in the projected image. After processing, the system can determine which pixel area of ​​the projected image the prompt light effect should fall on, ensuring that the projected prompt light effect precisely coincides with the actual position of the physical operator on the chessboard, avoiding problems such as the prompt light spot shifting to adjacent hexagonal grids, insufficient coverage, or misleading the operator. The control module binds the projection pixel area of ​​the current operator to be synchronized with the light effect parameter combination and sends corresponding projection control commands to the projection device, causing the projection device to project the prompt light effect within the projection pixel area according to the light effect parameter combination. The queried light effect color is used as the display color value parameter, the flashing frequency as the time control parameter, and the light effect pattern as the graphics rendering parameter within the area. Then, the projection device outputs the corresponding dynamic prompt light effect within the specified projection pixel area. If multiple operators to be synchronized exist simultaneously in the differential task queue, coordinate transformation and parameter binding are performed on the projected pixel regions of the multiple operators to be synchronized, and the projection device is controlled to perform the prompt light effect projection on multiple regions in parallel. In this way, concurrent prompts can be achieved in scenarios where multiple operators need to be adjusted after a decision, thereby improving the efficiency of entity situation synchronization.

[0074] like Figure 4 In one example, the hexagonal grid coordinates of the operator to be synchronized are converted into a projection pixel region in the coordinate system of the projection device. The projection device is then controlled to project cue light effects onto the projection pixel region according to the combination of light effect parameters, including:

[0075] 401. Perform coordinate transformation on the hexagonal grid coordinates of each operator to be synchronized in the difference task queue to obtain the corresponding projected pixel area of ​​each operator to be synchronized in the projection device coordinate system;

[0076] 402. After binding the projection pixel area corresponding to each operator to be synchronized with the light effect parameter combination, project the prompt light effect onto the projection pixel area, and control the projection device to perform parallel projection on the operators to be synchronized in the difference task queue.

[0077] In this example, the processing unit reads the hexagonal grid coordinates from the difference task queue line by line and sends the hexagonal grid coordinates of each operator to be synchronized into the coordinate transformation link. Since the difference task queue stores the grid positions in the chessboard coordinate system, while the projection device actually performs pixel-level display control in the projection device coordinate system, based on the pre-established calibration mapping relationship between the projection device and the chessboard coordinate system, each hexagonal grid coordinate is converted into the target pixel coverage area in the projected image, transforming "which grid on the chessboard needs a prompt" into "which pixel area in the projected image needs to be illuminated." The projected pixel area of ​​each operator to be synchronized is bound to the corresponding light effect parameter combination, and the spatial position parameters and display style parameters are encapsulated into the same projection control record. The projected pixel area is responsible for limiting the landing point range of the prompt light effect, while the light effect parameter combination is responsible for limiting the display method of the prompt light effect. The light effect parameter combination includes light effect color, flashing frequency, and light effect pattern. In specific implementation, brightness parameters are reserved for environmental adaptive adjustment. For example, when the difference type indicates "state error, immediate flipping operation required," a red light effect can be bound, flashing 3 times per second, along with a rectangular border and a flipping prompt pattern. When the difference type indicates "state awaiting manual confirmation," a yellow light effect can be bound, flashing once per second, along with a weaker prompt pattern. For grids whose status has been confirmed as correct, a solid green rectangular light spot is bound as a confirmation light effect. During the projection execution phase, the control module performs parallel projection control on multiple operators to be synchronized in the difference task queue. That is, it simultaneously issues independent light effect display commands to multiple projection pixel areas, enabling the projection device to synchronously project different or identical prompt light effects onto multiple hexagonal grid positions at the same time. When multiple entity operators have state differences in the same round of adjudication, corresponding prompt light spots are displayed simultaneously at multiple operator positions. The operator can simultaneously understand the location of all operators to be processed and their respective operational requirements through the different light effect appearances at different positions.

[0078] In one example, after projecting the cue light effect, the second physical state of the operator to be synchronized is identified. When the second physical state matches the digital target state, the projection device stops projecting the cue light effect and sends a synchronization confirmation signal to the server, including:

[0079] After projecting the cue light effect, identify the second physical state of the operator to be synchronized;

[0080] When the second physical state is consistent with the digital target state, the control projection device stops projecting prompt light effects onto the projection pixel area of ​​the corresponding operator to be synchronized, and sends a synchronization confirmation signal containing the operator's unique identifier and operation completion timestamp to the server.

[0081] In this example, after the projection of the cue light effect, the AR device enters a continuous monitoring mode for the operators to be synchronized. It writes the unique identifiers and corresponding hexagonal grid coordinates of the operators in the synchronization state from the difference task queue into the active monitoring list. The image acquisition device continuously acquires images of the chessboard area at a fixed sampling period. Then, the state recognition module repeatedly performs physical state recognition on the sub-regions where each operator to be synchronized is located in the active monitoring list. The recognition method is consistent with the method used for the first physical state recognition, focusing on color features, pattern features, and orientation features. Specifically, it performs HSV color space hue component extraction on the currently facing side of the operator to determine the facing state, performs pattern template matching to confirm the pattern identifier, and performs contour direction angle calculation to determine the current orientation. These three recognition results are then combined to form the current physical state description of the corresponding operator to be synchronized within the sampling period. The current physical state description obtained again after the cue light effect is projected serves as the second physical state of the operator to be synchronized. To avoid misjudgments caused by occlusion, blurring, or transient intermediate states during the operator's flipping, moving, or returning of the physical operator, the sampled frames are first filtered for validity when recognizing the second physical state. When the image acquisition device detects hand occlusion, operator tilting, partial pattern loss, or temporary disappearance of color features, resulting in the current sub-region image lacking stable recognition conditions, the processing unit marks such sampling frames as transition frames and skips the judgment. Only valid sampling frames with complete features and identifiable states are processed for second physical state recognition and consistency verification. After obtaining the second physical state corresponding to a valid sampling frame, the state recognition module compares the second physical state with the digital target state recorded in the corresponding entry of the difference task queue. The comparison dimensions include facing state, pattern identifier, and orientation. Facing state determines whether the color corresponding to the hue component matches the target color; pattern identifier determines whether the template matching result matches the target pattern type; and orientation determines whether the contour direction angle matches the target orientation. When all three dimensions match in a valid sampling frame, the "three-dimensional matching" result is checked for consistency across multiple consecutive valid sampling frames. Only when the matching condition is met in N consecutive frames is the second physical state of the corresponding operator to be synchronized finally confirmed to be consistent with the digital target state, thus determining that the entity operation has been effectively completed. The value of N in N consecutive frames is set during system initialization, with a typical value of 3 frames. The number of consecutive matching confirmation frames is preset to 3 frames. The number of consecutive preset frames and the sampling frame rate of the image acquisition device together determine the status confirmation time window. The status confirmation time window is configured during system initialization according to the deduction rhythm requirements and the tolerance for misjudgment.When the second physical state matches the digital target state after multiple consecutive frames of confirmation, the processing unit triggers the subsequent feedback link. On one hand, it sends a stop command to the projection device, causing the projection device to stop projecting prompt light effects onto the projection pixel area of ​​the corresponding operator to be synchronized. The precise extinguishing of the prompt light effect on the physical chessboard surface serves as immediate visual feedback that the operator has correctly completed the physical operation. On the other hand, to improve the visual confirmation effect, after stopping the prompt light effect, a confirmation light effect, such as a solid green confirmation light effect, is briefly projected onto the same projection pixel area, allowing the operator to intuitively see that a certain operator to be synchronized has switched from the "pending processing state" to the "completed state". Simultaneously with stopping the prompt light effect, the communication unit encapsulates the operator's unique identifier and the operation completion timestamp into a synchronization confirmation signal and sends it to the server. The operator's unique identifier is used to identify which entity operator has completed synchronization, and the operation completion timestamp is used to record the specific time of synchronization confirmation, facilitating the server's time-series reconstruction and result tracking of the entire simulation operation. After receiving the synchronization confirmation signal, the server writes it to the simulation operation audit log, enabling the digital system to accurately grasp the operation completion status of each operator on the physical chessboard. When there are multiple operators to be synchronized in the active monitoring list, the identification, confirmation, extinguishing, and feedback actions run in parallel. That is, the state identification module performs the second physical state identification and consistency judgment on all operators to be synchronized in parallel in each valid sampling frame, and the confirmation process of each operator to be synchronized is independent of each other. When an operator to be synchronized first meets the consistency condition for multiple consecutive frames, the prompt light effect is stopped and a synchronization confirmation signal is sent only for this operator, while the remaining operators to be synchronized that have not yet completed synchronization continue to remain in the active monitoring list to receive continuous identification and prompt light effect guidance until all operators to be synchronized have completed confirmation one by one or the current simulation round ends.

[0082] In one example, when the second physical state matches the digital target state, the control projection device stops projecting cue light effects onto the corresponding projection pixel area of ​​the operator to be synchronized, and sends a synchronization confirmation signal containing the operator's unique identifier and operation completion timestamp to the server, including:

[0083] When the second physical state is consistent with the digital target state, the control projection device stops projecting prompt light effects onto the projection pixel area of ​​the corresponding operator to be synchronized, and projects confirmation light effects onto the projection pixel area of ​​the operator to be synchronized.

[0084] The operator's unique identifier and operation completion timestamp of the operator to be synchronized are encapsulated into a synchronization confirmation signal and sent to the server. The server then writes the synchronization confirmation signal into the simulation operation audit log.

[0085] In this example, after the AR device confirms through continuous image acquisition and state recognition that the second physical state of a certain operator to be synchronized is consistent with the digital target state, the processing unit uses this determination as the trigger condition for subsequent feedback actions and immediately sends a local control command to the projection device for that operator to be synchronized, causing the projection device to stop projecting the original prompt light effect onto the projection pixel area of ​​the corresponding operator to be synchronized. Stopping projection is a separate extinguishing control for the target operator that has already completed synchronization. If there are other operators to be synchronized that have not yet completed synchronization in the active monitoring list, the prompt light effects of the other operators to be synchronized will remain in their original projection state and will not interfere with each other. After stopping the prompt light effect, a confirmation light effect is projected onto the projection pixel area of ​​the same operator to be synchronized, switching the "error guidance prompt" to "synchronization completion confirmation". Through a display form different from the prompt light effect, the operator is clearly conveyed to the operator that the current operator has reached the digital target state and no further adjustment is needed. The confirmation light effect uses a solid green light effect, making the chessboard surface visually distinct from the original flashing red or yellow prompt light effect. After all operators to be synchronized have been confirmed, a constant green confirmation light effect is projected onto all synchronized operators in this round to visually confirm that all physical operations required for this round of adjudication have been correctly completed. Simultaneously with the light effect state switch, the AR device's communication unit constructs a synchronization confirmation signal, encapsulating the operator's unique identifier and operation completion timestamp into the signal. The operator's unique identifier uniquely indicates which entity operator has completed synchronization, preventing record confusion when the server encounters multiple operators completing in parallel within the same round. The operation completion timestamp records the specific moment of confirmation of the corresponding operator's completion status, providing a temporal basis for reviewing the deduction process, analyzing the sequence of actions, and tracing responsibility. In addition to the two core fields mentioned above, the synchronization confirmation information also includes a description of the actual physical state after synchronization, used for server-side execution result verification. Upon receiving the synchronization confirmation signal, the server parses and processes it, writing the operator's unique identifier and operation completion timestamp into the simulation operation audit log. This formally incorporates the actual manual operation results on the physical chessboard into the digital system's process tracking chain, enabling the server to accurately grasp the synchronization completion status of each physical operator and form a traceable time-series record. The digital status record of the operator is updated to "synchronized and confirmed," and the synchronization confirmation status is synchronously updated to the digital situation display interface on the browser client, ensuring that the situation observed by the commander in the digital interface remains consistent with the physical situation on the physical chessboard in real time. Simultaneously, after all operators awaiting synchronization in this round have completed confirmation, the server writes the round's ruling, the completion status of each operator's operation, and the corresponding timestamp into the database, completing the archiving of this round's simulation record.

[0086] Reference Figure 5 This embodiment provides an AR wargame operator entity digital synchronization system based on bidirectional state verification, including:

[0087] Acquisition module 1 is used for the AR device to obtain the digital target state of each entity operator from the server and to acquire the first physical state of each entity operator;

[0088] State comparison module 2 is used to compare the first physical state with the digital target state one by one to obtain the difference task queue;

[0089] Light effect projection module 3 is used to control the projection device to project prompt light effects of the corresponding difference type onto the hexagonal grid coordinates of the operators to be synchronized in the difference task queue;

[0090] Synchronization confirmation module 4 is used to identify the second physical state of the operator to be synchronized after the projection of the prompt light effect. When the second physical state is consistent with the digital target state, the projection device is controlled to stop projecting the prompt light effect and send a synchronization confirmation signal to the server.

[0091] In this embodiment, the specific implementation of each unit in the above system embodiment is described in the above method embodiment, and will not be repeated here.

[0092] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, system, article, or method that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, system, article, or method. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, system, article, or method that includes that element.

[0093] The above description is only a preferred embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent structural or procedural transformations made based on the content of the present invention specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A method for synchronizing the digital entities of AR wargame operators based on bidirectional state verification, characterized in that, include: The AR device obtains the digital target state of each entity operator from the server and collects the first physical state of each entity operator. Specifically, this includes: after each round of adjudication, the server updates the status of all deployed entity operators on the simulation map, generating digital target states, which include unique identifiers for operators, hexagonal grid coordinates, and a description of the target's physical state; the set of digital target state information is pushed to an AR device, which parses it and stores it in a local state buffer; a chessboard image containing the entity operators is acquired using an image acquisition device, and the chessboard image is segmented according to a pre-calibrated hexagonal grid coordinate system to obtain sub-region images corresponding one-to-one with each hexagonal grid of the simulation map; after converting each sub-region image to the HSV color space, hue components are extracted, and the hue components are matched one by one with the hue ranges corresponding to each preset orientation state to obtain the orientation state of each entity operator; the sub-region images are compared with pre-stored operator standard pattern templates, and the pattern type corresponding to the operator standard pattern template with the highest similarity is taken as the pattern identifier of each entity operator, and the orientation state and the pattern identifier are taken as the first physical state of each entity operator. The first physical state is compared with the digital target state one by one to obtain the difference task queue; The control projection device projects a prompt light effect corresponding to the difference type onto the hexagonal grid coordinates of the operators to be synchronized in the difference task queue; After projecting the prompt light effect, the second physical state of the operator to be synchronized is identified. When the second physical state is consistent with the digital target state, the projection device is controlled to stop projecting the prompt light effect and send a synchronization confirmation signal to the server.

2. The AR wargame operator entity digital synchronization method based on bidirectional state verification according to claim 1, characterized in that, The first physical state is compared with the digital target state one by one to obtain a difference task queue, including: Based on the unique operator identifier of each entity operator, the orientation state and pattern identifier in the first physical state of each entity operator are compared with the corresponding digital target state in the local state buffer one by one to determine the operator to be synchronized and record the difference type. Write the hexagonal grid coordinates and corresponding difference types of the operator to be synchronized into the difference task queue.

3. The AR wargame operator entity digital synchronization method based on bidirectional state verification according to claim 1, characterized in that, The control projection device projects a cue light effect corresponding to the difference type onto the hexagonal grid coordinates of the operators to be synchronized in the difference task queue, including: Based on the difference type of each operator to be synchronized in the difference task queue, query the light effect parameter combination corresponding to each operator to be synchronized. The light effect parameter combination includes light effect color, flashing frequency and light effect pattern. The hexagonal grid coordinates of the operator to be synchronized are converted into the projection pixel area in the coordinate system of the projection device, and the projection device is controlled to project the prompt light effect onto the projection pixel area according to the light effect parameter combination.

4. The AR wargame operator entity digital synchronization method based on bidirectional state verification according to claim 3, characterized in that, Converting the hexagonal grid coordinates of the operator to be synchronized into a projection pixel region in the coordinate system of the projection device, and controlling the projection device to project cue light effects onto the projection pixel region according to the light effect parameter combination, includes: Perform coordinate transformation on the hexagonal grid coordinates of each operator to be synchronized in the difference task queue to obtain the corresponding projection pixel area of ​​each operator to be synchronized in the projection device coordinate system. After binding the projection pixel region corresponding to each operator to be synchronized with the light effect parameter combination, the prompt light effect is projected onto the projection pixel region, and the projection device is controlled to perform parallel projection on the operators to be synchronized in the difference task queue.

5. The AR wargame operator entity digital synchronization method based on bidirectional state verification according to claim 4, characterized in that, After projecting the cue light effect, the second physical state of the operator to be synchronized is identified. When the second physical state matches the digital target state, the projection device is controlled to stop projecting the cue light effect and a synchronization confirmation signal is sent to the server, including: After projecting the cue light effect, the second physical state of the operator to be synchronized is identified; When the second physical state is consistent with the digital target state, the projection device is controlled to stop projecting the prompt light effect onto the projection pixel area of ​​the corresponding operator to be synchronized, and a synchronization confirmation signal containing the operator's unique identifier and operation completion timestamp is sent to the server.

6. The AR wargame operator entity digital synchronization method based on bidirectional state verification according to claim 5, characterized in that, When the second physical state matches the digital target state, the projection device is controlled to stop projecting the prompt light effect onto the projection pixel area of ​​the corresponding operator to be synchronized, and a synchronization confirmation signal containing the operator's unique identifier and operation completion timestamp is sent to the server, including: When the second physical state is consistent with the digital target state, the projection device is controlled to stop projecting prompt light effects onto the projection pixel area corresponding to the operator to be synchronized, and to project confirmation light effects onto the projection pixel area of ​​the operator to be synchronized. The operator's unique identifier and operation completion timestamp of the operator to be synchronized are encapsulated into a synchronization confirmation signal and sent to the server, which then writes the synchronization confirmation signal into the simulation operation audit log.

7. An AR wargame operator entity digital synchronization system based on bidirectional state verification, characterized in that, The steps for implementing the AR wargame operator entity digital synchronization method based on bidirectional state verification as described in any one of claims 1 to 6 include: The acquisition module is used by the AR device to obtain the digital target state of each entity operator from the server and to acquire the first physical state of each entity operator. Specifically, this includes: after each round of adjudication, the server updates the state of all deployed entity operators on the simulation map to generate digital target states, which include unique identifiers of the operators, hexagonal grid coordinates, and a description of the target physical state; the set of digital target state information is pushed to the AR device, which parses it and stores it in a local state buffer; and an image acquisition device acquires a chessboard image containing the entity operators, and the image is then processed according to a pre-calibrated hexagonal grid. The coordinate system performs region segmentation on the chessboard image to obtain sub-region images that correspond one-to-one with each hexagonal grid of the deduced map; after converting each sub-region image to the HSV color space, the hue components are extracted, and the hue components are matched one by one with the hue ranges corresponding to each preset facing state to obtain the facing state of each entity operator; the sub-region images are compared with the pre-stored operator standard pattern templates to perform similarity calculation, and the pattern type corresponding to the operator standard pattern template with the highest similarity is taken as the pattern identifier of each entity operator, and the facing state and the pattern identifier are taken as the first physical state of each entity operator. The state comparison module is used to compare the first physical state with the digital target state one by one to obtain the difference task queue. The light effect projection module is used to control the projection device to project prompt light effects corresponding to the difference type onto the hexagonal grid coordinates of the operators to be synchronized in the difference task queue; The synchronization confirmation module is used to identify the second physical state of the operator to be synchronized after the projection of the prompt light effect. When the second physical state is consistent with the state of the digital target, the module controls the projection device to stop projecting the prompt light effect and sends a synchronization confirmation signal to the server.

Images