A radar fault information three-dimensional visualization method, system and electronic device

Abstract

This invention relates to the field of radar fault technology, and more particularly to a three-dimensional visualization method, system, and electronic device for radar fault information. The method includes: establishing a fault information tree structure for the radar according to the hierarchical inclusion relationship of components in each radar cabinet; marking key points on the three-dimensional structural diagram of the component corresponding to each node in the fault information tree structure, and marking the smallest replaceable unit on the component corresponding to each node in the fault information tree structure, thus obtaining the radar fault information tree; constructing a realistic three-dimensional visualization scene of the radar and the roaming action of each key point based on the radar fault information tree; and combining the realistic three-dimensional visualization scene and the roaming action of each key point with the radar fault information tree to obtain a three-dimensional visualized radar fault model, which can provide error information more quickly and intuitively, guiding operators to quickly and accurately locate faulty components of the equipment, effectively shortening maintenance time.

Description

Technical Field

[0001] This invention relates to the field of radar fault technology, and in particular to a three-dimensional visualization method, system and electronic device for radar fault information. Background Technology

[0002] With the rapid development of technology, radar systems are becoming increasingly large and complex, and the failure of any subsystem can have a significant impact on radar operation. Emergency measures for system board-level failures are becoming increasingly important. As a crucial component of military defense, radar requires faster and more efficient fault handling capabilities to meet battlefield needs. Traditional radar fault monitoring and display technology, which relies on "text + structural diagrams," presents fault information in a cumbersome manner, often displaying faulty components in multiple levels. This requires accessing each level sequentially to check the problem, and human factors significantly impact the response speed. Furthermore, due to the varying levels of management expertise and the different levels of competence among users and maintenance personnel in terms of mindset, physical condition, psychology, and knowledge, traditional methods cannot provide easily understandable descriptions and physical comparisons tailored to the users' professional backgrounds. This makes them more susceptible to errors caused by direct operational mistakes, significantly impacting the efficiency of emergency fault handling. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to address the shortcomings of the prior art by providing a three-dimensional visualization method, system and electronic device for radar fault information.

[0004] The technical solution of the three-dimensional visualization method for radar fault information of the present invention is as follows:

[0005] Based on the hierarchical inclusion relationship of the components in each radar cabinet, a fault information tree structure is established for the radar.

[0006] Key points are marked on the three-dimensional structural diagram of the component corresponding to each node in the fault information tree structure, and the smallest replaceable unit on the component corresponding to each node in the fault information tree structure is marked to obtain the fault information tree of the radar.

[0007] Based on the fault information tree of the radar, construct a realistic 3D visualization scene of the radar and the roaming action of each key point;

[0008] The simulated 3D visualization scene and the roaming motion of each key point are then combined with the radar's fault information tree to obtain a 3D visualized radar fault model.

[0009] The beneficial effects of the three-dimensional visualization method for radar fault information of the present invention are as follows:

[0010] Using a 3D graphical display method, coupled with assistant prompts, error information can be provided more quickly and intuitively. Through visually visible equipment displays, operators can be guided to quickly and accurately locate faulty parts of the equipment, effectively shortening repair time, reducing the professional requirements for repair personnel, meeting the human factors engineering and safety requirements related to repair, and helping to improve the efficiency of emergency response to malfunctions.

[0011] The technical solution of the radar fault information three-dimensional visualization system of the present invention is as follows:

[0012] This includes creating modules, marking modules, building modules, and combining modules;

[0013] The establishment module is used to: establish a fault information tree structure for the radar according to the hierarchical inclusion relationship of the components in each radar cabinet;

[0014] The marking module is used to: mark key points on the three-dimensional structural diagram of the component corresponding to each node in the fault information tree structure, and mark the smallest replaceable unit on the component corresponding to each node in the fault information tree structure, so as to obtain the fault information tree of the radar;

[0015] The construction module is used to: construct a realistic 3D visualization scene of the radar and the roaming action of each key point based on the fault information tree of the radar;

[0016] The combining module is used to combine the simulated 3D visualization scene and the roaming action of each key point with the radar fault information tree to obtain a 3D visualized radar fault model.

[0017] The beneficial effects of the radar fault information three-dimensional visualization system of the present invention are as follows:

[0018] Using a 3D graphical display method, coupled with assistant prompts, error information can be provided more quickly and intuitively. Through visually visible equipment displays, operators can be guided to quickly and accurately locate faulty parts of the equipment, effectively shortening repair time, reducing the professional requirements for repair personnel, meeting the human factors engineering and safety requirements related to repair, and helping to improve the efficiency of emergency response to malfunctions.

[0019] The present invention provides a storage medium storing instructions, wherein when a computer reads the instructions, the computer executes a three-dimensional visualization method for radar fault information as described in any of the preceding claims.

[0020] An electronic device according to the present invention includes a processor and the above-described storage medium, wherein the processor executes instructions in the storage medium. Attached Figure Description

[0021] Figure 1 This is a flowchart illustrating a three-dimensional visualization method for radar fault information according to an embodiment of the present invention.

[0022] Figure 2 Build flowcharts for visualizing scenarios;

[0023] Figure 3 A schematic diagram of the structural framework of the butler broadcasting assistance system;

[0024] Figure 4 This is a schematic diagram of the structure of a three-dimensional visualization system for radar fault information according to an embodiment of the present invention. Detailed Implementation

[0025] like Figure 1 As shown in the figure, a three-dimensional visualization method for radar fault information according to an embodiment of the present invention includes the following steps:

[0026] S1. Based on the hierarchical inclusion relationship of components in each radar cabinet, establish a fault information tree structure for the radar, taking the main control cabinet, display control cabinet, and guidance cabinet as examples:

[0027] The component layer-by-layer containment relationship is specifically reflected in the following: the main control cabinet includes components such as the main control board, upload board, download board, and recording board; the display control cabinet includes a first display control assembly and a second display control assembly; the first display control assembly includes components such as the display control board, video processing plugins, graphics card, and monitoring processing plugins; the second display control assembly includes components such as the display control board, video processing plugins, graphics card, and monitoring processing plugins; the guide cabinet includes components such as the first guide board, the second guide board, and the timing board. Therefore:

[0028] The main control cabinet, display control cabinet, and guide cabinet are all top-level root nodes. The main control board, upload board, download board, and recording board of the main control cabinet are child nodes of the main control cabinet. The first display control combination and the second display control combination of the display control cabinet are child nodes of the display control cabinet. The first display control combination includes the display control board, video processing plug-in, graphics card, and monitoring processing plug-in as child nodes of the first display control combination. The display control board, video processing plug-in, graphics card, and monitoring processing plug-in of the second display control combination are child nodes of the second display control combination. The first guide board, the second guide board, and the timing board of the guide cabinet are child nodes of the guide cabinet, and so on. A fault information tree structure of the radar is established, and a three-dimensional structural diagram of the component corresponding to each node is added to each node of the fault information tree structure.

[0029] S2. Mark key points on the 3D structural diagram of the component corresponding to each node in the fault information tree structure, and mark the smallest replaceable unit on the component corresponding to each node in the fault information tree structure to obtain the radar fault information tree.

[0030] In this process, a location point is defined as a key point in the 3D structure diagram based on the actual situation, so as to generate the roaming action of each key point.

[0031] The specific process of marking key points is as follows:

[0032] Based on the fault information tree structure, the location of the observation camera to be placed under the three-dimensional frontal view of each child node, combined with the reasonable observation distance, as well as its importance and whether it is necessary to store the mark of multi-view observation, are stored. When it is necessary to automatically observe the node when a fault occurs, the node should be marked with the mark of needing to store multi-view observation and store the placement information of multiple cameras. In this way, the marking of key points is completed.

[0033] The minimum replaceable unit on each component can be determined according to the actual situation. For example, the minimum replaceable unit of a liquid-cooled fan is the fan and the coolant. The specific process of determining and marking the minimum replaceable unit on the component corresponding to each node in the fault information tree structure is as follows: In the perspective corresponding to the key point of a single fault node, there may be multiple detailed fault information contents, such as fan failure, abnormal coolant flow, temperature sensor failure, excessive current of components, etc. Therefore, the minimum replaceable unit in the monitorable three-dimensional structural model needs to be marked separately.

[0034] S3. Based on the radar's fault information tree, construct a realistic 3D visualization scene of the radar and the roaming action of each key point, specifically:

[0035] Using methods or tools such as 3D graphics development libraries or 3D visualization engines, firstly, based on the 3D world coordinate system, an external environment such as a house or equipment cabin is constructed according to the actual scene. Then, each cabinet model is placed in the position where the physical objects should be placed, and according to the actual structural design, 3D models of combinations, boards, etc., are placed inside the cabinets. Then, based on the previously recorded key points, a camera movement script is generated to show the progressive action of the camera from a fixed viewing angle of the whole scene in an idle state to a roaming viewing angle of each key point. In this way, a 3D visualization scene of radar with simulated physical objects and the roaming action of each key point are constructed.

[0036] S4. The simulated 3D visualization scene and the roaming motion of each key point are combined with the radar's fault information tree to obtain a 3D visualized radar fault model. The specific combination method is as follows:

[0037] The relationships generated by the visualization scene, fault information tree, and roaming actions corresponding to key points are combined. For example, the three pieces of information, namely the display and control cabinet, the total fault of the display and control cabinet, and the roaming actions of the camera view corresponding to the key points of the display and control cabinet, become a relationship combination. All 3D models, fault information trees, and key point roaming scripts in the entire system are combined one by one.

[0038] Optionally, the above technical solution also includes:

[0039] S5. According to the radar's fault information tree, the real-time fault information of the radar is parsed to obtain at least one target node corresponding to the real-time fault information of the radar, and the fault information of each target node is determined from the real-time fault information of the radar. The specific implementation process is as follows:

[0040] The system analyzes real-time radar fault information messages and classifies and hierarchically forms a structural consistency correspondence with the fault information tree based on the cabinet and board where the fault information is located. After receiving a new real-time fault message in each communication cycle, the node fault status is updated.

[0041] S6. Based on the key points of each target node, a 3D visualized radar fault model is used for perspective navigation, and the fault information of each target node is displayed. The specific implementation process is as follows:

[0042] When a fault occurs, a complete information list is displayed based on the fault details. The camera moves along the faulty node using the camera panning script generated in step S3, gradually zooming in on the fault's location. When multiple faults occur simultaneously, the panning script is executed sequentially, displaying the location and status of each fault node. A brief delay is maintained between each fault display transition to allow the user sufficient time to confirm the information. After all faults are displayed, the user can select a single fault from the information list for individual fault display.

[0043] Optionally, the above technical solution also includes:

[0044] S7. Obtain the maintenance method corresponding to each target node from the radar's fault database;

[0045] S8. Display the maintenance methods corresponding to each target node.

[0046] Optionally, the above technical solution also includes:

[0047] S9. While navigating through a 3D visualized radar fault model, a virtual announcer with a 3D human model provides voice broadcasts of fault information and repair methods for each target node. Specifically:

[0048] The text information corresponding to the fault is identified and simultaneously converted into audio content for broadcast.

[0049] The "steward" explains and demonstrates the key aspects of the fault and the repair procedures to the operator.

[0050] Based on information such as the length of the broadcast content and the level of importance of the issue, the system automatically adjusts the speaking speed and the degree of 3D lip-syncing of the announcer. This provides a more approachable auxiliary presentation method, reducing operators' complete reliance on visuals and relaxing them through interactive playback.

[0051] The following describes a three-dimensional visualization of radar fault information according to another embodiment of the present invention, including:

[0052] S10, Local Top-Level Structure Tree Root Node: The top-level structure tree root node includes the overall text display and graphical prompts of top-level rack-level fault information. Specifically:

[0053] By performing top-level fault analysis on real-time radar fault information and extracting fault descriptions and maintenance location methods from the fault database, a comprehensive index list of node information is created. This index list is then displayed to the user, while simultaneously marking key points for camera roaming at the top level. This allows for the construction of camera roaming routes and rapid switching of viewpoints. Based on the roaming route, the system gradually advances to the frontal view of the rack, displaying the rack's location and information to the user in a realistic scenario.

[0054] S11, Combined-level information display node:

[0055] The system constructs secondary-level details, expands the power-saving information comprehensive index list into secondary relationships, stores relevant information to be queried, sets key point markers for combination-level roaming, and sets key actions that need to be performed from the top-level node to the combination-level node, such as the rotation relationship of the outer cabinet door opening, the view observability analysis of the multi-combination model in the cabinet, and the deep caching settings of multi-level details.

[0056] S12, Minimum replaceable element node:

[0057] Information indexing, detailed low-level construction, and unit-level action refinement will be performed based on the smallest replaceable unit level of the radar system hardware. This level requires setting more detailed and clear multi-angle rotation positioning key points, as well as detailed cross-sectional actions at the board level under multiple views. Based on the smallest locatable fault information, detailed content such as board component positioning, chip-level fault display actions, and three-dimensional data stream interruption paths will be set. Trial users can intuitively understand the physical location operation process of fault points and related influence areas in a "top-down" and "follow the map" manner.

[0058] Furthermore, based on the clearly defined minimum replaceable unit details, when a fault occurs, after completing its own fault point action, it queries the upper-level nodes and the pre-set influence domain relationships to analyze the fault level linkage impact and form same-level or even reverse action settings.

[0059] Figure 2 It is a visual flowchart for scene construction. Based on... Figure 1 The key point information, comprehensive information index list, and action scripts are used to construct a simulated 3D visualization scene.

[0060] A basic scene is constructed based on the scene hierarchy. Under fault-free conditions, the resource usage of the equipment is minimized, and the basic scene is rendered using programmable rendering pipeline technology. Referring to the user's roaming camera position and the placement of equipment models within the scene, Level of Detail (LOD) technology is used to render objects and scenes corresponding to different depths at different locations. The level of detail for the scene and objects is divided into N levels, each representing the importance classification of the scene or object based on the level of detail required for rendering. The importance level gradually increases from 1 to N. For example, environmental content such as vehicle-mounted cabins, equipment deployment halls, and fixed scene furnishings are set to Level 1; top-level objects such as racks are set to Level 2; composite information is set to Level 3; LRU information is set to Level 4, and so on. During the loading of scene and object models, detail blurring sampling is performed according to the set level to improve scene construction efficiency.

[0061] To enhance the realism of the scene, the ADS lighting algorithm is used to improve the model's realism. The pixel color of each vertex in the model is determined by Equation 1. observe To ultimately display the color, I ambient The calculation method for ambient light color components is as shown in Formula 2, I diffuse The calculation method for diffuse color components is as shown in Formula 3, I specular The specular color component is calculated as shown in Formula 4. Light represents the lighting color, and Material represents the material color. N is the unit normal vector, L is the unit backlight vector, R is the unit reflected light vector, and V is the inverse viewpoint vector.

[0062] I observe =I ambient +I diffuse +I specular (1)

[0063] I ambient =Light ambient *Material ambient (2)

[0064] I diffuse =Light diffuse *Material diffuse *max(dot(N,L),0) (3)

[0065] Ispecular =Light specular *Material specular *max(dot(R,V) n ,0) (4)

[0066] In addition, the system also provides a butler broadcasting auxiliary system.

[0067] Figure 3 This is a schematic diagram of the structural framework of the butler broadcasting assistance system. The system includes a historical fault broadcasting action frame information storage module and a butler voice conversion and broadcasting action matching module.

[0068] The historical broadcast action frame information temporary module records the past occurrence sequence of fault information and corresponding action script key information based on time and key information points, providing a corresponding information list. When users want to review the fault occurrence process and the gradual evolution of the affected domain through operation, it provides data and action triggering basis. For example, when a user selects a certain fault information sequence to replay the historical fault process, after the module loads the stored content based on time or key point information index, the module performs the viewpoint, scene, and model action restoration process. After all pre-starting related information is restored, the module starts to pass the information to be rendered to the rendering cache according to the time flow based on the recorded actions, key information, etc., and completes the historical information reproduction by re-rendering the information at that moment.

[0069] The voice conversion and broadcasting action matching module is used to display fault information from the system. When a fault occurs, the module recognizes the corresponding text information and simultaneously converts it into audio content for broadcast. This allows personnel to grasp more information from different angles while watching the on-screen content. Furthermore, the "butler's" narration and action demonstrations provide operators with guidance on the criticality of the fault and appropriate repair actions. The module analyzes the fault information text and automatically adjusts the speaking speed and the degree of 3D lip-syncing based on the length of the broadcast content and the severity of the problem. This provides a more user-friendly auxiliary display method, reducing operators' complete reliance on the visuals and relaxing their mindset through interaction.

[0070] With the rapid development of technology, radar systems are becoming increasingly large and complex, and a failure in any subsystem can have a significant impact on radar operation. Emergency measures for system board-level failures are becoming increasingly important. As a crucial component of military defense, radar requires faster and more efficient fault handling capabilities to meet battlefield needs. The method described above, using a 3D graphical display with auxiliary prompts, can provide error information more quickly and intuitively. Through visually accessible equipment displays, operators can be guided to quickly and accurately locate faulty components, effectively shortening repair time, reducing the professional requirements for maintenance personnel, and meeting human factors engineering and safety requirements related to maintenance.

[0071] In the above embodiments, although the steps are numbered S1, S2, etc., they are only specific embodiments given in this application. Those skilled in the art can adjust the execution order of S1, S2, etc. according to the actual situation, which is also within the protection scope of this invention. It can be understood that in some embodiments, some or all of the above embodiments may be included.

[0072] like Figure 4 As shown, a radar fault information three-dimensional visualization system 200 according to an embodiment of the present invention includes an establishment module 210, a marking module 220, a construction module 230 and a combination module 240;

[0073] Module 210 is used to: establish a tree structure of radar fault information according to the hierarchical inclusion relationship of components in each radar cabinet;

[0074] The marking module 220 is used to: mark key points on the three-dimensional structural diagram of the component corresponding to each node in the fault information tree structure, and mark the smallest replaceable unit on the component corresponding to each node in the fault information tree structure, so as to obtain the fault information tree of the radar.

[0075] The construction module 230 is used to: construct a realistic 3D visualization scene of the radar and the roaming action of each key point based on the radar's fault information tree;

[0076] Module 240 is used to combine the simulated 3D visualization scene and the roaming motion of each key point with the radar fault information tree to obtain a 3D visualized radar fault model.

[0077] Optionally, the above technical solution also includes a parsing module and a display module;

[0078] The parsing module is used to: parse the real-time fault information of the radar according to the radar's fault information tree, obtain at least one target node corresponding to the real-time fault information of the radar, and determine the fault information of each target node from the real-time fault information of the radar.

[0079] The display module is used to: perform a perspective roaming in a 3D visualized radar fault model based on the key points of each target node, and display the fault information of each target node.

[0080] Optionally, the above technical solution also includes an acquisition module;

[0081] The acquisition module is used to: retrieve the maintenance method corresponding to each target node from the radar's fault database;

[0082] The display module is also used to display the maintenance methods corresponding to each target node.

[0083] Optionally, the above technical solution also includes a voice broadcast module;

[0084] The voice broadcast module is used to broadcast fault information and maintenance methods for each target node via voice through a virtual announcer with a 3D human body model while the view roams in the 3D visualized radar fault model.

[0085] The parameters and steps for implementing the corresponding functions of each unit module in the radar fault information three-dimensional visualization system 200 of the present invention described above can be referred to the parameters and steps in the embodiments of the radar fault information three-dimensional visualization method described above, and will not be repeated here.

[0086] An embodiment of the present invention provides a storage medium storing instructions, which, when read by a computer, cause the computer to execute a three-dimensional visualization method for radar fault information as described above.

[0087] An electronic device according to an embodiment of the present invention includes a processor and the aforementioned storage medium. The processor executes instructions in the storage medium. The electronic device may be a computer, a mobile phone, or the like.

[0088] Those skilled in the art will know that this invention can be implemented as a system, method, or computer program product.

[0089] Therefore, this disclosure can be implemented in the following forms: it can be entirely hardware, entirely software (including firmware, resident software, microcode, etc.), or a combination of hardware and software, generally referred to herein as a "circuit," "module," or "system." Furthermore, in some embodiments, the invention can also be implemented as a computer program product in one or more computer-readable media, the computer-readable medium containing computer-readable program code.

[0090] Any combination of one or more computer-readable media may be used. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in connection with an instruction execution system, apparatus, or device.

[0091] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. A three-dimensional visualization method for radar fault information, characterized in that, include: Based on the hierarchical inclusion relationship of the components in each radar cabinet, a fault information tree structure is established for the radar. Mark key points on the three-dimensional structural diagram of the component corresponding to each node in the fault information tree structure, and mark the smallest replaceable unit on the component corresponding to each node in the fault information tree structure to obtain the fault information tree of the radar. Based on the fault information tree of the radar, construct a realistic 3D visualization scene of the radar and the roaming action of each key point; The simulated 3D visualization scene and the roaming motion of each key point are combined with the radar's fault information tree to obtain a 3D visualized radar fault model. Also includes: According to the fault information tree of the radar, the real-time fault information of the radar is parsed to obtain at least one target node corresponding to the real-time fault information of the radar, and the fault information of each target node is determined from the real-time fault information of the radar. Based on the key points of each target node, the viewpoint is roamed in the three-dimensional visualized radar fault model, and the fault information of each target node is displayed.

2. The three-dimensional visualization method for radar fault information according to claim 1, characterized in that, Also includes: Obtain the maintenance method corresponding to each target node from the fault database of the radar; The maintenance methods corresponding to each target node are displayed.

3. The three-dimensional visualization method for radar fault information according to claim 2, characterized in that, Also includes: While navigating through the three-dimensional visualized radar fault model, a virtual announcer with a three-dimensional human body model provides voice broadcasts of fault information and repair methods for each target node.

4. A three-dimensional visualization system for radar fault information, characterized in that, This includes creating modules, marking modules, building modules, and combining modules; The establishment module is used to: establish a fault information tree structure for the radar according to the hierarchical inclusion relationship of the components in each radar cabinet; The marking module is used to: mark key points on the three-dimensional structural diagram of the component corresponding to each node in the fault information tree structure, and mark the smallest replaceable unit on the component corresponding to each node in the fault information tree structure, so as to obtain the fault information tree of the radar; The construction module is used to: construct a realistic 3D visualization scene of the radar and the roaming action of each key point based on the fault information tree of the radar; The combining module is used to: combine the simulated three-dimensional visualization scene and the roaming action of each key point with the radar fault information tree to obtain a three-dimensional visualized radar fault model. It also includes a parsing module and a display module; The parsing module is used to: parse the real-time fault information of the radar according to the fault information tree of the radar, obtain at least one target node corresponding to the real-time fault information of the radar, and determine the fault information of each target node from the real-time fault information of the radar. The display module is used to: perform a perspective roaming in the three-dimensional visualized radar fault model based on the key points of each target node, and display the fault information of each target node.

5. A three-dimensional visualization system for radar fault information according to claim 4, characterized in that, It also includes an acquisition module; The acquisition module is used to: acquire the maintenance method corresponding to each target node from the fault database of the radar; The display module is also used to display the maintenance method corresponding to each target node.

6. A three-dimensional visualization system for radar fault information according to claim 5, characterized in that, It also includes a voice broadcast module; The voice broadcast module is used to broadcast the fault information and maintenance methods of each target node via voice through a virtual announcer with a three-dimensional human body model while the view is roaming in the three-dimensional visualized radar fault model.

7. A storage medium, characterized in that, The storage medium stores instructions, and when the computer reads the instructions, the computer executes a three-dimensional visualization method for radar fault information as described in any one of claims 1 to 3.

8. An electronic device, characterized in that, It includes a processor and the storage medium of claim 7, wherein the processor executes instructions in the storage medium.

Images