Intelligent radar seat man-machine interaction system and interaction method based on autonomous control

Abstract

The invention provides an intelligent radar seat man-machine interaction system based on autonomous control, and belongs to the technical field of radar seat control, and the system comprises a voice equipment module which is used for receiving user voice data; the computer input and output equipment module is used for inputting control information; the seat computer module is used for receiving the control information and the user voice data and processing the control information and the voice data; the AR / VR equipment module is used for displaying the information processed by the seat computer module through AR / VR equipment; and the display equipment module is used for displaying the information processed by the seat computer module through a display screen. According to the system, radar display and control of an intelligent man-machine interaction technology function are realized, display and control of radar equipment are realized by utilizing a multi-equipment multi-interaction mode, the interaction modes are rich, the experience of operators is improved, and current environment situation information is displayed more comprehensively.

Description

Technical Field

[0001] The present invention belongs to the technical field of radar seat control, and in particular relates to an intelligent radar seat human-computer interaction system and an interaction method based on autonomous control. Background Art

[0002] Radar plays an important role in perceiving real-time environmental situation information in the environment. How to conveniently and effectively complete the control operation of the radar, quickly and accurately obtain the situation information in the current environment and display it to the command system, and the operator can make a timely response strategy are the key factors in the use of radar equipment. The modern information environment has put forward more complex requirements for radar data processing.

[0003] Therefore, it is necessary to provide a radar seat human-computer interaction system that can solve the above problems to adapt to the development of modern informatization. Summary of the invention

[0004] In order to solve the above problems, the purpose of the present invention is to provide an intelligent radar seat human-computer interaction system based on autonomous control to realize the display of current environmental situation information obtained by the radar, so that the operator can timely and accurately grasp the real-time environmental situation by observing the radar seat human-computer interaction system.

[0005] In order to achieve the above object, the present invention provides the following technical solution, an intelligent radar seat human-computer interaction system based on autonomous control, the system comprising:

[0006] Voice device module, used for receiving user voice data;

[0007] Computer input and output device module, used to input control information;

[0008] The seat computer module is used to receive the control information input by the computer input and output device module and the user voice data received by the voice device module, and process the control information and voice data;

[0009] AR / VR device module, used to display the information processed by the seat computer module through AR / VR device; and

[0010] The display device module is used to display the information processed by the seat computer module through the display screen.

[0011] The seat computer module is provided with an autonomous control submodule for realizing autonomous control. After receiving the information input by the radar device, the autonomous control submodule directly processes the data and transmits the processed information to the display device module for display. The autonomous control submodule is configured with a database trained based on sample data.

[0012] The intelligent radar seat human-computer interaction system based on autonomous control provided by the present invention also has the following characteristics: the voice device module includes a microphone submodule for receiving user voice and a voice conversion processing submodule for converting the voice received by the microphone submodule into voice data.

[0013] The intelligent radar seat human-computer interaction system based on autonomous control provided by the present invention also has the following characteristics: the computer input-output device module includes one or more input submodules selected from a mouse submodule and a handle input submodule.

[0014] The intelligent radar seat human-computer interaction system based on autonomous control provided by the present invention also has the following characteristics: the seat computer module includes a computer host submodule and a GPU graphics card submodule installed in the card slot of the computer host submodule for processing image calculations and intelligent autonomous processing calculations.

[0015] The intelligent radar seat human-computer interaction system based on autonomous control provided by the present invention also has the following characteristics: the AR / VR device module includes an AR / VR processing software sub-module for generating image, sound and video information and an AR / VR device sub-module for displaying the image, sound and video information generated by the AR / VR processing sub-module.

[0016] The intelligent radar seat human-computer interaction system based on autonomous control provided by the present invention also has the feature that the display device module includes multiple split-screen displays.

[0017] Another object of the present invention is to provide a human-computer interaction method for an intelligent radar seat based on autonomous control, the method being implemented based on any of the aforementioned systems, comprising:

[0018] Control data is input through the seat computer module, and after the control data is transcoded and processed, it forms a network data stream and is transmitted to the radar equipment through the network;

[0019] Acquire status information from radar equipment, and after solving and processing, obtain radar equipment status data and transmit it to display device for display;

[0020] Acquire the detected target data from the radar device, and after solving and processing, obtain the target data and transmit it to the display device for display;

[0021] Acquire detection image data from the radar device, obtain target data after solving and processing, and transmit the target data to the display device for display;

[0022] Acquire radar equipment fault status data from the radar equipment, obtain the radar equipment fault status after solving and processing, transmit the data to the display device for display, and issue an alarm in the form of voice;

[0023] Turn on the intelligent autonomous processing mode, obtain the detection data through the radar equipment, analyze it, and obtain the target data and image data. According to the currently obtained target data and image data, adjust the control parameters of the radar equipment, form a network data stream through transcoding processing, and transmit it to the radar equipment to complete the control of the radar.

[0024] The intelligent radar seat human-computer interaction method based on autonomous control provided by the present invention also has the following characteristics: the method also includes situation information processing to realize interaction with the digital map of the background of the radar seat human-computer interaction software display screen.

[0025] Beneficial Effects

[0026] The intelligent radar seat human-computer interaction system based on autonomous control provided by the present invention realizes the radar display and control of intelligent human-computer interaction technology functions, and realizes the display and control of radar equipment by utilizing multiple devices and multiple interaction methods. The rich interaction methods improve the operator experience and more comprehensively display the current environmental situation information. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0028] Figure 1 A schematic diagram of a human-machine interaction interface of an intelligent radar seat human-machine interaction system based on autonomous control provided by an embodiment of the present invention;

[0029] Figure 2 A schematic diagram of the architecture of an intelligent radar seat human-computer interaction system based on autonomous control provided in an embodiment of the present invention;

[0030] Figure 3 The present invention provides a hardware process diagram of an intelligent radar seat human-computer interaction system based on autonomous control according to an embodiment of the present invention. DETAILED DESCRIPTION

[0031] The present invention is further described in detail below in conjunction with the accompanying drawings and examples, but it should be noted that these implementation modes are not limitations of the present invention, and equivalent changes or substitutions in functions, methods, or structures made by ordinary technicians in the field based on these implementation modes are all within the scope of protection of the present invention.

[0032] In the description of the embodiments of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside" and "outside" etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the invention.

[0033] In addition, the terms "first", "second", "third", etc. are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first", "second", etc. may explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, "plurality" means two or more.

[0034] The terms "installed", "connected" and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the invention can be understood according to specific circumstances.

[0035] like Figure 1-Figure 3 As shown, an embodiment of the present invention provides an intelligent radar seat human-computer interaction system based on autonomous control, the system comprising: a voice device module for receiving user voice data; a computer input and output device module for inputting control information; a seat computer module for receiving the control information input by the computer input and output device module and the user voice data received by the voice device module, and processing the control information and voice data;

[0036] The AR / VR device module is used to display the information processed by the seat computer module through the AR / VR device; and the display device module is used to display the information processed by the seat computer module through the display screen.

[0037] The seat computer module is provided with an autonomous control submodule for realizing autonomous control. After receiving the information input by the radar device, the autonomous control submodule directly processes the data and transmits the processed information to the display device module for display. The autonomous control submodule is configured with a database trained based on sample data.

[0038] In some embodiments, the voice device module includes a microphone submodule for receiving user voice and a voice conversion processing submodule for converting the voice received by the microphone submodule into voice data.

[0039] The system provided by the above embodiment enables the control of the radar device in a variety of ways. The radar device can be controlled by mouse and keyboard operations; the handle can also be operated to control the radar; the radar device can be controlled by voice equipment; and the radar can be controlled through AR / VR equipment.

[0040] In some embodiments, the computer input-output device module includes one or more input submodules selected from a mouse submodule and a handle input submodule.

[0041] In some embodiments, the seat computer module includes a computer host submodule and a GPU graphics card submodule installed in a card slot of the computer host submodule for processing image calculations and intelligent autonomous processing calculations.

[0042] In some embodiments, the AR / VR device module includes an AR / VR processing software sub-module for generating image, sound and video information and an AR / VR device sub-module for displaying the image, sound and video information generated by the AR / VR processing sub-module.

[0043] In some embodiments, the display device module includes multiple split-screen displays.

[0044] In some embodiments, a human-computer interaction method for an intelligent radar seat based on autonomous control is provided, and the method is implemented based on any of the above-mentioned systems, including:

[0045] Control data is input through the seat computer module, and after the control data is transcoded and processed, it forms a network data stream and is transmitted to the radar equipment through the network;

[0046] Acquire status information from radar equipment, and after solving and processing, obtain radar equipment status data and transmit it to display device for display;

[0047] Acquire the detected target data from the radar device, and after solving and processing, obtain the target data and transmit it to the display device for display;

[0048] Acquire detection image data from the radar device, obtain target data after solving and processing, and transmit the target data to the display device for display;

[0049] Acquire radar equipment fault status data from the radar equipment, obtain the radar equipment fault status after solving and processing, transmit the data to the display device for display, and issue an alarm in the form of voice;

[0050] Turn on the intelligent autonomous processing mode, obtain the detection data through the radar equipment, analyze it, and obtain the target data and image data. According to the currently obtained target data and image data, adjust the control parameters of the radar equipment, form a network data stream through transcoding processing, and transmit it to the radar equipment to complete the control of the radar.

[0051] In some embodiments, the method further includes situation information processing to enable interaction with a digital map of the background of a display screen of the radar seat human-computer interaction software.

[0052] In the actual use of the autonomously controlled intelligent radar seat human-computer interaction system provided in any of the above embodiments, the operator can use and operate it on the seat computer to control the radar and dynamically display the battlefield situation information obtained by the observation radar equipment. For example, radar status information and target track, SAR image information, and aircraft status parameter display. The radar seat human-computer interaction software architecture is as follows: Figure 2 As shown, the radar seat human-computer interaction software display interface is as follows Figure 3 The radar seat human-computer interaction software can also be turned on in autonomous mode. According to the current combat environment, the radar can be autonomously controlled to complete the radar detection of areas or targets.

[0053] Based on sample data training, the radar can perceive and identify the battlefield environment in which it is located. According to the type of mission, it can autonomously adjust the radar's working mode (air, ground / sea and SAR imaging mode), autonomously adjust and control the beam, autonomously adjust and transform the waveform, autonomously control the power, and autonomously adjust the anti-interference strategy. It can also identify the detected targets, manage the targets according to the threat level, and present the results to the mission handlers.

[0054] The interactive control of the radar seat human-computer interaction software mainly includes two parts of interactive control. One is the control and display of radar equipment, including the radar's working mode command, parameter control, and intelligent autonomous control; comprehensive display of real-time situation information, radar working status display, radar fault status information display, track information, identification information fusion display, etc., and also includes the information display function of other on-board radar cross-linked equipment. The other is the control and display of human-computer interaction equipment, mainly including voice equipment modules, computer keyboard mouse / handle modules, AR / VR equipment modules, etc. The above solution realizes the intelligentization of multiple devices to complete the human-computer interaction technology of radar.

[0055] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principle of the present invention shall be included in the protection scope of the present invention. The above description is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and variations can be made without departing from the technical principles of the present invention. These improvements and variations should also be regarded as the protection scope of the present invention.

Claims

1. An intelligent radar seat human-computer interaction system based on autonomous control, characterized in that: The system comprises: Voice device module, used for receiving user voice data; Computer input and output device module, used to input control information; The seat computer module is used to receive the control information input by the computer input and output device module and the user voice data received by the voice device module, and process the control information and voice data; AR / VR device module, used to display the information processed by the seat computer module through AR / VR device; and The display device module is used to display the information processed by the seat computer module through the display screen. The seat computer module is provided with an autonomous control submodule for realizing autonomous control. After receiving the information input by the radar device, the autonomous control submodule directly processes the data and transmits the processed information to the display device module for display. The autonomous control submodule is configured with a database trained based on sample data.

2. The intelligent radar seat human-computer interaction system based on autonomous control according to claim 1 is characterized in that: The voice device module includes a microphone submodule for receiving user voice and a voice conversion processing submodule for converting the voice received by the microphone submodule into voice data.

3. The intelligent radar seat human-computer interaction system based on autonomous control according to claim 1 is characterized in that: The computer input-output device module includes one or more input submodules selected from a mouse submodule and a handle input submodule.

4. The intelligent radar seat human-computer interaction system based on autonomous control according to claim 1 is characterized in that: The seat computer module includes a computer host submodule and a GPU graphics card submodule installed in a card slot of the computer host submodule for processing image calculations and intelligent autonomous processing calculations.

5. The intelligent radar seat human-computer interaction system based on autonomous control according to claim 1 is characterized in that: The AR / VR device module includes an AR / VR processing software submodule for generating image, sound and video information and an AR / VR device submodule for displaying the image, sound and video information generated by the AR / VR processing submodule.

6. The intelligent radar seat human-computer interaction system based on autonomous control according to claim 1 is characterized in that: The display device module includes a plurality of split-screen displays.

7. A human-computer interaction method for intelligent radar seats based on autonomous control, characterized in that: The method is implemented based on the system according to any one of claims 1 to 6, and includes: Control data is input through the seat computer module, and after the control data is transcoded and processed, it forms a network data stream and is transmitted to the radar equipment through the network; Acquire status information from radar equipment, and after solving and processing, obtain radar equipment status data and transmit it to display device for display; Acquire the detected target data from the radar device, and after solving and processing, obtain the target data and transmit it to the display device for display; Acquire detection image data from the radar device, obtain target data after solving and processing, and transmit the target data to the display device for display; Acquire radar equipment fault status data from the radar equipment, obtain the radar equipment fault status after solving and processing, transmit the data to the display device for display, and issue an alarm in the form of voice; Turn on the intelligent autonomous processing mode, obtain the detection data through the radar equipment, analyze it, and obtain the target data and image data. According to the currently obtained target data and image data, adjust the control parameters of the radar equipment, form a network data stream through transcoding processing, and transmit it to the radar equipment to complete the control of the radar.

8. The human-computer interaction method of intelligent radar seat based on autonomous control according to claim 7 is characterized in that: The method also includes situation information processing to achieve interaction with a digital map of the background of the display screen of the radar seat human-computer interaction software.

Images