Display console control system based on intelligent sensing module and control method thereof

Abstract

The invention relates to the technical field of man-machine interaction, and provides a display and control console control system based on an intelligent sensing module and a control method thereof, which can improve the operation convenience and user satisfaction of a display and control console and promote the application and development of an intelligent sensing technology in multiple fields. According to the system, the operation convenience of the display and control console is improved, through the integrated voice recognition module, a user can directly control the display and control console through voice instructions without manually operating complex keys or interfaces, and the working efficiency is greatly improved especially in the scene that the two hands are occupied or quick response is needed. Meanwhile, the addition of the voiceprint recognition module ensures that only an authorized user can operate, so that the security and confidentiality of the system are enhanced.

Description

Technical Field

[0001] The present invention relates to the technical field of human-computer interaction, and in particular to a display and control console control system based on an intelligent sensor module and a control method thereof. Background Art

[0002] With the continuous development of science and technology, the display and control console is increasingly widely used in various fields, such as industrial control, military command, aerospace, etc. The traditional display and control console control method mainly relies on input devices such as keyboard, mouse, touch screen, etc., which are not convenient to operate and cannot meet the needs of some special scenarios. Therefore, a more intelligent and convenient display and control console control method and system is needed. By integrating advanced intelligent sensing technology, the intelligent, automated and personalized operation of the display and control console can be realized, which requires the ability to accurately capture the user's operating intentions and environmental changes, such as voice commands, voiceprint recognition and ambient light, so as to automatically adjust the various parameters of the display and control console, such as displaying maps, transmitting, etc., to provide the most suitable operating experience. At the same time, the intelligent sensing module must also ensure that only authorized users can operate. However, there is currently no such dual-redundant reinforcement machine and method. Summary of the invention

[0003] In view of this, the present invention provides a display and control console control system based on an intelligent sensor module and a control method thereof, which can improve the operating convenience and user satisfaction of the display and control console, and promote the application and development of intelligent sensing technology in multiple fields.

[0004] To achieve the above purpose, the technical solution of the present invention is as follows:

[0005] The present invention provides a display and control console control system based on an intelligent sensor module, comprising:

[0006] The intelligent sensor module is used to collect and process information about the external environment or operators. The intelligent sensor module further includes the following modules:

[0007] The speech recognition module uses a deep learning algorithm to recognize user voice commands;

[0008] Voiceprint verification module, which is used to capture the user's voice input through a microphone, pre-process, extract features, pattern match and result judgment to achieve user identity verification;

[0009] The voice and voiceprint hybrid module combines voice recognition and voiceprint verification to provide a dual verification mechanism to ensure that only authorized users can perform specific operations;

[0010] Environmental monitoring module, which monitors the environmental parameters around the display and control console in real time and automatically adjusts the display and control console settings or issues an alarm according to environmental conditions;

[0011] Network communication module, supporting data exchange of multiple communication protocols;

[0012] Fault detection and early warning module, real-time monitoring of the operating status of the display console and its components, predicting potential faults and issuing early warnings;

[0013] The log recording and analysis module records the operation log, fault log and environmental parameter changes of the display console, and performs data analysis to provide a basis for system optimization;

[0014] The dual redundant reinforcement machine, as the core processing unit, generates control instructions based on the information provided by the intelligent sensor module to ensure the continuous and stable operation of the display and control console.

[0015] Among them, the speech recognition module only supports the recognition of designated command words and arbitrary continuous words in Mandarin, and performs semantic analysis on complex voice instructions, understands the user's intentions and converts them into corresponding operation instructions.

[0016] The voiceprint verification module uses Mel-frequency cepstral coefficients, fundamental frequency and spectrum envelope features to extract voiceprint features, and uses a Gaussian mixture model for pattern matching to determine whether the input voice matches the stored voiceprint, thereby verifying the user's identity.

[0017] Among them, the environmental monitoring module will trigger an alarm to remind the operator to take measures when the environmental parameters exceed the safety range, and automatically adjust the display brightness and contrast of the display console to adapt to different environmental conditions.

[0018] Wherein, the network communication module supports multiple communication protocols including wired connections.

[0019] The log recording and analysis module stores the acquired information in txt format and determines whether it is within the error range through the before and after data comparison function.

[0020] The present invention also provides a display and control console control method based on an intelligent sensor module, characterized in that it comprises the following steps:

[0021] Install the intelligent sensor module on the display console;

[0022] Connect the intelligent sensor module to the dual-redundant reinforcement machine of the display and control console, and transmit the information collected by the sensor to the dual-redundant reinforcement machine through the sensor driver;

[0023] After receiving the information transmitted by the intelligent sensor module, the dual-redundant reinforcement machine performs preliminary processing and analysis, including voice recognition processing, voiceprint recognition verification, environmental monitoring analysis and equipment status monitoring;

[0024] Execute corresponding control operations based on the processed information.

[0025] It also includes steps of user interaction and feedback, providing users with real-time information display, operation instructions and troubleshooting suggestions through the display console interface, and collecting user feedback to optimize control strategies.

[0026] Among them, the working status of the intelligent sensor module and the dual redundant reinforcement machine are checked regularly, and software updates and hardware maintenance are carried out.

[0027] Beneficial effects:

[0028] 1. The system of the present invention improves the convenience of display and control console operation. Through the integrated voice recognition module, users can directly control the display and control console with voice commands, without manually operating complex buttons or interfaces, which greatly improves work efficiency, especially in scenarios where both hands are occupied or quick response is required. At the same time, the addition of the voiceprint recognition module ensures that only authorized users can perform operations, enhancing the security and confidentiality of the system.

[0029] 2. The system environment monitoring module of the present invention can sense the temperature, humidity, light and other environmental parameters around the display and control console in real time, creating a more comfortable working environment for users and improving the adaptability of the display and control console to the environment.

[0030] 3. The fault detection and early warning module in the system of the present invention can timely discover and report potential safety hazards to avoid the occurrence of safety accidents; the log recording and analysis module can collect and analyze system usage data, and the system has high reliability and stability.

[0031] 4. The integration of the intelligent sensor module and the network communication module of the system of the present invention enables the display and control console to exchange data with other devices, realize remote monitoring and management, and realize intelligent remote management of the display and control console.

[0032] 5. The method of the present invention is implemented based on the system of the present invention, which improves the convenience of the display and control console operation. Through the integrated voice recognition module, the user can directly control the display and control console with voice commands, without manually operating complex buttons or interfaces, which greatly improves work efficiency, especially in scenarios where both hands are occupied or a quick response is required. At the same time, the addition of the voiceprint recognition module ensures that only authorized users can perform operations, enhancing the security and confidentiality of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 It is a schematic diagram of the system composition of the present invention. DETAILED DESCRIPTION

[0034] The present invention is described in detail below with reference to the accompanying drawings and embodiments.

[0035] The present invention provides a control system for a display and control console based on an intelligent sensor module, comprising a display and control console housing, an intelligent sensor module, a dual redundant reinforcement machine, a touch screen, a tracking ball and a keyboard. The display and control console housing is an external protection structure of the display and control console; the intelligent sensor module is used to collect and process information of the external environment or operators; the dual redundant reinforcement machine is used as a core processing unit to generate control instructions according to the information of the sensor module for controlling the display and control console; the touch screen is used as a display device for displaying information; and the tracking ball and keyboard are used as input devices.

[0036] Specifically, the intelligent sensing module includes a voice recognition module, a voiceprint verification module, a voice and voiceprint hybrid module, an environmental monitoring module, a network communication module, a fault detection and warning module, and a log recording and analysis module;

[0037] Among them, the voice recognition module adopts advanced deep learning algorithms, which can quickly and accurately recognize the user's voice commands. The module has adaptive learning capabilities and can be optimized according to the voice characteristics and usage environment of different users to continuously improve the recognition accuracy. At the same time, in order to ensure the clear reception of voice commands, the module also integrates noise suppression and echo cancellation technology to effectively reduce the interference of environmental noise on voice recognition. In the voice recognition module, it is divided into designated command word recognition and arbitrary continuous word recognition. The designated command word recognition is to set the corresponding command word in advance, and it can only be recognized when the corresponding command word is triggered. In terms of voice command processing, the module can perform semantic analysis on complex voice commands, understand the user's intentions, and convert them into corresponding operation instructions and send them to the core processing unit of the display and control console. In addition, the voice recognition module only supports Mandarin.

[0038] Voiceprint verification module: It integrates the core functions of voiceprint collection, preprocessing, feature extraction, pattern matching and result determination. In the voiceprint collection stage, the module uses a high-precision microphone to capture the user's voice input and ensure the stability and clarity of the signal during the collection process. Subsequently, the preprocessing module will filter and reduce the noise of the original voice signal to eliminate background noise and unnecessary interference. Among them, feature extraction is the core link of voiceprint verification. This module uses advanced signal processing algorithms to extract unique voiceprint features from the preprocessed voice signal, such as Mel frequency cepstral coefficients, fundamental frequency and spectrum envelope. These features can accurately reflect the uniqueness of the user's voice and provide strong support for the subsequent matching process. The voiceprint verification module improves the accuracy and security of identity authentication, ensuring that only authorized users can operate the display console.

[0039] Speech and voiceprint hybrid module: When the user issues a voice command, voice recognition is first performed to determine the content of the command; then voiceprint recognition is performed to verify the user's identity. Only when both the voice command and the user's identity are verified, the corresponding operation will be performed. The design of this hybrid module not only improves the security and reliability of the system, but also provides users with a more convenient and natural interactive experience. Users no longer need to enter cumbersome passwords, they can complete the operation through voice commands, while ensuring the security of the operation. This module integrates the dual functions of speech recognition and voiceprint recognition, aiming to provide a more comprehensive and secure interactive experience. It can not only recognize the user's voice command, respond quickly and perform the corresponding operation, but also verify the user's identity through voiceprint analysis, ensuring that only registered and authorized users can control the display console by voice. This dual verification mechanism greatly improves the security and reliability of the system and prevents unauthorized access and operation. Among them, the pattern matching process of the voiceprint is: compare the extracted voiceprint features with the stored voiceprint database. The optimized matching algorithm Gaussian mixture model is used to ensure the accuracy and efficiency of the matching. By calculating the similarity between the features, the module can determine whether the input voice matches the stored voiceprint. The conclusion of identity authentication is output based on the matching results. If the similarity exceeds the preset threshold, it is judged as verification passed; otherwise, it is judged as verification failed.

[0040] The environmental monitoring module is used to monitor the environmental parameters around the display and control console in real time, including temperature, humidity, light intensity, etc. The environmental monitoring module transmits the collected data to the dual redundant reinforcement machine, which can automatically adjust the display brightness, contrast and other parameters of the display and control console according to the environmental parameters to adapt to different environmental conditions and ensure that the operator can clearly see the information on the screen. At the same time, when the environmental parameters exceed the safe range, such as excessive temperature or excessive humidity, the module will sound an alarm to remind the operator to take appropriate measures to protect the normal operation of the display and control console equipment.

[0041] The network communication module is responsible for data exchange between the display and control console and other systems or devices. This module supports multiple communication protocols, mainly supporting wired connections, so that the display and control console can access a wider network environment and realize monitoring, data sharing and other functions.

[0042] The fault detection and early warning module monitors the operating status of the display and control console and its components in real time, analyzes data through intelligent algorithms, predicts potential faults and issues early warnings. This module can effectively improve the reliability and stability of the display and control console and reduce losses caused by sudden faults.

[0043] The log recording and analysis module records the daily information of the display and control console, such as the operation log of the display and control console, the fault log obtained from the fault detection module, and the temperature, humidity, and light environment parameter changes obtained from the environmental monitoring module. The acquired information is stored in the dual redundant reinforcement machine of the display and control console in txt format. The next step of data analysis will extract data from the dual redundant reinforcement machine and compare it with the pre-set threshold. The threshold is set within a certain range to avoid the arbitrariness brought by a single threshold, and the before and after comparison function of the same data is adopted to record the difference and determine whether it is within the error range. This module can help users understand the use of the display and control console, discover potential problems, and provide a basis for subsequent system optimization and improvement.

[0044] In this embodiment, the intelligent sensing module includes multiple sensors such as microphones, environmental noise, temperature, humidity, light, current, voltage and audio feature extraction sensors (usually integrated in voiceprint recognition algorithms) for collecting various information of the display and control console.

[0045] The present invention provides a control method for a display and control console based on an intelligent sensor module, which is implemented based on the control system of the present invention and includes the following steps:

[0046] Step 1: Install the smart sensor module on the display console;

[0047] Step 2: Connect the intelligent sensor module to the dual-redundant reinforcement machine of the display and control console, and transmit the information collected by the sensor to the dual-redundant reinforcement machine through the sensor driver.

[0048] Step 3: After receiving the information transmitted by the intelligent sensor module, the dual redundant reinforcement machine performs preliminary processing and analysis, including:

[0049] · Speech recognition processing: Utilize the integrated speech recognition module to convert the speech signal collected by the microphone into text information for subsequent command recognition or interactive feedback.

[0050] · Voiceprint recognition verification: Through audio feature extraction sensors and voiceprint recognition algorithms, the user identity is analyzed and verified to ensure that only authorized users can perform specific operations or access sensitive information.

[0051] · Environmental monitoring and analysis: Analyze sensor data such as environmental noise, temperature, humidity, and light to evaluate whether the working environment of the display and control console is suitable. If there is any abnormality, trigger corresponding environmental adjustment measures or early warnings.

[0052] · Equipment status monitoring: Current and voltage sensors monitor the operating status of the display console and its ancillary equipment to detect potential power failures or overloads in a timely manner.

[0053] Step 4: Perform corresponding control operations according to the processed information. If it is a legitimate voice command and the user's identity is verified by voiceprint, the dual redundant reinforcement machine sends the command to the actuator of the display console to complete the corresponding operation, such as switching the display interface, adjusting parameters, etc. If the environmental parameters are out of range, the dual redundant reinforcement machine automatically adjusts the brightness, volume, contrast and other parameters of the display console to adapt to user preferences or environmental changes, or starts cooling equipment, dehumidification equipment, etc. to maintain a good working environment. If an abnormal situation is identified by the fault detection module, the dual redundant reinforcement machine immediately starts the early warning mechanism, sends an alarm message to relevant personnel, starts the backup system or executes the fault recovery program according to the preset strategy to ensure the continuous and stable operation of the display console. Finally, the log recording and analysis module is automatically called to record relevant information. Among them, the log recording module records all sensor data, user operations, system responses and fault events for subsequent data analysis and performance optimization. At the same time, the analysis module is used to deeply mine the data, identify potential problem trends, and optimize the system configuration.

[0054] Step 5: User interaction and feedback. The dual-redundant reinforcement machine provides users with real-time information display, operation instructions and troubleshooting suggestions through the display console interface. At the same time, it collects user feedback on the display console adjustment, continuously optimizes the control strategy through intelligent algorithms, and improves user experience and system performance.

[0055] Furthermore, the working status of the intelligent sensor module and the dual redundant reinforcement machine can be checked regularly, and necessary software updates and hardware maintenance can be performed to ensure that the system is always in the best operating state. At the same time, according to technological development and changes in user needs, the system functions can be upgraded iteratively, and new sensor technologies and control strategies can be introduced to achieve continuous maintenance and upgrades.

[0056] In summary, the above are only preferred embodiments of the present invention and are not intended to limit the protection scope of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A display and control console control system based on an intelligent sensor module, characterized in that: include: The intelligent sensor module is used to collect and process information about the external environment or operators. The intelligent sensor module further Includes the following modules: The speech recognition module uses a deep learning algorithm to recognize user voice commands; Voiceprint verification module, which is used to capture the user's voice input through a microphone, pre-process, extract features, pattern match and result judgment to achieve user identity verification; The voice and voiceprint hybrid module combines voice recognition and voiceprint verification to provide a dual verification mechanism to ensure that only authorized users can perform specific operations; Environmental monitoring module, which monitors the environmental parameters around the display and control console in real time and automatically adjusts the display and control console settings or issues an alarm according to environmental conditions; Network communication module, supporting data exchange of multiple communication protocols; Fault detection and early warning module, real-time monitoring of the operating status of the display console and its components, predicting potential faults and issuing early warnings; The log recording and analysis module records the operation log, fault log and environmental parameter changes of the display console, and performs data analysis to provide a basis for system optimization; The dual redundant reinforcement machine, as the core processing unit, generates control instructions based on the information provided by the intelligent sensor module to ensure the continuous and stable operation of the display and control console.

2. The control system according to claim 1, characterized in that: The speech recognition module only supports the recognition of designated command words and any continuous words in Mandarin, and performs semantic analysis on complex voice instructions to understand the user's intentions and convert them into corresponding operation instructions.

3. The control system according to claim 1 or 2, characterized in that: The voiceprint verification module uses Mel-frequency cepstral coefficients, fundamental frequency and spectrum envelope features to extract voiceprint features, and uses a Gaussian mixture model for pattern matching to determine whether the input voice matches the stored voiceprint, thereby verifying the user's identity.

4. The control system according to claim 1 or 2, characterized in that: The environmental monitoring module will trigger an alarm to remind the operator to take measures when the environmental parameters exceed the safe range, and automatically adjust the display brightness and contrast of the display console to adapt to different environmental conditions.

5. The control system according to claim 4, characterized in that: The network communication module supports multiple communication protocols including wired connections.

6. The control system according to claim 4, characterized in that: The log recording and analysis module stores the acquired information in txt format and determines whether it is within the error range through the before and after data comparison function.

7. A display console control method based on an intelligent sensor module, characterized in that: The steps include: Install the intelligent sensor module on the display console; Connect the intelligent sensor module to the dual-redundant reinforcement machine of the display and control console, and transmit the information collected by the sensor to the dual-redundant reinforcement machine through the sensor driver; After receiving the information transmitted by the intelligent sensor module, the dual-redundant reinforcement machine performs preliminary processing and analysis, including voice recognition processing, voiceprint recognition verification, environmental monitoring analysis and equipment status monitoring; Execute corresponding control operations based on the processed information.

8. The control method according to claim 7, characterized in that: It also includes user interaction and feedback steps, providing users with real-time information display, operation instructions and troubleshooting suggestions through the display console interface, and collecting user feedback to optimize control strategies.

9. The control method according to claim 7 or 8, characterized in that: Regularly check the working status of the intelligent sensor module and dual redundant reinforcement machine, and perform software updates and hardware maintenance.

Images