A smart helmet control method based on IMU
By analyzing the external environment and operating status of the inertial measurement unit, combining network environment information, a synchronous potential risk analysis model is established, and the real-time and stability of the intelligent helmet control system is solved, which improves the gaming experience and supplier trust.
Patent Information
- Application Number
- CN202410538063.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-04-30
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2044-04-30
AI Technical Summary
The existing IMU-based smart helmet control system lacks real-time and stability when facing abnormal operation of inertial measurement units and data synchronization delays, resulting in unsatisfactory or untimely changes in the perspective of the aircraft in the game, affecting player experience and suppliers. Trust.
By obtaining the external environment information and operating status information of the inertial measurement unit, the external vibration fluctuation coefficient and the ternary data deviation coefficient are calculated, and the regional network environment information is obtained, the data synchronization delay coefficient is calculated, a synchronization potential hazard analysis model is established, and the synchronization potential hazard analysis index is generated. , conduct classification and early warning to ensure the real-time and stability of the system.
It improves the system's ability to adapt to environmental changes, accurately evaluate data synchronization delays, timely discover and solve synchronization problems, and improves player experience and supplier trust.
Smart Images

Figure CN118605724B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of intelligent helmet control, and more specifically, to an intelligent helmet control method based on IMU. Background Art
[0002] The IMU-based smart helmet control system is a system that uses inertial measurement unit (IMU) technology to achieve head posture perception and control. IMU usually includes accelerometers and gyroscopes, and determines the movement state and direction of the user's head by measuring the acceleration, angular velocity and other head posture data information of the user's head.
[0003] In flight simulation games, the IMU-based smart helmet control system obtains the head posture information of the player wearing the smart helmet and synchronizes it to the game system. The game system can dynamically adjust the viewing angle and direction of the aircraft based on the obtained player's head posture information to synchronize it with the player's head movement. When the user turns his head, the viewing angle in the game will change accordingly. However, due to the differences in the environments of different players, for example, fluctuations in external vibrations may cause operational risks in the inertial measurement unit, and fluctuations in the regional network environment may cause delays in the synchronization of head posture information and the game system. The existing IMU-based smart helmet control system cannot achieve timely intelligent perception of operational abnormalities and synchronization delays in the inertial measurement unit, and lacks universal early warning judgment standards, resulting in reduced real-time and stability of the collaboration between the smart helmet control system and the game system, resulting in the game system being unable to receive accurate head posture information in a timely manner, resulting in unsatisfactory or untimely changes in the aircraft viewing angle in the game, which reduces the player's user experience and affects the game supplier's trust in the smart helmet control system.
[0004] In order to solve the above defects, a technical solution is now provided. Summary of the invention
[0005] In order to overcome the above-mentioned defects of the prior art, an embodiment of the present invention provides a smart helmet control method based on IMU to solve the problems raised in the above-mentioned background technology.
[0006] To achieve the above object, the present invention provides the following technical solutions:
[0007] A smart helmet control method based on IMU includes the following steps:
[0008] Step S1, obtaining external environment information and operating state information of the inertial measurement unit during operation, and calculating the external vibration fluctuation coefficient according to the external environment information, and calculating the ternary data deviation coefficient according to the operating state information of the inertial measurement unit during operation;
[0009] Step S2, obtaining regional network environment information when the IMU-based smart helmet control system and the game system perform data synchronization, and calculating the data synchronization delay coefficient according to the regional network environment information;
[0010] Step S3, establishing a synchronization hidden danger analysis model according to the external vibration fluctuation coefficient, the ternary data deviation coefficient, and the data synchronization delay coefficient, comprehensively analyzing whether there is a synchronization abnormality hidden danger in the collaboration between the IMU-based smart helmet control system and the game system, and generating a synchronization hidden danger analysis index;
[0011] Step S4, comparing the synchronization hidden danger analysis index with a preset synchronization hidden danger analysis index threshold, and classifying whether there is a synchronization abnormality hidden danger in the collaboration between the IMU-based smart helmet control system and the game system;
[0012] Step S5, according to the classification results of the synchronization abnormality hidden dangers, the real-time performance and stability of the smart helmet control system based on IMU are warned.
[0013] In a preferred embodiment, in step S1, the external environment information of the inertial measurement unit during operation is obtained, the external vibration fluctuation degree is analyzed, and the external vibration fluctuation coefficient is obtained to measure the external vibration degree of the inertial measurement unit. The acquisition logic of the external vibration fluctuation coefficient is as follows:
[0014] The time domain vibration signal of the inertial measurement unit within the T time period is obtained through the vibration sensor, and the collected time domain vibration signal is preprocessed, and the preprocessed time domain vibration signal is converted into a frequency domain vibration signal, which can be calculated by the following formula In the formula, X(f) represents the amplitude of the vibration signal at frequency f, x(t) represents the vibration data at time t, T1 represents the starting time of the T time period, T2 represents the ending time of the T time period, and e -j2πft represents a complex exponential function, where e represents the base of a natural number, j represents an imaginary unit, π represents pi, f represents frequency, and t represents time; the power spectral density of the vibration signal at frequency f is calculated to represent the energy distribution of the vibration signal in the frequency domain. The expression is as follows: S(f) = |X(f)| 2 , where S(f) represents the power spectrum density of the vibration signal at frequency f; the expression for calculating the external vibration fluctuation coefficient is as follows Where wzj represents the external vibration fluctuation coefficient, [f min , f max ] indicates the preset frequency range;
[0015] Obtain the operating status information of the inertial measurement unit during operation, analyze the data response consistency of the measuring element, and obtain the ternary data deviation coefficient to measure the operating status of the inertial measurement unit. The acquisition logic of the ternary data deviation coefficient is as follows:
[0016] Obtain the historical data of the three measuring components, and calculate the correlation coefficient j lx between the accelerometer and gyroscope data, the correlation coefficient jcx between the accelerometer and magnetometer data, and the correlation coefficient tcx between the gyroscope and magnetometer data according to the historical data of the measuring components. The calculation expression of the correlation coefficient j lx is as follows K i and Y i They represent the values of the two measuring elements in the i-th group of historical data, i=1, 2, 3, 4, ..., n, and n is a positive integer; the calculation method of the correlation coefficient jcx and the correlation coefficient tcx is consistent with the calculation method of the correlation coefficient j lx;
[0017] The actual operation data of different measuring elements are obtained within the T time period of the actual operation of the measuring element, and the standard deviation jsb of the actual operation data of the accelerometer, the standard deviation tlb of the actual operation data of the gyroscope, and the standard deviation clb of the actual operation data of the magnetometer are calculated respectively. The expression of the standard deviation jsb of the actual operation data of the accelerometer is as follows: Where jsb represents the standard value of the actual operating data of the accelerometer.
[0018] Standard deviation, js u represents the actual operating data value at the uth moment, u=1, 2, 3, 4, ..., v, where v is a positive integer, It represents the mean value of the actual operation data of the accelerometer within the T time period. The calculation method of the standard deviation tlb of the actual operation data of the gyroscope and the standard deviation clb of the actual operation data of the magnetometer is the same as the calculation method of the standard deviation jsb of the actual operation data of the accelerometer; and the calculation expression of the ternary data deviation coefficient is calculated according to the standard deviation of the actual operation data of different measuring elements and the correlation coefficient between different measuring elements as follows
[0019] In a preferred embodiment, in step S2, the regional network environment information when the IMU-based smart helmet control system and the game system perform data synchronization is obtained, the delay risk of data synchronization is analyzed, and the data synchronization delay coefficient is obtained to measure the delay of data synchronization between the IMU-based smart helmet control system and the game system. The logic for obtaining the data synchronization delay coefficient is as follows:
[0020] The response time of each data synchronization between the IMU-based smart helmet control system and the game system is obtained within the T time period, and a response time data sequence is established, which is marked as D = {d1, d2, ..., d q};
[0021] Construct the response duration data matrix M and mark it as
[0022] Perform singular value decomposition on the response time data matrix M to obtain three matrices U, ∑ and V T , that is, M=U∑V T , where U is a left singular vector matrix whose column vectors are left singular vectors, ∑ is a singular value matrix whose diagonal elements are singular values, and V T is the transpose of the right singular vector matrix V;
[0023] Sort the singular values in the singular value matrix ∑ from large to small, and select the first k singular values whose singular values are greater than the singular value threshold and their corresponding left singular vectors and right singular vectors;
[0024] The response duration data matrix M is reconstructed according to the selected first k singular values and their corresponding left singular vectors and right singular vectors to obtain the reconstructed matrix of the response duration data matrix M, which is marked as Calculate the data synchronization delay coefficient Where sty represents the data synchronization delay coefficient, d p Represents the elements in the response duration data matrix M, d ′ p Represents the response time data reconstruction matrix M ′ Elements within.
[0025] In a preferred embodiment, the external vibration fluctuation coefficient, the ternary data deviation coefficient, and the data synchronization delay coefficient are normalized, and a synchronization hidden danger analysis model is constructed based on the normalized external vibration fluctuation coefficient, the ternary data deviation coefficient, and the data synchronization delay coefficient to generate a synchronization hidden danger analysis index tbo. The formula of the model is as follows: Wherein a1, a2, and a3 represent preset proportional coefficients of the external vibration fluctuation coefficient, the ternary data deviation coefficient, and the data synchronization delay coefficient, respectively, and a1, a2, and a3 are all greater than 0.
[0026] In a preferred embodiment, the synchronization hidden danger analysis index is compared with a preset synchronization hidden danger analysis index threshold, and whether there is a synchronization abnormality hidden danger in the collaboration between the IMU-based smart helmet control system and the game system is classified as follows:
[0027] If the synchronous hidden danger analysis index is greater than the preset synchronous hidden danger analysis index threshold, a synchronous risk signal is generated;
[0028] If the synchronization hidden danger analysis index is less than or equal to the preset synchronization hidden danger analysis index threshold, a synchronization normal signal is generated.
[0029] In a preferred embodiment, when a synchronous risk signal is generated, the synchronous hidden danger analysis index generated in the subsequent multiple T time periods is obtained, a data analysis set is established, and the data analysis set is marked as wt = {tbo α}, where α={1,2,3…β}, β is a positive integer;
[0030] Calculate the outliers of the synchronous hidden danger analysis index numbered β in the data analysis set. The expression is as follows Where afg represents the outlier of the synchronous hidden danger analysis index numbered β, qf is the average value of the synchronous hidden danger analysis index in the data analysis set, and jy is the standard deviation of the synchronous hidden danger analysis index in the data analysis set.
[0031] In a preferred embodiment, the outliers of the synchronous hidden danger analysis index are compared with the preset warning threshold, and the real-time performance and stability of the IMU-based smart helmet control system are warned, and the classification is as follows:
[0032] If the outlier of the synchronous hidden danger analysis index is greater than the preset warning threshold, a warning signal is generated;
[0033] If the outlier of the synchronous hidden danger analysis index is less than or equal to the preset warning threshold, there is no need to generate a warning signal.
[0034] Technical effects and advantages of the present invention:
[0035] 1. The present invention obtains external environment information and operating status information when an inertial measurement unit is running, and calculates an external vibration fluctuation coefficient and a ternary data deviation coefficient according to the external environment information and the operating status information, thereby improving the adaptability of the system to environmental changes, and obtains regional network environment information when an intelligent helmet control system based on an IMU performs data synchronization with a game system, and calculates a data synchronization delay coefficient according to the regional network environment information, thereby helping to accurately evaluate the delay of data synchronization, improve the efficiency and accuracy of data synchronization, establish a synchronization hidden danger analysis model, comprehensively consider the external vibration fluctuation coefficient, the ternary data deviation coefficient and the data synchronization delay coefficient, comprehensively analyze the synchronization abnormality hidden dangers of the collaboration between the intelligent helmet control system based on the IMU and the game system, ensure the comprehensiveness and accuracy of the analysis, compare the synchronization hidden danger analysis index with a preset synchronization hidden danger analysis index threshold, classify the synchronization abnormality hidden dangers, and warn the real-time and stability of the intelligent helmet control system based on the IMU, timely discover and solve synchronization problems, improve the real-time and stability of the system, enhance the game experience of players, and enhance the trust of game suppliers in the intelligent helmet control system. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] In order to facilitate understanding by those skilled in the art, the present invention is further described below in conjunction with the accompanying drawings;
[0037] Figure 1 Schematic diagram of the structure of the method of the embodiment of the present invention. DETAILED DESCRIPTION
[0038] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0039] Example
[0040] Figure 1 The present invention provides an IMU-based smart helmet control method, comprising the following steps:
[0041] Step S1, obtaining external environment information and operating state information of the inertial measurement unit during operation, and calculating the external vibration fluctuation coefficient according to the external environment information, and calculating the ternary data deviation coefficient according to the operating state information of the inertial measurement unit during operation;
[0042] In an IMU-based smart helmet control system, the inertial measurement unit (IMU) is usually composed of accelerometers, gyroscopes, and magnetometers. These sensors can measure the acceleration, angular velocity, and orientation of the helmet to determine the posture and movement of the player's head. The accelerometer is used to measure linear acceleration, the gyroscope is used to measure angular velocity, and the magnetometer is used to determine the orientation of the helmet relative to the earth's magnetic field.
[0043] The data collected by IMU through these sensors can provide accurate information about the head posture. This data can be synchronized with the game system by the smart helmet control system to adjust the perspective and direction of the aircraft in the game to synchronize it with the player's head movement.
[0044] The inertial measurement unit is easily affected by external vibrations, which may cause errors in the measured data, resulting in the potential for synchronization anomalies in the collaboration between the smart helmet control system based on the IMU and the game system. When the external vibration of the inertial measurement unit fluctuates abnormally, it may cause the following effects on the data synchronization between the smart helmet control system based on the IMU and the game system:
[0045] Deviation of posture data: External vibration may cause errors in the inertial measurement unit, resulting in deviations in the measured head posture data. This will cause inaccurate head posture information received by the game system, thus affecting the viewing angle and direction adjustment of the aircraft in the game;
[0046] Synchronization delay: External vibrations may cause delays in the collection and transmission of inertial measurement unit data, making it impossible for the game system to obtain the latest head posture information in a timely manner. This will cause a delay between the change in the perspective of the aircraft in the game and the movement of the player's head, reducing the real-time and responsiveness of the game;
[0047] Data loss: Strong external vibrations may cause data loss or erroneous measurements in the inertial measurement unit, which will make the head posture information received by the game system incomplete or inaccurate, thus affecting the control of the aircraft and user experience in the game;
[0048] Therefore, by obtaining the external environment information when the inertial measurement unit is running, analyzing the external vibration fluctuation degree, and obtaining the external vibration fluctuation coefficient, the external vibration degree of the inertial measurement unit is measured. The logic of obtaining the external vibration fluctuation coefficient is as follows:
[0049] The time domain vibration signal of the inertial measurement unit within the T time period is obtained through the vibration sensor, and the collected time domain vibration signal is preprocessed, and the preprocessed time domain vibration signal is converted into a frequency domain vibration signal, which can be calculated by the following formula In the formula, X(f) represents the amplitude of the vibration signal at frequency f, x(t) represents the vibration data at time t, T1 represents the starting time of the T time period, T2 represents the ending time of the T time period, and e -j2πft represents a complex exponential function, where e represents the base of a natural number, j represents an imaginary unit, π represents pi, f represents frequency, and t represents time; the power spectral density of the vibration signal at frequency f is calculated to represent the energy distribution of the vibration signal in the frequency domain. The expression is as follows: S(f) = |X(f)| 2 , where S(f) represents the power spectrum density of the vibration signal at frequency f; the expression for calculating the external vibration fluctuation coefficient is as follows Where wzj represents the external vibration fluctuation coefficient, [f min , f max ] indicates the preset frequency range;
[0050] It should be noted that, since the inertial measurement unit is embedded in the smart helmet, the vibration sensor can be installed on the smart helmet, and the time domain vibration signal of the smart helmet is measured to represent the time domain vibration signal of the inertial measurement unit;
[0051] It can be seen from the above calculation formula that the greater the external vibration fluctuation coefficient, the greater the degree of external vibration to which the inertial measurement unit is subjected, which reflects that the operating hidden danger of the inertial measurement unit is greater, and the greater the impact on the collaborative synchronization between the IMU-based smart helmet control system and the game system;
[0052] Accelerometers, gyroscopes, and magnetometers are commonly used measurement components in inertial measurement units (IMUs) to measure acceleration, angular velocity, and magnetic field strength of objects. When used to measure the head posture data of a player user, these measurement components are usually used simultaneously to provide a more accurate posture estimate.
[0053] Under normal circumstances, the accelerometer, gyroscope, and magnetometer will respond to changes in head posture at the same time and provide consistent data. However, when one or more of the data changes while the others remain unchanged, it reflects that there may be an abnormality in the operation of a certain measurement element, resulting in inconsistent data response, which may lead to the risk of synchronization anomalies in the collaboration between the IMU-based smart helmet control system and the game system.
[0054] When there is an abnormality in the consistency of data response, the following impacts may be caused on the data synchronization between the IMU-based smart helmet control system and the game system:
[0055] Unstable head posture estimation: Due to data inconsistency, the smart helmet control system may not be able to accurately estimate the player's head posture, resulting in instability in posture estimation. This may cause the game system to be unable to accurately track the movement of the player's head, thus affecting the gaming experience;
[0056] Perspective deviation or jitter: If the head posture data is inconsistent, the perspective of the aircraft in the game may be offset or jittered. This may make the player feel uncomfortable and even affect the playability of the game;
[0057] Delayed response: If there is an anomaly in data synchronization, the game system may delay responding to changes in the player's head posture. This will cause the game system to be unable to track the player's head movement in real time, thus affecting the immersion and interactivity of the game;
[0058] Therefore, by obtaining the operating status information of the inertial measurement unit during operation, analyzing the data response consistency of the measuring element, and obtaining the ternary data deviation coefficient, the operating status of the inertial measurement unit is measured. The logic for obtaining the ternary data deviation coefficient is as follows:
[0059] Obtain the historical data of the three measuring components, and calculate the correlation coefficient jlx between the accelerometer and gyroscope data, the correlation coefficient jcx between the accelerometer and magnetometer data, and the correlation coefficient tcx between the gyroscope and magnetometer data based on the historical data of the measuring components. The calculation expression of the correlation coefficient jlx is as follows K i and Y i They represent the values of the two measuring elements in the i-th group of historical data, i=1, 2, 3, 4, ..., n, and n is a positive integer; the calculation method of the correlation coefficient jcx and the correlation coefficient tcx is consistent with the calculation method of the correlation coefficient jlx;
[0060] It should be noted that the historical data of the measuring elements are selected from the data of the three measuring elements running stably, and the historical data are screened by technicians in this field according to the actual situation;
[0061] The actual operation data of different measuring elements are obtained within the T time period of the actual operation of the measuring element, and the standard deviation jsb of the actual operation data of the accelerometer, the standard deviation tlb of the actual operation data of the gyroscope, and the standard deviation clb of the actual operation data of the magnetometer are calculated respectively. The expression of the standard deviation jsb of the actual operation data of the accelerometer is as follows: Where jsb represents the standard deviation of the actual operating data of the accelerometer, js u represents the actual operating data value at the uth moment, u=1, 2, 3, 4, ..., v, where v is a positive integer, It represents the mean value of the actual operation data of the accelerometer within the T time period. The calculation method of the standard deviation tlb of the actual operation data of the gyroscope and the standard deviation clb of the actual operation data of the magnetometer is the same as the calculation method of the standard deviation jsb of the actual operation data of the accelerometer; and the calculation expression of the ternary data deviation coefficient is calculated according to the standard deviation of the actual operation data of different measuring elements and the correlation coefficient between different measuring elements as follows
[0062] It can be seen from the above calculation formula that the larger the ternary data deviation coefficient is, the worse the operating state of the inertial measurement unit is, reflecting that the operating hidden danger of the inertial measurement unit is greater, and the greater the impact on the collaborative synchronization between the IMU-based smart helmet control system and the game system;
[0063] Step S2, obtaining regional network environment information when the IMU-based smart helmet control system and the game system perform data synchronization, and calculating the data synchronization delay coefficient according to the regional network environment information;
[0064] Since different players use smart helmets in different areas with different network environments, if the network environment in the area where the player is located fluctuates abnormally, there may be a delay in the data synchronization between the smart helmet control system based on the IMU and the game system;
[0065] When the network environment in the area where the player is located fluctuates abnormally, it may cause the following impacts on the data synchronization between the IMU-based smart helmet control system and the game system:
[0066] Increased data synchronization delay: Abnormal fluctuations in the network environment may cause increased data synchronization delays, which will cause the synchronization between head posture changes and game screens to decrease, affecting players' immersion and gaming experience;
[0067] Data loss or error: Network fluctuations may cause data loss or error, resulting in head posture data being lost or damaged during synchronization, or incomplete or inaccurate data received by the game system. This will cause the game system to be unable to accurately capture the player's head movement, causing the game screen to be misaligned or jittery with the player's actual operation;
[0068] Unstable synchronization: Abnormal fluctuations in the network environment may lead to instability in data synchronization, which is manifested as uncertainty or unevenness in the data synchronization speed. This will make the game system unable to respond to the player's head posture changes in time, causing the game screen to freeze or delay, reducing the fluency and realism of the game;
[0069] Degraded user experience: The combination of the above factors will lead to a decline in the overall gaming experience of players, which may make them feel uncomfortable or dissatisfied, and affect their trust in the smart helmet control system and gaming system, which may affect user loyalty and brand image;
[0070] Therefore, by obtaining the regional network environment information when the IMU-based smart helmet control system and the game system are performing data synchronization, the potential delays in data synchronization are analyzed, and the data synchronization delay coefficient is obtained to measure the data synchronization delay between the IMU-based smart helmet control system and the game system. The logic for obtaining the data synchronization delay coefficient is as follows:
[0071] The response time of each data synchronization between the IMU-based smart helmet control system and the game system is obtained within the T time period, and a response time data sequence is established, which is marked as D = {d1, d2, ..., d q};
[0072] Construct the response duration data matrix M and mark it as
[0073] Perform singular value decomposition on the response time data matrix M to obtain three matrices U, ∑ and V T , that is, M=U∑V T , where U is a left singular vector matrix whose column vectors are left singular vectors, ∑ is a singular value matrix whose diagonal elements are singular values, and V T is the transpose of the right singular vector matrix V;
[0074] It should be noted that decomposing the response time data matrix into three matrices can be achieved through linear algebra calculations, which is an existing mature technology and will not be described in detail here;
[0075] Sort the singular values in the singular value matrix ∑ from large to small, and select the first k singular values whose singular values are greater than the singular value threshold and their corresponding left singular vectors and right singular vectors;
[0076] The response duration data matrix M is reconstructed according to the selected first k singular values and their corresponding left singular vectors and right singular vectors to obtain the reconstructed matrix of the response duration data matrix M, which is marked as Calculate the data synchronization delay coefficient Where sty represents the data synchronization delay coefficient, d p Represents the elements in the response duration data matrix M, d ′ p Represents the response time data reconstruction matrix M ′ Elements within;
[0077] It can be seen from the above calculation formula that the larger the data synchronization delay coefficient is, the higher the probability of delay hidden dangers when the IMU-based smart helmet control system and the game system perform data synchronization, and the greater the impact on the collaborative synchronization between the IMU-based smart helmet control system and the game system;
[0078] Step S3, establishing a synchronization hidden danger analysis model according to the external vibration fluctuation coefficient, the ternary data deviation coefficient, and the data synchronization delay coefficient, comprehensively analyzing whether there is a synchronization abnormality hidden danger in the collaboration between the IMU-based smart helmet control system and the game system, and generating a synchronization hidden danger analysis index;
[0079] The external vibration fluctuation coefficient, the ternary data deviation coefficient, and the data synchronization delay coefficient are normalized, and a synchronization hidden danger analysis model is constructed based on the normalized external vibration fluctuation coefficient, the ternary data deviation coefficient, and the data synchronization delay coefficient to generate the synchronization hidden danger analysis index tbo. The formula based on the model is as follows: Wherein a1, a2, and a3 represent the preset proportional coefficients of the external vibration fluctuation coefficient, the ternary data deviation coefficient, and the data synchronization delay coefficient, respectively, and a1, a2, and a3 are all greater than 0;
[0080] It can be seen from the above calculation expression that the larger the external vibration fluctuation coefficient, the larger the ternary data deviation coefficient, and the larger the data synchronization delay coefficient, the larger the synchronization hidden danger analysis index, indicating that the operation hidden danger of the inertial measurement unit and the delay hidden danger of data synchronization are greater, and the greater the impact on the collaborative synchronization between the IMU-based intelligent helmet control system and the game system. Conversely, the smaller the external vibration fluctuation coefficient, the smaller the ternary data deviation coefficient, and the smaller the data synchronization delay coefficient, the smaller the synchronization hidden danger analysis index, indicating that the operation hidden danger of the inertial measurement unit and the delay hidden danger of data synchronization are smaller, and the impact on the collaborative synchronization between the IMU-based intelligent helmet control system and the game system is smaller;
[0081] Step S4, comparing the synchronization hidden danger analysis index with a preset synchronization hidden danger analysis index threshold, and classifying whether there is a synchronization abnormality hidden danger in the collaboration between the IMU-based smart helmet control system and the game system;
[0082] The synchronization hidden danger analysis index is compared with the preset synchronization hidden danger analysis index threshold, and the collaboration between the IMU-based smart helmet control system and the game system is classified to determine whether there is a synchronization abnormality hidden danger. The classification is as follows:
[0083] If the synchronization risk analysis index is greater than the preset synchronization risk analysis index threshold, it indicates that the operation risk of the inertial measurement unit and the delay risk of data synchronization are greater, and the impact on the collaborative synchronization between the IMU-based smart helmet control system and the game system is greater, and a synchronization risk signal is generated;
[0084] If the synchronization hidden danger analysis index is less than or equal to the preset synchronization hidden danger analysis index threshold, it indicates that the operation hidden danger of the inertial measurement unit and the delay hidden danger of data synchronization are smaller, and the impact on the collaborative synchronization between the IMU-based smart helmet control system and the game system is smaller, and a synchronization normal signal is generated;
[0085] Step S5, according to the classification result of the synchronization abnormality hidden danger, early warning is given on the real-time performance and stability of the IMU-based smart helmet control system;
[0086] When a synchronous risk signal is generated, the synchronous hidden danger analysis index generated in the subsequent multiple T time periods is obtained, a data analysis set is established, and the data analysis set is marked as wt = {tbo α}, where α={1,2,3…β}, β is a positive integer;
[0087] Calculate the outliers of the synchronous hidden danger analysis index numbered β in the data analysis set. The expression is as follows Where afg represents the outlier of the synchronous hidden danger analysis index numbered β, qf is the average value of the synchronous hidden danger analysis index in the data analysis set, and jy is the standard deviation of the synchronous hidden danger analysis index in the data analysis set;
[0088] The outliers of the synchronous hidden danger analysis index are compared with the preset warning threshold, and the real-time and stability of the IMU-based smart helmet control system are warned. The classification is as follows:
[0089] If the outlier of the synchronous hidden danger analysis index is greater than the preset warning threshold, it means that as the use time of the smart helmet control system based on IMU increases, its real-time performance and stability are getting worse and worse, and a warning signal is generated;
[0090] If the outlier of the synchronous hidden danger analysis index is less than or equal to the preset warning threshold, it means that the real-time performance and stability of the intelligent helmet control system based on IMU have not shown a significant downward trend, and there is no need to generate a warning signal;
[0091] The present invention obtains external environment information and operation status information when an inertial measurement unit is running, and calculates an external vibration fluctuation coefficient and a ternary data deviation coefficient according to the external environment information and the operation status information, so as to improve the adaptability of the system to environmental changes, obtains regional network environment information when an intelligent helmet control system based on an IMU performs data synchronization with a game system, and calculates a data synchronization delay coefficient according to the regional network environment information, so as to help accurately evaluate the delay of data synchronization, improve the efficiency and accuracy of data synchronization, establish a synchronization hidden danger analysis model, comprehensively consider the external vibration fluctuation coefficient, the ternary data deviation coefficient and the data synchronization delay coefficient, comprehensively analyze the synchronization abnormality hidden danger of the collaboration between the intelligent helmet control system based on the IMU and the game system, ensure the comprehensiveness and accuracy of the analysis, compare the synchronization hidden danger analysis index with a preset synchronization hidden danger analysis index threshold, classify the synchronization abnormality hidden danger, and warn the real-time and stability of the intelligent helmet control system based on the IMU, timely discover and solve synchronization problems, improve the real-time and stability of the system, enhance the game experience of players, and enhance the trust of game suppliers in the intelligent helmet control system.
[0092] The above formulas are all dimensionless and numerical calculations. The formula is a formula for the most recent real situation obtained by collecting a large amount of data and performing software simulation. The preset parameters in the formula are set by technicians in this field according to actual conditions.
[0093] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0094] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A smart helmet control method based on IMU, characterized in that: The steps include: Step S1, obtaining external environment information and operating state information of the inertial measurement unit during operation, and calculating the external vibration fluctuation coefficient according to the external environment information, and calculating the ternary data deviation coefficient according to the operating state information of the inertial measurement unit during operation; Obtain the external environment information when the inertial measurement unit is running, analyze the external vibration fluctuation degree, and obtain the external vibration fluctuation coefficient to measure the external vibration degree of the inertial measurement unit. The logic for obtaining the external vibration fluctuation coefficient is as follows: The time domain vibration signal of the inertial measurement unit within the T time period is obtained through the vibration sensor, and the collected time domain vibration signal is preprocessed, and the preprocessed time domain vibration signal is converted into a frequency domain vibration signal, which is calculated by the following formula In the formula, X(f) represents the amplitude of the vibration signal at frequency f, x(t) represents the vibration data at time t, T1 represents the starting time of the T time period, T2 represents the ending time of the T time period, and e -j2πft represents a complex exponential function, where e represents the base of a natural number, j represents an imaginary unit, π represents pi, f represents frequency, and t represents time; the power spectral density of the vibration signal at frequency f is calculated to represent the energy distribution of the vibration signal in the frequency domain. The expression is as follows: S(f) = |X(f)| 2 , where S(f) represents the power spectrum density of the vibration signal at frequency f; the expression for calculating the external vibration fluctuation coefficient is as follows Where wzj represents the external vibration fluctuation coefficient, [f min , f max ] indicates the preset frequency range; Obtain the operating status information of the inertial measurement unit during operation, analyze the data response consistency of the measuring element, and obtain the ternary data deviation coefficient to measure the operating status of the inertial measurement unit. The acquisition logic of the ternary data deviation coefficient is as follows: Obtain the historical data of the three measuring components, and calculate the correlation coefficient jlx between the accelerometer and gyroscope data, the correlation coefficient jcx between the accelerometer and magnetometer data, and the correlation coefficient tcx between the gyroscope and magnetometer data based on the historical data of the measuring components. The calculation expression of the correlation coefficient jlx is as follows K i and Y i They represent the values of the two measuring elements in the i-th group of historical data, i=1, 2, 3, 4, ..., n, and n is a positive integer; the calculation method of the correlation coefficient jcx and the correlation coefficient tcx is consistent with the calculation method of the correlation coefficient jlx; The actual operation data of different measuring elements are obtained within the T time period of the actual operation of the measuring element, and the standard deviation jsb of the actual operation data of the accelerometer, the standard deviation tlb of the actual operation data of the gyroscope, and the standard deviation clb of the actual operation data of the magnetometer are calculated respectively. The expression of the standard deviation jsb of the actual operation data of the accelerometer is as follows: Where jsb represents the standard deviation of the actual operating data of the accelerometer, js u represents the actual operating data value at the uth moment, u=1, 2, 3, 4, ..., v, where v is a positive integer, It represents the mean value of the actual operation data of the accelerometer within the T time period. The calculation method of the standard deviation tlb of the actual operation data of the gyroscope and the standard deviation clb of the actual operation data of the magnetometer is the same as the calculation method of the standard deviation jsb of the actual operation data of the accelerometer; and the calculation expression of the ternary data deviation coefficient is calculated according to the standard deviation of the actual operation data of different measuring elements and the correlation coefficient between different measuring elements as follows Step S2, obtaining regional network environment information when the IMU-based smart helmet control system and the game system perform data synchronization, and calculating the data synchronization delay coefficient according to the regional network environment information; Step S3, establishing a synchronization hidden danger analysis model according to the external vibration fluctuation coefficient, the ternary data deviation coefficient, and the data synchronization delay coefficient, comprehensively analyzing whether there is a synchronization abnormality hidden danger in the collaboration between the IMU-based smart helmet control system and the game system, and generating a synchronization hidden danger analysis index; Step S4, comparing the synchronization hidden danger analysis index with a preset synchronization hidden danger analysis index threshold, and classifying whether there is a synchronization abnormality hidden danger in the collaboration between the IMU-based smart helmet control system and the game system; Step S5, according to the classification results of the synchronization abnormality hidden dangers, the real-time performance and stability of the IMU-based smart helmet control system are warned.
2. The IMU-based smart helmet control method according to claim 1, characterized in that: In step S2, the regional network environment information when the IMU-based smart helmet control system and the game system perform data synchronization is obtained, the potential delays in data synchronization are analyzed, and the data synchronization delay coefficient is obtained to measure the delay in data synchronization between the IMU-based smart helmet control system and the game system. The logic for obtaining the data synchronization delay coefficient is as follows: The response time of each data synchronization between the IMU-based smart helmet control system and the game system is obtained within the T time period, and a response time data sequence is established, which is marked as D = {d1, d2, ..., d q }; Construct the response duration data matrix M and mark it as Perform singular value decomposition on the response time data matrix M to obtain three matrices U, ∑ and V T , that is, M=U∑V T , where U is a left singular vector matrix whose column vectors are left singular vectors, ∑ is a singular value matrix whose diagonal elements are singular values, and V T is the transpose of the right singular vector matrix V; Sort the singular values in the singular value matrix ∑ from large to small, and select the first k singular values whose singular values are greater than the singular value threshold and their corresponding left singular vectors and right singular vectors; The response duration data matrix M is reconstructed according to the selected first k singular values and their corresponding left singular vectors and right singular vectors to obtain the reconstructed matrix of the response duration data matrix M, which is marked as Calculate the data synchronization delay coefficient Where sty represents the data synchronization delay coefficient, d p Represents the elements in the response duration data matrix M, d' p Represents the elements in the response duration data reconstruction matrix M'.
3. The IMU-based smart helmet control method according to claim 2, characterized in that: The external vibration fluctuation coefficient, the ternary data deviation coefficient, and the data synchronization delay coefficient are normalized, and a synchronization hidden danger analysis model is constructed based on the normalized external vibration fluctuation coefficient, the ternary data deviation coefficient, and the data synchronization delay coefficient to generate the synchronization hidden danger analysis index tbo. The formula based on the model is as follows: Wherein a1, a2, and a3 represent preset proportional coefficients of the external vibration fluctuation coefficient, the ternary data deviation coefficient, and the data synchronization delay coefficient, respectively, and a1, a2, and a3 are all greater than 0.
4. The IMU-based smart helmet control method according to claim 3, characterized in that: The synchronization hidden danger analysis index is compared with the preset synchronization hidden danger analysis index threshold, and the collaboration between the IMU-based smart helmet control system and the game system is classified to determine whether there is a synchronization abnormality hidden danger. The classification is as follows: If the synchronous hidden danger analysis index is greater than the preset synchronous hidden danger analysis index threshold, a synchronous risk signal is generated; If the synchronization hidden danger analysis index is less than or equal to the preset synchronization hidden danger analysis index threshold, a synchronization normal signal is generated.
5. The IMU-based smart helmet control method according to claim 4, characterized in that: When a synchronous risk signal is generated, the synchronous hidden danger analysis index generated in the subsequent multiple T time periods is obtained, a data analysis set is established, and the data analysis set is marked as wt = {tbo α }, where α={1,2,3…β}, β is a positive integer; Calculate the outliers of the synchronous hidden danger analysis index numbered β in the data analysis set. The expression is as follows Where afg represents the outlier of the synchronous hidden danger analysis index numbered β, qf is the average value of the synchronous hidden danger analysis index in the data analysis set, and jy is the standard deviation of the synchronous hidden danger analysis index in the data analysis set.
6. The IMU-based smart helmet control method according to claim 5, characterized in that: The outliers of the synchronous hidden danger analysis index are compared with the preset warning threshold, and the real-time and stability of the IMU-based smart helmet control system are warned. The classification is as follows: If the outlier of the synchronous hidden danger analysis index is greater than the preset warning threshold, a warning signal is generated; If the outlier of the synchronous hidden danger analysis index is less than or equal to the preset warning threshold, there is no need to generate a warning signal.
