An underground audio and video relay communication interactive system
By using relay transmission and signal optimization of multiple communication nodes in the downhole audio-visual connection communication interaction system, the problem of signal interference and distance limitation of the downhole communication system is solved, stable and efficient audio-visual data transmission is achieved, and communication is improved Quality and safety management.
Patent Information
- Application Number
- CN202411218304.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-02
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2044-09-02
AI Technical Summary
The signal of the underground communication system is susceptible to interference in complex environments, resulting in poor communication stability and weakening of signal strength during deep well operations, resulting in incomplete and timely transmission of audio and video data, affecting safe production and management.
The downhole audio and video relay communication interaction system is adopted, and the signal strength is monitored in real time and the signal parameters are adjusted through the relay transmission method of multiple communication nodes. The optimization module compresses and encodes information and prioritizes important information transmission, and adds redundant information to the data. Perform verification.
Ensure that information transmission is not interrupted in complex underground environments, break through communication distance limitations, improve communication stability and security early warning capabilities, and ensure data integrity and accuracy.
Smart Images

Figure CN118764591B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the technical field of audio and video communication, in particular to an underground audio and video relay communication interaction system. Background Art
[0002] With the continuous increase in energy demand, the mining and exploration of resources such as coal, metal minerals, oil, and natural gas have continued to deepen, and the scale and scope of underground operations have been expanding. Whether it is deep-well coal mining, complex vein excavation of metal minerals, or deep exploration and development of oil and gas, higher requirements are placed on the safety, efficiency, and management of underground operations. In this context, advanced communication systems are needed to meet the information transmission and interaction needs in underground operations, and underground audio and video relay communication interaction systems have emerged.
[0003] In the existing underground communication technology, such as KT158 coal mine communication system, two-way voice communication between the workers above and below the mine has been realized, which is convenient for the transmission of work instructions and information feedback; it supports group voice communication between underground workers, which is convenient for collaborative work; and it can transmit some simple text data, such as work reports, equipment parameters, etc.
[0004] However, the above technologies still have the following deficiencies:
[0005] 1. Poor communication stability. Due to the complex underground environment, there are a lot of rocks, metals and electromagnetic interference sources, which makes the signal prone to attenuation, distortion and interruption during transmission. For example, when the mining equipment generates electromagnetic waves during operation, it will cause serious interference to the communication signal, resulting in problems such as freezing of audio and video transmission, blurred images, intermittent sound, etc., which greatly affects the quality and efficiency of communication. In emergency situations, such as accidents or disasters, if the communication system cannot transmit signals stably, it will bring great difficulties to rescue and emergency command work, and may even delay the best time for rescue.
[0006] 2. Limited communication distance. In deep well operations, as the depth increases, the signal strength weakens rapidly, resulting in the inability to transmit audio and video data completely and in a timely manner. For example, in a mine with a depth of several thousand meters, the communication between the workers at the bottom of the well and the wellhead control center may experience signal loss and excessive delay, making it impossible for the surface to understand the underground operation in real time, and the underground workers cannot receive instructions and information from the surface in a timely manner. This limitation in communication distance poses a great hidden danger to underground production safety and management. Summary of the invention
[0007] The present invention provides an underground audio and video relay communication interactive system, which solves the above technical problems by establishing a communication node relay transmission method.
[0008] The technical solution of the present invention is as follows:
[0009] An underground audio and video relay communication interactive system, characterized by comprising:
[0010] An audio and video acquisition module, wherein the audio and video acquisition module uses high-precision audio and video acquisition equipment to accurately acquire audio information and video information;
[0011] A preprocessing module, which is used to store the information collected by the audio and video collection module and select important information for priority transmission;
[0012] An optimization module, which is used to compress and encode important information that is transmitted first after preprocessing, thereby reducing the amount of data and the transmission bandwidth requirement;
[0013] A relay communication module, the relay communication module includes a plurality of communication nodes, and is used to realize relay wireless communication transmission between the plurality of communication nodes, so as to ensure that information is not interrupted in the underground environment;
[0014] An interactive module, the interactive module includes a command unit and an operation unit, the command unit is used to switch, control, verify and manage audio and video for the commander on the well, and the operation unit is used to control and encrypt audio and video for the underground workers;
[0015] The interaction relationship between the modules of the underground audio and video relay communication interactive system is as follows:
[0016] The audio and video acquisition module is connected to the operation unit. The staff uses the operation unit to turn on the audio and video acquisition module to collect audio and video information, and transmit it to the preprocessing module in real time. The preprocessing module stores and selects the information, and then transmits the selected important information to the optimization module in priority. The optimization module compresses and encodes the information and transmits the encoded information to the relay communication module. Each communication node in the relay communication module monitors the signal strength in real time and adjusts related signal parameters, and relays the information to the command unit. The command unit verifies the received information and provides it for relevant personnel to view and issue instructions after verification.
[0017] Preferably, the audio and video acquisition module can automatically adjust the acquisition angle and focal length according to the height, position and range of activities of different staff members to ensure that complete and accurate audio and video information is collected.
[0018] Preferably, the preprocessing module includes a storage unit and a selection unit;
[0019] The storage unit is based on a large-capacity storage device and is used to completely store the audio and video information collected by the audio and video collection module;
[0020] The selection unit selects the information after storage, selects important information for priority transmission, and selects non-important information for subsequent transmission or transmission when there is no important information transmission task.
[0021] Preferably, the selection unit selects in the following manner:
[0022] A voice keyword set is set according to historical dangerous situations, and the probability of occurrence of voice keywords is calculated. When safety-related words appear, they are listed as important information. At the same time, according to the actual production situation of the mine, the staff can add keywords to the selection unit through the interactive module;
[0023] Set the keyword set to , g is the number of keywords, set two types of information: important information and non-important information, calculate the probability of the voice keywords appearing in the acquired voice text D, and determine whether the voice text D is important information;
[0024] Let i be the index of the category, represents the i-th category, and i is set to 1 or 2 to represent important information or non-important information, that is, For important information categories, For a non-important information category, for a piece of speech text D obtained, when a keyword in the keyword set is detected in it, the probability P( |D) and the probability P( |D), and then classify according to the probability size; It means that given a known speech text D, it belongs to the category The probability of The calculation formula is:
[0025] ;
[0026] in, It is expressed as the probability of the occurrence of speech text D, which means the probability of the occurrence of speech text D in all the collected speech samples, because can be obtained according to the number of samples taken, so by comparing Judging by the size , It means that in the known category The probability of the voice text D appearing in the case of
[0027] The calculation does not consider the relevance of keywords, so the keywords appearing in the information are independent of each other. The calculation formula is as follows:
[0028] ;
[0029] Among them, j is the index of the keyword sample, representing the jth keyword, is the keyword In category The probability of occurrence in is obtained through statistics of historical communication data. Yes Category The prior probability itself is obtained by the ratio of important information to unimportant information in historical data;
[0030] Finally, if , the voice text D is determined as important information, otherwise it is determined as non-important information; at the same time, the keyword set can set a part of the keywords as a high-risk keyword set, and the high-risk keyword set is set by the staff according to the actual production situation of the mine. When the selection unit detects the high-risk keyword set, the language text is immediately determined as important information.
[0031] Preferably, the optimization module divides the original audio and video data into a specified audio segment or a frame of image for compression encoding;
[0032] For audio data, the original audio data is divided into multiple audio segments, and for each audio segment , the audio DCT transform formula is:
[0033] ;
[0034] The scaling factor is for:
[0035] ;
[0036] Indicates that after DCT transformation, the frequency The compression value at k;
[0037] Frequency is the characteristic of a signal in the frequency domain; frequency in audio means the pitch of the sound. In the compressed value after DCT transformation, the low-frequency part contains the main energy and basic characteristics of the audio signal, while the high-frequency part corresponds to subtle and rapidly changing components.
[0038] in, represents frequency, k represents frequency index, and its value range is 0 to L-1. is a frequency The relevant scaling factor is used to ensure the conservation of audio compression transformation. r represents the sample index in the time domain. Represents the value of the original audio signal at sample r, and L is the number of sampling points of the signal;
[0039] For video data, the original video data is divided according to the number of frames. For each frame, a pixel block f(x, y) of size M×N is formed, where , the DCT transform formula is:
[0040] ;
[0041] The scaling factor is and for:
[0042] ;
[0043] Indicates that after DCT transformation, the pixel block The compression value at ;
[0044] u and v represent the pixel block index in the horizontal and vertical directions, respectively, and the value range is usually 0 to M-1 and 0 to N-1;
[0045] and The horizontal and vertical frequencies are and The associated scaling factors are used to ensure the energy conservation and normalization properties of the transformation;
[0046] x and y represent the horizontal and vertical position indices of the pixel in the image block, respectively. Indicates that the original image is at position The pixel value at , M is the horizontal width of the image block, and N is the vertical height of the image block;
[0047] Finally got the relevant and The collection is the value of the compressed original data, and the generated compressed data information is transmitted.
[0048] Preferably, the relay communication module divides the underground operation area into multiple levels and partitions, and each level and partition is provided with an independent communication node; each communication node includes a signal monitoring unit and a communication unit;
[0049] The signal monitoring unit monitors the signal status in real time and can dynamically adjust the signal transmission power according to the change of signal strength to extend the communication distance;
[0050] The communication unit is used to complete the relay communication of each communication node. Each communication node is responsible for signal transmission within a partition, and the signal transmission distance is extended by relaying.
[0051] Preferably, the signal monitoring unit;
[0052] Signal strength calculation:
[0053] ;
[0054] Among them, S represents the signal strength of the relay signal received by the communication node from the previous communication node, A is the transmission power of the transmitter, H is the gain of the transmitting and receiving antennas, and B is the distance between the two communication nodes; is the path loss exponent;
[0055] Signal quality assessment:
[0056] ;
[0057] Where: Q represents signal quality, T is noise power, which is the total energy of sound radiated into space by the noise source per unit time, obtained by direct measurement in the signal environment;
[0058] Automatically adjust the transmit power:
[0059] ;
[0060] in: is the adjusted transmit power, is the original transmission power, is the adjustment factor; is the target signal quality; is the current signal quality; the adjustment factor is determined based on the power requirements of historical signal transmission conditions;
[0061] Automatic frequency adjustment:
[0062] ;
[0063] in: is the adjusted frequency, is the original frequency, The frequency adjustment step size refers to the frequency change amount each time the frequency is adjusted;
[0064] Sign is a sign function, which is used to perform different processing or judgments according to the positive or negative value. ,but ,but
[0065] .
[0066] Preferably, the command unit in the interaction module is also used to send a request to the operation unit to resend the corresponding data when data loss or error is found;
[0067] The operating unit in the interactive module adds redundant information to the collected and transmitted audio and video data, and when the command unit receives the data, it can use the redundant information for verification.
[0068] Preferably, the command unit and the operation unit verify the redundant information in the following manner:
[0069] The operation unit divides the audio and video data into information blocks of fixed size and processes each information block; calculates a function value of fixed length for each information block, and the operation unit adds these function values as redundant information outside the audio and video information block, and numbers the information blocks according to the time series order;
[0070] After receiving the information, the command unit recalculates the function value for each information block and compares it with the received redundant information label based on the time series. If there is inconsistency or missing, it means that there is an error in the information block;
[0071] The function value includes but is not limited to a hash function, a cyclic redundancy check function and a parity check function.
[0072] Compared with the prior art, the present invention has the following beneficial effects:
[0073] 1. The present invention realizes relay transmission between different communication nodes by setting up multiple communication nodes through the relay communication module, ensuring that information is not interrupted in the complex environment underground. The signal monitoring unit of each communication node monitors the signal status in real time, dynamically adjusts the signal transmission power and frequency, so that the signal maintains a strong intensity in the deep well environment, thereby breaking through the limitation of communication distance and ensuring the integrity and timely transmission of audio and video data. The optimization module compresses the information, reduces the amount of data, and alleviates communication tension.
[0074] 2. The present invention stores and selects important information for priority transmission through the preprocessing module, thereby enhancing the pertinence and effectiveness of communication, improving the security warning capability, and alleviating some communication pressure. It stores all audio and video information and provides a basis for subsequent investigations; the interactive module adds redundant information to the collected and transmitted audio and video data, and can use the redundant information for verification. When a data error is found, a request is sent to the sender to resend it, thereby ensuring the integrity and accuracy of the data. BRIEF DESCRIPTION OF THE DRAWINGS
[0075] Figure 1 It is a work flow chart of the present invention;
[0076] Figure 2 It is a flow chart of the transmission of audio and video information to the relay communication module of the present invention;
[0077] Figure 3It is a flow chart of the transmission of audio and video information from the relay communication module to the command unit of the present invention. DETAILED DESCRIPTION
[0078] The following embodiments of the present invention are further described in detail with reference to the accompanying drawings and examples; the following examples are used to illustrate the present invention but are not intended to limit the scope of the present invention;
[0079] The present invention provides an underground audio and video relay communication interactive system, comprising:
[0080] An audio and video acquisition module, wherein the audio and video acquisition module uses high-precision audio and video acquisition equipment to accurately acquire audio information and video information;
[0081] A preprocessing module, which is used to store the information collected by the audio and video collection module and select important information for priority transmission;
[0082] An optimization module, which is used to compress and encode information, reduce the amount of data, and reduce the transmission bandwidth requirement;
[0083] A relay communication module, which includes a plurality of communication nodes and is used to realize relay transmission between different communication nodes to ensure that information is not interrupted in the underground environment;
[0084] An interactive module, the interactive module includes a command unit and an operation unit, which are used to provide an interactive interface for users. The command unit is used to switch, control and manage audio and video for the commanders on the well, and the operation unit is used to switch, control and manage audio and video for the operators underground.
[0085] The interaction relationship between the modules of the underground audio and video relay communication interactive system is as follows:
[0086] The audio and video acquisition module is connected to the operation unit. The staff uses the operation unit to turn on the audio and video acquisition module to collect audio and video information, and transmit it to the preprocessing module in real time. The preprocessing module stores and selects the information, and then transmits the selected important information to the optimization module in priority. The optimization module compresses and encodes the information and transmits the encoded information to the relay communication module. Each communication node in the relay communication module monitors the signal strength in real time and adjusts related signal parameters, and relays the information to the command unit. The command unit verifies the received information and provides it for relevant personnel to view and issue instructions after verification.
[0087] Embodiment 1: Figure 1-3 As shown, in this embodiment, when the staff is performing related work underground, if they encounter a situation that may cause danger, they need to request audio and video communication from their superiors to make decisions on subsequent tasks;
[0088] The staff uses the operating unit in the interactive module to start the video communication;
[0089] The audio and video acquisition module receives the control instructions from the operation unit and automatically collects complete and accurate audio and video information; and transmits the collected information to the pre-processing module in real time;
[0090] At the same time, the operation unit divides the audio information and the video information into information blocks of fixed sizes and processes each information block;
[0091] A hash function value of a fixed length is calculated for each information block, and the operation unit adds these function values to the audio and video information block as redundant information; and the information blocks are numbered according to the time series order;
[0092] By adding redundant information to the collected and transmitted audio and video data through the operating unit in the interactive module, the command unit can use the redundant information for verification. When data errors are found, a request instruction for information retransmission is sent to the sender, thereby ensuring the integrity and accuracy of the data and enhancing the stability of communication.
[0093] The storage unit in the preprocessing module uses a large-capacity storage device to completely store the original audio and video information collected by the audio and video acquisition module;
[0094] The selection unit in the preprocessing module selects the information after storage, selects important information for priority transmission, and transmits non-important information when there is no important information to be transmitted.
[0095] Select the unit selection method as follows:
[0096] Set voice keyword sets based on historical danger situations , g is the number of keywords, and two types of information are set: important information and non-important information. The occurrence probability of voice keywords such as danger, pressure, and over-limit is calculated to determine whether it is important information;
[0097] Let i be the index of the category, represents the i-th category, and i is set to 1 or 2 to represent important information or non-important information, that is, For important information categories, For a non-important information category, for a piece of speech text D obtained, when a keyword in the keyword set is detected in it, the probability P( |D) and the probability P( |D), and then classify according to the probability size; It means that given a known speech text D, it belongs to the category The probability of The calculation formula is:
[0098] ;
[0099] in, It is expressed as the probability of the occurrence of speech text D, which means the probability of the occurrence of speech text D in all the collected speech samples, because can be obtained according to the number of samples taken, so by comparing Judging by the size , It means that in the known category The probability of the speech text D appearing in the case of
[0100] The calculation does not consider the relevance of keywords, so the keywords appearing in the information are independent of each other. The calculation formula is as follows:
[0101] ;
[0102] Among them, j is the index of the keyword sample, representing the jth keyword, is the keyword In category The probability of occurrence in is obtained through statistics of historical communication data. Yes Category The prior probability itself is obtained by the ratio of important information to unimportant information in historical data;
[0103] The prior probability represents the initial estimate of whether the information belongs to the important information category or the unimportant information category based on historical data without considering the specific speech text. It reflects the proportional distribution of important information and unimportant information in the historical data. When calculating the probability that the speech text belongs to different categories, the prior probability provides a basic reference value for subsequent calculations.
[0104] By statistically analyzing historical communication data, the probability of each keyword appearing in the important information and non-important information categories is determined. Then, for a given voice text, if the keywords appear in the information independently, the product of the probability of each keyword appearing in the corresponding category is calculated based on the multiplication principle of the probability of independent events.
[0105] Finally, the result after calculation is , that is, the probability that the speech text D belongs to the important information category is greater than the probability that it belongs to the non-important information category, then the speech text D is determined to be important information, and the continuous audio and video content containing this text content is transmitted to the optimization module;
[0106] Suppose at a certain moment, a voice text D is received: "The gas concentration is abnormally high and may be dangerous."
[0107] In the keyword set, the staff set a high-risk keyword set based on the actual production situation of the mine, including "abnormal gas concentration", "collapse risk", "water seepage sign", etc. The high-risk keyword "abnormal gas concentration" was detected in this speech text. According to the rules, when the selection unit detects the high-risk keyword set, it immediately determines this language text as important information.
[0108] The pre-processing module stores and selects important information for priority transmission to the optimization module, which relieves some of the communication pressure and provides a basis for subsequent investigations;
[0109] Embodiment 2: Figure 1-3 As shown, in this embodiment, when the underground communication bandwidth is insufficient, the optimization module divides the original audio and video data transmitted by the preprocessing module into a specified audio segment or a frame of image for compression;
[0110] For audio data, the original audio data is divided into multiple audio segments, and for each audio segment , the audio DCT transform formula is:
[0111] ;
[0112] The scaling factor is for:
[0113] ;
[0114] Indicates that after DCT transformation, the frequency The compression value at k;
[0115] Frequency is the characteristic of a signal in the frequency domain; frequency in audio means the pitch of the sound. In the compressed value after DCT transformation, the low-frequency part contains the main energy and basic characteristics of the audio signal, while the high-frequency part corresponds to subtle and rapidly changing components.
[0116] in, represents frequency, k represents frequency index, and its value range is 0 to L-1. is a frequency The relevant scaling factor is used to ensure the conservation of audio compression transformation. r represents the sample index in the time domain. Represents the value of the original audio signal at sample r, and L is the number of sampling points of the signal;
[0117] For video data, the original video data is divided according to the number of frames. For each frame, a pixel block f(x, y) of size M×N is formed, where , the DCT transform formula is:
[0118] ;
[0119] The scaling factor is and for:
[0120] ;
[0121] Indicates that after DCT transformation, the pixel block The compression value at ;
[0122] u and v represent the pixel block index in the horizontal and vertical directions, respectively, and the value range is usually 0 to M-1 and 0 to N-1;
[0123] and The horizontal and vertical frequencies are and The associated scaling factors are used to ensure the energy conservation and normalization properties of the transformation;
[0124] x and y represent the horizontal and vertical position indices of the pixel in the image block, respectively. Indicates that the original image is at position The pixel value at , M is the horizontal width of the image block, and N is the vertical height of the image block;
[0125] Finally got the relevant and The collection is the compressed value of the original data.
[0126] By compressing information through optimization modules, the amount of data is reduced and the pressure of communication is reduced.
[0127] Embodiment 3: Figure 1-3 As shown, in this embodiment, after the information encoding is completed, it is transmitted to the relay communication module;
[0128] The relay communication module divides the underground operation area into multiple levels and partitions, and sets independent communication nodes for each level and partition. The partitions are divided according to different areas of underground operation, and then divided into layers according to different transmission distances of different partitions, generally according to the effective transmission distance of wireless transmission in the underground.
[0129] Through the relay communication module, a certain operation area of the underground operation is divided into three levels: bottom, middle and top. Each level is equipped with an independent communication node. The communication node is a communication entity, such as an intelligent wireless repeater, which is responsible for wireless communication and extends the communication distance through relay communication.
[0130] Each communication node includes a signal monitoring unit and a communication unit. The signal monitoring unit first monitors the signal status of the communication node in real time, and then dynamically adjusts the signal transmission power according to the change of signal strength to extend the communication distance;
[0131] The communication unit is used to complete the relay communication of each communication node. Each communication node is responsible for signal transmission within a partition, and the signal transmission distance is extended by relay.
[0132] The signal monitoring unit calculates the signal strength:
[0133] ;
[0134] Among them, S represents the signal strength of the relay signal received by the communication node from the previous communication node, A is the transmission power of the transmitter, H is the gain of the transmitting and receiving antennas, and B is the distance between the two communication nodes; is the path loss exponent;
[0135] Signal quality assessment:
[0136] ;
[0137] Where: Q represents signal quality, T is noise power, which is the total energy of sound radiated into space by the noise source per unit time, obtained by direct measurement in the signal environment; it is compared with the signal quality evaluation under the historical normal test environment, and if it does not meet the normal quality evaluation, the transmission power is automatically adjusted.
[0138] Automatically adjust the transmit power:
[0139] ;
[0140] in: is the adjusted transmit power, is the original transmission power, is the adjustment factor; is the target signal quality; is the current signal quality; the adjustment factor is determined based on the power requirements of historical signal transmission conditions;
[0141] Automatic frequency adjustment:
[0142] ;
[0143] in: is the adjusted frequency, is the original frequency, The frequency adjustment step size refers to the frequency change amount each time the frequency is adjusted;
[0144] Sign is a sign function, which is used to perform different processing or judgments according to the positive or negative value. ,but ,but
[0145] .
[0146] The signal monitoring unit of each communication node can monitor the signal status in real time and dynamically adjust the signal transmission power and frequency according to changes in signal strength. Compared with existing technologies, it can effectively ensure signal stability and quality.
[0147] It also enables the signal to maintain a strong intensity in a deep well environment. Compared with existing technologies, it breaks through the limitations of communication distance and ensures the integrity and timely transmission of audio and video data.
[0148] The relay communication module realizes relay transmission between different communication nodes by setting up multiple communication nodes, ensuring that information is not interrupted in the complex environment underground.
[0149] After continuous relay communication through the relay communication module, the information is transmitted to the command unit of the interactive module;
[0150] The operation unit divides the audio and video data into fixed-size information blocks at the beginning, and processes each information block; calculates a fixed-length function value for each information block, and adds these function values as redundant information outside the audio and video information block, and numbers the information blocks according to the time series order;
[0151] The command unit decompresses the compression of the optimization module to obtain audio and video information and redundant information;
[0152] The received information is divided into information blocks of fixed size, and the hash function value is recalculated for each information block and compared with the received function value; after receiving the information, the operation unit recalculates the function value for each information block and compares it with the received redundant information labeling based on the time series. If there is inconsistency or missing, it means that there is an error in the information block;
[0153] After comparative calculation, the redundant information is the same as the calculated hash function value. The audio and video information is presented to the commander through the command unit. The commander judges based on the audio and video situation and issues an order to suspend the underground task. The order is communicated in reverse through the command unit and transmitted to the operating unit of the underground staff. The underground staff completes the retreat task according to the order.
[0154] The operating unit adds redundant information of hash function values to the collected and transmitted audio and video data, and the command unit uses the redundant information to calculate and verify the hash function values, which improves the integrity and accuracy of the data to a certain extent and enhances the stability of communication.
[0155] The embodiments of the present invention are provided for the purpose of illustration and description. Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations of the present invention. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present invention.
Claims
1. An underground audio and video relay communication interactive system, characterized in that: include: An audio and video acquisition module, wherein the audio and video acquisition module uses high-precision audio and video acquisition equipment to accurately acquire audio information and video information; A preprocessing module, which is used to store the information collected by the audio and video collection module and select important information for priority transmission; An optimization module, which is used to compress and encode important information that is transmitted first after preprocessing, thereby reducing the amount of data and the transmission bandwidth requirement; A relay communication module, the relay communication module includes a plurality of communication nodes, the plurality of communication nodes are connected via a wireless network for transmitting audio and video information; An interactive module, the interactive module includes a command unit and an operation unit, the command unit is used to switch, control, verify and manage audio and video for the commander on the well, and the operation unit is used to control and encrypt audio and video for the underground workers; The interaction relationship between the modules of the underground audio and video relay communication interactive system is as follows: The audio and video acquisition module is connected to the operation unit. The staff uses the operation unit to turn on the audio and video acquisition module to collect audio and video information, and transmit it to the pre-processing module in real time. The pre-processing module stores and selects the information, and then transmits the selected important information to the optimization module in priority. The optimization module compresses and encodes the information and transmits the encoded information to the relay communication module. Each communication node of the relay communication module monitors the signal strength in real time and adjusts the relevant signal parameters, and relays the information to the command unit. The command unit verifies the received information, and after verification, it is available for relevant personnel to view and issue instructions; The preprocessing module includes a storage unit and a selection unit; The storage unit is based on a large-capacity storage device and is used to completely store the audio and video information collected by the audio and video collection module; The selection unit selects the information after storage, selects important information for priority transmission, and selects non-important information for subsequent transmission or transmission when there is no important information transmission task; The selection unit selection method is as follows: A voice keyword set is set according to historical dangerous situations, and the probability of occurrence of voice keywords is calculated. When safety-related words appear, they are listed as important information. At the same time, according to the actual production situation of the mine, the staff can add keywords to the selection unit through the interactive module; Set the keyword set to , g is the number of keywords, set two types of information: important information and non-important information, calculate the probability of the voice keywords appearing in the acquired voice text D, and determine whether the voice text D is important information; Let i be the index of the category, represents the i-th category, and i is set to 1 or 2 to represent important information or non-important information, that is, For important information categories, For a non-important information category, for a piece of speech text D obtained, when a keyword in the keyword set is detected in it, the probability P( |D) and the probability P( |D), and then classify according to the probability size; It means that given a known speech text D, it belongs to the category The probability of The calculation formula is: ; in, It is expressed as the probability of the occurrence of speech text D, which means the probability of the occurrence of speech text D in all the collected speech samples, because can be obtained according to the number of samples taken, so by comparing Judging by the size , It means that in the known category The probability of the speech text D appearing in the case of The calculation does not consider the relevance of keywords, so the keywords appearing in the information are independent of each other. The calculation formula is as follows: ; Among them, j is the index of the keyword sample, representing the jth keyword, is the keyword In category The probability of occurrence in is obtained through statistics of historical communication data. Yes Category The prior probability itself is obtained by the ratio of important information to unimportant information in historical data; Finally, if , the voice text D is determined as important information, otherwise it is determined as non-important information; at the same time, the keyword set can set a part of the keywords as a high-risk keyword set, and the high-risk keyword set is set by the staff according to the actual production situation of the mine. When the selection unit detects the high-risk keyword set, the language text is immediately determined as important information; The optimization module divides the original audio and video data into a specified audio segment or a frame of image for compression encoding; For audio data, the original audio data is divided into multiple audio segments, and for each audio segment , the audio DCT transform formula is: ; The scaling factor is for: ; Indicates that after DCT transformation, the frequency The compression value at k; Frequency is the characteristic of a signal in the frequency domain; frequency in audio means the pitch of the sound. In the compressed value after DCT transformation, the low-frequency part contains the main energy and basic characteristics of the audio signal, while the high-frequency part corresponds to subtle and rapidly changing components. in, represents frequency, k represents frequency index, and its value range is 0 to L-1. is a frequency The relevant scaling factor is used to ensure the conservation of audio compression transformation. r represents the sample index in the time domain. Represents the value of the original audio signal at sample r, and L is the number of sampling points of the signal; For video data, the original video data is divided according to the number of frames. For each frame, a pixel block f(x, y) of size M×N is formed, where , the DCT transform formula is: ; The scaling factor is and for: ; Indicates that after DCT transformation, the pixel block The compression value at ; u and v represent the pixel block index in the horizontal and vertical directions, respectively, and the value range is usually 0 to M-1 and 0 to N-1; and The horizontal and vertical frequencies are and The associated scaling factors are used to ensure the energy conservation and normalization properties of the transformation; x and y represent the horizontal and vertical position indices of the pixel in the image block, respectively. Indicates that the original image is at position The pixel value at , M is the horizontal width of the image block, and N is the vertical height of the image block; Finally got the relevant and The collection is the value of the compressed original data, and the generated compressed data information is transmitted.
2. The underground audio and video relay communication interactive system according to claim 1, characterized in that: The audio and video acquisition module can automatically adjust the acquisition angle and focal length according to the height, position and range of activities of different staff members to ensure that complete and accurate audio and video information is collected.
3. The underground audio and video relay communication interactive system according to claim 1, characterized in that: The relay communication module divides the underground operation area into multiple levels and partitions, and each level and partition is provided with an independent communication node; each communication node includes a signal monitoring unit and a communication unit; The signal monitoring unit monitors the signal status in real time and can dynamically adjust the signal transmission power according to the change of signal strength to extend the communication distance; The communication unit is used to complete the relay communication of each communication node. Each communication node is responsible for signal transmission within a partition, and the signal transmission distance is extended by relaying.
4. The underground audio and video relay communication interactive system as claimed in claim 3, characterized in that: In the signal monitoring unit: Signal strength calculation: ; Among them, S represents the signal strength of the relay signal received by the communication node from the previous communication node, A is the transmission power of the transmitter, H is the gain of the transmitting and receiving antennas, and B is the distance between the two communication nodes; is the path loss exponent; Signal quality assessment: ; Where: Q represents signal quality, T is noise power, which is the total energy of sound radiated into space by the noise source per unit time, obtained by direct measurement in the signal environment; Automatically adjust the transmit power: ; in: is the adjusted transmit power, is the original transmission power, is the adjustment factor; is the target signal quality; is the current signal quality; the adjustment factor is determined based on the power requirements of historical signal transmission conditions; Automatic frequency adjustment: ; in: is the adjusted frequency, is the original frequency, The frequency adjustment step size refers to the frequency change amount each time the frequency is adjusted; Sign is a sign function, which is used to perform different processing or judgments according to the positive or negative value. ,but .
5. The underground audio and video relay communication interactive system according to claim 1, characterized in that: The command unit in the interaction module is also used to send a request to the operation unit to resend the corresponding data when data loss or error is found; The operating unit in the interactive module adds redundant information to the collected and transmitted audio and video data, and when the command unit receives the data, it can use the redundant information for verification.
6. An underground audio and video relay communication interactive system as claimed in claim 5, characterized in that: The command unit and the operation unit verify the redundant information in the following manner: The operation unit divides the audio and video data into information blocks of fixed size and processes each information block; calculates a function value of fixed length for each information block, and the operation unit adds these function values as redundant information outside the audio and video information block, and numbers the information blocks according to the time series order; After receiving the information, the command unit recalculates the function value for each information block and compares it with the received redundant information label based on the time series. If there is inconsistency or missing, it means that there is an error in the information block; The function value includes but is not limited to a hash function, a cyclic redundancy check function and a parity check function.
