Intelligent monitoring method and device for tunneling equipment

Through the combination of AR technology and explosion-proof gimbal camera, the problem of limited video surveillance display angle of the excavator is solved, and the panoramic monitoring and automatic follow-up switching of the excavator is realized, which improves the efficiency and safety of remote operation and is used for remote control. Provides reliable evidence.

CN118890440APending Publication Date: 2024-11-01TAIYUAN INST OF CHINA COAL TECH & ENG GROUP +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410986412.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-23
Publication Date
2024-11-01

AI Technical Summary

Technical Problem

The video monitoring display of the boring machine has a limited monitoring position and the angle of the monitoring display screen, which cannot provide the multi-angle, blind spotless working state video screen of the boring machine, resulting in low remote operation efficiency and restricting remote control applications.

Method used

Using intelligent monitoring methods based on AR technology, the rotation angle information is obtained through explosion-proof AR glasses, the control signal is converted into action commands, the explosion-proof gimbal camera is driven to rotate, the panoramic video monitoring screen is obtained, and the wireless signal is transmitted to the AR glasses to realize the panoramic view. Monitor and automatic follow-up switch.

Benefits of technology

Provide remote operators with no dead angle video images, improve the working efficiency and safety of the boring machine, realize an immersive operation experience, and provide a reliable basis for remote control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118890440A_ABST
    Figure CN118890440A_ABST
Patent Text Reader

Abstract

The invention provides an intelligent monitoring method and device for tunneling equipment, and relates to the technical field of AR intelligent monitoring of coal mine tunneling machines, and the method comprises the steps: transmitting a monitoring image signal to an anti-explosion video collection control box; the explosion-proof video acquisition control box receives the video signal and sends the video signal received by the control box to the explosion-proof CPE; the explosion-proof CPE converts the received video signal into a wireless signal and transmits the wireless signal to the explosion-proof base station; and the explosion-proof base station receives the video signal and transmits the video signal to the explosion-proof AR glasses through a wireless signal, and the explosion-proof AR glasses receives and displays the video signal. According to the invention, a dead-corner-free video picture is provided for a tunneling remote operator, and the remote operator can fully and accurately see the panoramic working state of the tunneling machine at any place beside the equipment at a first visual angle by wearing AR glasses.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of AR intelligent monitoring of coal mine tunneling machines, and in particular to an intelligent monitoring method and device for tunneling equipment. Background Art

[0002] With the advancement of intelligent construction of coal mines, the technical level of tunnel boring machines has been significantly improved. Operators can be freed to move to a position far away from the front, the underground centralized control center or the ground dispatching room, and use the tunnel boring machine video monitoring display to achieve remote control of the tunnel boring machine. However, the current tunnel boring machine video monitoring display usually uses multiple cameras installed on the tunnel boring machine, which has the problem of limited monitoring position and monitoring display screen angle, and cannot provide remote operators with a video screen basis for the tunnel boring machine's multi-angle working status without blind spots. Remote operators often need manual intervention to achieve reliable remote operation of the tunnel boring machine, which greatly reduces the tunneling efficiency and restricts the normalization of remote control of the tunnel boring machine.

[0003] How to solve the problem of limited monitoring position and monitoring display angle of the tunnel boring machine, realize 360-degree monitoring of the tunnel boring machine status, provide tunnel boring remote operators with video images without blind spots, enable remote operators to fully and accurately see the panoramic working status of the tunnel boring machine from a first-person perspective anywhere near the equipment, realize immersive operation of remote operators, and provide a reliable basis for remote control of the tunnel boring machine, needs to be solved urgently. Summary of the invention

[0004] The technical problem to be solved by the present invention is to provide an intelligent monitoring method and device for tunneling equipment, to realize panoramic monitoring of the tunneling machine status based on AR technology, to provide tunneling remote operators with video images without blind spots, and the remote operators wearing AR glasses can fully and accurately see the panoramic working status of the tunneling machine from a first-person perspective anywhere near the equipment, and to realize automatic follow-up switching of the camera to the panoramic monitoring position through an information interaction mechanism.

[0005] In order to solve the above technical problems, the technical solution of the present invention is as follows:

[0006] In a first aspect, a method for intelligent monitoring of tunneling equipment is provided, the method comprising:

[0007] Determine a control signal according to the rotation angle information obtained by the explosion-proof AR glasses, and convert the control signal into an action command. The explosion-proof AR glasses include an angle sensor;

[0008] Responding to the action instruction and executing the action to obtain a video monitoring screen signal of the working status of the tunnel boring machine at the current angle;

[0009] Send the monitoring screen signal to the explosion-proof video acquisition control box;

[0010] The explosion-proof video acquisition control box receives the video signal and sends the video signal received by the control box to the explosion-proof CPE;

[0011] The explosion-proof CPE converts the received video signal into a wireless signal and transmits it to the explosion-proof base station;

[0012] The explosion-proof base station receives the video signal and transmits the video signal to the explosion-proof AR glasses via wireless signals. The explosion-proof AR glasses receive the video signal and display it.

[0013] Furthermore, a control signal is determined according to the rotation angle information obtained by the explosion-proof AR glasses, and the control signal is converted into an action instruction, including:

[0014] The explosion-proof PTZ camera receives control signals transmitted from the explosion-proof video acquisition control box through the built-in Ethernet interface;

[0015] After receiving the control signal, the explosion-proof pan / tilt camera analyzes the control signal and converts the control signal into an action instruction.

[0016] Further, responding to the action instruction and executing the action to obtain the video monitoring screen signal of the working status of the tunnel boring machine at the current angle includes:

[0017] The driving motor rotates the pan / tilt head at a specified angle according to the action instruction to obtain a specified angle;

[0018] After the explosion-proof pan / tilt camera rotates to the specified angle, the camera is started to obtain the video monitoring screen of the working status of the tunnel boring machine at the current angle;

[0019] AR glasses have built-in anti-shake algorithms with low power consumption, low latency, and large-angle rotation adaptability to solve the problem of video screen shaking and dizziness caused by large-scale rotation of AR glasses. After the AR glasses determine the rotation angle, they confirm it, and the explosion-proof camera video screen is fixed.

[0020] The AR glasses rotate the head according to the displayed image, and the rotation sensor detects the rotation of the head. The AR glasses issue a driving instruction to drive the camera to rotate according to the rotation, so that the image captured by the camera and displayed in the AR glasses is the rotated image.

[0021] Furthermore, the monitoring screen signal is sent to the explosion-proof video acquisition control box, including:

[0022] Convert the captured images into electronic signals;

[0023] Encoding the electronic signal to obtain an encoded data stream;

[0024] The encoded data stream is sent to the explosion-proof video acquisition control box through the network interface.

[0025] Furthermore, the explosion-proof video acquisition control box receives the video signal and sends the video signal received by the control box to the explosion-proof CPE, including:

[0026] The explosion-proof video acquisition control box receives the encoded data stream from the explosion-proof PTZ camera through the built-in network interface;

[0027] The explosion-proof video acquisition control box processes the encoded data stream to obtain a processed signal. After the signal is processed, the control box re-encodes the video signal and converts the video signal into a data signal transmitted through the network;

[0028] The explosion-proof video acquisition control box sends the data signal to the explosion-proof CPE through a network interface.

[0029] Furthermore, the explosion-proof CPE converts the received video signal into a wireless signal and transmits it to the explosion-proof base station, including:

[0030] The explosion-proof CPE receives the data signal from the explosion-proof video acquisition control box;

[0031] Decoding the data signal back into an original video signal;

[0032] Converting the original video signal into a wireless signal;

[0033] The modulated radio waves are transmitted to the explosion-proof base station.

[0034] Furthermore, the explosion-proof base station receives the video signal and transmits the video signal to the explosion-proof AR glasses via a wireless signal, and the explosion-proof AR glasses receive the video signal and display it, including:

[0035] Receive wireless signals from explosion-proof CPE;

[0036] Send the wireless signal to the explosion-proof AR glasses again;

[0037] The explosion-proof AR glasses receive the video signal and decode it to obtain the video signal;

[0038] The explosion-proof AR glasses display the received video signal on the display screen.

[0039] In a second aspect, an intelligent monitoring device for tunneling equipment includes an acquisition module and a processing module, wherein the acquisition module includes:

[0040] The explosion-proof pan-tilt camera is installed on the height adjustment frame on the top of the tunnel boring machine body, and is used for Ethernet signal A to collect panoramic video information of the working status of the tunnel boring machine and transmit the video signal to the explosion-proof video acquisition control box via Ethernet signal A; Ethernet signal A receives the AR glasses driving control signal A transmitted by the explosion-proof video acquisition control box, and the control signal A controls the rotation angle of the camera to monitor the panoramic working status of different positions of the tunnel boring machine; the processing module includes:

[0041] The explosion-proof video acquisition control box is installed on the body of the tunnel boring machine and is used for Ethernet signal A to receive the video information transmitted by the explosion-proof panoramic pan-tilt camera, and transmit the video signal to the explosion-proof CPE via Ethernet signal B; Ethernet signal B receives the AR glasses drive control signal B transmitted by the explosion-proof CPE, and calculates the AR glasses drive control signal B into the AR glasses drive control signal A, and sends the AR glasses drive control signal A to the explosion-proof panoramic pan-tilt camera via Ethernet signal A.

[0042] According to a third aspect, a computing device includes:

[0043] one or more processors;

[0044] The storage device is used to store one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the above method.

[0045] In a fourth aspect, a computer-readable storage medium stores a program, and the program implements the above method when executed by a processor.

[0046] The above solution of the present invention includes at least the following beneficial effects:

[0047] The above scheme of the present invention realizes panoramic monitoring of the state of the tunnel boring machine based on AR technology, and provides a video picture with no blind spots for the tunnel boring remote operator. The remote operator wearing AR glasses can fully and accurately see the panoramic working state of the tunnel boring machine from a first-person perspective anywhere near the equipment, and realizes automatic follow-up switching of the camera to the panoramic monitoring position through the information interaction mechanism, which provides the operator with an immersive operation experience in a more scientific and convenient way, and provides a reliable basis for the remote control of the tunnel boring machine. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 It is a flow chart of the intelligent monitoring method for tunneling equipment provided by an embodiment of the present invention.

[0049] Figure 2 It is a schematic diagram of an intelligent monitoring device for tunneling equipment provided by an embodiment of the present invention.

[0050] Figure 3It is a specific application schematic diagram of the intelligent monitoring device for tunneling equipment provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0051] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0052] like Figure 1 As shown, an embodiment of the present invention provides an intelligent monitoring method for tunneling equipment, the method comprising:

[0053] Step 11, determining a control signal according to the rotation angle information obtained by the explosion-proof AR glasses, and converting the control signal into an action instruction, wherein the explosion-proof AR glasses include an angle sensor;

[0054] Step 12, responding to the action instruction and executing the action to obtain a video monitoring screen signal of the working status of the tunnel boring machine at the current angle;

[0055] Step 13, sending the monitoring screen signal to the explosion-proof video acquisition control box;

[0056] Step 14, the explosion-proof video acquisition control box receives the video signal, and sends the video signal received by the control box to the explosion-proof CPE;

[0057] Step 15, the explosion-proof CPE converts the received video signal into a wireless signal and transmits it to the explosion-proof base station;

[0058] Step 16: The explosion-proof base station receives the video signal and transmits the video signal to the explosion-proof AR glasses via wireless signals. The explosion-proof AR glasses receive the video signal and display it.

[0059] In the embodiment of the present invention, by converting the control signal into an action instruction, the tunneling equipment can respond and execute the action quickly and accurately, thereby improving the work efficiency; enhancing the work safety, obtaining the video monitoring screen signal of the working status of the tunneling machine at the current angle, and monitoring the working status of the tunneling equipment in real time, timely discovering and handling possible risks and problems, thereby enhancing the work safety. By sending the monitoring screen signal to the explosion-proof video acquisition control box, and transmitting it through the explosion-proof CPE and the explosion-proof base station, the working status video monitoring screen signal can be transmitted to the explosion-proof AR glasses for display in real time, so that the operator can observe the working status of the tunneling equipment in real time, so as to better control the work progress and quality. The control box, CPE, base station and AR glasses are all explosion-proof designs, which can be used safely in explosive environments, greatly reducing the safety risks caused by equipment failures. The working status of the tunneling equipment can be directly observed using the explosion-proof AR glasses, without the need for additional display equipment, which is convenient and fast. In general, this intelligent monitoring method for tunneling equipment effectively improves the working efficiency and safety of the tunneling equipment through real-time video monitoring, explosion-proof design and display using AR glasses, and provides convenience for the operation and monitoring of the tunneling equipment.

[0060] In a preferred embodiment of the present invention, the above step 11 may include:

[0061] Step 111, the explosion-proof PTZ camera receives a control signal transmitted from the explosion-proof video acquisition control box through a built-in Ethernet interface;

[0062] Step 112, after receiving the control signal, the explosion-proof PTZ camera analyzes the control signal and converts the control signal into an action instruction.

[0063] In an embodiment of the present invention, real-time control feedback can be achieved by transmitting control signals through an Ethernet interface. This means that the operator can accurately control the movement of the pan-tilt camera and adjust the viewing angle and focal length in real time to meet actual needs. The Ethernet interface provides greater flexibility, and the pan-tilt camera can be remotely controlled through the network. The operator can control it at different locations without directly contacting the device, which improves the convenience and flexibility of operation. The control signal transmitted through the Ethernet interface can provide higher precision. Compared with traditional control methods such as serial ports or parallel ports, the signal transmitted by the Ethernet interface is more stable, and the movement of the pan-tilt camera can be accurately controlled to achieve more accurate positioning and tracking. The Ethernet interface can support the control of multiple pan-tilt cameras and realize centralized management of multiple devices. In this way, the operator can control multiple cameras at the same time and improve work efficiency. In summary, through the Ethernet interface in step 111, the explosion-proof pan-tilt camera can achieve beneficial effects such as real-time control, flexibility, high-precision control and scalability.

[0064] In a preferred embodiment of the present invention, the above step 12 may include:

[0065] Step 121, driving the motor to rotate the pan / tilt head at a specified angle according to the action instruction to obtain a specified angle;

[0066] Step 122, after the explosion-proof pan-tilt camera rotates to the specified angle, the camera is started to obtain the video monitoring picture of the working status of the tunnel boring machine at the current angle; the operator rotates his head according to the displayed image, and the rotation of the head drives the AR glasses to rotate. The rotation sensor detects the rotation angle of the head, and the AR glasses issues a driving instruction to drive the camera to rotate according to the rotation angle, so that the image captured by the camera is displayed in the AR glasses as the rotated image, wherein, by Determine the relationship between the final angle of the camera and the original angle and the rotation angle, where θ final is the final angle of the camera, θ t represents the target angle of the camera rotation, ω′ represents the relationship between the drive command and the sensor signal, and θ min and θ max Respectively represent the minimum and maximum angles that the camera can rotate. is an integral expression, which represents the total angle adjusted according to the relationship between the sensor signal and the drive command in the time period from 0 to T. (1-d) is a damping factor, which is used to smooth or slow down the rotation speed of the camera to prevent the camera from following the head rotation too quickly. φ represents the rotation angle of the head of the AR glasses user. g(φ) is a linear function, which can be expressed as: S=g(φ)=k×φ, where S is the sensor signal, k is a proportional constant, which represents the proportional relationship between the head rotation angle and the sensor signal, and τ represents any instant between the starting time point 0 and the ending time point T when performing integral calculation.

[0067] In the embodiment of the present invention, by driving the motor to rotate the pan-tilt according to the specified angle, the precise positioning of the pan-tilt can be achieved, and the operator can accurately align the camera with the target position to obtain the required monitoring picture; by driving the motor to rotate the pan-tilt through the action instruction, automatic control can be achieved. The operator only needs to issue an instruction, and the system can automatically complete the rotation of the pan-tilt without manual intervention, which improves the convenience and efficiency of operation; by specifying different angles, the driving motor can rotate the pan-tilt to different positions. In this way, the operator can adjust the angle of the pan-tilt according to actual needs to obtain different viewing angles and monitoring pictures. By starting the camera, the explosion-proof pan-tilt camera can obtain the video monitoring picture of the working status of the tunnel boring machine in real time, and the operator can understand the working status of the tunnel boring machine at any time, find problems in time and take corresponding measures. The monitoring picture obtained by the camera can be transmitted to the remote terminal through the network to realize remote monitoring. The operator can monitor at different locations without direct contact with the equipment, which improves the convenience and flexibility of monitoring. The monitoring picture obtained by the camera can be recorded and stored. In this way, the operator can perform long-term data analysis and recording of the working status of the tunnel boring machine.

[0068] In a preferred embodiment of the present invention, the above step 13 may include:

[0069] Step 131, converting the captured image into an electronic signal, specifically including: the optical lens at the front end of the camera is used to focus the light in the scene and guide it to the image sensor, and convert the received light into an electronic signal; when the light is irradiated onto the image sensor through the lens, each pixel (photosensitive element) on the sensor absorbs photons and generates an electric charge; in a CCD sensor, the charge moves across the entire sensor and is then read and converted into a voltage signal; in a CMOS sensor, each pixel has an amplifier that converts the charge into a voltage, allowing the CMOS sensor to achieve a faster reading speed with lower power consumption; the processed analog signal is then converted into a digital signal by an analog-to-digital converter, and the ADC converts the continuous analog voltage into a discrete digital value;

[0070] Step 132, encoding the electronic signal to obtain a coded data stream, specifically including: preprocessing the electronic signal, converting the image data from the spatial domain to another domain, using the coded area in the current frame to predict the content of the uncoded area; by comparing the content of the current frame with the adjacent frames, the encoder can identify and use temporal redundancy, thereby significantly reducing the amount of data to be encoded and transmitted; the encoder generates a series of data, including transform coefficients, motion vectors, prediction modes, etc. Finally, the encoder packages all the coded data and related information into a standard format and outputs it as a file or stream;

[0071] Step 133, sending the encoded data stream to the explosion-proof video acquisition control box through the network interface.

[0072] In an embodiment of the present invention, the captured images are converted into electronic signals and encoded, so that the image information can be transmitted in a digital form, which can reduce interference and distortion during signal transmission and ensure high-quality transmission of the images. By sending the encoded data stream to the explosion-proof video acquisition control box through the network interface, real-time transmission can be achieved, and it can be transmitted to the control box with almost no delay, so that the operator can obtain the latest monitoring images in a timely manner. By transmitting the encoded data stream through the network interface, remote monitoring can be achieved. The operator can connect to the explosion-proof video acquisition control box through the network to remotely view and control the captured images without directly contacting the equipment, thereby improving the convenience and flexibility of monitoring. By sending the encoded data stream to the explosion-proof video acquisition control box, centralized storage of data can be achieved, and the operator can store and manage the captured images for a long time, which is convenient for subsequent data analysis and playback.

[0073] In a preferred embodiment of the present invention, the above step 14 may include:

[0074] Step 141, the explosion-proof video acquisition control box receives the encoded data stream from the explosion-proof PTZ camera through the built-in network interface;

[0075] Step 142, the explosion-proof video acquisition control box processes the encoded data stream to obtain a processed signal. After the signal is processed, the control box re-encodes the video signal and converts the video signal into a data signal transmitted through the network;

[0076] Step 143: The explosion-proof video acquisition control box sends the data signal to the explosion-proof CPE through the network interface.

[0077] In the embodiment of the present invention, through the built-in network interface, the explosion-proof video acquisition control box can efficiently receive the encoded data stream from the explosion-proof pan-tilt camera, which can ensure the rapid transmission of data, reduce transmission delays, and improve transmission efficiency. The explosion-proof video acquisition control box processes the received encoded data stream to obtain a processed signal, and can optimize, compress or decode the data to improve the quality and availability of the data. When the signal processing is completed, the explosion-proof video acquisition control box re-encodes the video signal and converts it into a data signal transmitted through the network, which can meet the requirements of network transmission and improve the stability and reliability of data transmission. Sending the data signal to the explosion-proof CPE through the network interface can achieve remote access. The operator can connect to the explosion-proof CPE through the network, remotely obtain and view the video signal, and realize remote monitoring and operation.

[0078] In a preferred embodiment of the present invention, the above step 15 may include:

[0079] Step 151, the explosion-proof CPE receives the data signal from the explosion-proof video acquisition control box;

[0080] Step 152, decoding the data signal back into the original video signal;

[0081] Step 153, converting the original video signal into a wireless signal;

[0082] Step 154, transmitting the modulated radio waves to the explosion-proof base station.

[0083] In an embodiment of the present invention, the explosion-proof CPE can receive data signals from the explosion-proof video acquisition control box. In this way, reliable transmission and reception of data can be ensured to avoid data loss or damage. The explosion-proof CPE decodes the received data signal back to the original video signal, and can restore the original video content to ensure the accuracy and integrity of the data. Converting the original video signal into a wireless signal can achieve wireless transmission, get rid of the limitations of wired connections, achieve wireless transmission of video signals, and improve the flexibility and convenience of transmission. By emitting the modulated radio waves and transmitting them to the explosion-proof base station, remote transmission can be achieved, and the video signal can be transmitted within a certain range. Operators can receive and view the video signal at a location far away from the site, which improves the convenience and flexibility of monitoring.

[0084] In a preferred embodiment of the present invention, the above step 16 may include:

[0085] Step 161, receiving a wireless signal sent from an explosion-proof CPE;

[0086] Step 162, transmitting the wireless signal to the explosion-proof AR glasses again;

[0087] Step 163, the explosion-proof AR glasses receive the video signal and decode it to obtain a video signal;

[0088] Step 164, the explosion-proof AR glasses display the received video signal on a display screen.

[0089] In an embodiment of the present invention, by receiving wireless signals emitted from an explosion-proof CPE, the explosion-proof AR glasses can realize wireless reception of video signals, get rid of the limitations of wired connections, and improve the convenience and flexibility of use. The wireless signal is transmitted to the explosion-proof AR glasses again to ensure the stable transmission of the video signal. In this way, the quality and reliability of the video signal can be guaranteed to avoid signal loss or damage. After receiving the video signal, the explosion-proof AR glasses decode it to obtain the original video signal, and can restore the content of the video to ensure the accuracy and integrity of the video. The explosion-proof AR glasses display the received video signal in real time on the display screen, and the operator can watch the real-time video screen at any time and understand the situation on the scene in a timely manner.

[0090] like Figure 2 As shown, an embodiment of the present invention further provides an intelligent monitoring device 20 for tunneling equipment, comprising an acquisition module 21 and a processing module 22, wherein the acquisition module 21 comprises:

[0091] The explosion-proof pan-tilt camera is installed on the height adjustment frame on the top of the tunnel boring machine body, and is used for Ethernet signal A to collect panoramic video information of the working status of the tunnel boring machine and transmit the video signal to the explosion-proof video acquisition control box via Ethernet signal A; Ethernet signal A receives the AR glasses driving control signal A transmitted by the explosion-proof video acquisition control box, and the control signal A controls the rotation angle of the camera to monitor the panoramic working status of different positions of the tunnel boring machine; the processing module 22 includes:

[0092] The explosion-proof video acquisition control box is installed on the body of the tunnel boring machine and is used for Ethernet signal A to receive the video information transmitted by the explosion-proof panoramic pan-tilt camera, and transmit the video signal to the explosion-proof CPE via Ethernet signal B; Ethernet signal B receives the AR glasses drive control signal B transmitted by the explosion-proof CPE, and calculates the AR glasses drive control signal B into the AR glasses drive control signal A, and sends the AR glasses drive control signal A to the explosion-proof panoramic pan-tilt camera via Ethernet signal A.

[0093] Optionally, obtaining a control signal and converting the control signal into an action instruction includes:

[0094] The explosion-proof PTZ camera receives control signals transmitted from the explosion-proof video acquisition control box through the built-in Ethernet interface;

[0095] After receiving the control signal, the explosion-proof pan / tilt camera analyzes the control signal and converts the control signal into an action instruction.

[0096] Optionally, responding to the action instruction and executing the action to obtain a video monitoring screen signal of the working status of the tunnel boring machine at the current angle includes:

[0097] The driving motor rotates the pan / tilt head at a specified angle according to the action instruction to obtain a specified angle;

[0098] After the explosion-proof pan / tilt camera rotates to the specified angle, the camera is started to obtain the video monitoring screen of the working status of the tunnel boring machine at the current angle;

[0099] The AR glasses rotate the head according to the displayed image, and the rotation sensor detects the rotation of the head. The AR glasses issue a driving instruction to drive the camera to rotate according to the rotation, so that the image captured by the camera and displayed in the AR glasses is the rotated image.

[0100] Optionally, the monitoring screen signal is sent to the explosion-proof video acquisition control box, including:

[0101] Convert the captured images into electronic signals;

[0102] Encoding the electronic signal to obtain an encoded data stream;

[0103] The encoded data stream is sent to the explosion-proof video acquisition control box through the network interface.

[0104] Optionally, the explosion-proof video acquisition control box receives the video signal and sends the video signal received by the control box to the explosion-proof CPE, including:

[0105] The explosion-proof video acquisition control box receives the encoded data stream from the explosion-proof PTZ camera through the built-in network interface;

[0106] The explosion-proof video acquisition control box processes the encoded data stream to obtain a processed signal. After the signal is processed, the control box re-encodes the video signal and converts the video signal into a data signal transmitted through the network;

[0107] The explosion-proof video acquisition control box sends the data signal to the explosion-proof CPE through a network interface.

[0108] Optionally, the explosion-proof CPE converts the received video signal into a wireless signal and transmits it to the explosion-proof base station, including:

[0109] The explosion-proof CPE receives the data signal from the explosion-proof video acquisition control box;

[0110] Decoding the data signal back into an original video signal;

[0111] Converting the original video signal into a wireless signal;

[0112] The modulated radio waves are transmitted to the explosion-proof base station.

[0113] Optionally, the explosion-proof base station receives the video signal and transmits the video signal to the explosion-proof AR glasses via a wireless signal, and the explosion-proof AR glasses receive the video signal and display it, including:

[0114] Receive wireless signals from explosion-proof CPE;

[0115] Send the wireless signal to the explosion-proof AR glasses again;

[0116] The explosion-proof AR glasses receive the video signal and decode it to obtain the video signal;

[0117] The explosion-proof AR glasses display the received video signal on the display screen.

[0118] like Figure 3 As shown, in order to achieve the above-mentioned purpose, the present application also proposes an intelligent monitoring system for a tunnel boring machine, which also includes an explosion-proof pan-tilt camera, an explosion-proof video acquisition control box, an explosion-proof CPE, an explosion-proof base station and explosion-proof AR glasses.

[0119] The explosion-proof pan-tilt camera is installed on a height adjustment frame on the top of the tunnel boring machine body, and the explosion-proof pan-tilt camera has no obstruction in continuous movement of 360 degrees horizontally and 180 degrees vertically. It is used for Ethernet signal A to collect panoramic video information of the working status of the tunnel boring machine and transmit the video signal to the explosion-proof video acquisition control box via Ethernet signal A; Ethernet signal A receives the AR glasses drive control signal A transmitted by the explosion-proof video acquisition control box, and the control signal A controls the adjustment of the rotation angle of the camera to monitor the panoramic working status of different positions of the tunnel boring machine.

[0120] The explosion-proof video acquisition control box is installed on the body of the tunnel boring machine, and is used for Ethernet signal A to receive the video information transmitted by the explosion-proof panoramic PTZ camera, and transmit the video signal to the explosion-proof CPE via Ethernet signal B; Ethernet signal B receives the AR glasses drive control signal B transmitted by the explosion-proof CPE, and calculates the AR glasses drive control signal B into the AR glasses drive control signal A, and sends the AR glasses drive control signal A to the explosion-proof panoramic PTZ camera via Ethernet signal A;

[0121] The explosion-proof CPE is installed on the body of the tunnel boring machine, and is used for Ethernet signal B to receive the video signal transmitted by the explosion-proof video acquisition control box, and convert the video signal received by Ethernet signal B into a wireless signal and transmit it to the explosion-proof base station; the wireless signal receives the explosion-proof AR glasses drive control signal B transmitted by the explosion-proof base station, and sends the AR glasses drive control signal B to the explosion-proof video acquisition control box;

[0122] The wireless signals include but are not limited to 4G, 5G, and WIFI6;

[0123] The explosion-proof base station is set at the side of the excavated tunnel 50 to 100 meters behind the tunnel boring machine, and one explosion-proof base station is set every 150 to 200 meters. The wireless signal receives the video signal transmitted by the explosion-proof CPE and sends it to the explosion-proof AR glasses; the wireless signal receives the explosion-proof AR glasses drive control signal B and sends it to the explosion-proof CPE;

[0124] The explosion-proof AR glasses are composed of an AR glasses host and AR glasses. The AR glasses host is used to receive and process signals and is worn on the waist of the excavation operator or in a position that is easy to carry. The AR glasses are used to collect head rotation signals and display the display screen output by the AR glasses host. They are worn on the eyes of the excavation operator. The excavation machine operator is located anywhere covered by the explosion-proof base station network next to the excavation machine. The AR glasses host wireless signal receives the video signal transmitted by the explosion-proof base station, issues a drive control instruction and generates a drive control signal B to send to the explosion-proof base station; the AR glasses are used to collect head rotation signals and display the display screen output by the AR glasses host.

[0125] In addition, in order to achieve the above purpose, the present application also proposes an intelligent monitoring method for tunneling equipment, which specifically includes:

[0126] Explosion-proof AR glasses display monitoring images:

[0127] The explosion-proof pan-tilt camera receives the control signal A transmitted by the explosion-proof video acquisition control box through the Ethernet signal A. The control signal A includes the horizontal rotation angle signal and the vertical rotation signal of the explosion-proof pan-tilt camera. The explosion-proof pan-tilt camera performs actions according to the horizontal rotation angle signal and the vertical rotation signal value. After moving to the predetermined position, it collects the video monitoring picture of the working status of the tunnel boring machine at the current angle, and sends the current video monitoring picture signal of the working status of the tunnel boring machine to the explosion-proof video acquisition control box; the explosion-proof video acquisition control box, Ethernet signal A receives the collected video signal of the current video monitoring picture of the working status of the tunnel boring machine, and sends it to the explosion-proof CPE through Ethernet signal B; the explosion-proof CPE, Ethernet signal B receives the video signal of the current video monitoring picture of the working status of the tunnel boring machine, converts the video signal into a 4G, 5G or WIFI6 wireless signal and transmits it to the explosion-proof base station; the explosion-proof base station receives the video signal, and transmits the video signal to the explosion-proof AR glasses through the 4G, 5G or WIFI6 wireless signal, the explosion-proof AR glasses receive the video signal transmitted by the explosion-proof base station and display it; the operator can see the video monitoring picture of the working status of the tunnel boring machine at the current angle by wearing the explosion-proof AR glasses.

[0128] The explosion-proof AR glasses send a control signal B, and the explosion-proof AR glasses have a built-in angle sensor to obtain the horizontal rotation angle signal and vertical pitch angle signal of the current explosion-proof AR glasses.

[0129] The explosion-proof AR glasses are worn by the operator. After the operator starts the explosion-proof AR glasses, he activates the panoramic monitoring function button. The panoramic monitoring function button is realized by pressing the power key three times in a row. After the panoramic monitoring function is started, the operator can see the video monitoring screen of the working status of the tunnel boring machine at the current angle.

[0130] When the remote operator turns his head, the explosion-proof AR glasses rotate accordingly. The built-in angle sensor of the explosion-proof AR glasses obtains the horizontal rotation angle signal and vertical pitch angle signal of the explosion-proof AR glasses, and converts the horizontal rotation angle measurement signal and vertical pitch angle measurement signal of the explosion-proof AR glasses into control signal B. The control signal B is transmitted to the explosion-proof base station via 4G, 5G or WIFI6 wireless signals, and then the control signal B is transmitted from the explosion-proof base station to the explosion-proof CPE via 4G, 5G or WIFI6 wireless signals. The explosion-proof CPE converts the control signal B transmitted by the 4G, 5G or WIFI6 wireless signal into Ethernet signal B and sends it to the explosion-proof video acquisition control box.

[0131] The explosion-proof video acquisition control box analyzes and solves the received Ethernet signal B, and analyzes and compares it with the horizontal rotation angle signal and vertical rotation signal value of the current explosion-proof pan-tilt camera, and calculates the control signal A that drives the explosion-proof pan-tilt camera to move with the AR glasses. The control signal A includes the horizontal rotation angle signal value and the vertical rotation signal value of the explosion-proof pan-tilt camera. The control signal A is transmitted to the explosion-proof pan-tilt camera through the Ethernet signal B. The explosion-proof pan-tilt camera executes the action according to the action instruction, and realizes the video screen monitoring of the working status of the tunnel boring machine under the horizontal rotation and vertical pitch action of the AR glasses.

[0132] It should be noted that the device is a device corresponding to the above method, and all implementation methods in the above method embodiment are applicable to this embodiment and can achieve the same technical effect.

[0133] The embodiment of the present invention further provides a computing device, comprising: a processor, a memory storing a computer program, wherein when the computer program is executed by the processor, the method described above is executed. All implementations in the above method embodiment are applicable to this embodiment and can achieve the same technical effect.

[0134] The embodiment of the present invention also provides a computer-readable storage medium storing instructions, which, when executed on a computer, enable the computer to execute the method described above. All implementations in the above method embodiment are applicable to this embodiment and can achieve the same technical effect.

[0135] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0136] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0137] In the embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0138] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0139] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0140] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, ROM, RAM, magnetic disks, or optical disks.

[0141] In addition, it should be noted that in the apparatus and method of the present invention, it is obvious that each component or each step can be decomposed and / or recombined. These decompositions and / or recombinations should be regarded as equivalent schemes of the present invention. Moreover, the steps of performing the above-mentioned series of processing can naturally be performed in chronological order according to the order of description, but it is not necessary to perform them in chronological order, and some steps can be performed in parallel or independently of each other. For those of ordinary skill in the art, it is understood that all or any steps or components of the method and apparatus of the present invention can be implemented in any computing device (including processors, storage media, etc.) or a network of computing devices in hardware, firmware, software or a combination thereof, which can be achieved by those of ordinary skill in the art using their basic programming skills after reading the description of the present invention.

[0142] Therefore, the purpose of the present invention can also be achieved by running a program or a group of programs on any computing device. The computing device can be a well-known general device. Therefore, the purpose of the present invention can also be achieved by simply providing a program product containing a program code that implements the method or device. That is to say, such a program product also constitutes the present invention, and the storage medium storing such a program product also constitutes the present invention. Obviously, the storage medium can be any well-known storage medium or any storage medium developed in the future. It should also be pointed out that in the device and method of the present invention, it is obvious that each component or each step can be decomposed and / or recombined. These decompositions and / or recombinations should be regarded as equivalent schemes of the present invention. In addition, the steps of performing the above-mentioned series of processing can naturally be performed in chronological order according to the order of description, but it is not necessary to perform them in chronological order. Some steps can be performed in parallel or independently of each other.

[0143] The above is a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. An intelligent monitoring method for tunneling equipment, It is characterized in that The method comprises: Determine a control signal according to the rotation angle information obtained by the explosion-proof AR glasses, and convert the control signal into an action command. The explosion-proof AR glasses include an angle sensor; Responding to the action instruction and executing the action to obtain a video monitoring screen signal of the working status of the tunnel boring machine at the current angle; Send the monitoring screen signal to the explosion-proof video acquisition control box; The explosion-proof video acquisition control box receives the video signal and sends the video signal received by the control box to the explosion-proof CPE; The explosion-proof CPE converts the received video signal into a wireless signal and transmits it to the explosion-proof base station; The explosion-proof base station receives the video signal and transmits the video signal to the explosion-proof AR glasses via wireless signals. The explosion-proof AR glasses receive the video signal and display it.

2. The intelligent monitoring method for tunneling equipment according to claim 1, It is characterized in that Determine the control signal according to the rotation angle information obtained by the explosion-proof AR glasses, and convert the control signal into an action instruction, specifically including: The explosion-proof AR glasses have built-in anti-shake algorithms with low power consumption, low latency, and large-angle rotation adaptability to solve the problem of video screen shaking and dizziness caused by large-scale rotation of AR glasses. After the explosion-proof AR glasses obtain the rotation angle information and confirmation information, they are transmitted to the explosion-proof PTZ camera through the explosion-proof video acquisition control box. The explosion-proof PTZ camera receives control signals transmitted from the explosion-proof video acquisition control box through the built-in Ethernet interface; After receiving the control signal, the explosion-proof pan / tilt camera analyzes the control signal, converts the control signal into an action instruction, and keeps the video image fixed.

3. The intelligent monitoring method for tunneling equipment according to claim 2, It is characterized in that Responding to the action instruction and executing the action to obtain the video monitoring screen signal of the working status of the tunnel boring machine at the current angle, including: The driving motor rotates the pan / tilt head at a specified angle according to the action instruction to obtain a specified angle; After the explosion-proof pan / tilt camera rotates to the specified angle, the camera is started to obtain the video monitoring screen of the working status of the tunnel boring machine at the current angle; The rotation sensor detects the rotation of the head, and the AR glasses issue a driving instruction to drive the camera to rotate according to the rotation, so that the image captured by the camera and displayed in the AR glasses is the rotated image.

4. The intelligent monitoring method for tunneling equipment according to claim 3, It is characterized in that Send the monitoring screen signal to the explosion-proof video acquisition control box, including: Convert the captured images into electronic signals; Encoding the electronic signal to obtain an encoded data stream; The encoded data stream is sent to the explosion-proof video acquisition control box through the network interface.

5. The intelligent monitoring method for tunneling equipment according to claim 4, It is characterized in that The explosion-proof video acquisition control box receives the video signal and sends the video signal received by the control box to the explosion-proof CPE, including: The explosion-proof video acquisition control box receives the encoded data stream from the explosion-proof PTZ camera through the built-in network interface; The explosion-proof video acquisition control box processes the encoded data stream to obtain a processed signal. After the signal is processed, the control box re-encodes the video signal and converts the video signal into a data signal transmitted through the network; The explosion-proof video acquisition control box sends the data signal to the explosion-proof CPE through a network interface.

6. The intelligent monitoring method for tunneling equipment according to claim 5, It is characterized in that The explosion-proof CPE converts the received video signal into a wireless signal and transmits it to the explosion-proof base station, including: The explosion-proof CPE receives the data signal from the explosion-proof video acquisition control box; Decoding the data signal back into an original video signal; Converting the original video signal into a wireless signal; The modulated radio waves are transmitted to the explosion-proof base station.

7. The intelligent monitoring method for tunneling equipment according to claim 6, It is characterized in that The explosion-proof base station receives the video signal and transmits the video signal to the explosion-proof AR glasses via wireless signals. The explosion-proof AR glasses receive the video signal and display it, including: Receive wireless signals from explosion-proof CPE; Send the wireless signal to the explosion-proof AR glasses again; The explosion-proof AR glasses receive the video signal and decode it to obtain the video signal; The explosion-proof AR glasses display the received video signal on the display screen.

8. An intelligent monitoring device for tunneling equipment, It is characterized in that It includes an acquisition module and a processing module, and the acquisition module includes: The explosion-proof pan-tilt camera is installed on the height adjustment frame on the top of the tunnel boring machine body, and is used for Ethernet signal A to collect panoramic video information of the working status of the tunnel boring machine and transmit the video signal to the explosion-proof video acquisition control box via Ethernet signal A; Ethernet signal A receives the AR glasses driving control signal A transmitted by the explosion-proof video acquisition control box, and the control signal A controls the rotation angle of the camera to monitor the panoramic working status of different positions of the tunnel boring machine; the processing module includes: The explosion-proof video acquisition control box is installed on the body of the tunnel boring machine and is used for Ethernet signal A to receive the video information transmitted by the explosion-proof panoramic pan-tilt camera, and transmit the video signal to the explosion-proof CPE via Ethernet signal B; Ethernet signal B receives the AR glasses drive control signal B transmitted by the explosion-proof CPE, and calculates the AR glasses drive control signal B into the AR glasses drive control signal A, and sends the AR glasses drive control signal A to the explosion-proof panoramic pan-tilt camera via Ethernet signal A.

9. A computing device, It is characterized in that include: one or more processors; A storage device, used for storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a program, which, when executed by a processor, implements the method according to any one of claims 1 to 7.