Remote rescue remote sensing information processing method of biped rescue robot and related device
Through the remote rescue remote sensing information processing method of two-foot rescue robot, the remote operating system is used to obtain fire scene information, calculate the degree of disaster and determine rescue measures, solving the dangers caused by fire reignition and low information processing efficiency, and achieving safety and efficiency rescue operation.
Patent Information
- Application Number
- CN202411204163.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-29
- Publication Date
- 2024-12-06
AI Technical Summary
The resurgence of building fires has caused rescue workers to face huge dangers. Existing small robots are unable to effectively collect and process a variety of information at the fire site, resulting in low efficiency in rescue information processing.
The remote rescue remote sensing information processing method of the bipedal rescue robot is used to remotely control the bipedal rescue robot to enter the affected area through the remote operating system, obtain temperature, smoke concentration, video and audio information, calculate the degree of disaster indicators, and determine rescue measures based on the information. Ensure the safety of rescue personnel and improve information processing efficiency.
While ensuring the safety of rescue personnel, it has improved the efficiency of information processing on fire sites, effectively identified the rescue personnel and taken corresponding rescue measures, reducing the dangers brought about by rekindling.
Smart Images

Figure CN119088018A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent robots, and in particular to a remote rescue remote sensing information processing method and related devices for a bipedal rescue robot. Background Art
[0002] There is a risk of re-ignition after a fire in a building. Re-ignition refers to the situation where the fire spreads again after the fire is initially controlled due to reasons such as the site not being completely extinguished or being reignited. Rescuers face great danger when entering the fire scene. On the one hand, re-ignition may cause the situation to get out of control again, increasing the risk of injury or even death to rescuers; on the other hand, re-ignition may cause dangerous situations such as building collapse, posing a threat to rescuers entering.
[0003] Currently, rescue workers can control small robots to enter the fire scene for exploration, but small robots are greatly restricted by the terrain and cannot effectively collect and process a variety of information at the fire scene, resulting in low efficiency in rescue information processing. Summary of the invention
[0004] The embodiment of the present application provides a remote rescue remote sensing information processing method and related devices for a bipedal rescue robot, which realizes remote control of the bipedal rescue robot through a remote operation system to enter a disaster area to collect information, and then rescues the trapped persons after determining rescue measures for the trapped persons based on the information, thereby improving the efficiency of rescue information processing while ensuring the safety of the rescue personnel.
[0005] In a first aspect, an embodiment of the present application provides a remote rescue remote sensing information processing method for a bipedal rescue robot, which is applied to a remote operation system terminal for controlling a bipedal rescue robot, wherein the bipedal rescue robot is connected to the terminal of the remote operation system through a communication connection with a server of the remote operation system, and the method comprises:
[0006] Obtain first information about a disaster-stricken area collected by the bipedal rescue robot from the server, the first information including temperature information of the disaster-stricken area, smoke concentration information of the disaster-stricken area, video information of the disaster-stricken area, and audio information of the disaster-stricken area; determine a first indicator for measuring the degree of disaster in the disaster-stricken area according to the temperature information of the disaster-stricken area and the smoke concentration information of the disaster-stricken area in the first information; determine whether there are people to be rescued in the disaster-stricken area according to the video information of the disaster-stricken area and the audio information of the disaster-stricken area in the first information; detect that there are people to be rescued in the disaster-stricken area, and determine target rescue measures according to the first indicator and a preset threshold value of the degree of disaster; and send a first instruction to the bipedal rescue robot through the server, the first instruction being used to instruct the bipedal rescue robot to rescue the people to be rescued according to the target rescue measures.
[0007] In a second aspect, an embodiment of the present application provides a remote rescue remote sensing information processing device for a bipedal rescue robot, comprising:
[0008] An acquisition module, used to acquire first information of the disaster-stricken area collected by the bipedal rescue robot from the server, wherein the first information includes the temperature of the disaster-stricken area, the smoke concentration of the disaster-stricken area, and the video information and audio information of the disaster-stricken area;
[0009] A processing module is used to determine a first indicator for measuring the degree of disaster in the disaster-stricken area based on the temperature information of the disaster-stricken area and the smoke concentration information of the disaster-stricken area in the first information; and to determine whether there are people to be rescued in the disaster-stricken area based on the video information of the disaster-stricken area and the audio information of the disaster-stricken area in the first information; and to detect that there are people to be rescued in the disaster-stricken area, and determine target rescue measures based on the first indicator and a preset disaster degree threshold; and to send a first instruction to the bipedal rescue robot through the server, the first instruction being used to instruct the bipedal rescue robot to rescue the people to be rescued according to the target rescue measures.
[0010] In a third aspect, an embodiment of the present application provides a computer, including:
[0011] A memory, a processor, and an executable program code stored in the memory and executable on the processor, wherein the processor executes the method as described in any one of the first aspects when executing the executable program code.
[0012] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which is stored a remote rescue remote sensing information processing program for a bipedal rescue robot, wherein the remote rescue remote sensing information processing program for a bipedal rescue robot includes execution instructions, and the execution instructions are used to execute a method as described in any one of the first aspects.
[0013] In a fifth aspect, the present application provides a computer program product, which, when executed by a processor, is used to implement the method as described in any one of the first aspects.
[0014] By implementing the embodiment of the present application, the teleoperation system terminal first obtains the first information of the disaster area collected by the bipedal rescue robot from the server, the first information includes the temperature information of the disaster area, the smoke concentration information of the disaster area, and the video information and audio information of the disaster area; then, the first indicator for measuring the degree of disaster in the disaster area is determined according to the temperature information of the disaster area and the smoke concentration information of the disaster area in the first information; then, whether there are people to be rescued in the disaster area is determined according to the video information of the disaster area and the audio information of the disaster area in the first information; then, it is detected that there are people to be rescued in the disaster area, and the target rescue measures are determined according to the first indicator and the preset threshold of the degree of disaster; finally, the first instruction is sent to the bipedal rescue robot through the server, and the first instruction is used to instruct the bipedal rescue robot to rescue the rescue personnel according to the target rescue measures. The teleoperation system remotely controls the bipedal rescue robot to enter the disaster area to collect information, and then rescues the trapped personnel after determining the rescue measures for the trapped personnel according to the information, thereby improving the efficiency of rescue information processing while ensuring the safety of the rescue personnel. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the background technology, the drawings required for use in the embodiments of the present application or the background technology will be described below.
[0016] Figure 1 It is an architecture diagram of a remote rescue remote sensing information processing system of a bipedal rescue robot provided in an embodiment of the present application;
[0017] Figure 2 It is a flow chart of a remote rescue remote sensing information processing method of a biped rescue robot provided in an embodiment of the present application;
[0018] Figure 3 This is a schematic diagram of an operation interface of a remote operation system terminal provided in an embodiment of the present application;
[0019] Figure 4 This is a schematic diagram of a scene of a bipedal rescue robot extinguishing a fire provided by an embodiment of the present application;
[0020] Figure 5 This is a schematic diagram of an operation interface of a bipedal rescue robot for rescuing trapped persons provided in an embodiment of the present application;
[0021] Figure 6 This is a schematic diagram of an operation interface for a bipedal rescue robot walking provided by an embodiment of the present application;
[0022] Figure 7 is a top view of a bipedal rescue robot circumventing an obstacle provided by an embodiment of the present application;
[0023] Figure 8It is a structural diagram of a remote rescue remote sensing information processing device of a bipedal rescue robot provided in an embodiment of the present application;
[0024] Fig. 9 It is a structural diagram of a computer provided in an embodiment of the present application. DETAILED DESCRIPTION
[0025] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.
[0026] The terms "first", "second", "third", etc. in the specification, claims and drawings of this application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.
[0027] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.
[0028] There is a risk of re-ignition after a fire in a building. Re-ignition refers to the situation where the fire spreads again after the fire is initially controlled due to reasons such as the site not being completely extinguished or being reignited. Rescuers face great danger when entering the fire scene. On the one hand, re-ignition may cause the situation to get out of control again, increasing the risk of injury or even death to rescuers; on the other hand, re-ignition may cause dangerous situations such as building collapse, posing a threat to rescuers entering. At present, rescuers can control small robots to enter the fire scene for exploration, but small robots are greatly restricted by the terrain and cannot effectively collect and process various information at the fire scene, resulting in low efficiency in rescue information processing.
[0029] In view of the above problems, the embodiment of the present application provides a remote rescue remote sensing information processing method and related device of a bipedal rescue robot. The remote operation system terminal first obtains the first information of the disaster area collected by the bipedal rescue robot from the server, and the first information includes the temperature information of the disaster area, the smoke concentration information of the disaster area, and the video information and audio information of the disaster area; then, the first indicator for measuring the degree of disaster in the disaster area is determined according to the temperature information of the disaster area and the smoke concentration information of the disaster area in the first information; then, whether there are people to be rescued in the disaster area is determined according to the video information of the disaster area and the audio information of the disaster area in the first information; then, it is detected that there are people to be rescued in the disaster area, and the target rescue measures are determined according to the first indicator and the preset threshold of the degree of disaster; finally, the first instruction is sent to the bipedal rescue robot through the server, and the first instruction is used to instruct the bipedal rescue robot to rescue the rescue personnel according to the target rescue measures. The bipedal rescue robot is remotely controlled by the remote operation system to enter the disaster area to collect information, and then the rescue measures for the trapped personnel are determined according to the information to rescue the trapped personnel, thereby improving the efficiency of rescue information processing while ensuring the safety of the rescue personnel.
[0030] See also Figure 1 , Figure 1 1 is an architecture diagram of a remote rescue remote sensing information processing system for a bipedal rescue robot provided in an embodiment of the present application. The remote rescue remote sensing information processing system 100 for the bipedal rescue robot includes a terminal 101 of a remote operation system, a server 102 of the remote operation system, and a bipedal rescue robot 103. The terminal 101 of the remote control center is operated by a rescuer, and the rescuer communicates and transmits instructions with the server 102 through a remote control device (such as a joystick, a handle, etc.), and the server 102 then transmits the received information and instructions to the bipedal rescue robot 103. The main components of the terminal 101 include an operation interface, a remote control device, a communication module, and a data processing module. The operation interface is used to display relevant information of the bipedal rescue robot 103 and environmental information of the disaster area collected by the bipedal rescue robot 103; the remote control device is used for rescuers to control the bipedal rescue robot 103 in real time through manual operation; the terminal 101, the server 102, and the bipedal rescue robot 103 of the remote control center are all equipped with a wireless communication module (such as WI FI, Bluetooth or dedicated RF module), the wireless communication module is used to transmit instructions and receive information sent back by each module of the bipedal rescue robot 103; the data processing module is used to receive and analyze the environmental data obtained from the bipedal rescue robot, and present the environmental data on the operation interface.
[0031] Among them, see Figure 3 , Figure 3 is a schematic diagram of an operation interface of a remote operation system terminal provided in an embodiment of the present application, such as Figure 3As shown, the operation interface is used to display the real-time video collected by the bipedal rescue robot 103 through the visual sensor, and the first operation button A and the second operation button E are respectively arranged in the lower left corner and the lower right corner of the operation interface, the first operation button A is used to control the bipedal rescue robot 103 to turn left and right, and the second operation button E is used to control the bipedal rescue robot 103 to move forward and backward. A status bar C is arranged in the upper right corner of the operation interface, and the status bar C is used to display the current time, communication connection status, and information such as the power level of the remote operation system terminal. A function button D is arranged in the status bar C, and by clicking the function button D of the operation interface, the bipedal rescue robot status setting interface B can be opened in the middle of the operation interface. The user can change and set the mode of the bipedal rescue robot 103, the display method of the real-time video collected by the bipedal rescue robot 103 through the visual sensor, the function of each operation button, the button layout of the operation interface, etc. in the bipedal rescue robot status setting interface B.
[0032] Among them, the bipedal rescue robot 103 is a robot designed and constructed to be similar to the structure of human legs. It imitates the gait and movement of humans, and realizes walking, standing and performing various tasks through two mechanical legs with joints. The bipedal robot is usually composed of multiple electric joints, sensors, control systems and energy systems. Multiple electric joints can simulate the degrees of freedom of human joints, and balance, walking and other movements are achieved through precise control. Sensors are used to measure environmental information, such as visual sensors, depth sensors, tactile sensors and inertial measurement units (IMUs), etc. The control system is responsible for calculating and sending instructions to maintain balance, adjust gait and perform other tasks. The energy system provides the robot with the required electricity or other forms of energy. Preferably, the bipedal rescue robot 103 can be a humanoid robot.
[0033] Based on this, the present application provides a remote rescue remote sensing information processing method and related devices for a bipedal rescue robot. The present application is described in detail below in conjunction with the accompanying drawings.
[0034] See also Figure 2 , Figure 2 : is a flow chart of a remote rescue remote sensing information processing method of a bipedal rescue robot provided in an embodiment of the present application, such as Figure 2 As shown, the method comprises the following steps:
[0035] S201, obtaining first information of a disaster-stricken area collected by the bipedal rescue robot from the server;
[0036] Among them, the first information is used to help rescue personnel intuitively judge the situation in the disaster-stricken area. The first information includes the temperature of the disaster-stricken area, the smoke concentration of the disaster-stricken area, and the video information and audio information of the disaster-stricken area. The bipedal rescue robot can obtain the environmental information of the disaster-stricken area through its own multiple sensors. Specifically, the sensors of the bipedal rescue robot may include temperature sensors, gas concentration sensors, smoke detectors, cameras, sound sensors, and distance sensors, etc.
[0037] Among them, smoke detectors are used to detect smoke particles in the air, helping to find the location of the fire source and issue an early alarm; temperature sensors are used to monitor changes in ambient temperature. In a fire, they can quickly grasp the temperature distribution and avoid damage or danger caused by high-temperature areas; gas concentration sensors are used to detect the concentration levels of harmful gases in the air, such as CO, CO2, etc., and provide environmental safety assessment data; visual sensors, such as cameras, can capture images or videos, and use image processing technology to achieve target detection, recognition and tracking functions, assisting rescue personnel in obtaining real-time visual information; sound sensors, such as microphone arrays, are used to monitor surrounding sounds, including the sound of burning flames, human voices, etc., and use signal processing technology to determine whether there is a distress signal; distance sensors can obtain the distance information between the robot and obstacles, and achieve obstacle avoidance and path planning.
[0038] S202, determining a first indicator for measuring the degree of disaster in the disaster-stricken area according to the temperature information of the disaster-stricken area and the smoke density information of the disaster-stricken area in the first information;
[0039] Among them, the bipedal robot can continuously collect information in the disaster-stricken area by walking in the disaster-stricken area, and then preprocess the information in the disaster-stricken area. The preprocessing operations include data cleaning, smoothing, difference, standardization / normalization or anomaly detection, etc., and finally obtain the first information. For example, when the bipedal robot walks in the disaster-stricken area, it can cluster the temperature information of the disaster-stricken area and the smoke concentration information of the disaster-stricken area collected from different areas, remove abnormal data in the temperature information of the disaster-stricken area and the smoke concentration information of the disaster-stricken area, and then determine the first information by taking the average or the like.
[0040] In a possible implementation, determining a first indicator for measuring the extent of disaster in the disaster-stricken area according to the temperature information of the disaster-stricken area and the smoke density information of the disaster-stricken area in the first information includes:
[0041] Obtain a first difference between the temperature information and a preset temperature threshold; obtain a first product of the first difference and a preset temperature coefficient; obtain a second difference between the smoke concentration information and the preset smoke concentration threshold; obtain a second product of the second difference and a preset smoke concentration coefficient; obtain a sum of the first product and the second product, the sum being a first indicator for measuring the extent of disaster in the disaster-stricken area.
[0042] Among them, a temperature threshold T1 is set, and the unit of the temperature threshold is Celsius by default. The smoke concentration threshold S1, the smoke concentration can be PM2.5 (particles with a diameter of less than or equal to 2.5 microns) concentration or PM10 (particles with a diameter of less than or equal to 10 microns) concentration. T1 and S1 are the temperature and smoke concentration in the air under normal conditions (no disasters such as fire). T1 and S1 can be adjusted according to the application scenario. After the robot obtains the temperature T2 and the smoke concentration S2 in the affected area, the calculation formula of the first indicator γ used to measure the degree of disaster in the affected area is as follows:
[0043] γ=K1(T2-T1)+K2(S2-S1), where K1 and K2 are temperature coefficient and smoke concentration coefficient respectively, which can determine the influence of temperature and smoke concentration on the degree of disaster. The larger γ is, the greater the degree of disaster. Generally, the difference between smoke concentration in a fire scene and that in a normal situation is large, which can reach hundreds or even thousands. Therefore, the order of magnitude of K2 is generally lower than that of K1. For example, when K1 is 1, K2 is 0.1.
[0044] For example, the temperature threshold T1 is 30°C and the smoke concentration S1 is 30ug / m 3 According to the first information collected by the bipedal rescue robot, it is determined that the temperature T2 in the disaster-stricken area is 50°C, the smoke concentration S2 in the disaster-stricken area is 200ug / m3, K1 is 1, and K2 is 0.1. At this time, according to the calculation formula of the disaster degree, the first indicator γ is 1x(50-30)+0.1x(200-30)=37.
[0045] It can be seen that in this example, by calculating the first indicator that can measure the degree of disaster in the disaster-stricken area based on the temperature of the disaster-stricken area, the smoke concentration in the disaster-stricken area, and the normal temperature and smoke concentration, it is beneficial to ensure the accuracy of subsequent assessments of the degree of disaster in the disaster-stricken area, thereby facilitating the subsequent adoption of corresponding rescue measures based on the calculated degree of disaster.
[0046] S203, determining whether there are people waiting for rescue in the disaster-stricken area according to the video information and audio information of the disaster-stricken area in the first information;
[0047] Among them, the first information includes not only the temperature of the disaster-stricken area and the smoke concentration in the disaster-stricken area, but also image information collected by the bipedal rescue robot through the visual sensor and audio information collected by the audio sensor.
[0048] Among them, before the terminal of the remote operation system obtains the image information and audio information of the disaster area collected by the bipedal rescue robot from the remote operation system server, the remote operation system server can first pre-process the collected image information and audio information. The pre-processing operations taken on the image information include image denoising, image enhancement, image resizing and feature extraction, etc., and the pre-processing operations taken on the audio information include noise reduction, audio enhancement, spectral analysis and speech recognition to text conversion, etc. The pre-processing operations can be used alone or in combination, and there is no limitation here.
[0049] For example, assuming that the bipedal rescue robot collects a blurry and noisy image from the disaster area through its own surveillance camera, the teleoperation system server can first apply a Gaussian filter to remove some of the noise; the Gaussian filter blurs the image by applying a Gaussian function around each pixel of the image and removes smaller noise points in the image. After removing the noise, the image can be enhanced to improve its visual quality and details, including adjusting the brightness, contrast, and color balance of the image. Specifically, the overall contrast of the image can be enhanced by histogram equalization, or the contrast of different regions can be adjusted by applying an adaptive contrast enhancement algorithm. The processed image can be further used for target detection, region recognition, or other analysis tasks, using computer vision algorithms to detect building damage in the image or identify the location of people.
[0050] In one possible implementation, determining whether there are people waiting to be rescued in the disaster-stricken area based on the video information and audio information of the disaster-stricken area in the first information includes: determining a first result based on the audio information of the disaster-stricken area; determining a second result based on the video information of the disaster-stricken area; and determining that there are people waiting to be rescued in the disaster-stricken area when the first result or the second result is that there are people waiting to be rescued in the disaster-stricken area.
[0051] Specifically, determining a first result based on the audio information of the disaster-stricken area includes: obtaining a first audio result based on whether there is a person sending the first audio information in the audio information of the disaster-stricken area; obtaining a second audio result based on whether there is a regular second audio information in the audio information of the disaster-stricken area; when the first audio result is that there is a person sending the first audio information in the audio information of the disaster-stricken area, or the second audio result is that there is a regular second audio information in the audio information of the disaster-stricken area, it is determined that the first result is that there are people waiting to be rescued in the disaster-stricken area.
[0052] Among them, the remote operation system server can first pre-process the collected audio information, and then the remote operation system server or the terminal of the remote operation system uses a human voice detection algorithm to analyze the preprocessed audio information to obtain a first audio result; at the same time, the remote operation system server or the terminal of the remote operation system performs pattern analysis on the preprocessed audio data to detect whether there is a regular sound pattern, such as a distress signal, continuous sound or fixed frequency sound, etc., to obtain a second audio result.
[0053] Among them, the rescue personnel of the remote control terminal can directly judge based on the audio data to detect whether there is a regular sound pattern, such as a distress signal, continuous sound or sound of a fixed frequency, and obtain a second audio result.
[0054] Among them, the human voice detection algorithm is a technology used to identify and extract the human voice part of the audio signal. It can identify the human voice component in the sound signal based on the sound spectrum, energy distribution and other characteristics. After determining that there is a human voice or a sound of a fixed frequency, the first result is determined to be that there are people waiting to be rescued in the disaster area. After that, the direction and position of the specific sound signal can be further determined through the sound source localization algorithm.
[0055] Exemplarily, a short-time energy method based on energy threshold is used as a human voice detection algorithm. The algorithm calculates the short-time energy of the audio signal in time and compares it with a preset energy threshold. When the short-time energy exceeds the threshold, it is determined to contain a human voice part; otherwise, it is determined to be a non-human voice part. This method is simple and easy to implement, and is suitable for relatively clear and low background noise situations. In a disaster-stricken area, a bipedal rescue robot collects a recording containing rescue shouts and background noise. After the remote operation system server preprocesses the recording, the remote operation system terminal can use a short-time energy method based on energy threshold to detect whether there is a human voice part in it. Specifically, the recording signal is first framed, and then the short-time power or amplitude square of the signal in each frame is calculated as the local energy, and then a suitable energy threshold is set. If the local energy in a frame exceeds the energy threshold, it is judged that the recording contains human voice; otherwise, it is deemed that the recording does not contain human voice.
[0056] Among them, pattern analysis is a method used to discover, describe and understand the potential structures and regularities in data. In this scheme, pattern analysis is used to detect whether there are regular sound patterns in the audio information collected by the bipedal rescue robot.
[0057] Exemplarily, cluster analysis is used as a pattern analysis method. A bipedal rescue robot collects a recording in a disaster area. After the remote operation system server pre-processes the recording, the remote operation system terminal can use cluster analysis to find groups with similar motion patterns or path behaviors. First, the distance between each pair of trajectories is calculated according to the Euclidean distance metric, and then the clustering algorithm is applied to divide the trajectories into multiple clusters. Each cluster represents a group with common motion characteristics or target behavior patterns, such as fixed-frequency sounds, continuous vocalizations, etc.
[0058] It can be seen that in this example, by analyzing the audio information of the disaster-stricken area and combining the first audio result and the second audio result, a comprehensive assessment of the situation of the rescue personnel can be provided, the accuracy of the judgment can be improved, and misjudgment or missed judgment can be avoided as much as possible.
[0059] In one possible implementation, determining a second result based on the video information of the disaster-stricken area includes: obtaining a first video result based on whether there is first video information containing people in the video information of the disaster-stricken area; obtaining a second video result based on whether there is second video information containing a distress sign in the video information of the disaster-stricken area; when the first video result is that there is first video information containing people in the video information of the disaster-stricken area, or the second video result is that there is second video information containing a distress sign in the video information of the disaster-stricken area, it is determined that the second result is that there are people waiting to be rescued in the disaster-stricken area.
[0060] Among them, the distress sign can be a flashing message emitted by a flash light or laser light, a high-brightness object in a conspicuous position, a distress message in the form of text or pattern, etc. Specifically, the distress message includes words such as "SOS", "HELP", "Help" or patterns related to distress, etc.
[0061] Among them, the rescue personnel of the remote operation system terminal can directly make a judgment based on the video information of the disaster-stricken area, detect whether there are people or distress signs in the video information of the disaster-stricken area, and obtain the second result.
[0062] Among them, the hotspot detection algorithm can be based on threshold segmentation, Gaussian mixture model, morphological operation and machine learning methods, etc. In actual use, multiple algorithms can be combined to achieve hotspot detection to ensure the accuracy of hotspot detection.
[0063] Among them, the bipedal rescue robot can use computer vision technology to perform face detection on the collected image information to obtain a second result. The face detection method can be facial feature extraction, pattern matching or deep learning algorithm. The bipedal rescue robot can also use a posture estimation algorithm to analyze the body contour and joint position in the image information to determine whether there are people to be rescued.
[0064] Among them, the bipedal rescue robot can also obtain thermal imaging image data of different temperature areas in the disaster area through thermal imaging cameras, and determine the people to be rescued through hotspot detection algorithms.
[0065] It can be seen that in this example, combining the detection results of audio and image helps rescuers to more comprehensively assess the situation at the fire scene, which is conducive to improving the accuracy of judging whether there are people to be rescued at the fire scene.
[0066] S204, detecting that there are people to be rescued in the disaster-stricken area, and determining target rescue measures according to the first indicator and a preset disaster severity threshold;
[0067] In a possible implementation, determining a target rescue measure according to the first indicator and a preset disaster severity threshold includes:
[0068] When it is detected that the first indicator is less than a preset disaster severity threshold, the target rescue measure is determined to be the first rescue measure, and the first rescue measure is used to eliminate the source of the disaster; when it is detected that the first indicator is greater than or equal to the preset disaster severity threshold, the target rescue measure is determined to be the second rescue measure, and the second rescue measure is used to rescue personnel.
[0069] Among them, the bipedal rescue robot can obtain a first indicator for measuring the degree of disaster in the disaster-stricken area based on the collected first information, and compare the obtained first indicator with a preset disaster degree threshold. When the first indicator is less than the preset disaster degree threshold, it is considered that the current disaster degree is low, and the target rescue measure is the first rescue measure for eliminating the source of the disaster. The first rescue measure may be using a fire extinguisher to eliminate the source of fire, using refractory materials to isolate the source of fire, etc.; when the first indicator is not less than the preset disaster degree threshold, it is considered that the current disaster degree is high, and the target rescue measure is the second rescue measure for rescuing personnel. The second rescue measure may be that the bipedal rescue robot carries the trapped persons on its back, holds the trapped persons horizontally, and drags the trapped persons, etc.
[0070] Among them, the bipedal rescue robot needs to protect the trapped people from secondary injuries as much as possible when taking rescue measures.
[0071] Among them, see Figure 4 , Figure 4 FIG. 1 is a schematic diagram of a scene of a bipedal rescue robot extinguishing a fire provided in an embodiment of the present application. Figure 4 As shown, when the first indicator is less than the preset disaster severity threshold, it is determined that the fire damage severity is low, and the rescue personnel can issue instructions through the terminal of the remote operation system to control the bipedal rescue robot to directly eliminate the fire source through the fire extinguisher and other equipment it carries, thereby solving the problem.
[0072] Exemplarily, the preset disaster severity threshold is 50, the temperature threshold T1 is 30°C, the smoke concentration S1 is 10ug / m3, and the bipedal rescue robot obtains the temperature T2 in the disaster-stricken area and the smoke concentration S2 in the air in the first information as 40°C and 400ug / m3 respectively, K1 and K2 are 1 and 0.1 respectively. At this time, according to the calculation formula of the first indicator, the first indicator γ is 49, and the first indicator 49 is greater than the preset disaster severity threshold 50. It is considered that the disaster severity is low at this time, and the target rescue measure is determined to be the first rescue measure. The bipedal rescue robot can directly eliminate the fire source by carrying equipment such as fire extinguishers.
[0073] Among them, see Figure 5 , Figure 5 Schematic diagram of an operation interface of a bipedal rescue robot for rescuing trapped persons provided in an embodiment of the present application. Figure 5 As shown, when the first indicator is not less than the preset disaster severity threshold, it is considered that the current disaster severity is high, and the bipedal rescue robot needs to directly rescue the trapped persons. The rescuer can determine in the remote operation system terminal that the bipedal rescue robot rescues the trapped persons by carrying the trapped persons and escaping from the disaster area. At this time, the rescuer can obtain the real-time posture of the bipedal rescue robot on the left side of the display interface of the remote operation system terminal, and rotate the real-time posture of the bipedal rescue robot by adjusting the adjustment button G set below the area for displaying the real-time posture of the bipedal rescue robot. The parameter box F on the right side of the display interface of the remote operation system terminal corresponds to the display of multiple parameters of the current bipedal rescue robot, including but not limited to The parameters include the position of each joint point of the bipedal rescue robot, the joint angle, the orientation and rotation angle of the bipedal rescue robot, and the head status information of the bipedal rescue robot. At the same time, the parameter box F includes the X frame speed of the current bipedal rescue robot (the moving speed of the bipedal rescue robot in the front and back directions on the plane) and the Y frame speed of the bipedal rescue robot (the moving speed of the bipedal rescue robot in the left and right directions on the plane). Rescuers can directly adjust the above multiple parameters in the parameter box F. The current three-dimensional space coordinate position of the bipedal rescue robot is usually represented by (x, y, z). The current orientation and rotation angle of the bipedal rescue robot can be described using Euler angles, quaternions or rotation matrices.
[0074] For example, the preset disaster severity threshold is 30, the temperature threshold T1 is 30°C, the smoke concentration S1 is 10ug / m3, and the temperature T2 and the smoke concentration S2 in the air in the disaster area obtained by the bipedal rescue robot in the first information are 50°C and 500ug / m 3, K1 and K2 are 1 and 0.1 respectively. At this time, according to the calculation formula of the first indicator, the first indicator γ is 69. The first indicator 69 is greater than the preset disaster degree threshold 30. It is considered that the disaster degree is high at this time, and the target rescue measure is determined to be the second rescue measure. The bipedal rescue robot carries the trapped persons to help them escape from the disaster area.
[0075] It can be seen that in this example, the rescue measures are determined by comparing the first indicator and the preset disaster severity threshold. When the fire severity is low, the fire source is directly eliminated by carrying fire extinguishers and other equipment; when the fire severity is high, measures are taken to help the rescue personnel evacuate the disaster area, which can achieve a rapid response to the disaster and ensure the personal safety of the trapped people.
[0076] S205, sending a first instruction to the bipedal rescue robot through the server, wherein the first instruction is used to instruct the bipedal rescue robot to rescue the person to be rescued according to the target rescue measure;
[0077] It can be seen that in this example, the bipedal rescue robot is remotely controlled by the teleoperation system to enter the disaster area to collect information, and then rescue the trapped people after determining the rescue measures for the trapped people based on the information, thereby improving the efficiency of rescue information processing while ensuring the safety of the rescuers.
[0078] In a possible implementation, the method further includes:
[0079] Based on the video information of the disaster area collected by the bipedal rescue robot from the server, it is judged whether there are obstacles in the walking path of the bipedal rescue robot; when it is detected that there are obstacles in the walking path of the bipedal rescue robot, it is judged whether the height of the obstacle is lower than a preset height threshold; when it is detected that the height of the obstacle is lower than the preset height threshold, a second instruction is sent to the bipedal rescue robot through the server, and the second instruction is used to instruct the bipedal rescue robot to climb over the obstacle; when it is detected that the height of the obstacle is not lower than the preset height threshold, a third instruction is sent to the bipedal rescue robot through the server, and the third instruction is used to instruct the bipedal rescue robot to bypass the obstacle.
[0080] Among them, the height of the obstacle can be determined by the remote operation system terminal based on information collected by the depth sensor of the bipedal rescue robot, stereo vision constructed by multiple cameras, information collected by the ultrasonic sensor or information collected by the infrared sensor.
[0081] Among them, see Figure 6 , Figure 6 Schematic diagram of an operation interface of a bipedal rescue robot walking provided by an embodiment of the present application. Figure 6As shown, the bipedal rescue robot can collect video information in real time according to the visual sensor during walking. After receiving the information at the remote operation system terminal, the rescue personnel determine whether there is an obstacle in the walking path of the bipedal rescue robot. After determining that there is an obstacle F in the walking path of the bipedal rescue robot, the height of the obstacle F can be determined to be H according to the information collected by the infrared sensor or the visual sensor. The height H of the obstacle F is higher than the preset height threshold H1. At this time, the rescue personnel send a third instruction to the bipedal rescue robot through the server at the remote operation system terminal to instruct the bipedal rescue robot to bypass the obstacle and continue walking.
[0082] Specifically, see Figure 7 , Figure 7 FIG. 1 is a top view of a bipedal rescue robot bypassing an obstacle provided by an embodiment of the present application. Figure 7 As shown, the original walking path of the bipedal rescue robot is path A1. During the walking process, an obstacle B is detected, and the height of obstacle B is higher than the preset height threshold. Therefore, after the remote operation system terminal sends the third instruction through the server, the bipedal rescue robot bypasses obstacle B, walks along path A2, and then continues to return to the original walking path A1.
[0083] Among them, the robot's path planning algorithm can be A-star algorithm, Dijkstra algorithm, Rapid Exploring Random Tree (RRT) and Potential Field algorithm (Potent ia l Field), etc. The robot's walking path can also be directly specified by the terminal of the remote operation system according to the constructed map.
[0084] It can be seen that in this example, obstacles on the walking path are judged and detected based on video information, and corresponding instructions are sent to the bipedal rescue robot when the height of the obstacle is higher than the preset height threshold, so that the bipedal robot can directly bypass the obstacle, which helps to improve the working efficiency of the bipedal robot.
[0085] In one possible implementation, it is determined whether the width of the walking path of the bipedal rescue robot exceeds a first width threshold based on the video information of the disaster area collected by the bipedal rescue robot from the server; when it is detected that the width of the walking path of the bipedal rescue robot exceeds the first width threshold, a fourth instruction is sent to the bipedal rescue robot through the server, and the fourth instruction is used to instruct the bipedal rescue robot to walk along the original walking path; when it is detected that the width of the walking path of the bipedal rescue robot does not exceed the first width threshold, it is determined whether the width of the walking path of the bipedal rescue robot exceeds a second width threshold; when it is detected that the width of the walking path of the bipedal rescue robot exceeds the second width threshold, a fifth instruction is sent to the bipedal rescue robot through the server, and the fifth instruction is used to instruct the bipedal rescue robot to walk sideways along the original walking path.
[0086] Specifically, the humanoid robot is equipped with sensors or cameras for monitoring the width of the target travel path in real time. The sensors can measure the distance between obstacles on both sides and compare it with the size of the robot itself. Based on the width detection result and the preset width threshold, the remote operation system terminal will send different instructions to the robot through the server. If it is detected that the travel path is slightly narrower than the robot itself but can meet the needs of the robot to pass sideways, a decision will be sent for the bipedal rescue robot to walk sideways along the original walking path.
[0087] Among them, the first width threshold and the second width threshold can be set by the rescue personnel in the remote operation system terminal. The bipedal rescue robot can also crawl through some lower height passages. Specifically, in narrow passages in different environments, such as aisles, doorways, etc., different instructions can be selected to control the bipedal rescue robot to adapt to narrow passages of different degrees, shapes and positions.
[0088] It can be seen that in this example, obstacles on the walking path are judged and detected based on video information, and corresponding instructions are sent to the bipedal rescue robot according to the relationship between the obstacle width and the first width threshold and the second width threshold, so that the bipedal robot can walk according to the original path, which helps to improve the working efficiency of the bipedal robot.
[0089] See also Figure 8 , Figure 8 is a structural diagram of a remote rescue remote sensing information processing device of a bipedal rescue robot provided in an embodiment of the present application, such as Figure 8 As shown, the remote rescue remote sensing information processing device 800 of the bipedal rescue robot includes:
[0090] An acquisition module 801 is used to acquire first information of the disaster-stricken area collected by the bipedal rescue robot from the server, wherein the first information includes the temperature of the disaster-stricken area, the smoke concentration of the disaster-stricken area, and the video information and audio information of the disaster-stricken area;
[0091] Processing module 802 is used to determine a first indicator for measuring the degree of disaster in the disaster-stricken area based on the temperature information of the disaster-stricken area and the smoke concentration information of the disaster-stricken area in the first information; and to determine whether there are people to be rescued in the disaster-stricken area based on the video information of the disaster-stricken area and the audio information of the disaster-stricken area in the first information; and to detect that there are people to be rescued in the disaster-stricken area, and determine target rescue measures based on the first indicator and a preset disaster degree threshold; and to send a first instruction to the bipedal rescue robot through the server, and the first instruction is used to instruct the bipedal rescue robot to rescue the people to be rescued according to the target rescue measures.
[0092] In a possible implementation, in terms of determining a first indicator for measuring the degree of disaster in the disaster-stricken area based on the temperature information of the disaster-stricken area and the smoke concentration information of the disaster-stricken area in the first information, the acquisition module 801 is specifically used to: obtain a first difference between the temperature information of the disaster-stricken area and a preset temperature threshold; obtain a first product of the first difference and a preset temperature coefficient; obtain a second difference between the smoke concentration information of the disaster-stricken area and the preset smoke concentration threshold; obtain a second product of the second difference and a preset smoke concentration coefficient; obtain the sum of the first product and the second product, and the sum is the first indicator for measuring the degree of disaster in the disaster-stricken area.
[0093] In one possible implementation, in terms of determining whether there are people waiting to be rescued in the disaster-stricken area based on the video information and audio information of the disaster-stricken area in the first information, the processing module 802 is specifically used to: determine a first result based on the audio information of the disaster-stricken area in the first information; determine a second result based on the video information of the disaster-stricken area in the first information; and determine that there are people waiting to be rescued in the disaster-stricken area when it is detected that the first result or the second result is that there are people waiting to be rescued in the disaster-stricken area.
[0094] In one possible implementation, in terms of determining the first result based on the audio information of the disaster-stricken area in the first information, the processing module 802 is specifically used to: obtain a first audio result based on whether there is a person sending the first audio information in the audio information of the disaster-stricken area; obtain a second audio result based on whether there is a regular second audio information in the audio information of the disaster-stricken area; when the first audio result is that there is a person sending the first audio information in the audio information of the disaster-stricken area, and / or the second audio result is that there is a regular second audio information in the audio information of the disaster-stricken area, determine that the first result is that there are people waiting to be rescued in the disaster-stricken area.
[0095] In one possible implementation, in terms of determining the second result based on the video information of the disaster-stricken area, the processing module 802 is specifically used to: obtain a first video result based on whether there is first video information containing people in the video information of the disaster-stricken area; obtain a second video result based on whether there is second video information containing a distress sign in the video information of the disaster-stricken area; when the first video result is that there is first video information containing people in the video information of the disaster-stricken area, and / or the second video result is that there is second video information containing a distress sign in the video information of the disaster-stricken area, it is determined that the second result is that there are people to be rescued in the disaster-stricken area.
[0096] In one possible implementation, in terms of determining the target rescue measure based on the first indicator and the preset disaster severity threshold, the processing module 802 is specifically used to: when it is detected that the first indicator is less than the preset disaster severity threshold, determine the target rescue measure as the first rescue measure, and the first rescue measure is used to eliminate the source of the disaster; when it is detected that the first indicator is greater than or equal to the preset disaster severity threshold, determine the target rescue measure as the second rescue measure, and the second rescue measure is used to rescue personnel.
[0097] In one possible implementation, the processing module 802 is also used to: determine whether there are obstacles in the walking path of the bipedal rescue robot based on the video information of the disaster area collected by the bipedal rescue robot from the server; when it is detected that there are obstacles in the walking path of the bipedal rescue robot, determine whether the height of the obstacle is lower than a preset height threshold; when it is detected that the height of the obstacle is lower than the preset height threshold, send a second instruction to the bipedal rescue robot through the server, and the second instruction is used to instruct the bipedal rescue robot to climb over the obstacle; when it is detected that the height of the obstacle is not lower than the preset height threshold, send a third instruction to the bipedal rescue robot through the server, and the third instruction is used to instruct the bipedal rescue robot to bypass the obstacle.
[0098] In one possible implementation, the processing module 802 is also used to: determine whether the width of the walking path of the bipedal rescue robot exceeds a first width threshold based on the video information of the disaster area collected by the bipedal rescue robot from the server; when it is detected that the width of the walking path of the bipedal rescue robot exceeds the first width threshold, send a fourth instruction to the bipedal rescue robot through the server, and the fourth instruction is used to instruct the bipedal rescue robot to walk along the original walking path; when it is detected that the width of the walking path of the bipedal rescue robot does not exceed the first width threshold, determine whether the width of the walking path of the bipedal rescue robot exceeds a second width threshold; when it is detected that the width of the walking path of the bipedal rescue robot exceeds the second width threshold, send a fifth instruction to the bipedal rescue robot through the server, and the fifth instruction is used to instruct the bipedal rescue robot to walk sideways along the original walking path.
[0099] It is worth pointing out that the specific functional implementation of the remote rescue remote sensing information processing device 800 of the bipedal rescue robot can be found in the above Figure 2 The description of the remote rescue remote sensing information processing method of the bipedal rescue robot shown in the figure, for example, the acquisition module 801 is used to implement the relevant content of executing S201, and the processing module 802 is used to implement the relevant content of executing S202-S205. The various units or modules in the remote rescue remote sensing information processing device 800 of the bipedal rescue robot can be respectively or completely combined into one or several other units or modules to form, or some (some) of the units or modules can be further divided into multiple smaller units or modules in function to form, which can achieve the same operation without affecting the realization of the technical effect of the embodiment of the present invention. The above-mentioned units or modules are divided based on logical functions. In actual applications, the function of one unit (or module) is realized by multiple units (or modules), or the function of multiple units (or modules) is realized by one unit (or module).
[0100] Based on the description of the above method embodiments and related device embodiments, please refer to Fig. 9 , a schematic diagram of the structure of a computer 900 provided in an embodiment of the present invention. Fig. 9 The computer 900 shown includes a processor 901 , a memory 902 , a communication interface 903 and a bus 904 . The processor 901 , the memory 902 , and the communication interface 903 are connected to each other through the bus 904 .
[0101] Optionally, the memory 902 is a ROM, a static storage device, a dynamic storage device or a RAM.
[0102] The memory 902 can store programs. When the executable program code stored in the memory 902 is executed by the processor 901, the processor 901 and the communication interface 903 are used to execute Figure 2 The various steps of the remote rescue remote sensing information processing method of the biped rescue robot of the illustrated embodiment.
[0103] Processor 901 adopts a general-purpose CPU, a microprocessor, an application-specific integrated circuit ASIC, a GPU or one or more integrated circuits to execute relevant programs to execute the remote rescue remote sensing information processing method of the bipedal rescue robot in the method embodiment of the present application.
[0104] Processor 901 can also be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the remote rescue remote sensing information processing method of the bipedal rescue robot of the present application can be completed by the hardware integrated logic circuit or software instructions in the processor 901. Optionally, processor 901 is a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component. The processor can implement or execute the methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor is a microprocessor or the processor is any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application can be directly embodied as a hardware decoding processor to execute, or the hardware and software modules in the decoding processor are combined and executed. The optional software module is located in a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register or other mature storage media in the art. The storage medium is located in the memory 902, and the processor 901 reads the information in the memory 902, and combines its hardware to complete the functions required to be executed by the acquisition module 801 and the processing module 802 included in the remote rescue remote sensing information processing device 800 of a bipedal rescue robot in an embodiment of the present application, or executes the remote rescue remote sensing information processing method of the bipedal rescue robot in the method embodiment of the present application.
[0105] The communication interface 903 uses a transceiver or other related device such as, but not limited to, a transceiver.
[0106] The bus 904 may include a path for transmitting information between various components of the computer 900 (eg, the memory 902 , the processor 901 , and the communication interface 903 ).
[0107] It should be noted that although Fig. 9The computer 900 shown only shows a memory, a processor, and a communication interface, but in the specific implementation process, those skilled in the art should understand that the computer 900 also includes other devices necessary for normal operation. At the same time, based on specific needs, those skilled in the art should understand that the computer 900 may also include hardware devices for implementing other additional functions. In addition, those skilled in the art should understand that the computer 900 may also only include the devices necessary for implementing the embodiments of the present application, and does not necessarily include Fig. 9 All devices shown in .
[0108] An embodiment of the present application provides a computer-readable storage medium, in which a computer program for electronic data exchange is stored. The computer program includes execution instructions, and the execution instructions are used to execute part or all of the steps of any one of the methods for processing remote rescue remote sensing information of a bipedal rescue robot recorded in the above-mentioned embodiment of the method for processing remote rescue remote sensing information of a bipedal rescue robot. The above-mentioned computer includes an electronic terminal device.
[0109] An embodiment of the present application provides a computer program product, wherein the computer program product includes a computer program, and the computer program can be operated to enable a computer to perform part or all of the steps of any one of the methods for remote rescue remote sensing information processing of a bipedal rescue robot as recorded in the above method embodiments. The computer program product can be a software installation package.
[0110] It should be noted that, for the sake of simplicity, the embodiments of the remote rescue remote sensing information processing method of any of the aforementioned bipedal rescue robots are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the present application.
[0111] The above is a detailed introduction to the embodiments of the present application. This article uses specific examples to illustrate the principles and implementation methods of the remote rescue remote sensing information processing method and related devices of a bipedal rescue robot of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, based on the idea of the remote rescue remote sensing information processing method and related devices of a bipedal rescue robot of the present application, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present application.
[0112] The present application is described with reference to the flowcharts and / or block diagrams of the methods, hardware products, and computer program products of the embodiments of the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0113] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 The memory may include: a flash disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0114] Although the present application is described herein in conjunction with various embodiments, in the process of implementing the claimed application, those skilled in the art may understand and implement other variations of the disclosed embodiments by viewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "one" does not exclude multiple situations. Certain measures are recorded in different dependent claims, but this does not mean that these measures cannot be combined to produce good results.
[0115] A person skilled in the art can understand that all or part of the steps in the various methods of the method embodiments of any of the above-mentioned methods for processing remote sensing information for remote rescue of a bipedal rescue robot can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable memory, which may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc.
[0116] It can be understood that any product that is controlled or configured to execute the processing method of the flowchart described in the embodiment of the remote rescue remote sensing information processing method of a bipedal rescue robot in the present application, such as the device and computer program product in the above flowchart, falls within the scope of the related products described in the present application.
[0117] Obviously, those skilled in the art can make various changes and modifications to the remote sensing information processing method and related devices for remote rescue of a bipedal rescue robot provided in this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is also intended to include these modifications and variations.
Claims
1. A remote rescue remote sensing information processing method for a bipedal rescue robot, characterized in that: The method is applied to a teleoperation system terminal for controlling a bipedal rescue robot, wherein the bipedal rescue robot is connected to the teleoperation system terminal through a server of the teleoperation system, and comprises: Acquire first information of the disaster-stricken area collected by the bipedal rescue robot from the server, the first information including temperature information of the disaster-stricken area, smoke concentration information of the disaster-stricken area, video information of the disaster-stricken area, and audio information of the disaster-stricken area; Determine a first indicator for measuring the degree of disaster in the disaster-stricken area according to the temperature information of the disaster-stricken area and the smoke density information of the disaster-stricken area in the first information; Determine whether there are people waiting to be rescued in the disaster-stricken area according to the video information and audio information of the disaster-stricken area in the first information; When it is detected that there are people to be rescued in the disaster-stricken area and it is detected that the first indicator is less than a preset disaster severity threshold, the target rescue measure is determined to be a first rescue measure, and the first rescue measure is used to eliminate the source of the disaster; when it is detected that there are people to be rescued in the disaster-stricken area and it is detected that the first indicator is greater than or equal to the preset disaster severity threshold, the target rescue measure is determined to be a second rescue measure, and the second rescue measure is used to rescue people; A first instruction is sent to the bipedal rescue robot through the server, wherein the first instruction is used to instruct the bipedal rescue robot to rescue the person to be rescued according to the target rescue measure.
2. The method according to claim 1, characterized in that The first indicator for measuring the degree of disaster in the disaster-stricken area is determined according to the temperature information of the disaster-stricken area and the smoke density information of the disaster-stricken area in the first information, including: Obtaining a first difference between the temperature information of the disaster-stricken area and a preset temperature threshold; Obtaining a first product of the first difference and a preset temperature coefficient; Obtaining a second difference between the smoke concentration information of the disaster-stricken area and a preset smoke concentration threshold; Obtaining a second product of the second difference and a preset smoke concentration coefficient; A sum of the first product and the second product is obtained, where the sum is a first indicator for measuring the extent of disaster in the disaster-stricken area.
3. The method according to claim 2, characterized in that The determining whether there are persons to be rescued in the disaster-stricken area according to the video information and the audio information of the disaster-stricken area in the first information includes: Determine a first result according to the audio information of the disaster-stricken area in the first information; Determine a second result according to the video information of the disaster-stricken area in the first information; When it is detected that the first result or the second result is that there are persons waiting to be rescued in the disaster-stricken area, it is determined that there are persons waiting to be rescued in the disaster-stricken area.
4. The method according to claim 3, characterized in that Determining the first result according to the audio information of the disaster-stricken area in the first information includes: Obtaining a first audio result according to whether a person sends a first audio message in the audio information of the disaster-stricken area; Obtaining a second audio result according to whether there is regular second audio information in the audio information of the disaster-stricken area; When the first audio result is that a person sends a first audio message in the audio information of the disaster-stricken area, and / or the second audio result is that there is a regular second audio message in the audio information of the disaster-stricken area, it is determined that the first result is that there are people waiting to be rescued in the disaster-stricken area.
5. The method according to claim 3, characterized in that Determining the second result according to the video information of the disaster-stricken area includes: Obtaining a first video result according to whether the first video information of the disaster-stricken area contains a person; Obtaining a second video result according to whether there is second video information containing a distress sign in the video information of the disaster-stricken area; When the first video result is that the video information of the disaster-stricken area contains first video information containing persons, and / or the second video result is that the video information of the disaster-stricken area contains second video information containing a distress sign, it is determined that the second result is that there are persons to be rescued in the disaster-stricken area.
6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: Determining whether there are obstacles in the walking path of the bipedal rescue robot according to the video information of the disaster area collected by the bipedal rescue robot from the server; Detecting that there is an obstacle in the walking path of the bipedal rescue robot, and determining whether the height of the obstacle is lower than a preset height threshold; When it is detected that the height of the obstacle is lower than the preset height threshold, a second instruction is sent to the bipedal rescue robot through the server, wherein the second instruction is used to instruct the bipedal rescue robot to perform an operation of climbing over the obstacle; When it is detected that the height of the obstacle is not lower than the preset height threshold, a third instruction is sent to the bipedal rescue robot through the server, and the third instruction is used to instruct the bipedal rescue robot to perform an operation of bypassing the obstacle.
7. A remote rescue remote sensing information processing device for a bipedal rescue robot, characterized in that: The device comprises: An acquisition module, used for acquiring first information of the disaster-stricken area collected by the bipedal rescue robot from the server, wherein the first information includes the temperature of the disaster-stricken area, the smoke concentration of the disaster-stricken area, and the video information and audio information of the disaster-stricken area; A processing module, used to determine a first indicator for measuring the degree of disaster in the disaster-stricken area based on the temperature information of the disaster-stricken area and the smoke concentration information of the disaster-stricken area in the first information; and used to determine whether there are people to be rescued in the disaster-stricken area based on the video information of the disaster-stricken area and the audio information of the disaster-stricken area in the first information; and used to determine that a target rescue measure is a first rescue measure when it is detected that there are people to be rescued in the disaster-stricken area and the first indicator is less than a preset threshold value of the degree of disaster, and the first rescue measure is used to eliminate the source of the disaster; when it is detected that there are people to be rescued in the disaster-stricken area and the first indicator is greater than or equal to the preset threshold value of the degree of disaster, the target rescue measure is determined to be a second rescue measure, and the second rescue measure is used to rescue people; and used to send a first instruction to the bipedal rescue robot through the server, and the first instruction is used to instruct the bipedal rescue robot to rescue the people to be rescued according to the target rescue measure.
8. A computer, characterized in that: include: A memory, a processor, and an executable program code stored in the memory and executable on the processor, wherein the processor executes the steps of the remote rescue remote sensing information processing method of the bipedal rescue robot as claimed in any one of claims 1 to 6 when executing the executable program code.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a remote rescue remote sensing information processing program of a bipedal rescue robot, and the remote rescue remote sensing information processing program of the bipedal rescue robot includes execution instructions, and the execution instructions are used to execute the steps of the remote rescue remote sensing information processing method of the bipedal rescue robot as described in any one of claims 1-6.
Citation Information
Cited By
AED first-aid method based on humanoid robot and related products
CN120116229A
