Closed area inspection method and device, equipment, storage medium and product

By obtaining three-dimensional point cloud maps and sensor data, generating planning paths and realizing automatic navigation, the intelligent problem of dynamic scene inspection and patrol inspection in complex environments is solved, and the inspection efficiency and security are improved.

CN119088009AActive Publication Date: 2024-12-06GUANGDONG POWER GRID CO LTD +1
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202411184877.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-27
Publication Date
2024-12-06
Estimated Expiration
2044-08-27

AI Technical Summary

Technical Problem

The existing independent inspection and inspection technology has limited dynamic scenario processing capabilities in complex environments and requires manual intervention, which cannot achieve intelligent inspection and inspection in the true sense.

Method used

By obtaining a three-dimensional point cloud map of the closed area, generating a planned inspection path based on the inspection and inspection tasks, and using sensors to perceive environmental data, the intelligent inspection and inspection of mobile robots in closed scenarios can be realized, and can automatically navigate to the target point and upload environmental data. .

Benefits of technology

Implementing intelligent inspections and inspections in complex environments improves inspections and inspections, reduces labor costs, and can complete tasks without manual intervention.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119088009A_ABST
    Figure CN119088009A_ABST
Patent Text Reader

Abstract

The invention discloses an inspection method, device and equipment for a closed area, a storage medium and a product, and relates to the technical field of robot control. The method comprises the following steps: acquiring a three-dimensional point cloud map of a closed inspection area; generating a planned inspection path according to the inspection task and the three-dimensional point cloud map; after each target inspection point is navigated along the planned inspection path, the environmental data of the target inspection points are sensed through the sensors, and the environmental data are uploaded to the control center, so that intelligent inspection can be realized in a closed scene, a dynamic scene in a complex environment has certain processing capability, manual intervention is not needed, and the inspection efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of robot control technology, and in particular to a closed area inspection method, device, equipment, storage medium and product. Background Art

[0002] With the continuous development of robotics technology, mobile robots are increasingly used in various fields. Among them, closed scene intelligent inspection technology, as one of the important application scenarios, has received more and more attention.

[0003] In closed scenarios, such as warehouses and factory workshops, traditional inspection methods can no longer meet actual needs due to the small space, complex layout and frequent movement of people.

[0004] Existing autonomous patrol technologies have limited capabilities for handling dynamic scenes in complex environments and often require manual intervention or pre-set rules, making it impossible to achieve truly intelligent patrols. Summary of the invention

[0005] The present invention provides a closed area inspection method, device, equipment, storage medium and product to solve the problem that the existing autonomous inspection technology has limited processing ability for dynamic scenes in complex environments and requires manual intervention.

[0006] In a first aspect, an embodiment of the present invention provides a closed area inspection method, which is applied to a mobile robot in a closed inspection area, and the method includes:

[0007] Obtain a three-dimensional point cloud map of the closed inspection area;

[0008] Generate a planned inspection route according to the inspection task and the three-dimensional point cloud map;

[0009] Navigate to each target inspection point along the planned inspection route;

[0010] After arriving at each target inspection point, the sensor senses the environmental data of the target inspection point and uploads the environmental data to the control center.

[0011] Furthermore, the step of obtaining a three-dimensional point cloud map of the closed inspection area includes:

[0012] Controlling the mobile robot to move in the closed inspection area, and scanning the surrounding environment by a laser radar arranged on the mobile robot to obtain point cloud data;

[0013] estimating a motion trajectory based on odometer data of the mobile robot;

[0014] Based on the real-time positioning and map building algorithm, a three-dimensional point cloud map of the closed inspection area is generated according to the motion trajectory, the odometer data and the point cloud data.

[0015] Furthermore, the step of generating a planned inspection route according to the inspection task and the three-dimensional point cloud map includes:

[0016] Determine a target inspection point set according to the inspection task, and mark the target inspection point set on the three-dimensional point cloud map;

[0017] On the three-dimensional point cloud map, a constraint optimization algorithm is used to generate a planned inspection path of the mobile robot according to the target inspection point set and the operating parameters of the mobile robot.

[0018] Furthermore, the constrained optimization algorithm includes: an objective function and constraint conditions;

[0019] The objective function is:

[0020] min p(x,y) =(C+λL+μT+εD);

[0021]

[0022] The constraints are:

[0023] min(R(s)-Ri)≤γ;

[0024] g(P(x,y))≤A;

[0025] Wherein, C represents the total energy consumption of the mobile robot along the planned inspection path, P(x, y) is the position of the mobile robot on the three-dimensional point cloud map, f(P(x, y)) represents the energy consumption function of the mobile robot at position P(x, y), and L represents the length of the planned inspection path; T represents the total time consumption of the mobile robot along the planned inspection path, v represents the speed of the mobile robot, and v(P(x, y)) represents the speed function of the mobile robot at position P(x, y); D represents the total deviation between the planned inspection path and the target inspection point set, R(s) represents the trajectory point on the planned inspection path, Ri represents the i-th target inspection point in the target inspection point set, and γ represents the set threshold; (x j ,y j ) represents the jth boundary point of the closed inspection area; g(P(x,y)) represents the constraint function of the mobile robot at position P(x,y).

[0026] Furthermore, the step of navigating to each target inspection point along the planned inspection route includes:

[0027] The planned inspection route is divided into a plurality of path points according to the spatial order;

[0028] The sensor is used to obtain in real time whether there are obstacles on the planned inspection section between two adjacent path points;

[0029] If there is an obstacle, a local path planning is performed on the planned inspection section to obtain an obstacle avoidance section;

[0030] If there is no obstacle, the vehicle will proceed along the planned patrol route to the next path point until reaching each of the target patrol points.

[0031] Furthermore, if there is an obstacle, after the step of performing local path planning on the planned inspection section to obtain an obstacle avoidance section, the method further includes:

[0032] Calculating the deviation distance between the obstacle avoidance section and the planned inspection section;

[0033] If the deviation distance is greater than the set distance threshold, a planned inspection route section to the next path point is regenerated;

[0034] If the deviation distance is not greater than the set threshold, the vehicle returns to the planned inspection section after walking along the obstacle avoidance section.

[0035] In a second aspect, an embodiment of the present invention provides a closed area inspection device, which is applied to a mobile robot in a closed inspection area, wherein the mobile robot is provided with a sensor, and the device comprises:

[0036] A map acquisition module is used to obtain a three-dimensional point cloud map of a closed inspection area;

[0037] A path planning module, used to generate a planned patrol path according to the patrol task and the three-dimensional point cloud map;

[0038] The inspection module is used to navigate to each target inspection point along the planned inspection route, sense the environmental data of the target inspection point through the sensor, and upload the environmental data to the control center.

[0039] In a third aspect, an embodiment of the present invention provides a mobile robot, the mobile robot comprising:

[0040] at least one processor; and

[0041] a memory communicatively connected to the at least one processor; wherein,

[0042] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the closed area inspection method described in any embodiment of the present invention.

[0043] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the closed area inspection method described in any embodiment of the present invention when executed.

[0044] In a fifth aspect, an embodiment of the present invention provides a computer program product including a computer program, and when the computer program is executed by a processor, the closed area inspection method described in any embodiment of the present invention is implemented.

[0045] The technical solution of the embodiment of the present invention obtains a three-dimensional point cloud map of a closed patrol area; generates a planned patrol route according to the patrol task and the three-dimensional point cloud map; navigates to each target patrol point along the planned patrol route, senses the environmental data of the target patrol point through sensors, and uploads the environmental data to a control center. It can realize intelligent patrol in a closed scene, and has a certain processing capability for dynamic scenes in complex environments without human intervention. The existing autonomous patrol technology has limited processing capability for dynamic scenes in complex environments and requires human intervention. It has the beneficial effect of improving patrol efficiency and reducing labor costs.

[0046] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0048] Figure 1 A flowchart of a closed area inspection method provided in Embodiment 1 of the present invention;

[0049] Figure 2 A flowchart of a closed area inspection method provided in Embodiment 2 of the present invention;

[0050] Figure 3 A schematic diagram of the structure of a closed area inspection device provided in Embodiment 3 of the present invention;

[0051] Figure 4 It is a structural schematic diagram of a mobile robot that implements the closed area inspection method of an embodiment of the present invention. DETAILED DESCRIPTION

[0052] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0053] It should be noted that the terms "including" and "having" and any variations thereof in the specification and claims of the present invention and the above-mentioned drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or apparatus comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or apparatus.

[0054] Embodiment 1

[0055] Figure 1 This is a flow chart of a closed area inspection method provided in the first embodiment of the present invention. This embodiment can be applied to the inspection of the closed area based on the mobile robot. The method can be executed by the closed area inspection device. The closed area inspection device can be implemented in the form of hardware and / or software. The closed area inspection device can be configured in. Figure 1 As shown, the method includes:

[0056] S110, obtaining a three-dimensional point cloud map of the closed inspection area.

[0057] Among them, the closed inspection area can be understood as a closed area that needs to be inspected, such as an underground parking lot, a stadium or a library. The three-dimensional point cloud map can be understood as a map drawn by a three-dimensional point cloud. It should be noted that the three-dimensional point cloud map can include areas that can be inspected, and may also include areas that cannot be inspected where obstacles are located.

[0058] Specifically, the three-dimensional point cloud map of the closed patrol area can be obtained by collecting the three-dimensional point cloud of the closed patrol area and drawing a map to obtain the three-dimensional point cloud map, or directly obtaining the generated three-dimensional point cloud map from a third-party database or cloud.

[0059] S120: Generate a planned inspection route based on the inspection task and the three-dimensional point cloud map.

[0060] Among them, the inspection task can be understood as a task that requires a mobile robot to perform inspection work. The inspection task may include: inspection content, such as target inspection points; and may also include: inspection time and inspection method and other information. The planned query path can be understood as the path planned according to the inspection task. It is understandable that the planned inspection path needs to pass through each target inspection point included in the inspection task.

[0061] Specifically, according to the task information contained in the inspection task and the three-dimensional point cloud map of the closed inspection area, a planned inspection path corresponding to the inspection task is planned on the three-dimensional point cloud map.

[0062] S130: After navigating to each target patrol point along the planned patrol route, the environmental data of the target patrol point is sensed by the sensor and uploaded to the control center

[0063] Among them, the target inspection point can be understood as a location that needs to be designated for arrival and inspection.

[0064] Specifically, after determining the planned query path, the mobile robot automatically navigates to each target inspection point along the planned inspection path to implement inspection of each target inspection point.

[0065] S140: After arriving at each target inspection point, the environmental data of the target inspection point is sensed by sensors, and the environmental data is uploaded to the control center.

[0066] The environmental data may be understood as data of the environment around the target inspection point, for example, including static target data and dynamic target data. The environmental data may be image data, video data or point cloud data, which is not limited in this embodiment.

[0067] Specifically, after the mobile robot arrives at each target inspection point in turn along the planned inspection route, at the target inspection point, the surrounding environment and data are perceived by the sensors on the mobile robot, and the environmental data is uploaded to the control center, thereby completing a fully automatic inspection in the closed inspection area.

[0068] The technical solution of the embodiment of the present invention is to obtain a three-dimensional point cloud map of a closed patrol area; generate a planned patrol path according to the patrol task and the three-dimensional point cloud map; navigate to each target patrol point along the planned patrol path, perceive the environmental data of the target patrol point through sensors, and upload the environmental data to a control center. It can realize intelligent patrol in a closed scene, and has a certain processing capability for dynamic scenes in complex environments, without the need for human intervention, thereby improving patrol efficiency and reducing labor costs.

[0069] Embodiment 2

[0070] Figure 2This is a flow chart of a closed area inspection method provided in Embodiment 2 of the present invention. This embodiment is further refined based on the above embodiment:

[0071] The step of generating a planned patrol path based on the patrol task and the three-dimensional point cloud map includes: determining a target patrol point set based on the patrol task, and marking the target patrol point set on the three-dimensional point cloud map; on the three-dimensional point cloud map, using a constraint optimization algorithm to generate a planned patrol path for the mobile robot based on the target patrol point set and the operating parameters of the mobile robot.

[0072] like Figure 2 As shown, the method includes:

[0073] S210, obtaining a three-dimensional point cloud map of the closed inspection area.

[0074] In an optional embodiment, the step of obtaining a three-dimensional point cloud map of the closed inspection area includes: controlling the robot to move in the closed inspection area, and scanning the surrounding environment by means of a laser radar provided on the mobile robot to obtain point cloud data; estimating a motion trajectory according to the odometer data of the mobile robot; and generating a three-dimensional point cloud map of the closed inspection area according to the motion trajectory, the odometer data and the point cloud data based on an instant positioning and map building algorithm.

[0075] Specifically, according to the scene characteristics and task requirements of the closed inspection area, the parameters of the laser radar on the mobile robot are configured, such as scanning frequency, resolution, and field of view. The mobile robot is controlled to move slowly in the closed inspection area, and the laser radar set on the mobile robot is controlled to scan the surrounding environment during the movement, collect point cloud data of the surrounding environment in real time, and record the odometer data of the mobile robot. In order to improve the quality of the collected data, the point cloud data can be pre-processed by noise reduction. The odometer data of the mobile robot is used to estimate the motion trajectory of the mobile robot. According to the motion trajectory, odometer data, and point cloud data, the simultaneous localization and mapping (SLAM) algorithm is run to estimate the position and posture of the mobile robot in the global coordinate system, and the local point cloud is continuously accumulated to finally generate a three-dimensional point cloud map of the closed inspection area.

[0076] S220: Determine a target patrol point set according to the patrol task, and mark the target patrol point set on the three-dimensional point cloud map.

[0077] The target inspection point set can be understood as the set of target inspection points that need to be inspected, such as R = {R1, R2, ..., R n},R nCheck point for the nth target.

[0078] Specifically, according to the inspection task, such as the task requirement of full coverage scanning or key area monitoring, a set of inspection target points is determined, and the target area is marked on the map with each inspection target point in the set of inspection target points.

[0079] S230. On the three-dimensional point cloud map, a constraint optimization algorithm is used to generate a planned inspection path for the mobile robot according to the target inspection point set and the operating parameters of the mobile robot.

[0080] Specifically, when planning the inspection route, factors such as the mobile robot's operating radius, working space constraints, energy consumption, and distance from the target inspection point are comprehensively considered, and a more reasonable and efficient planned inspection route is generated with the help of a constraint optimization algorithm.

[0081] Optionally, the constrained optimization algorithm includes: an objective function and constraint conditions;

[0082] The objective function is:

[0083] min p(x,y) =(C+λL+μT+εD);

[0084]

[0085] The constraints are:

[0086] min(R(s)-Ri)≤γ;

[0087] g(P(x,y))≤A;

[0088] Wherein, C represents the total energy consumption of the mobile robot along the planned inspection path, P(x, y) is the position of the mobile robot on the three-dimensional point cloud map, f(P(x, y)) represents the energy consumption function of the mobile robot at position P(x, y), and L represents the length of the planned inspection path; T represents the total time consumption of the mobile robot along the planned inspection path, v represents the speed of the mobile robot, and v(P(x, y)) represents the speed function of the mobile robot at position P(x, y); D represents the total deviation between the planned inspection path and the target inspection point set, R(s) represents the trajectory point on the planned inspection path, Ri represents the i-th target inspection point in the target inspection point set, and γ represents the set threshold; (x j ,y j ) represents the jth boundary point of the closed inspection area; g(P(x,y)) represents the constraint function of the mobile robot at position P(x,y).

[0089] Specifically, during the optimization process, the constraint condition g(P(x,y))≤A is introduced to consider the impact of the workspace constraint A on the path to ensure that the path does not cross the inaccessible area and does not exceed the scope of the workspace, thereby meeting the constraints on the workspace in practical applications. In addition, the constraint condition min(R(s)-Ri)≤γ is introduced to ensure that the planned path must pass through the neighborhood of the target inspection point, thereby constraining the passing points of the planned inspection path.

[0090] S240, after navigating to each target inspection point along the planned inspection route, the environmental data of the target inspection point is sensed by the sensor, and the environmental data is uploaded to the control center.

[0091] In an optional embodiment, the step of navigating to each target inspection point along the planned inspection path includes: dividing the planned inspection path into multiple path points in spatial order; obtaining in real time through sensors whether there are obstacles on the planned inspection section between two adjacent path points; if there are obstacles, performing local path planning on the planned inspection section to obtain an obstacle avoidance section; if there are no obstacles, reaching the next path point along the planned inspection section until reaching each of the target inspection points.

[0092] Specifically, the planned inspection path is decomposed into a series of path points and a series of planned inspection sections between two adjacent path points in spatial order; the kinematics of each path point is inversely solved according to the kinematic model of the mobile robot to obtain the corresponding joint angle or speed command; the laser radar or visual sensor is used to detect in real time whether there are obstacles on the mobile robot's path, and once an obstacle is detected, the obstacle avoidance strategy is immediately triggered, and the local path is dynamically planned to bypass the obstacle by adjusting the speed and direction of the mobile robot. If there is no obstacle, the next path point is reached along the planned inspection section until the target inspection point is reached.

[0093] According to the posture feedback of the mobile robot, it is determined whether the mobile robot has reached the target path point. Navigation can be stopped when a certain threshold condition is met. During the entire navigation process, the motion control is continuously adjusted according to the posture feedback so that the mobile robot can accurately track the corrected local path. The mobile robot stops accurately at the target path point and aligns the orientation to prepare for subsequent environmental perception. The sensors on the mobile robot, such as RGB-D cameras and infrared thermal imagers, are used to perceive the target point and the surrounding environment, obtain detailed information about the target point, and send the inspection completion status of the current viewpoint to the control center, waiting for the next instruction.

[0094] Optionally, if there is an obstacle, after the step of performing local path planning on the planned patrol section to obtain the obstacle avoidance section, it also includes: calculating the deviation distance between the obstacle avoidance section and the planned patrol section; if the deviation distance is greater than a set distance threshold, regenerating the planned patrol section to reach the next path point; if the deviation distance is not greater than the set threshold, walking along the obstacle avoidance section and then returning to the planned patrol section.

[0095] Specifically, let D(a, b) represent the dynamic obstacle detection function of the mobile robot at position (a, b), if there is a dynamic obstacle, then D(a, b) = 1, otherwise D(a, b) = 0;

[0096] Furthermore, let V(a,b) represent the speed of the mobile robot at position (a,b), and θ(a,b) represent the orientation angle of the mobile robot at position (a,b). When a dynamic obstacle is detected, the obstacle avoidance strategy needs to be triggered. Obstacle avoidance can be achieved by adjusting the speed and orientation angle, for example:

[0097] V new (a,b)=V max -k v .D(a,b);

[0098] θ new (a,b)=θ old (a,b)+k θ .sign(θ obs -θ old );

[0099] Among them, V max is the maximum speed of the mobile robot; k v is the speed adjustment factor, which is used to adjust the speed according to the obstacle distance; θ old is the current orientation angle of the mobile robot; θ obs is the angle of the obstacle relative to the mobile robot; k θ is the angle adjustment coefficient, which is used to adjust the heading angle according to the obstacle position; sign() is the sign function, which is used to determine the adjustment direction.

[0100] By adjusting the speed and orientation angle of the mobile robot, the mobile robot can avoid obstacles in real time when dynamic obstacles are detected, and continue to move along the originally planned inspection path, thereby realizing dynamic planning of the local path.

[0101] If there is a large deviation between the obstacle avoidance path and the planned inspection path, it is necessary to match it with the global path and regenerate a local path passing through the viewpoint; if there is no large deviation, follow the obstacle avoidance path and then return to the planned inspection path.

[0102] The deviation distance between the obstacle avoidance path and the planned inspection path can be represented by the Fréchet distance between the two. If it exceeds a set threshold Q, it is determined that there is a large deviation between the obstacle avoidance path and the planned inspection path.

[0103] In a specific example, deep learning technology is used to process the uploaded environmental data of the target inspection point to achieve intelligent detection and judgment of abnormal situations such as fire, smoke, suspicious objects, etc., and send the detection results to the control center.

[0104] The technical solution of the embodiment of the present invention is to obtain a three-dimensional point cloud map of a closed patrol area; determine a set of target patrol points according to the patrol task, and mark the set of target patrol points on the three-dimensional point cloud map; on the three-dimensional point cloud map, use a constraint optimization algorithm to generate a planned patrol path for the mobile robot according to the set of target patrol points and the operating parameters of the mobile robot; after navigating to each target patrol point along the planned patrol path, sense the environmental data of the target patrol point through sensors, and upload the environmental data to a control center, so that the path can be adjusted in real time in a dynamic environment, obstacles can be avoided, and intelligent patrol tasks can be realized, thereby improving the mobile robot's perception ability and comprehensiveness of the environment, enhancing the autonomy and adaptability of the mobile robot, improving the efficiency and safety of the patrol task, and at the same time improving the response speed and real-time performance of the patrol task, providing reliable technical support for smart patrols in closed scenes.

[0105] Embodiment 3

[0106] Figure 3 This is a schematic diagram of the structure of a closed area inspection device provided by the third embodiment of the present invention. Figure 3 As shown, the device includes: a map acquisition module 310, a path planning module 320 and a patrol inspection module 330; wherein,

[0107] A map acquisition module 310 is used to acquire a three-dimensional point cloud map of a closed inspection area;

[0108] A path planning module 320, used to generate a planned patrol path according to the patrol task and the three-dimensional point cloud map;

[0109] The inspection module 330 is used to navigate to each target inspection point along the planned inspection route, sense the environmental data of the target inspection point through the sensor, and upload the environmental data to the control center.

[0110] The technical solution of the embodiment of the present invention is to obtain a three-dimensional point cloud map of a closed patrol area; generate a planned patrol path according to the patrol task and the three-dimensional point cloud map; navigate to each target patrol point along the planned patrol path, perceive the environmental data of the target patrol point through sensors, and upload the environmental data to a control center. It can realize intelligent patrol in a closed scene, and has a certain processing capability for dynamic scenes in complex environments, without the need for human intervention, thereby improving patrol efficiency.

[0111] Optionally, the map acquisition module 310 is specifically used for:

[0112] Controlling the mobile robot to move in the closed inspection area, and scanning the surrounding environment by a laser radar arranged on the mobile robot to obtain point cloud data;

[0113] estimating a motion trajectory based on odometer data of the mobile robot;

[0114] Based on the real-time positioning and map building algorithm, a three-dimensional point cloud map of the closed inspection area is generated according to the motion trajectory, the odometer data and the point cloud data.

[0115] Optionally, the path planning module 320 includes:

[0116] A patrol point marking unit, used to determine a target patrol point set according to the patrol task, and mark the target patrol point set on the three-dimensional point cloud map;

[0117] The patrol path generation unit is used to generate the planned patrol path of the mobile robot based on the target patrol point set and the operating parameters of the mobile robot by using a constraint optimization algorithm on the three-dimensional point cloud map.

[0118] Optionally, the constrained optimization algorithm includes: an objective function and constraint conditions;

[0119] The objective function is:

[0120] min p(x,y) =(C+λL+μT+εD);

[0121]

[0122] The constraints are:

[0123] min(R(s)-Ri)≤γ;

[0124] g(P(x,y))≤A;

[0125] Wherein, C represents the total energy consumption of the mobile robot along the planned inspection path, P(x, y) is the position of the mobile robot on the three-dimensional point cloud map, f(P(x, y)) represents the energy consumption function of the mobile robot at position P(x, y), and L represents the length of the planned inspection path; T represents the total time consumption of the mobile robot along the planned inspection path, v represents the speed of the mobile robot, and v(P(x, y)) represents the speed function of the mobile robot at position P(x, y); D represents the total deviation between the planned inspection path and the target inspection point set, R(s) represents the trajectory point on the planned inspection path, Ri represents the i-th target inspection point in the target inspection point set, and γ represents the set threshold; (x j ,y j ) represents the jth boundary point of the closed inspection area; g(P(x,y)) represents the constraint function of the mobile robot at position P(x,y).

[0126] Optionally, the inspection module 330 is specifically used for:

[0127] The planned inspection route is divided into a plurality of path points according to the spatial order;

[0128] The sensor is used to obtain in real time whether there are obstacles on the planned inspection section between two adjacent path points;

[0129] If there is an obstacle, a local path planning is performed on the planned inspection section to obtain an obstacle avoidance section;

[0130] If there is no obstacle, the vehicle will proceed along the planned patrol route to the next path point until reaching each of the target patrol points.

[0131] Optionally, if there is an obstacle, after the step of performing local path planning on the planned inspection section to obtain an obstacle avoidance section, the method further includes:

[0132] The path return module is used to calculate the deviation distance between the obstacle avoidance section and the planned inspection section; if the deviation distance is greater than a set distance threshold, the planned inspection section to reach the next path point is regenerated; if the deviation distance is not greater than the set threshold, the vehicle returns to the planned inspection section after walking along the obstacle avoidance section.

[0133] The closed area inspection device provided in the embodiment of the present invention can execute the closed area inspection method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0134] Embodiment 4

[0135] Figure 4A schematic diagram of a mobile robot 10 that can be used to implement an embodiment of the present invention is shown. The mobile robot is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The mobile robot can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0136] like Figure 4 As shown, the mobile robot 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the mobile robot 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0137] A number of components in the mobile robot 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the mobile robot 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0138] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The processor 11 executes the various methods and processes described above, such as a closed area inspection method.

[0139] In some embodiments, the patrol method of the closed area can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on the mobile robot 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the patrol method of the closed area described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured to execute the patrol method of the closed area by any other appropriate means (for example, by means of firmware).

[0140] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0141] In some embodiments, the patrol method of the closed area can be implemented as a computer program, which is invisibly included in a computer program product. The computer program implements the patrol method of the closed area of ​​the present invention when executed by the processor. The computer program product can be understood as a software product that mainly implements its solution through a computer program. The computer program for implementing the method of the present invention can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flowchart and / or block diagram are implemented. The computer program can be executed entirely on the machine, partially on the machine, as an independent software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0142] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0143] To provide interaction with a user, the systems and techniques described herein can be implemented on a mobile robot having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the mobile robot. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0144] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0145] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0146] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0147] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for inspecting a closed area, characterized in that: A mobile robot is applied to a closed patrol area, wherein the mobile robot is provided with a sensor, and the method comprises: Obtain a three-dimensional point cloud map of the closed inspection area; Generate a planned inspection route according to the inspection task and the three-dimensional point cloud map; After navigating to each target inspection point along the planned inspection route, the environmental data of the target inspection point is sensed by the sensor, and the environmental data is uploaded to the control center.

2. The closed area inspection method according to claim 1, characterized in that: The step of obtaining a three-dimensional point cloud map of a closed inspection area includes: Controlling the mobile robot to move in the closed inspection area, and scanning the surrounding environment by a laser radar arranged on the mobile robot to obtain point cloud data; estimating a motion trajectory based on odometer data of the mobile robot; Based on the real-time positioning and map building algorithm, a three-dimensional point cloud map of the closed inspection area is generated according to the motion trajectory, the odometer data and the point cloud data.

3. The closed area inspection method according to claim 1, characterized in that: The step of generating a planned inspection route according to the inspection task and the three-dimensional point cloud map includes: Determine a target inspection point set according to the inspection task, and mark the target inspection point set on the three-dimensional point cloud map; On the three-dimensional point cloud map, a constraint optimization algorithm is used to generate a planned inspection path of the mobile robot according to the target inspection point set and the operating parameters of the mobile robot.

4. The closed area inspection method according to claim 3, characterized in that: The constrained optimization algorithm includes: an objective function and constraint conditions; The objective function is: min p(x,y) =(C+λL+μT+εD); The constraints are: min(R(s)-Ri)≤γ; g(P(x,y))≤A; Wherein, C represents the total energy consumption of the mobile robot along the planned inspection path, P(x, y) is the position of the mobile robot on the three-dimensional point cloud map, f(P(x, y)) represents the energy consumption function of the mobile robot at position P(x, y), and L represents the length of the planned inspection path; T represents the total time consumption of the mobile robot along the planned inspection path, v represents the speed of the mobile robot, and v(P(x, y)) represents the speed function of the mobile robot at position P(x, y); D represents the total deviation between the planned inspection path and the target inspection point set, R(s) represents the trajectory point on the planned inspection path, Ri represents the i-th target inspection point in the target inspection point set, and γ represents the set threshold; (x j ,y j ) represents the jth boundary point of the closed inspection area; g(P(x,y)) represents the constraint function of the mobile robot at position P(x,y).

5. The closed area inspection method according to any one of claims 1 to 4, characterized in that: The step of navigating to each target inspection point along the planned inspection route includes: The planned inspection route is divided into a plurality of path points according to the spatial order; The sensor is used to obtain in real time whether there are obstacles on the planned inspection section between two adjacent path points; If there is an obstacle, a local path planning is performed on the planned inspection section to obtain an obstacle avoidance section; If there is no obstacle, the vehicle will proceed along the planned patrol route to the next path point until reaching each of the target patrol points.

6. The closed area inspection method according to claim 5, characterized in that: If there is an obstacle, after the step of performing local path planning on the planned inspection section to obtain an obstacle avoidance section, the method further includes: Calculating the deviation distance between the obstacle avoidance section and the planned inspection section; If the deviation distance is greater than the set distance threshold, a planned inspection route section to the next path point is regenerated; If the deviation distance is not greater than the set threshold, the vehicle returns to the planned inspection section after walking along the obstacle avoidance section.

7. A closed area inspection device, characterized in that: A mobile robot used in a closed patrol area, wherein the mobile robot is provided with a sensor, and the device comprises: A map acquisition module is used to obtain a three-dimensional point cloud map of a closed inspection area; A path planning module, used to generate a planned patrol path according to the patrol task and the three-dimensional point cloud map; The inspection module is used to navigate to each target inspection point along the planned inspection route, sense the environmental data of the target inspection point through the sensor, and upload the environmental data to the control center.

8. A mobile robot, characterized in that: The mobile robot comprises: at least one processor and sensor; and a memory in communication with the at least one processor and the sensor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the closed area inspection method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the closed area inspection method according to any one of claims 1 to 6 when executed.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the computer program implements the closed area inspection method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Automatic guide and obstacle avoidance method for robot

    CN103576686A

  • Inspection robot navigation method applied to natural gas power plant

    CN115248590A

  • Inspection method of industrial scene autonomous inspection robot

    CN117519169A

  • Control method and device of self-moving equipment, robot and storage medium

    CN117908523A

  • Method for judging navigation state of inspection robot

    CN118089781A