Automatic spraying method, device, intelligent mobile robot and storage medium

Through the intelligent mobile robot combining lidar and motion measurement module for autonomous positioning and precise spraying, the problems of low spray efficiency and high risk under manual operation are solved, and efficient and accurate automatic spraying operations are achieved.

CN117563843BActive Publication Date: 2024-11-15GUANGZHOU SAITE INTELLIGENCE TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311515049.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-11-14
Publication Date
2024-11-15
Estimated Expiration
2043-11-14

AI Technical Summary

Technical Problem

Existing spraying operations rely on manual operations, resulting in low efficiency, high cost and risks of infection and heat stroke, making it difficult to meet a wide range of and complex cleaning needs.

Method used

It adopts intelligent mobile robots, combined with lidar modules, motion measurement modules, nozzle devices and robotic arm devices, and autonomous positioning and precise spraying are carried out through real-time environmental information and operation area maps to achieve automated operations.

Benefits of technology

It improves spraying efficiency, reduces the risk of manual intervention, shortens working time, and enhances spraying accuracy and application adaptability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117563843B_ABST
    Figure CN117563843B_ABST
Patent Text Reader

Abstract

The embodiment of the present application provides an automatic spraying method, device, intelligent mobile robot and storage medium, the method comprising: when determining that the current working state of the intelligent mobile robot is an allowed working state, comparing the real-time environmental information generated by the laser radar module with the set working area map to determine the real-time position point of the intelligent mobile robot; comparing the real-time position point with the set working moving path to determine the target position point, and driving the intelligent mobile robot to move to the target position point based on the real-time motion information fed back by the motion measurement module; when the real-time position point is consistent with the target position point, controlling the nozzle device to spray the ground spraying area pre-associated with the target position point, and controlling the mechanical arm device to spray the non-ground spraying area pre-associated with the target position point. The spraying operation time is reduced and the spraying efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of robotics technology, and in particular to an automatic spraying method, device, intelligent mobile robot, and storage medium. Background Art

[0002] At present, with the diversified development of all walks of life, spraying operations have begun to be widely used in all aspects of people's lives to meet different levels of needs. For example, due to the large mobility of people in public places and the high density of people, it provides good conditions for the spread of various pathogens, which can easily pose a greater threat to people's health. Therefore, it is necessary to spray and disinfect the indoor and outdoor environment regularly to reduce the risk of disease transmission, increase the workload of disinfection and epidemic prevention, and the cleaning scope is wide and the cleaning process is complicated; for example, due to the increasing degree of urban greening and the increasing area of ​​road greening, in order to ensure the effect of road greening, it is necessary to spray and moisten regularly; in addition, there are also spraying paints for indoor and outdoor decoration, etc., which all have certain needs for spraying operations.

[0003] However, the application scenarios of the above-mentioned spraying action usually require pure manual work or manually operated auxiliary equipment to complete, which has high labor costs and may pose adverse risks such as infection and heat stroke to the staff. In addition, the need for manual intervention is time-consuming and laborious, resulting in reduced cleaning efficiency and affecting the timeliness of the operation. Summary of the invention

[0004] The embodiments of the present application provide an automatic spraying method, device, intelligent mobile robot and storage medium to solve the problems of time wasting, low spraying efficiency and timeliness of operations caused by manual participation in spraying operations. The method improves the reliability of the robot's autonomous positioning of real-time position points by combining real-time environmental information and a set work area map, and further provides accurate control information for the movement of the robot in combination with a set work movement path and real-time motion information. The method controls the nozzle device and the robotic arm device to spray different areas associated with the target position points, taking into account the requirements of different spraying accuracies, improving the requirements of different spraying applications, reducing the spraying operation time and improving the spraying efficiency.

[0005] In a first aspect, an embodiment of the present application provides an automatic spraying method, which is applied to an intelligent mobile robot, wherein the intelligent mobile robot is provided with a laser radar module, a motion measurement module, a spray head device, and a mechanical arm device;

[0006] The automatic spraying method comprises:

[0007] When it is determined that the current working state of the intelligent mobile robot is a permitted working state, the real-time location point of the intelligent mobile robot is determined based on the comparison of the real-time environmental information generated by the laser radar module with the set working area map;

[0008] Compare the real-time position point with the set operation moving path to determine the target position point, and drive the intelligent mobile robot to move toward the target position point based on the real-time motion information fed back by the motion measurement module;

[0009] When the real-time position point is consistent with the target position point, the sprinkler device is controlled to spray the ground spraying area pre-associated with the target position point, and the robotic arm device is controlled to spray the non-ground spraying area pre-associated with the target position point, and the operation status of the ground spraying area and the non-ground spraying area in the operation area map is updated to a spraying completion status.

[0010] Optionally, the intelligent mobile robot is provided with a spray liquid tank and a liquid level sensor;

[0011] The specific process of determining the current working state of the intelligent mobile robot includes:

[0012] Performing validity detection on the acquired liquid level sensing information, wherein the liquid level sensing information is a real-time measurement result of the current liquid level height of the spray liquid tank by the liquid level sensor;

[0013] In the case where the liquid level sensor information is valid information, extracting the current liquid level height from the liquid level sensor information, and calculating the remaining liquid capacity according to the current liquid level height and the liquid tank structural parameters;

[0014] comparing the remaining liquid capacity with the required liquid capacity corresponding to the preset spraying area;

[0015] In a case where the remaining liquid capacity is greater than or equal to the required liquid capacity corresponding to the preset spraying area, determining that the current working state of the intelligent mobile robot is an allowed working state;

[0016] When the remaining liquid capacity is less than the required liquid capacity corresponding to the preset spraying area, it is determined that the current working state of the intelligent mobile robot is a prohibited working state.

[0017] Optionally, after the effectiveness detection of the acquired liquid level sensor information is performed, the method further includes:

[0018] When the liquid level sensing information is invalid information, it is determined that the current working state of the intelligent mobile robot is a prohibited working state.

[0019] Optionally, after determining that the current working state of the intelligent mobile robot is a prohibited working state, the method further includes:

[0020] The current state parameters of the intelligent mobile robot are uploaded to the system background, and an acoustic and optical alarm signal is output through an acoustic and optical sensor.

[0021] Optionally, controlling the robotic arm device to spray the non-ground spraying area pre-associated with the target position point includes:

[0022] Extracting a motion trajectory corresponding to the robotic arm device based on the real-time environmental information corresponding to the target location point and the associated non-ground spraying area;

[0023] The robot arm device is controlled to spray along the motion trajectory based on the real-time motion information.

[0024] Optionally, the intelligent mobile robot further includes a visual recognition module;

[0025] The controlling the mechanical arm device to spray the non-ground spraying area pre-associated with the target position point includes:

[0026] The visual recognition module is used to identify the contours of items in the non-ground spraying area associated with the target location point;

[0027] When there is a target object among the objects in the area and the contour recognition result is consistent with the contour of the object to be sprayed, the robot arm device is controlled to spray the target object.

[0028] Optionally, the automatic spraying method further comprises:

[0029] Acquire real-time liquid level sensor information based on a preset time interval, extract the real-time liquid level height from the real-time liquid level sensor information, and drive the intelligent mobile robot to return to the preset starting position when the real-time liquid level height is lower than a preset capacity limit;

[0030] Or, when the real-time position point is consistent with the end position of the operation moving path, the intelligent mobile robot is driven to return to the preset starting position.

[0031] In a second aspect, an embodiment of the present application further provides an automatic spraying device, which is applied to an intelligent mobile robot, wherein the intelligent mobile robot is provided with a laser radar module, a motion measurement module, a spray head device, and a mechanical arm device;

[0032] The automatic spraying device comprises:

[0033] A position determination unit is configured to determine the real-time position point of the intelligent mobile robot by comparing the real-time environment information generated by the laser radar module with a set operation area map when determining that the current operation state of the intelligent mobile robot is an allowed operation state;

[0034] A position moving unit is configured to compare the real-time position point with a set operation moving path to determine a target position point, and drive the intelligent mobile robot to move toward the target position point based on the real-time motion information fed back by the motion measurement module;

[0035] The area spraying unit is configured to control the sprinkler device to spray the ground spraying area pre-associated with the target position point when the real-time position point is consistent with the target position point, and control the robot arm device to spray the non-ground spraying area pre-associated with the target position point, and update the operation status of the ground spraying area and the non-ground spraying area in the operation area map to a spraying completion status.

[0036] Optionally, the intelligent mobile robot is provided with a spray liquid tank and a liquid level sensor;

[0037] A position determination unit comprising:

[0038] A sensor information detection module is configured to detect the effectiveness of the acquired liquid level sensor information, where the liquid level sensor information is a real-time measurement result of the current liquid level height of the spray liquid tank by the liquid level sensor;

[0039] The remaining liquid determination module is configured to extract the current liquid level height from the liquid level sensor information when the liquid level sensor information is valid information, and calculate the remaining liquid capacity according to the current liquid level height and the liquid tank structural parameters;

[0040] A liquid capacity comparison module is configured to compare the remaining liquid capacity with the required liquid capacity corresponding to the preset spraying area;

[0041] The first state determination module is configured to determine that the current working state of the intelligent mobile robot is an allowed working state when the remaining liquid capacity is greater than or equal to the required liquid capacity corresponding to the preset spraying area;

[0042] The second state determination module is configured to determine that the current working state of the intelligent mobile robot is a prohibited working state when the remaining liquid capacity is less than the required liquid capacity corresponding to the preset spraying area.

[0043] Optionally, the location determination unit further includes:

[0044] The third state determination module is configured to determine that the current working state of the intelligent mobile robot is a prohibited working state when the liquid level sensor information is invalid information.

[0045] Optionally, the location determination unit further includes:

[0046] The state feedback module is configured to upload the current state parameters of the intelligent mobile robot to the system background and output the sound and light alarm signal through the sound and light sensor.

[0047] Optional, area spray unit, including:

[0048] A motion trajectory determination module is configured to extract a motion trajectory corresponding to the robotic arm device based on real-time environmental information corresponding to the target location point and an associated non-ground spraying area;

[0049] The robotic arm spraying module is configured to control the robotic arm device to spray along a motion trajectory based on real-time motion information.

[0050] Optionally, the intelligent mobile robot further includes a visual recognition module;

[0051] Area spraying unit, comprising:

[0052] An object recognition module is configured to recognize the contour of an object in a non-ground spraying area associated with a target position point through a visual recognition module;

[0053] The object spraying module is configured to control the robot arm device to spray the target object when the contour recognition result of the target object in the area objects is consistent with the contour of the object to be sprayed.

[0054] Optionally, it also includes an end operation unit configured as:

[0055] Acquire real-time liquid level sensor information based on a preset time interval, extract the real-time liquid level height from the real-time liquid level sensor information, and drive the intelligent mobile robot to return to a preset starting position when the real-time liquid level height is lower than a preset capacity limit;

[0056] Or, when the real-time position point is consistent with the end position of the operation moving path, the intelligent mobile robot is driven to return to the preset starting position.

[0057] In a third aspect, an embodiment of the present application further provides an intelligent mobile robot, comprising: a spray liquid tank; a liquid level sensor; a laser radar module; a motion measurement module; a nozzle device; a robotic arm device; a visual recognition module; one or more processors; and a storage device configured to store one or more programs, so that when the one or more programs are executed by the one or more processors, the one or more processors implement the automatic spraying method described in any embodiment of the present application.

[0058] In a fourth aspect, an embodiment of the present application further provides a non-volatile storage medium storing computer executable instructions, wherein the computer executable instructions are configured to execute the automatic spraying method described in the embodiment of the present application when executed by a computer processor.

[0059] In an embodiment of the present application, by determining that the current working state of the intelligent mobile robot is an allowed working state, comparing the real-time environmental information generated by the laser radar module with the set working area map, the real-time position point of the intelligent mobile robot is determined; the real-time position point is compared with the set working moving path to determine the target position point, and based on the real-time motion information fed back by the motion measurement module, the intelligent mobile robot is driven to move toward the target position point; when the real-time position point is consistent with the target position point, the sprinkler device is controlled to spray the ground spraying area pre-associated with the target position point, and the robotic arm device is controlled to spray the non-ground spraying area pre-associated with the target position point, and the working status of the ground spraying area and the non-ground spraying area in the working area map is updated to a spraying completion status. It is achieved by combining real-time environmental information and the set work area map to improve the reliability of the robot's autonomous positioning of the real-time position point, and further combining the set work movement path and real-time motion information to provide accurate control information for the robot's movement. By controlling the nozzle device and the robotic arm device to spray different areas associated with the target position point, it takes into account the requirements of different spraying accuracies, improves the spraying of different application requirements, reduces the spraying operation time, and improves the spraying efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] Figure 1 A flow chart of an automatic spraying method provided in an embodiment of the present application;

[0061] Figure 2 A flowchart of a method for determining the current working state of an intelligent mobile robot provided in an embodiment of the present application;

[0062] Figure 3 A schematic diagram of a working area map of an intelligent mobile robot provided in an embodiment of the present application;

[0063] Figure 4 A flow chart of a method for spraying a non-ground spraying area using a robotic arm device provided in an embodiment of the present application;

[0064] Figure 5 A flow chart of a method for spraying objects in a non-ground spraying area using a robotic arm device provided in an embodiment of the present application;

[0065] Figure 6 A structural block diagram of an automatic spraying device provided in an embodiment of the present application;

[0066] Figure 7 A schematic diagram of the structure of an intelligent mobile robot provided in an embodiment of the present application. DETAILED DESCRIPTION

[0067] The embodiments of the present application are further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the embodiments of the present application, rather than to limit the embodiments of the present application. It should also be noted that, for ease of description, only parts related to the embodiments of the present application are shown in the accompanying drawings, rather than all structures.

[0068] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0069] Figure 1A flowchart of an automatic spraying method provided for an embodiment of the present application, the automatic spraying method is applied to an intelligent mobile robot, wherein the intelligent mobile robot may be a robot that can move autonomously or perform tasks in the physical world, and the intelligent mobile robot may be provided with a sensor module and computing power to sense the surrounding environment and achieve autonomous navigation and task execution. The intelligent mobile robot of the embodiment of the present application is provided with a laser radar module, a motion measurement module, a nozzle device, and a mechanical arm device, wherein the laser radar module can achieve distance measurement by emitting pulsed laser beams and measuring the time they reflect back, the laser radar module may include a laser transmitter and a receiver, and point cloud data describing the surrounding environment information may be obtained through the laser radar module, the point cloud data is discrete three-dimensional coordinate points, and a high-resolution three-dimensional map may be created using the point cloud data to support navigation and decision making; the motion measurement module may include a wheel odometer, an inertial measurement unit, etc., wherein the wheel odometer may be provided with an encoder or other sensor to The rotation angle or rotation amount of the wheel is measured, and then the displacement and direction of the mobile robot are calculated. Due to the problem of cumulative error in the wheel odometer, it is also necessary to correct the cumulative error through the set inertial measurement unit to improve the accuracy of positioning. The inertial measurement unit is an integrated sensor system, which may include a three-axis accelerometer and a three-axis gyroscope, which are used to measure and record the three-dimensional linear acceleration and angular velocity of the mobile robot. The displacement, direction and posture of the object can be inferred based on the aforementioned measurement values; the nozzle device can be a device that sprays liquid into a specific area or surface in a controlled manner. The nozzle device may include a nozzle, through which the fluid can be released into a jet or spray. According to the characteristics of different application scenarios, the flow rate, spray direction, angle and intensity of the fluid can also be controlled to meet the needs of different uses; the robotic arm device can be a control device including a robotic arm, a drive module, etc. Specifically, the robotic arm can be connected by multiple joints, each joint can realize rotation or movement on one axis, and the end of the robotic arm can be installed with a nozzle, and the spraying operation of a specific area is performed based on a predetermined path and motion planning. Such as Figure 1 As shown, the automatic spraying method specifically includes the following steps:

[0070] Step S101: When it is determined that the current working state of the intelligent mobile robot is a permitted working state, the real-time environmental information generated by the laser radar module is compared with the set working area map to determine the real-time position of the intelligent mobile robot.

[0071] The current working state of the intelligent mobile robot can be determined specifically according to the current state parameters of the robot to determine whether the robot is suitable for performing the current spraying task. Specifically, the current working state of the robot can include an allowed working state and a prohibited working state, and the current state parameters can include the communication state and operation state of each sensor module, actuator, etc. in the robot, and can also include the real-time state of specific devices corresponding to the spraying operation, such as a spray liquid tank, a spray head solenoid valve, a water pump, etc.

[0072] Optionally, before the intelligent mobile robot performs the spraying operation, it is necessary to confirm the liquid capacity of the spraying liquid tank to ensure the normal progress of the spraying operation. Figure 2 A flow chart of a method for determining the current working state of an intelligent mobile robot provided in an embodiment of the present application, wherein the intelligent mobile robot is provided with a spray liquid tank and a liquid level sensor, such as Figure 2 As shown, the specific process of determining the current working state of the intelligent mobile robot includes:

[0073] Step S1011, performing validity detection on the acquired liquid level sensing information, where the liquid level sensing information is a real-time measurement result of the current liquid level height of the spray liquid tank by the liquid level sensor.

[0074] Among them, since the intelligent mobile robot will automatically spray along the preset route and will not return to the starting point until the spraying task of the preset route is completed, it is necessary to ensure whether the liquid capacity of the spray tank meets the needs of the spraying operation. To confirm the liquid capacity of the spray tank, the current liquid level of the spray tank can be determined by the liquid level sensor, so the validity of the obtained liquid level sensor information must be determined first.

[0075] Step S1012: When the liquid level sensor information is valid information, the current liquid level height is extracted from the liquid level sensor information, and the remaining liquid capacity is calculated according to the current liquid level height and the liquid tank structural parameters.

[0076] Specifically, when the liquid level sensor information meets the conditions such as the preset data format and the restricted range, it can be regarded as valid information, and the intelligent mobile robot can use the valid information as reference data for calculating the liquid capacity. The remaining liquid capacity can be calculated based on the current liquid level height extracted from the liquid level sensor information and the liquid tank structural parameters. For example, the product of the current liquid level height and the length and width parameters of the spray tank can be used as the remaining liquid capacity. Optionally, when the liquid level sensor information is invalid information, the current working state of the intelligent mobile robot can be determined as a prohibited working state, reducing the risk of operation failure due to insufficient liquid capacity of the spray tank.

[0077] Step S1013: compare the remaining liquid capacity with the required liquid capacity corresponding to the preset spraying area.

[0078] The preset spraying area corresponding to the preset route of the intelligent mobile robot will be calculated in advance, and the required liquid capacity will be calculated based on the preset spraying area. Different application scenarios will have different requirements for the liquid concentration per unit area, and the corresponding required liquid capacity will also be different. Comparing the remaining liquid capacity with the required liquid capacity can determine whether the robot is allowed to start the spraying operation.

[0079] Step S1014: when the remaining liquid capacity is greater than or equal to the required liquid capacity corresponding to the preset spraying area, determine that the current working state of the intelligent mobile robot is an allowed working state.

[0080] Step S1015: When the remaining liquid capacity is less than the required liquid capacity corresponding to the preset spraying area, determine that the current working state of the intelligent mobile robot is a prohibited working state.

[0081] Therefore, by confirming the comparison result of the remaining liquid capacity and the required liquid capacity, it is possible to determine the remaining liquid situation in the spray liquid tank and whether the intelligent mobile robot is in a state that allows it to work, thereby reducing the situation where the spraying operation is stopped midway due to insufficient liquid capacity, resulting in operation failure, and at the same time reducing unnecessary time loss caused by the need for temporary replenishment.

[0082] Optionally, in the case of confirming that the intelligent mobile robot is in a prohibited working state, the current state parameters of the intelligent mobile robot can be uploaded to the system background, where the current state parameters can be the remaining liquid capacity, the state of other sensor modules, etc. The background personnel can confirm the obtained current state parameters, and replenish the liquid or shut down to check the abnormality in time. In addition, the sound and light alarm signal can be output through the sound and light sensor, and the sound and light sensor can be a buzzer, indicator light, etc., which can promptly remind on-site personnel that the robot cannot start normally and needs to be confirmed for abnormality.

[0083] In addition, in addition to confirming whether it is in a state where work is allowed, the intelligent mobile robot also needs to determine its own real-time position point as a starting point. Specifically, the set operation area map can be obtained by pre-scanning the area to be operated in advance through the laser radar module during the robot's operation preparation stage, and constructing it based on the collected point cloud data and geographic location information. The operation area map can also add the robot's operation movement path and the pre-planned spraying area of ​​each path point. For example, for a certain path point, it can be defined that the area with a set radius range with the path point as the center is the spraying area, or the area with a specified angle range is the spraying area, which is not limited in this application. When the intelligent mobile robot is in the starting state, it can be based on the real-time environmental information generated by the laser radar module, which corresponds to the real-time point cloud data of the robot's current position point, and compare the real-time point cloud data with the set operation area map to determine the real-time position point corresponding to the local point cloud data in the operation area map that overlaps with the point cloud data or reaches a preset similarity. The real-time position point can be an absolute coordinate position in the world coordinate system, or a relative coordinate position based on a set origin, which is not limited in this application.

[0084] Step S102: Compare the real-time position point with the set operation moving path to determine the target position point, and drive the intelligent mobile robot to move toward the target position point based on the real-time motion information fed back by the motion measurement module.

[0085] in, Figure 3 A schematic diagram of an operating area map of an intelligent mobile robot provided in an embodiment of the present application, such as Figure 3 As shown, the work area map may include preset environmental information 301 and a work moving path 302, and the work moving path may be a track composed of a set number of path points. After the intelligent mobile robot completes the determination of the real-time position point, it is necessary to compare the real-time position point with the work moving path, so as to determine the next position point relative to the real-time position point that the robot needs to reach, that is, the target position point. The motion planning of the robot from the real-time position point to the target position point needs to be combined with the real-time motion information fed back by the motion measurement module, such as the displacement information and posture information of the robot, so as to drive the robot to reach the target position point.

[0086] Step S103, when the real-time position point is consistent with the target position point, the sprinkler device is controlled to spray the ground spraying area pre-associated with the target position point, and the robotic arm device is controlled to spray the non-ground spraying area pre-associated with the target position point, and the operation status of the ground spraying area and the non-ground spraying area in the operation area map is updated to the spraying completion status.

[0087] Specifically, in the embodiment of the present application, the nozzle device can be arranged on the side and the outside of the bottom of the intelligent mobile robot to spray the ground spraying area, and the mechanical arm device can be arranged on the top of the intelligent mobile robot to spray the specific position of the non-ground spraying area, for example, a space area with a certain height, an object of a special shape, such as a cabinet, a table, etc. Further, when it is confirmed that the real-time position point is consistent with the target position point, the nozzle device can be controlled to spray the ground spraying area pre-associated with the target position point. Since the installation position of the nozzle device is fixed, the spraying function of the nozzle device can be realized by controlling the conduction and disconnection state of the water pump and the solenoid valve. Since the mechanical arm device needs to spray a specific position, it is necessary to involve the movement control of the mechanical arm to complete it. For the area that has completed the spraying, its operation status in the operation area map can be updated to the spraying completion state, thereby, the completion of the spraying operation can be mastered, and data reference can be provided for the next spraying operation planning.

[0088] In one embodiment, Figure 4 A flowchart of a method for spraying a non-ground spraying area using a robotic arm device provided in an embodiment of the present application, such as Figure 4 As shown, the specific process of controlling the mechanical arm device to spray the non-ground spraying area pre-associated with the target position point includes:

[0089] Step S1031: extracting a motion trajectory corresponding to the robot arm device based on the real-time environmental information corresponding to the target location point and the associated non-ground spraying area.

[0090] Among them, the real-time environmental information corresponding to the target position point corresponds to the global environmental area where the intelligent mobile robot is located, and the associated non-ground spraying area may be discontinuously distributed in the global environmental area, so it is necessary to plan the motion trajectory of the robotic arm. Specifically, the intelligent mobile robot can generate the motion trajectory of the robotic arm in real time according to the real-time environmental information and the information of the associated non-ground spraying area, or it can be a motion trajectory pre-stored at the target position point, which can be directly extracted and used when the robot arrives at the target position point.

[0091] Step S1032: Control the robotic arm device to spray along the motion trajectory based on the real-time motion information.

[0092] Therefore, the real-time position and posture of the robotic arm device can be confirmed through the real-time motion information of the robotic arm device. Combined with the real-time position and posture, the robotic arm can be controlled to spray accurately along the motion trajectory to meet the spraying needs of a specific area with high flexibility.

[0093] In one embodiment, Figure 5A flowchart of a method for spraying objects in a non-ground spraying area using a robotic arm device provided in an embodiment of the present application, such as Figure 5 As shown, the intelligent mobile robot also includes a visual recognition module; the specific process of controlling the mechanical arm device to spray the non-ground spraying area pre-associated with the target position point includes:

[0094] Step S1033: using a visual recognition module to identify the contours of objects in the non-ground spraying area associated with the target location point.

[0095] The intelligent mobile robot can also use a visual recognition module, such as a color camera, an infrared camera, a depth camera, and a thermal imaging sensor, which can be set according to the actual application scenario requirements. The robot can use the visual recognition module to identify the contours of items in the non-ground spraying area and obtain the locations and features of all items in the area.

[0096] Step S1034: When there is a target object in the area whose contour recognition result is consistent with the contour of the object to be sprayed, control the robot arm device to spray the target object.

[0097] Specifically, the spraying operation of the intelligent mobile robot can be to spray the target objects in the non-ground spraying area, so the contour recognition results of the objects in all areas can be compared with the contours of the set objects to be sprayed. When it is confirmed that there are target objects with the same contours, the position of the target objects can be determined based on the sensor information of the visual recognition module, and the mechanical arm device can be controlled to spray the target objects. In this way, the needs of refined operations can be met, and objects required in specific application scenarios can be sprayed accurately or supplemented.

[0098] In the above, when it is determined that the current working state of the intelligent mobile robot is an allowed working state, the real-time environmental information generated by the lidar module is compared with the set working area map to determine the real-time position point of the intelligent mobile robot; the real-time position point is compared with the set working moving path to determine the target position point, and based on the real-time motion information fed back by the motion measurement module, the intelligent mobile robot is driven to move toward the target position point; when the real-time position point is consistent with the target position point, the sprinkler device is controlled to spray the ground spraying area pre-associated with the target position point, and the robotic arm device is controlled to spray the non-ground spraying area pre-associated with the target position point, and the working status of the ground spraying area and the non-ground spraying area in the working area map is updated to the spraying completion status. It is achieved by combining real-time environmental information and the set work area map to improve the reliability of the robot's autonomous positioning of the real-time position point, and further combining the set work movement path and real-time motion information to provide accurate control information for the robot's movement. By controlling the nozzle device and the robotic arm device to spray different areas associated with the target position point, it takes into account the requirements of different spraying accuracies, improves the spraying of different application requirements, reduces the spraying operation time, and improves the spraying efficiency.

[0099] Optionally, on the basis of the foregoing embodiments, a mechanism for the intelligent mobile robot to return to a preset starting position may be provided. Specifically, real-time liquid level sensor information may be obtained based on a preset time interval, and the real-time liquid level height may be extracted from the real-time liquid level sensor information. When the real-time liquid level height is lower than a preset capacity limit, the intelligent mobile robot may be driven to return to the preset starting position. This can effectively deal with the situation where the robot leaks due to adverse environmental factors or its own abnormal factors, making it impossible to complete the operation. The robot may return to the preset starting position in time without continuing to complete the remaining path, thereby improving the efficiency of abnormality handling.

[0100] In addition, when the real-time position point is consistent with the end position of the operation moving path, the intelligent mobile robot can be driven to return to the preset starting position, or when a remote stop operation command is received from the system background, the robot automatically returns to the preset starting position, allowing the robot's operations to be flexibly deployed.

[0101] Figure 6 This is a structural block diagram of an automatic spraying device provided in an embodiment of the present application. The device is configured to execute the automatic spraying method provided in the above embodiment, and has the corresponding functional modules and beneficial effects of the execution method. The automatic spraying device is applied to an intelligent mobile robot, which is provided with a laser radar module, a motion measurement module, a spray head device and a mechanical arm device. Figure 6 As shown, the device specifically includes:

[0102] The position determination unit 101 is configured to determine the real-time position point of the intelligent mobile robot by comparing the real-time environment information generated by the laser radar module with the set operation area map when determining that the current working state of the intelligent mobile robot is the allowed working state;

[0103] The position moving unit 102 is configured to compare the real-time position point with the set operation moving path to determine the target position point, and drive the intelligent mobile robot to move to the target position point based on the real-time motion information fed back by the motion measurement module;

[0104] The area spraying unit 103 is configured to control the sprinkler device to spray the ground spraying area pre-associated with the target position point when the real-time position point is consistent with the target position point, and to control the robotic arm device to spray the non-ground spraying area pre-associated with the target position point, and to update the operation status of the ground spraying area and the non-ground spraying area in the operation area map to a spraying completion status.

[0105] In the above, the reliability of the robot's autonomous positioning of the real-time position point is improved by combining the real-time environmental information and the set work area map, and further combined with the set work movement path and real-time motion information to provide accurate control information for the robot's movement, and by controlling the nozzle device and the robotic arm device to spray different areas associated with the target position point, taking into account the requirements of different spraying accuracies, improving the spraying of different application requirements, reducing the spraying operation time, and improving the spraying efficiency.

[0106] In a possible embodiment, the intelligent mobile robot is provided with a spray liquid tank and a liquid level sensor;

[0107] The position determination unit 101 includes:

[0108] A sensor information detection module is configured to detect the effectiveness of the acquired liquid level sensor information, where the liquid level sensor information is a real-time measurement result of the current liquid level height of the spray liquid tank by the liquid level sensor;

[0109] The remaining liquid determination module is configured to extract the current liquid level height from the liquid level sensor information when the liquid level sensor information is valid information, and calculate the remaining liquid capacity according to the current liquid level height and the liquid tank structural parameters;

[0110] A liquid capacity comparison module is configured to compare the remaining liquid capacity with the required liquid capacity corresponding to the preset spraying area;

[0111] The first state determination module is configured to determine that the current working state of the intelligent mobile robot is an allowed working state when the remaining liquid capacity is greater than or equal to the required liquid capacity corresponding to the preset spraying area;

[0112] The second state determination module is configured to determine that the current working state of the intelligent mobile robot is a prohibited working state when the remaining liquid capacity is less than the required liquid capacity corresponding to the preset spraying area.

[0113] In a possible embodiment, the location determination unit 101 further includes:

[0114] The third state determination module is configured to determine that the current working state of the intelligent mobile robot is a prohibited working state when the liquid level sensor information is invalid information.

[0115] In a possible embodiment, the location determination unit 101 further includes:

[0116] The state feedback module is configured to upload the current state parameters of the intelligent mobile robot to the system background and output the sound and light alarm signal through the sound and light sensor.

[0117] In a possible embodiment, the regional spraying unit 103 includes:

[0118] A motion trajectory determination module is configured to extract a motion trajectory corresponding to the robotic arm device based on real-time environmental information corresponding to the target location point and an associated non-ground spraying area;

[0119] The robotic arm spraying module is configured to control the robotic arm device to spray along a motion trajectory based on real-time motion information.

[0120] In a possible embodiment, the intelligent mobile robot further includes a visual recognition module;

[0121] The regional spraying unit 103 comprises:

[0122] An object recognition module is configured to recognize the contour of an object in a non-ground spraying area associated with a target position point through a visual recognition module;

[0123] The object spraying module is configured to control the robot arm device to spray the target object when the contour recognition result of the target object in the area objects is consistent with the contour of the object to be sprayed.

[0124] In a possible embodiment, it further includes a finishing operation unit configured to:

[0125] Acquire real-time liquid level sensor information based on a preset time interval, extract the real-time liquid level height from the real-time liquid level sensor information, and drive the intelligent mobile robot to return to a preset starting position when the real-time liquid level height is lower than a preset capacity limit;

[0126] Or, when the real-time position point is consistent with the end position of the operation moving path, the intelligent mobile robot is driven to return to the preset starting position.

[0127] Figure 7 A schematic diagram of the structure of an intelligent mobile robot provided in an embodiment of the present application is shown in FIG. Figure 7 As shown, the intelligent mobile robot includes: a spray liquid tank 201; a liquid level sensor (not shown in the figure); a laser radar module 202; a motion measurement module (not shown in the figure); a nozzle device 203; a robotic arm device 204; a visual recognition module (not shown in the figure); one or more processors (not shown in the figure); a storage device (not shown in the figure), configured to store one or more programs, when one or more programs are executed by one or more processors, so that one or more processors can be used to execute the automatic spraying method provided in any of the above embodiments, with corresponding functions and beneficial effects.

[0128] An embodiment of the present application also provides a non-volatile storage medium containing computer executable instructions, which, when executed by a computer processor, is configured to execute an automatic spraying method described in the above embodiment, including: when it is determined that the current working state of the intelligent mobile robot is an allowed working state, comparing the real-time environmental information generated by the laser radar module with the set working area map to determine the real-time position point of the intelligent mobile robot; comparing the real-time position point with the set working moving path to determine the target position point, and driving the intelligent mobile robot to move toward the target position point based on the real-time motion information fed back by the motion measurement module; when the real-time position point is consistent with the target position point, controlling the sprinkler device to spray the ground spraying area pre-associated with the target position point, and controlling the robotic arm device to spray the non-ground spraying area pre-associated with the target position point, and updating the working status of the ground spraying area and the non-ground spraying area in the working area map to a spraying completion state.

[0129] Storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media, such as CD-ROM, floppy disk or tape devices; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; non-volatile memory, such as flash memory, magnetic media and optical storage; registers or other similar types of memory elements, etc. Storage media may also include other types of memory or combinations thereof. In addition, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system, which is connected to the first computer system via a network (such as the Internet). The second computer system can provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations (e.g., in different computer systems connected via a network). The storage medium may store program instructions (e.g., embodied as a computer program) that can be executed by one or more processors.

[0130] Of course, the storage medium containing computer executable instructions provided in the embodiment of the present application, whose computer executable instructions are not limited to the automatic spraying method described above, can also execute related operations in the automatic spraying method provided in any embodiment of the present application.

[0131] It is worth noting that in the embodiment of the above-mentioned automatic spraying system, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not configured to limit the protection scope of the embodiments of the present application.

[0132] It should be noted that the numbering of each step in this scheme is only used to describe the overall design framework of this scheme, and does not represent the necessary order relationship between the steps. On the basis that the overall implementation process conforms to the overall design framework of this scheme, it belongs to the protection scope of this scheme, and the order of precedence in the form of text during description is not an exclusive limitation on the specific implementation process of this scheme. It should be understood by those skilled in the art that the embodiments of the present application can be provided as methods, systems, or computer program products. In a typical configuration, a computing device includes one or more processors (CPU), an input / output interface, a network interface, and a memory. The memory may include non-permanent memory in a computer-readable medium, a random access memory (RAM) and / or a non-volatile memory in the form of a read-only memory (ROM) or a flash memory (flash RAM). The memory is an example of a computer-readable medium.

[0133] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0134] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. An automatic spraying method, applied to an intelligent mobile robot, characterized in that: The intelligent mobile robot is provided with a laser radar module, a motion measurement module, a nozzle device and a mechanical arm device; The automatic spraying method comprises: When it is determined that the current working state of the intelligent mobile robot is a permitted working state, the real-time location point of the intelligent mobile robot is determined based on the comparison of the real-time environmental information generated by the laser radar module with the set working area map; Compare the real-time position point with the set operation moving path to determine the target position point, and drive the intelligent mobile robot to move toward the target position point based on the real-time motion information fed back by the motion measurement module; When the real-time position point is consistent with the target position point, the sprinkler device is controlled to spray the ground spraying area pre-associated with the target position point, and the robot arm device is controlled to spray the non-ground spraying area pre-associated with the target position point, and the operation status of the ground spraying area and the non-ground spraying area in the operation area map is updated to a spraying completion state; Wherein, the intelligent mobile robot is provided with a spray liquid tank and a liquid level sensor; The specific process of determining the current working state of the intelligent mobile robot includes: Performing validity detection on the acquired liquid level sensing information, wherein the liquid level sensing information is a real-time measurement result of the current liquid level height of the spray liquid tank by the liquid level sensor; In the case where the liquid level sensor information is valid information, extracting the current liquid level height from the liquid level sensor information, and calculating the remaining liquid capacity according to the current liquid level height and the liquid tank structural parameters; comparing the remaining liquid capacity with the required liquid capacity corresponding to the preset spraying area; In a case where the remaining liquid capacity is greater than or equal to the required liquid capacity corresponding to the preset spraying area, determining that the current working state of the intelligent mobile robot is an allowed working state; When the remaining liquid capacity is less than the required liquid capacity corresponding to the preset spraying area, it is determined that the current working state of the intelligent mobile robot is a prohibited working state.

2. The automatic spraying method according to claim 1, characterized in that: After the effectiveness detection of the acquired liquid level sensor information is performed, the method further includes: When the liquid level sensing information is invalid information, it is determined that the current working state of the intelligent mobile robot is a prohibited working state.

3. The automatic spraying method according to any one of claims 1 or 2, characterized in that: After determining that the current working state of the intelligent mobile robot is a prohibited working state, the method further includes: The current state parameters of the intelligent mobile robot are uploaded to the system background, and an acoustic and optical alarm signal is output through an acoustic and optical sensor.

4. The automatic spraying method according to claim 1, characterized in that: The controlling the mechanical arm device to spray the non-ground spraying area pre-associated with the target position point includes: Extracting a motion trajectory corresponding to the robotic arm device based on the real-time environmental information corresponding to the target location point and the associated non-ground spraying area; The robot arm device is controlled to spray along the motion trajectory based on the real-time motion information.

5. The automatic spraying method according to claim 1, characterized in that: The intelligent mobile robot also includes a visual recognition module; The controlling the mechanical arm device to spray the non-ground spraying area pre-associated with the target position point includes: The visual recognition module is used to identify the contours of items in the non-ground spraying area associated with the target location point; When there is a target object among the objects in the area and the contour recognition result is consistent with the contour of the object to be sprayed, the robot arm device is controlled to spray the target object.

6. The automatic spraying method according to claim 1, characterized in that: The automatic spraying method further comprises: Acquire real-time liquid level sensor information based on a preset time interval, extract the real-time liquid level height from the real-time liquid level sensor information, and drive the intelligent mobile robot to return to a preset starting position when the real-time liquid level height is lower than a preset capacity limit; Or, when the real-time position point is consistent with the end position of the operation moving path, the intelligent mobile robot is driven to return to the preset starting position.

7. Automatic spraying device, applied to intelligent mobile robot, characterized in that: The intelligent mobile robot is provided with a laser radar module, a motion measurement module, a nozzle device and a mechanical arm device; The automatic spraying device comprises: A position determination unit is configured to determine the real-time position point of the intelligent mobile robot by comparing the real-time environment information generated by the laser radar module with a set operation area map when determining that the current operation state of the intelligent mobile robot is an allowed operation state; A position moving unit is configured to compare the real-time position point with a set operation moving path to determine a target position point, and drive the intelligent mobile robot to move toward the target position point based on the real-time motion information fed back by the motion measurement module; an area spraying unit, configured to, when the real-time position point is consistent with the target position point, control the spray head device to spray the ground spraying area pre-associated with the target position point, and control the mechanical arm device to spray the non-ground spraying area pre-associated with the target position point, and update the operation status of the ground spraying area and the non-ground spraying area in the operation area map to a spraying completion state; Among them, the intelligent mobile robot is provided with a spray liquid tank and a liquid level sensor; A position determination unit comprising: A sensor information detection module is configured to perform validity detection on the acquired liquid level sensor information, where the liquid level sensor information is a real-time measurement result of the current liquid level height of the spray liquid tank by the liquid level sensor; The remaining liquid determination module is configured to extract the current liquid level height from the liquid level sensor information when the liquid level sensor information is valid information, and calculate the remaining liquid capacity according to the current liquid level height and the liquid tank structural parameters; A liquid capacity comparison module is configured to compare the remaining liquid capacity with the required liquid capacity corresponding to the preset spraying area; The first state determination module is configured to determine that the current working state of the intelligent mobile robot is an allowed working state when the remaining liquid capacity is greater than or equal to the required liquid capacity corresponding to the preset spraying area; The second state determination module is configured to determine that the current working state of the intelligent mobile robot is a prohibited working state when the remaining liquid capacity is less than the required liquid capacity corresponding to the preset spraying area.

8. An intelligent mobile robot, characterized in that: include: Spray liquid tank; Liquid level sensor; LiDAR module; Motion measurement module; sprinkler device; Robotic arm device; Visual recognition module; one or more processors; A storage device configured to store one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the automatic spraying method according to any one of claims 1 to 6.

9. A non-volatile storage medium storing computer executable instructions, wherein the computer executable instructions are configured to perform the automatic spraying method according to any one of claims 1 to 6 when executed by a computer processor.