Robot control method, device, robot and storage medium
By monitoring the motor status and environment of the mobile robot, the motor will be locked if specific conditions are met, which solves the safety hazards caused by the robot being pushed in the suspended state in the prior art and improves the safety of the robot.
Patent Information
- Application Number
- CN202111618351.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-27
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2041-12-27
AI Technical Summary
The control logic of existing mobile robots is incomplete, which makes it easy to be pushed during the pause state, posing a safety hazard, which may lead to damage or loss of the robot.
By monitoring the motor status and surrounding environment of the robot, if specific conditions are met (such as being pushed, approaching an obstacle or having a child), a lock command will be sent to keep the motor in a locked state and prevent the robot from moving.
It effectively reduces safety risks, prevents robots from being lost and damaged, and improves the safety of robots.
Smart Images

Figure CN114310885B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of mobile robots, and in particular to a robot control method, a robot control device, a robot and a storage medium. Background Art
[0002] With the advancement of science and technology and the development of robotics, a variety of mobile robots have emerged in various fields to reduce or even replace manual labor, such as cleaning robots for cleaning the floor, home care robots for interacting with humans, and service robots for providing commodity delivery services to users. Mobile robots can accept human commands and perform corresponding tasks according to pre-set control logic, and are intelligent, autonomous, and highly flexible.
[0003] However, the control logic of existing mobile robots is still not perfect, and there are safety risks. For example, after executing or completing a task, a temporarily stopped robot is in an unattended state and is easily pushed by others, which may cause collision with obstacles, causing damage to the robot or even loss of the robot, posing a greater safety risk. Summary of the invention
[0004] The present invention provides a robot control method, device, robot and storage medium to solve the problem in the prior art that a paused mobile robot is easily pushed by people, posing a potential safety hazard.
[0005] A robot control method is provided, comprising:
[0006] Determine whether the robot's motor state is in the pause state;
[0007] If the motor state of the robot is in a paused state, the robot's own state and / or surrounding environment are monitored to obtain a monitoring result, and whether the motor locking condition is met is determined based on the monitoring result;
[0008] If the monitoring result meets the motor locking condition, a locking instruction is sent to the motor of the robot, so that the motor performs the motor locking operation according to the locking instruction.
[0009] Determine whether the robot is in safety mode; Optionally, before sending a lock command to the motor of the robot, the method further includes:
[0010] If the robot is in safety mode, a lock command is sent to the robot's motors.
[0011] Optionally, the monitoring result includes state information and moving speed, and determining whether the motor lock condition is met based on the monitoring result includes:
[0012] Determine whether the robot's status information is in a pushed state;
[0013] If it is determined that the state information of the robot is in a pushed state, determining whether the moving speed of the robot is greater than a preset speed;
[0014] If the moving speed of the robot is greater than the preset speed, it is determined that the monitoring result meets the motor lock condition.
[0015] Optionally, the monitoring result includes positioning information and / or environmental monitoring information, and determining whether the motor lock condition is met based on the monitoring result includes:
[0016] Determine whether the distance between the robot and the current map boundary is less than a preset distance based on the robot's own positioning information and / or the environmental monitoring information around the robot;
[0017] If it is determined that the distance between the robot and the current map boundary is less than a preset distance, it is determined that the monitoring result meets the motor lock condition.
[0018] Optionally, the monitoring result includes environmental monitoring information, and determining whether the motor lock condition is met based on the monitoring result includes:
[0019] Determine whether there are children around the robot based on the environmental monitoring information around the robot;
[0020] If there are children around the robot, it is determined that the monitoring results meet the motor locking conditions.
[0021] Optionally, determining whether there is a child around the robot based on environmental monitoring information around the robot includes:
[0022] Determine whether there is facial information in the environmental monitoring information;
[0023] If there is facial information in the environmental monitoring information, the facial information is input into a preset facial recognition model to obtain a facial recognition result output by the preset facial recognition model;
[0024] If the face recognition result is a child's face, it is determined that there are children around the robot.
[0025] Optionally, the robot's safety mode is set as follows:
[0026] The robot's safety mode is set as follows:
[0027] When receiving an on signal from the safety switch, modifying the safety mode parameter to a preset on parameter according to the on signal to turn on the safety mode of the robot;
[0028] When receiving the closing signal of the safety switch, obtaining the permission verification information;
[0029] Perform user authority verification based on authority verification information;
[0030] If the user authority verification result is passed, the safety mode parameter is modified to the preset shutdown parameter to turn off the robot's safety mode.
[0031] A robot control device is provided, comprising:
[0032] A determination module is used to determine whether the motor state of the robot is in a pause state;
[0033] A monitoring module, for monitoring the robot's own state and / or surrounding environment to obtain monitoring results if the robot's motor state is in a paused state, and determining whether the motor locking condition is met based on the monitoring results;
[0034] The locking module is used to send a locking instruction to the motor of the robot if the monitoring result meets the motor locking condition, so that the motor performs the motor locking operation according to the locking instruction.
[0035] A robot is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the steps of the robot control method are implemented when the processor executes the computer program.
[0036] A readable storage medium is provided, wherein the readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned robot control method are implemented.
[0037] In a solution provided by the above-mentioned robot control method, device, robot and storage medium, it is determined whether the motor state of the robot is in a pause state; if the motor state of the robot is in a pause state, the robot's own state and / or the surrounding environment are monitored to obtain a monitoring result, and based on the monitoring result, it is determined whether the motor locking condition is met; if the monitoring result meets the motor locking condition, a locking instruction is sent to the robot's motor so that the motor performs the motor locking operation according to the locking instruction; in the present invention, after determining that the robot's motor is in a pause state, the robot's own state and / or the surrounding environment are monitored, so that when it is determined that there is a safety hazard, the motor is automatically locked, making the robot unable to move, which can reduce safety risks and prevent the loss of the robot, thereby improving the safety of the robot. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.
[0039] Figure 1is a schematic structural diagram of a robot in one embodiment of the present invention;
[0040] Figure 2 is a schematic flow chart of a robot control method in one embodiment of the present invention;
[0041] Figure 3 is another schematic flow chart of a robot control method according to an embodiment of the present invention;
[0042] Figure 4 is a schematic structural diagram of a robot control device in one embodiment of the present invention;
[0043] Figure 5 is another schematic diagram of the structure of a robot in one embodiment of the present invention;
[0044] Figure 6 1 is another structural schematic diagram of a robot control device in one embodiment of the present invention. DETAILED DESCRIPTION
[0045] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0046] The robot control method provided by the embodiment of the present invention can be applied in Figure 1 In the robot shown, the robot includes a motor, an environment monitoring device and a robot control device. The motor and the environment monitoring device communicate with the robot control device via a bus. The robot in this embodiment is a mobile robot.
[0047] The robot control device determines whether the motor state of the robot is in a paused state. If the motor state of the robot is in a paused state, the robot's own state is monitored, and / or the surrounding environment is monitored through an environmental monitoring device to obtain a monitoring result, and determines whether the motor locking condition is met based on the monitoring result; if the monitoring result meets the motor locking condition, a locking instruction is sent to the robot's motor so that the motor performs the motor locking operation according to the locking instruction; in this embodiment, after determining that the robot's motor is in a paused state, the robot's own state and / or the surrounding environment are monitored, so that when it is determined that there is a safety hazard, the motor is automatically locked, making the robot unable to move, which can reduce safety risks and prevent the loss of the robot, thereby improving the safety of the robot.
[0048] In this embodiment, the robot includes a motor, an environmental monitoring device and a robot control device. This is only for exemplary purposes. In other embodiments, the robot also includes other devices, such as an electronic control unit, a safety switch and a display screen, which will not be repeated here.
[0049] In one embodiment, if Figure 2 As shown, a robot control method is provided, which is applied in Figure 1 The robot in the example is used to illustrate the following steps:
[0050] S10: Determine whether the motor state of the robot is a pause state.
[0051] After the robot is turned on, the motor on the robot will feed back its status to the robot control device in real time. The robot control device needs to determine whether the robot's motor status is paused based on the status of the motor feedback. If it is detected that the robot's motor status is not paused, the robot's motor status will continue to be detected until it is determined that the motor status is paused.
[0052] Among them, the pause state is the state in which the robot cannot move and the motor temporarily stops running when the motor encounters external force (such as people, obstacles, etc.) during the robot's task execution; or the state in which the motor stops running when the robot is waiting for a task, or the state in which the motor stops running after the robot is powered off. When the robot is executing a task, if it detects that the display page on the robot is clicked, or detects that the emergency stop button on the robot is triggered, a pause command is sent to the motor, and the motor stops running and is in a pause state after receiving the pause command, and the pause state is fed back to the robot control device; after completing the task, the robot has no task to execute temporarily, and at this time a pause command is sent to the motor, and the motor stops running and is in a pause state after receiving the pause command to wait for the next task, and the pause state is fed back to the robot control device; after the robot is powered off, the motor stops running and is in a pause state, and the pause state is fed back to the robot control device.
[0053] The motor status of the robot includes running status, paused status and locked status. When the robot is moving, the motor status of the robot is running status; when the robot is stationary, the motor status of the robot is paused status, in which the robot can move, such as being pushed by a person or moving according to instructions; when the motor status of the robot is locked status, the motor is locked and the robot cannot move, that is, it cannot be pushed by a person, and can only move after receiving relevant instructions.
[0054] S20: If the motor state of the robot is a paused state, the robot's own state and / or surrounding environment are monitored to obtain monitoring results, and based on the monitoring results, it is determined whether the motor locking condition is met.
[0055] After determining whether the robot's motor state is in a paused state, if the robot's motor state is in a paused state, indicating that the robot is paused or in a stationary state waiting for a task, the robot control device needs to monitor the robot's own state, and / or monitor the robot's surrounding environment through a link monitoring device to obtain monitoring results, so as to monitor whether the robot is pushed by a person and whether there are unsafe factors around it, and determine whether the motor locking conditions are met based on the monitoring results.
[0056] S30: If the monitoring result meets the motor locking condition, a locking instruction is sent to the motor of the robot, so that the motor performs the motor locking operation according to the locking instruction.
[0057] After monitoring the robot's own state and / or surrounding environment to obtain monitoring results, and determining whether the motor locking condition is met based on the monitoring results, if the monitoring results meet the motor locking condition, it means that the robot may be pushed by a person and / or there may be unsafe factors around it, then the robot control device will send a locking instruction to the robot's motor so that the motor performs the motor locking operation according to the locking instruction. If the monitoring results do not meet the motor locking condition, it means that the robot may be pushed by a person and / or there are no unsafe factors around it, and there is no need to lock the motor.
[0058] Among them, after sending a locking command to the robot's motor, in order to further prevent the motor from being locked by mistake, the motor will check whether the robot's safety mode parameter is a preset start parameter after receiving the locking command. If the safety mode parameter is the preset start parameter, indicating that the safety mode is on, the motor responds to the locking command and executes the motor locking operation to reduce the safety risk caused by the robot being moved manually; if the safety mode parameter is not the preset start parameter, but the preset close parameter, indicating that the safety mode is not on, the motor does not respond to the locking command and does not execute the motor locking operation to reduce the possibility of subsequent inability to perform tasks due to the motor being locked.
[0059] In this embodiment, by determining whether the motor state of the robot is in a paused state, if the motor state of the robot is in a paused state, the robot's own state is monitored, and / or the surrounding environment is monitored through an environmental monitoring device to obtain a monitoring result, and based on the monitoring result, it is determined whether the motor locking condition is met; if the monitoring result meets the motor locking condition, a locking instruction is sent to the robot's motor so that the motor performs the motor locking operation according to the locking instruction; after determining that the robot's motor is in a paused state, the robot's own state and the surrounding environment are monitored to automatically lock the motor when it is determined that there is a safety hazard, so that the robot cannot move. This can reduce safety risks and prevent the loss of the robot, thereby improving the safety of the robot.
[0060] In one embodiment, if Figure 3 As shown, before step S30, that is, before sending a locking instruction to the motor of the robot, the method further specifically includes the following steps:
[0061] S301: Determine whether the robot is in safety mode.
[0062] After determining that the monitoring results meet the motor lock conditions, before sending a lock command to the robot's motor, in order to avoid repeated operations, it is also necessary to determine whether to turn on the safety mode.
[0063] If the monitoring result does not meet the motor lock condition, it means that the robot may be pushed by a person and / or there are no unsafe factors around it. In this case, there is no need to determine whether the robot is in safety mode to reduce robot operation.
[0064] S302: If the robot turns on the safety mode, a locking command is sent to the motor of the robot.
[0065] After determining that the robot is in safety mode, if the robot is in safety mode, a locking command is directly sent to the robot's motor so that the motor performs the motor locking operation according to the locking command; if the robot is not in safety mode, it is necessary to turn on the safety mode first, and then send a locking command to the robot's motor.
[0066] In this embodiment, before sending a locking command to the robot's motor, it is necessary to determine whether the robot has turned on the safety mode. If the robot has turned on the safety mode, a locking command is sent to the robot's motor, and confirmation that the safety mode is turned on is first performed. After confirming that the safety mode is turned on, the locking command is sent. This avoids the possibility of failure of the motor locking operation due to the safety mode not being turned on, and can also avoid repeated operations to turn on the safety mode, thereby improving the robot's response speed.
[0067] In one embodiment, after step S301, that is, after determining whether the robot is in safety mode, the method further specifically includes the following steps:
[0068] S303: If the robot has not turned on the safety mode, a turn-on instruction is sent to the robot, so that the robot turns on the safety mode of the robot according to the turn-on instruction.
[0069] After determining whether the robot is in safety mode, if the robot is not in safety mode, the robot control device sends an activation instruction to the electronic control unit of the robot, so that the electronic control unit of the robot activates the safety mode of the robot according to the activation instruction.
[0070] Among them, after the robot control device sends a start-up command to the electronic control unit of the robot, the electronic control unit receives the start-up command and changes the safety mode parameters to preset start-up parameters after receiving the start-up command. At this time, the safety mode is turned on, that is, the safety mode of the robot is turned on according to the start-up command.
[0071] Among them, if the robot does not turn on the safety mode, the robot control device calls the corresponding interface of the software development kit (SDK) to notify the SDK to send an opening instruction to the robot's electronic control unit. After the robot's electronic control unit receives the opening instruction sent by the SDK, it changes the safety mode parameters to the preset opening parameters, and the safety mode is turned on. The opening of the safety mode can be completed by sending an opening instruction to the robot's electronic control unit through the SDK and changing the safety mode parameters. Only the instructions sent by the robot itself can control the movement of the robot. It is simple, fast, safe and reliable, and does not require extra devices and operations.
[0072] S304: After the safety mode is turned on, a locking command is sent to the motor of the robot.
[0073] After the safety mode is turned on, the robot control device sends a locking command to the robot's motor. After receiving the locking command, the motor will check whether the safety mode parameter is the preset turning-on parameter. If the safety mode parameter is the preset turning-on parameter, the motor will respond to the locking command and execute the motor locking operation to reduce the safety risk caused by the robot being moved manually; if the safety mode parameter is not the preset turning-on parameter but the preset turning-off parameter, the motor will not respond to the locking command and will not execute the motor locking operation to reduce the possibility of subsequent inability to execute tasks due to the motor being locked.
[0074] In this embodiment, after determining whether the robot has turned on the safety mode, if the robot has not turned on the safety mode, an opening instruction is sent to the robot, so that the robot turns on the safety mode of the robot according to the opening instruction; after the safety mode is turned on, a locking instruction is sent to the robot's motor; after determining that the monitoring result meets the motor locking condition, the safety mode is automatically turned on, and then the motor locking operation is performed, thereby avoiding the possibility of failure of the motor locking operation due to the safety mode not being turned on, and then the motor can be locked in time, thereby avoiding safety hazards caused by being pushed at will by people.
[0075] In one embodiment, the monitoring result includes state information and moving speed, and the state information is obtained based on the detection of its own state. In step S20, whether the motor lock condition is met is determined based on the monitoring result, which specifically includes the following steps:
[0076] SA31: Determine whether the robot's status information is in a pushed state.
[0077] After determining that the motor state of the robot is in the pause state, the robot control device needs to monitor the robot's own state and the surrounding environment to monitor in real time whether the robot's state information is in the pushed state.
[0078] Among them, since the robot's motor state is in a paused state, the robot cannot move. At this time, it determines whether it is pushed based on its own moving state. If the robot moves and has a certain moving speed, it is judged that the robot is in a pushed state at this time, which poses a safety risk.
[0079] SA22: If it is determined that the state information of the robot is in a pushed state, determine whether the moving speed of the robot is greater than a preset speed.
[0080] After determining whether the state information of the robot is in a pushed state, if it is determined that the state information of the robot is in a pushed state, it is determined whether the moving speed of the robot is greater than a preset speed. When the robot is moved, the faster the moving speed, the more uncontrollable the robot is, and the higher the risk of collision. When the moving speed is low, the risk of collision is low. Therefore, it is necessary to detect the moving speed of the robot when the robot is pushed. That is, after determining that the state information of the robot is in a pushed state, it is necessary to determine in real time whether the moving speed of the robot is greater than a preset speed.
[0081] SA23: If the robot's moving speed is greater than the preset speed, it is determined that the monitoring result meets the motor lock condition.
[0082] After determining whether the robot's moving speed is greater than the preset speed, if the robot's moving speed is greater than the preset speed, it means that the robot is more likely to have a collision accident and the safety risk is higher. Then, it is determined that the monitoring result meets the motor locking condition, and the motor needs to be locked so that the robot cannot move to ensure the safety of the robot.
[0083] In this embodiment, by determining whether the state information of the robot is a pushed state; if the state information of the robot is determined to be a pushed state, then determining whether the moving speed of the robot is greater than a preset speed; if the moving speed of the robot is greater than the preset speed, then determining that the monitoring result meets the motor locking condition, the specific steps for determining whether the motor locking condition is met based on the monitoring result are clarified, and by monitoring the moving speed of the robot, the robot motor can be locked in time when the speed is fast, thereby avoiding safety hazards caused by being pushed at will by people, thereby ensuring the safety of the robot.
[0084] In one embodiment, the monitoring result includes positioning information and / or environmental monitoring information. Optionally, the positioning information is obtained by detecting its own state and / or monitoring the surrounding environment, and the environmental detection information is obtained by detecting the surrounding environment. In step S20, determining whether the motor locking condition is met based on the monitoring result specifically includes the following steps:
[0085] SB21: Determine whether the distance between the robot and the current map boundary is less than a preset distance based on the robot's own positioning information and / or the environmental monitoring information around the robot.
[0086] After determining that the robot's motor state is in a paused state, the robot control device needs to determine whether the distance between the robot and the current map boundary is less than a preset distance based on its own positioning information and map information, and / or determine whether the distance between the robot and the current map boundary is less than a preset distance based on environmental monitoring information around the robot.
[0087] In an optional embodiment, when the robot is running in a fixed scene, it will obtain the map information of the fixed scene through mapping. Since the fixed scene that the robot needs to run is limited, for example, a 200-square-meter store has a boundary, which may be a wall or an empty area. Therefore, the corresponding map information also has a map boundary, which corresponds to the boundary of the fixed scene. Since the map information only contains positioning information, obstacle information, fall information, etc. within the map boundary. Therefore, by determining the machine
[0088] After determining whether the distance between the robot and the current map boundary is less than the preset distance, it is determined based on environmental monitoring information that the distance between the robot and the current map boundary is less than the preset distance, indicating that the robot is close to the map boundary and continuing to move will collide with map boundary obstacles, or the robot may fall, be stolen, or become unpositionable. At this time, the safety person checks whether the distance between the robot and the current map boundary is less than the preset distance to prevent the robot from moving out of the fixed scene.
[0089] SB22: If it is determined that the distance between the robot and the current map boundary is less than a preset distance, it is determined that the monitoring result satisfies the motor lock condition.
[0090] If the risk is high, it is determined that the monitoring results meet the motor locking conditions, and the motor needs to be locked so that the robot cannot move to ensure the safety of the robot.
[0091] In this embodiment, based on the robot's own positioning information and / or the environmental monitoring information around the robot, it is determined whether the distance between the robot and the current map boundary is less than a preset distance; if it is determined that the distance between the robot and the current map boundary is less than the preset distance, it is determined that the monitoring result meets the motor locking condition. By monitoring the distance between the robot and the map boundary, the specific steps for determining whether the motor locking condition is met based on the monitoring result are clarified, and the robot motor can be locked in time when approaching the map boundary, thereby reducing the risk of the robot colliding, falling or being stolen, and ensuring the safety of the robot.
[0092] In one embodiment, after determining that the robot's state information is in a pushed state, it is also necessary to determine whether the distance between the robot and the current map boundary is less than a preset distance based on the robot's own positioning information and / or the environmental monitoring information around the robot. If it is determined that the distance between the robot and the current map boundary is less than the preset distance, it is determined that the monitoring result meets the motor locking condition, thereby locking the motor so that the robot cannot move, thereby ensuring the safety of children.
[0093] In one embodiment, the monitoring result includes environmental monitoring information. In step S20, determining whether the motor lock condition is met based on the monitoring result specifically includes the following steps:
[0094] SC21: Determine whether there are children around the robot based on the environmental monitoring information around the robot.
[0095] After determining that the motor state of the robot is in the pause state, the robot control device needs to determine whether there is a child around the robot based on the environmental monitoring information around the robot when monitoring the surrounding environment of the robot.
[0096] SC22: If there are children around the robot, determine that the monitoring results meet the motor lock condition.
[0097] After determining whether there are children around the robot based on the environmental monitoring information around the robot, if it is determined that there are children around the robot, it is determined that the monitoring results meet the motor locking conditions to lock the motor so that the robot cannot move, thereby reducing safety risks such as children pushing the robot or the robot colliding with children, thereby ensuring the safety of children.
[0098] In one embodiment, after determining that the robot's state information is in a pushed state, it is also necessary to determine whether there are children around the robot based on the environmental monitoring information around the robot. If it is determined that there are children around the robot, it is determined that the monitoring results meet the motor locking conditions, thereby locking the motor so that the robot cannot move and ensuring the safety of the children.
[0099] In this embodiment, before determining whether the state information of the robot is in a pushed state, it is determined whether there are children around the robot based on the environmental monitoring information around the robot; if there are children around the robot, it is determined that the monitoring results meet the motor locking conditions, and the specific steps for determining whether the motor locking conditions are met based on the monitoring results are clarified. When it is detected that there are children around, the motor of the robot is locked in time, making the robot unable to move, thereby avoiding safety hazards caused by being pushed by children at will and ensuring the safety of children.
[0100] In one embodiment, step SC21, i.e., determining whether there is a child around the robot according to the environmental monitoring information around the robot, specifically includes the following steps:
[0101] SC211: Determine whether there is facial information in the environmental monitoring information.
[0102] When monitoring the robot's surrounding environment, determine whether there is face information in the environmental monitoring information around the robot. In this embodiment, the robot's surrounding environment can be monitored in real time by a camera to obtain environmental monitoring information, and the environmental monitoring information can be identified using face recognition technology to determine whether there is face information in the environmental monitoring information.
[0103] SC212: If there is facial information in the environmental monitoring information, the facial information is input into a preset facial recognition model to obtain a facial recognition result output by the preset facial recognition model.
[0104] After determining whether there is facial information in the environmental monitoring information, if it is determined that there is facial information in the environmental monitoring information, the facial information is input into a preset facial recognition model to obtain a facial recognition result output by the preset facial recognition model. The preset facial recognition model is a deep learning model pre-trained based on facial data of users of different age groups, which can accurately identify the type of face in the facial information, that is, the age group to which the face belongs. Facial types include children's faces, teenagers' faces, adult faces, and elderly faces.
[0105] SC213: If the face recognition result is a child's face, it is determined that there are children around the robot.
[0106] After inputting the facial information into the preset facial recognition model to obtain the facial recognition result output by the preset facial recognition model, if the facial recognition result is a child's face, it is determined that there are children around the robot.
[0107] In this embodiment, determining the presence of children around the robot based on the face information in the environmental monitoring information and the preset face recognition model is only an exemplary description. In other embodiments, all human body information in the environmental monitoring information can also be determined, and the presence of children around the robot can be determined based on the human height in all human body information; if there is a human height less than the preset height in all human body information, it is determined that there are children around the robot; if there is no human height less than the preset height in all human body information, it is determined that there are no children around the robot. Determining whether there are children around the robot by means of human height is simple and fast, and can improve the response speed of the robot.
[0108] In this embodiment, it is determined whether there is facial information in the environmental monitoring information; if there is facial information in the environmental monitoring information, the facial information is input into a preset facial recognition model to obtain the facial recognition result output by the preset facial recognition model; if the facial recognition result is a child's face, it is determined that there are children around the robot. The specific steps of determining whether there are children around the robot based on the environmental monitoring information around the robot are clarified, and the preset facial recognition model is used to recognize the facial information, which has high accuracy and is simple and convenient, reduces the amount of calculation, and can quickly obtain results.
[0109] In one embodiment, before step S10, the safety mode parameters of the robot may be preset to turn on or off the safety mode, so that the user can turn on or off the safety mode according to actual needs.
[0110] The security mode is set as follows:
[0111] S01: When an on signal of the safety switch is received, the safety mode parameters are modified to preset on parameters according to the on signal to turn on the safety mode of the robot.
[0112] In one embodiment, when the safety mode needs to be turned on, the user can turn on the robot's safety mode through the safety switch set on the robot to prevent the robot from being pushed by others, thereby avoiding safety hazards caused by being pushed at will by others.
[0113] The user manually turns on the safety switch on the robot. At this time, the robot control device receives the start signal of the safety switch. When the start signal of the safety switch in the robot is received, the safety mode parameters are modified to the preset start parameters according to the start signal to turn on the safety mode of the robot. So that when the robot's motor state is detected to be in the pause state later, the robot control device directly determines whether the robot turns on the safety mode according to the safety mode parameters; so that when the motor receives the lock command later, it determines whether to execute the lock command according to the safety mode parameters.
[0114] Among them, when the start signal of the safety switch in the robot is received, the robot control device calls the corresponding interface of the SDK and notifies the SDK to send a start instruction to the electronic control unit; after the electronic control unit receives the start instruction sent by the SDK, it modifies the safety mode parameters to the preset start parameters, and the robot's safety mode is turned on.
[0115] S02: When a closing signal of the safety switch is received, obtaining permission verification information; and performing user permission verification based on the permission verification information.
[0116] When the safety mode needs to be turned off, the user can turn off the safety mode of the robot through the safety switch set on the robot, so as to facilitate the mobile robot to perform other management and maintenance work. When the user manually turns off the safety switch on the robot, the robot control device will receive the safety switch off signal; when receiving the safety switch off signal, it will obtain the permission verification information.
[0117] Optionally, the robot will display an authentication interface through the control device, so that the user can enter permission verification information in the authentication interface, and the robot performs user permission verification based on the permission verification information.
[0118] The user enters permission verification information including user information and verification code on the authentication interface.
[0119] That is, when receiving the closing signal of the safety switch, the robot control device will jump to the authentication interface and display it to the user. The user can scan the QR code on the authentication interface to enable the WeChat applet to perform user authority verification according to the user information bound to the user account, and complete the user authority verification to obtain the user authority verification result; the user can also click the verification code authentication button on the authentication interface. After receiving the verification code authentication instruction, the robot control device jumps to the verification code authentication interface, so that the user enters the verification code of the corresponding store bound to the robot in the verification code authentication interface, and performs user authority verification to obtain the user authority verification result.
[0120] S03: If the user authority verification result is passed, the safety mode parameter is modified to a preset shutdown parameter to turn off the robot's safety mode.
[0121] When the user authority verification is performed according to the authority verification information, if the user authority verification result is verified, it means that the user authority meets the requirements, then the safety mode parameters can be modified to the shutdown parameters, that is, the safety mode can be turned off. Specifically, the robot control device sends a shutdown instruction to the electronic control unit of the robot through the SDK, so that the electronic control unit modifies the safety mode parameters to the preset shutdown parameters according to the shutdown instruction to turn off the safety mode of the robot. If the user authority verification result is not verified, it means that the user authority does not meet the requirements and the safety mode cannot be turned off, and the safety mode shutdown operation will not be performed.
[0122] If the user authority verification result is passed, the robot control calls the corresponding SDK interface to notify the SDK to send a shutdown command to the robot's electronic control unit. After receiving the shutdown command, the electronic control unit modifies the safety mode parameters to the preset shutdown parameters to turn off the robot's safety mode.
[0123] In this embodiment, the safety mode shutdown operation is performed only when the user authority verification result is verified to pass, preventing the robot's safety mode from being arbitrarily shut down by unrelated personnel, thereby reducing the safety hazards caused by the robot's inability to perform motor locking operations when necessary.
[0124] In the present embodiment, when a turn-on signal of a safety switch in the robot is received, a turn-on instruction is sent to the robot, so that the robot modifies the safety mode parameters to preset turn-on parameters according to the turn-on instruction to turn on the robot's safety mode; when a turn-off signal of the safety switch is received, an authentication interface is displayed, so that the user can input permission verification information in the authentication interface, and perform user permission verification according to the permission verification information; if the user permission verification result is a passed verification, a turn-off instruction is sent to the robot, so that the robot modifies the safety mode parameters to preset turn-off parameters according to the turn-off instruction to turn off the robot's safety mode; the method of turning the robot's safety mode on or off is clarified, and the operation of turning the safety mode on or off is performed by modifying the parameters, which is simple and fast. In addition to the aforementioned automatic turning on of the safety mode, the safety mode can also be turned on manually, thereby ensuring the safety of the robot; in addition, it can prevent the robot's safety mode from being arbitrarily turned off by unrelated personnel, thereby reducing the safety hazards caused by the robot's inability to perform motor locking operations when necessary.
[0125] In one embodiment, step S301, that is, determining whether the robot is in safety mode, specifically includes the following steps:
[0126] S3011: Determine whether the robot's safety mode parameters are preset start parameters;
[0127] S3021: If the safety mode parameter is a preset start parameter, determining that the robot starts the safety mode;
[0128] S3031: If the safety mode parameter is not the preset activation parameter, it is determined that the robot is not in safety mode.
[0129] After monitoring the robot's own state and / or surrounding environment to obtain monitoring results, and determining whether the motor lock condition is met based on the monitoring results, if the monitoring results meet the motor lock condition, the robot control device determines the robot's safety mode parameters, whether they are preset start-up parameters; if the safety mode parameters are preset start-up parameters, it is determined that the robot is in safety mode; if the safety mode parameters are not preset start-up parameters but preset close parameters, it is determined that the robot is not in safety mode.
[0130] Among them, the preset opening parameter and the preset closing parameter can be 0 and 1 respectively. After monitoring the robot's own state and / or the surrounding environment to obtain the monitoring results, and determining whether the motor lock condition is met based on the monitoring results, if the monitoring result meets the motor lock condition, the robot control device determines the robot's safety mode parameter, whether it is 0; if the safety mode parameter is 0, it is determined that the robot is in safety mode; if the safety mode parameter is 1, and the safety mode parameter is not the preset opening parameter, it is determined that the robot is not in safety mode.
[0131] In this embodiment, the preset opening parameter and the preset closing parameter can be 0 and 1 respectively. This is only for exemplary description. In other embodiments, the preset opening parameter and the preset closing parameter can also be other parameters. For example, the preset opening parameter and the preset closing parameter can also be true and false respectively, or can also be -1 or 2 respectively.
[0132] In this embodiment, the robot's safety mode parameters are determined to see whether they are preset start-up parameters. If the safety mode parameters are preset start-up parameters, it is determined that the robot has turned on the safety mode; if the safety mode parameters are not preset start-up parameters, it is determined that the robot has not turned on the safety mode. Whether the safety mode is turned on is determined directly by reading the parameters, which is simple and convenient.
[0133] It should be understood that the order of execution of the steps in the above embodiment does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.
[0134] In one embodiment, a robot control device is provided, which corresponds one-to-one to the robot control method in the above embodiment. Figure 4 As shown, the robot control device includes a determination module 401, a monitoring module 402 and a locking module 403. The functional modules are described in detail as follows:
[0135] A determination module 401 is used to determine whether the motor state of the robot is a pause state;
[0136] The monitoring module 402 is used to monitor the robot's own state and / or surrounding environment to obtain monitoring results if the robot's motor state is in a paused state, and determine whether the motor lock condition is met based on the monitoring results;
[0137] The locking module 403 is used to send a locking instruction to the motor of the robot if the monitoring result meets the motor locking condition, so that the motor performs the motor locking operation according to the locking instruction.
[0138] Optionally, before sending the locking instruction to the motor of the robot, the locking module 403 is further used to:
[0139] Determining whether the robot turns on the safety mode;
[0140] If the robot turns on the safety mode, the locking instruction is sent to the motor of the robot.
[0141] Optionally, after determining whether the robot is in safety mode, the locking module 403 is further used to:
[0142] If the robot is not in safety mode, sending an enable command to the robot so that the robot can enable the safety mode of the robot according to the enable command;
[0143] After the safety mode is turned on, a locking command is sent to the motor of the robot so that the motor performs a motor locking operation according to the locking command.
[0144] Optionally, the monitoring result includes state information and moving speed, and the monitoring module 402 is specifically used for:
[0145] Determine whether the robot's status information is in a pushed state;
[0146] If it is determined that the state information of the robot is in a pushed state, determining whether the moving speed of the robot is greater than a preset speed;
[0147] If the moving speed of the robot is greater than the preset speed, it is determined that the monitoring result meets the motor lock condition.
[0148] Optionally, the monitoring result includes positioning information and / or environmental monitoring information, and the monitoring module 402 is further configured to:
[0149] Determining whether the distance between the robot and the current map boundary is less than a preset distance according to the positioning information of the robot itself and / or the environmental monitoring information around the robot;
[0150] If it is determined that the distance between the robot and the current map boundary is less than the preset distance, it is determined that the monitoring result meets the motor locking condition.
[0151] Optionally, the monitoring result includes environmental monitoring information, and the monitoring module 402 is further used to:
[0152] Determine whether there are children around the robot based on the environmental monitoring information around the robot;
[0153] If there are children around the robot, it is determined that the monitoring results meet the motor locking conditions.
[0154] Optionally, the monitoring module 402 is further configured to:
[0155] Determine whether there is facial information in the environmental monitoring information;
[0156] If there is facial information in the environmental monitoring information, the facial information is input into a preset facial recognition model to obtain a facial recognition result output by the preset facial recognition model;
[0157] If the face recognition result is a child's face, it is determined that there are children around the robot.
[0158] Optionally, the locking module 403 is further configured to:
[0159] Determine the robot's safety mode parameters and whether they are preset enable parameters;
[0160] If the safety mode parameter is the preset enable parameter, the robot is determined to enable the safety mode;
[0161] If the safety mode parameter is not the preset enable parameter, it is determined that the robot is not in safety mode.
[0162] Optionally, the robot control device further includes a modification module 404, and the modification module 404 is specifically used for:
[0163] When receiving an on signal from the safety switch, modifying the safety mode parameter to a preset on parameter according to the on signal to turn on the safety mode of the robot;
[0164] When receiving the closing signal of the safety switch, obtaining the permission verification information;
[0165] Perform user authority verification based on authority verification information;
[0166] If the user authority verification result is passed, the safety mode parameter is modified to the preset shutdown parameter to turn off the robot's safety mode.
[0167] For the specific definition of the robot control device, please refer to the definition of the robot control method above, which will not be repeated here. Each module in the above robot control device can be implemented in whole or in part by software, hardware and their combination. The above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0168] In one embodiment, a robot is provided, whose internal structure diagram can be shown as follows: Figure 5 As shown. The computer device includes a processor, a memory, a network interface, a display screen and an input device connected through a system bus. Among them, the processor of the robot is used to provide computing and control capabilities. The memory of the robot includes a storage medium and an internal memory. The storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the storage medium. The network interface of the robot is used to communicate with an external server through a network connection. When the computer program is executed by the processor, a robot control method is implemented.
[0169] In one embodiment, Figure 6 As shown, a robot control device or a robot is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the following steps are implemented:
[0170] Determine whether the robot's motor state is in the pause state;
[0171] If the motor state of the robot is in a paused state, the robot's own state and / or surrounding environment are monitored to obtain a monitoring result, and whether the motor locking condition is met is determined based on the monitoring result;
[0172] If the monitoring result meets the motor locking condition, a locking instruction is sent to the motor of the robot, so that the motor performs the motor locking operation according to the locking instruction.
[0173] In one embodiment, a readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
[0174] Determine whether the robot's motor state is in the pause state;
[0175] If the motor state of the robot is in a paused state, the robot's own state and / or surrounding environment are monitored to obtain a monitoring result, and whether the motor locking condition is met is determined based on the monitoring result;
[0176] If the monitoring result meets the motor locking condition, a locking instruction is sent to the motor of the robot, so that the motor performs the motor locking operation according to the locking instruction.
[0177] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing related hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory.
[0178] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.
[0179] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features thereof may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.
Claims
1. A robot control method, characterized in that: include: Determine whether the robot's motor state is in the pause state; If the motor state of the robot is the pause state, the robot's own state and / or surrounding environment are monitored to obtain a monitoring result, and whether the motor lock condition is met is determined based on the monitoring result, wherein the motor state of the robot includes a running state, a pause state and a locked state; If the monitoring result meets the motor locking condition, sending a locking instruction to the motor of the robot so that the motor performs a motor locking operation according to the locking instruction; After sending a locking command to the motor of the robot, in order to further prevent the motor from being locked by mistake, the motor checks whether the safety mode parameter of the robot is a preset opening parameter after receiving the locking command; If the safety mode parameter is the preset on parameter, indicating that the safety mode is on, the motor responds to the lock command and executes the motor lock operation to reduce the safety risk caused by the robot being moved manually; If the safety mode parameter is not the preset on parameter but the preset off parameter, it means that the safety mode is not on, then the motor will not respond to the lock command and will not perform the motor lock operation, so as to reduce the possibility of subsequent inability to perform tasks due to the motor being locked; The pause state includes a state in which the motor of the robot cannot move and temporarily stops running when the motor encounters an external force during the robot's task execution; or a state in which the motor stops running when the robot is waiting for a task, or a state in which the motor stops running after the robot is powered off; The monitoring result includes state information and moving speed, and determining whether the motor lock condition is met based on the monitoring result includes: Determining whether the state information of the robot is a pushed state; If it is determined that the state information of the robot is the pushed state, determining whether the moving speed of the robot is greater than a preset speed; If the moving speed of the robot is greater than the preset speed, it is determined that the monitoring result meets the motor locking condition.
2. The robot control method according to claim 1, characterized in that: Before sending a locking instruction to the motor of the robot, the method further comprises: Determine whether the robot is in safety mode; If the robot turns on the safety mode, the locking instruction is sent to the motor of the robot.
3. The robot control method according to claim 1, characterized in that: The monitoring result includes positioning information and / or environmental monitoring information, and determining whether the motor lock condition is met based on the monitoring result includes: Determining whether the distance between the robot and the current map boundary is less than a preset distance according to the positioning information of the robot itself and / or the environmental monitoring information around the robot; If it is determined that the distance between the robot and the current map boundary is less than the preset distance, it is determined that the monitoring result meets the motor locking condition.
4. The robot control method according to claim 1, characterized in that: The monitoring result includes environmental monitoring information, and determining whether the motor lock condition is met based on the monitoring result includes: Determining whether there is a child around the robot according to the environmental monitoring information around the robot; If there are children around the robot, it is determined that the monitoring result meets the motor locking condition.
5. The robot control method according to claim 4, characterized in that: The determining whether there is a child around the robot according to the environmental monitoring information around the robot includes: Determining whether there is facial information in the environmental monitoring information; If there is facial information in the environmental monitoring information, inputting the facial information into a preset facial recognition model to obtain a facial recognition result output by the preset facial recognition model; If the face recognition result is a child's face, it is determined that there are children around the robot.
6. The robot control method according to any one of claims 1 to 5, characterized in that: The robot's safety mode is set as follows: When receiving an on signal from a safety switch, modifying the safety mode parameter to a preset on parameter according to the on signal to turn on the safety mode of the robot; When receiving a closing signal of the safety switch, obtaining permission verification information; Performing user authority verification based on the authority verification information; If the user authority verification result is a passed verification, the safety mode parameter is modified to a preset shutdown parameter to shut down the safety mode of the robot.
7. A robot control device, characterized in that: include: A determination module is used to determine whether the motor state of the robot is in a pause state; A monitoring module, configured to monitor the robot's own state and / or surrounding environment to obtain a monitoring result if the robot's motor state is the pause state, and determine whether a motor lock condition is met based on the monitoring result, wherein the robot's motor state includes a running state, a pause state, and a locked state; A locking module, configured to send a locking instruction to the motor of the robot if the monitoring result satisfies the motor locking condition, so that the motor performs a motor locking operation according to the locking instruction; After sending a locking command to the motor of the robot, in order to further prevent the motor from being locked by mistake, the motor checks whether the safety mode parameter of the robot is a preset opening parameter after receiving the locking command; If the safety mode parameter is the preset on parameter, indicating that the safety mode is on, the motor responds to the lock command and executes the motor lock operation to reduce the safety risk caused by the robot being moved manually; If the safety mode parameter is not the preset on parameter but the preset off parameter, it means that the safety mode is not on, then the motor will not respond to the lock command and will not perform the motor lock operation, so as to reduce the possibility of subsequent inability to perform tasks due to the motor being locked; The pause state includes a state in which the motor of the robot cannot move and temporarily stops running when the motor encounters an external force during the robot's task execution; or a state in which the motor stops running when the robot is waiting for a task, or a state in which the motor stops running after the robot is powered off; The monitoring result includes state information and moving speed, and determining whether the motor lock condition is met based on the monitoring result includes: Determining whether the state information of the robot is a pushed state; If it is determined that the state information of the robot is the pushed state, determining whether the moving speed of the robot is greater than a preset speed; If the moving speed of the robot is greater than the preset speed, it is determined that the monitoring result meets the motor locking condition.
8. A robot comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: The processor is used to implement the steps of the robot control method according to any one of claims 1 to 6 when executing the computer program.
9. A readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the robot control method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Safety protection module for industrial robot
CN103955160A
Electric bicycle antitheft system
CN107933752A
Logistics vehicle carrying device
CN110901790A
Method for preventing robot from sliding on slope and robot
CN110989610A
Charging control method and device, storage medium and cleaning robot
CN111446757A
