Robot exception handling method and device, computer equipment and storage medium

By voice recognition of the sound information collected by the sweeping robot, abnormal sounds are recognized and cleaning modes and motion modes are adjusted, the problem of the robot causing harm to living objects during the cleaning process is solved, and cleaning efficiency is improved.

CN119014743APending Publication Date: 2024-11-26DREAM INNOVATION TECH (SUZHOU) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310565396.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-18
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

Existing sweeping robots may cause harm to living objects during cleaning, resulting in inefficient cleaning.

Method used

By voice recognition of the sound information collected by the robot, abnormal sounds are recognized and adjustment parameters are obtained, and cleaning modes and movement modes are adjusted to avoid causing harm to living objects.

Benefits of technology

It realizes the flexible response of the robot in different scenarios, avoids harm to living objects, and improves cleaning efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119014743A_ABST
    Figure CN119014743A_ABST
Patent Text Reader

Abstract

The invention discloses a robot exception handling method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: performing voice recognition on sound information collected by a robot to obtain a recognition result; when the recognition result shows that the sound information is the first abnormal sound and the sound information is obtained by collecting the sound information in the cleaning process of the robot, a first adjustment parameter is obtained according to the recognition result; the first abnormal sound is the abnormal sound emitted by a target object under the condition that the robot damages the target object in the cleaning process; one of the cleaning mode and the motion mode of the robot is adjusted according to the first adjusting parameter, by means of the method, the robot can be prevented from hurting the living object in the cleaning process, and therefore the cleaning efficiency can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of artificial intelligence technology, and specifically relates to a robot exception handling method, device, computer equipment and storage medium. Background Art

[0002] The current sweeping robot can act as a robot housekeeper in the home. It has a visual and voice system. As a mobile platform, it can do more work in monitoring and abnormality recognition. The existing sweeping robot may cause harm to living objects during the cleaning process, which will also lead to the problem of low cleaning efficiency. Summary of the invention

[0003] Therefore, the technical problem to be solved by the present invention is how to avoid the problem of low cleaning efficiency caused by harm to pets during the cleaning process.

[0004] In order to solve the above technical problems, the present invention provides a robot exception handling method, device, computer equipment and storage medium.

[0005] In a first aspect, the present invention provides a method for handling robot exceptions. The method comprises:

[0006] Perform speech recognition on the sound information collected by the robot to obtain recognition results;

[0007] When the recognition result indicates that the sound information is a first abnormal sound, and the sound information is obtained by the robot collecting sound information during the cleaning process, obtaining a first adjustment parameter according to the recognition result; the first abnormal sound refers to an abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process;

[0008] According to the first adjustment parameter, one of the cleaning mode and the motion mode of the robot is adjusted. In a second aspect, the present invention also provides an abnormality handling device for a machine, the device comprising:

[0009] The recognition module is used to perform speech recognition on the sound information collected by the robot to obtain the recognition result;

[0010] an acquisition module, configured to acquire a first adjustment parameter according to the recognition result when the recognition result indicates that the sound information is a first abnormal sound and the sound information is obtained by the robot collecting sound information during the cleaning process; the first abnormal sound refers to an abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process;

[0011] The adjustment module is used to adjust one of the cleaning mode and the motion mode of the robot according to the first adjustment parameter. In one embodiment, the adjustment module is also used to control the robot to slow down, pause or change the movement direction according to the first adjustment parameter.

[0012] In one embodiment, the acquisition module is also used to detect the operating parameters of the robot and obtain the detection result when the recognition result indicates that the sound information is a first abnormal sound and the sound information is obtained by the robot collecting sound information during the cleaning process; when the detection result indicates that the robot causes damage to the target object that emits the sound information during the cleaning process, the first adjustment parameter is obtained based on the recognition result.

[0013] In one embodiment, the acquisition module is also used for the operating parameters to include at least one of the roller brush current and the machine posture of the robot.

[0014] In one embodiment, the acquisition module is further configured to execute a step of detecting operating parameters of the robot when it is determined that the target object is in contact with the robot.

[0015] In one embodiment, the apparatus further comprises:

[0016] The control module is used to control the robot to reduce the roller brush speed if the robot does not cause damage to the target object that emits the sound information during the cleaning process.

[0017] A determination module is used to compare the machine posture with each sample posture in a preset posture sample set; wherein, the sample posture is a robot posture in which the probability of the robot causing damage to the target object during the cleaning process is greater than a preset value; and determine whether the robot causes damage to the target object that emits the sound information during the cleaning process based on the comparison result.

[0018] an interaction module, configured to track the position of a target object that emits the sound information to obtain the position of the target object when the recognition result indicates that the sound information is a second abnormal sound; the second abnormal sound is an abnormal sound emitted by the target object when the robot does not cause damage to the target object during the cleaning process;

[0019] A reminder message carrying the location is sent to a terminal corresponding to the monitored object, so that the monitored object can interact with the target object through a home camera or a camera of the robot.

[0020] In one embodiment, the interaction module is further used to determine the relative direction of the target object that emits the sound information, and the relative direction is the direction of the target object relative to the robot.

[0021] In one embodiment, the interaction module is also used to send the relative direction of the target object and the current position of the robot to the terminal corresponding to the monitored object, so that the terminal corresponding to the monitored object controls the home camera or the robot's camera to aim at the target object based on the relative direction of the target object and the current position of the robot, and the monitored object interacts with the target object through the home camera or the robot's camera.

[0022] In one embodiment, the interactive module is also used to collect sound information during the cleaning process to obtain the sound information; or, to collect sound information when the robot is stationary at a robot base station to obtain the sound information; or, to collect sound information when the robot is placed at a target position to obtain the sound information; or, to collect sound information when the robot moves to a specified position to obtain the sound information. In a third aspect, the present invention also provides a computer device, the computer device comprising a memory and a processor, the memory storing a computer program, and the processor implementing the following steps when executing the computer program:

[0023] Perform speech recognition on the sound information collected by the robot to obtain recognition results;

[0024] When the recognition result indicates that the sound information is a first abnormal sound, and the sound information is obtained by the robot collecting sound information during the cleaning process, obtaining a first adjustment parameter according to the recognition result; the first abnormal sound refers to an abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process;

[0025] According to the first adjustment parameter, one of the cleaning mode and the motion mode of the robot is adjusted. In a fourth aspect, the present invention further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0026] Perform speech recognition on the sound information collected by the robot to obtain recognition results;

[0027] When the recognition result indicates that the sound information is a first abnormal sound, and the sound information is obtained by the robot collecting sound information during the cleaning process, obtaining a first adjustment parameter according to the recognition result; the first abnormal sound refers to an abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process;

[0028] According to the first adjustment parameter, one of the cleaning mode and the motion mode of the robot is adjusted. In a fifth aspect, the present invention further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0029] Perform speech recognition on the sound information collected by the robot to obtain recognition results;

[0030] When the recognition result indicates that the sound information is a first abnormal sound, and the sound information is obtained by the robot collecting sound information during the cleaning process, obtaining a first adjustment parameter according to the recognition result; the first abnormal sound refers to an abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process;

[0031] According to the first adjustment parameter, one of the cleaning mode and the motion mode of the robot is adjusted. The above-mentioned robot exception handling method, device, computer equipment, storage medium and computer program product obtain a recognition result by performing voice recognition on the sound information collected by the robot; accurately recognize the collected sound information, and when the recognition result indicates that the sound information is a first abnormal sound, and the sound information is obtained by the robot during the cleaning process. The first adjustment parameter is obtained according to the recognition result; the first abnormal sound refers to the abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process; one of the cleaning mode and the motion mode of the robot is adjusted according to the first adjustment parameter. Determine the corresponding first adjustment parameter according to the recognition result, and adjust the robot's mode according to the first adjustment parameter, so as to realize the flexible response of the robot in different scenarios, thereby avoiding damage to living objects, thereby improving the cleaning efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0033] Figure 1 A diagram of an application environment of an exception handling method for a robot in one embodiment;

[0034] Figure 2 A schematic diagram of a flow chart of a method for handling an exception of a robot in one embodiment;

[0035] Figure 3 A schematic diagram of a process for obtaining a first adjustment parameter in an embodiment;

[0036] Figure 4 is a structural block diagram of an exception handling device of a robot in one embodiment;

[0037] Figure 5 is a structural block diagram of an exception handling device of a robot in another embodiment;

[0038] Figure 6 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0039] The technical solution of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. The present invention will be described in detail below with reference to the accompanying drawings and in conjunction with the embodiments. It should be noted that the embodiments of the present invention and the features in the embodiments can be combined with each other without conflict.

[0040] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0041] In the present invention, unless otherwise specified, the directional words used, such as "up, down, top, bottom", usually refer to the directions shown in the drawings, or to the components themselves in the vertical, perpendicular or gravity directions; similarly, for ease of understanding and description, "inside and outside" refer to the inside and outside relative to the outline of each component itself, but the above-mentioned directional words are not used to limit the present invention.

[0042] The robot exception handling method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown, the robot 102 performs voice recognition on the sound information collected by the robot to obtain a recognition result; when the recognition result indicates that the sound information is a first abnormal sound, and the sound information is obtained by the robot collecting sound information during the cleaning process, a first adjustment parameter is obtained based on the recognition result; the first abnormal sound refers to an abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process; one of the cleaning mode and the motion mode of the robot is adjusted according to the first adjustment parameter.

[0043] The robot 102 is any robot that can perform cleaning tasks, including a sweeping robot, a mopping robot, or a sweeping and mopping robot, etc. The robot 102 is equipped with a recorder, a camera, a radar, etc., and can detect living objects through the radar.

[0044] In one embodiment, Figure 2As shown, a robot cleaning method is provided, which is applied to Figure 1 The robot in the example is used to illustrate the following steps:

[0045] S202, performing speech recognition on the sound information collected by the robot to obtain a recognition result.

[0046] The sound information may include the frequency, decibel, and voice content involved in the sound, etc. The recognition result may refer to the recognition result of the sound information, and the recognition result may be used to indicate the sound source represented by the sound information or the corresponding abnormal scene. For example, the recognition result may indicate whether the sound information is the first abnormal sound or the second abnormal sound. The first abnormal sound may refer to an abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process. The second abnormal sound is an abnormal sound emitted by the target object when the robot does not cause damage to the target object during the cleaning process.

[0047] For example, the sound information of abnormal sounds emitted by the target object when the robot causes damage to the target object during the cleaning process can be pre-stored as the sound information set corresponding to the first abnormal sound; and the sound information of abnormal sounds emitted by the target object when the robot does not cause damage to the target object during the cleaning process can be pre-stored as the sound information set corresponding to the second abnormal sound. In actual application scenarios, after the robot collects sound information, the collected sound information can be compared with the pre-constructed sound information set to determine whether the collected sound information belongs to the first abnormal sound or the second abnormal sound.

[0048] Alternatively, the sound information corresponding to the first abnormal sound and the second abnormal sound may be collected in advance as samples to train a speech recognition model, so as to use the speech recognition model to perform speech recognition on the sound information collected by the robot to obtain a recognition result. The speech recognition model refers to a machine learning model for speech recognition, including but not limited to speech recognition models constructed based on speech recognition algorithms such as ASRT (Auto Speech Recognition Tool, automatic speech recognition), Deep Speech Recognition (Deep Speech Recognition, DSR), Wenet and whisper.

[0049] S204, when the recognition result indicates that the sound information is the first abnormal sound, and the sound information is obtained by the robot collecting sound information during the cleaning process, obtain the first adjustment parameter according to the recognition result; the first abnormal sound refers to the abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process.

[0050] The target object refers to the object that sends the sound information, including pets, infants, minors, the elderly and pregnant women, etc.

[0051] The cleaning process may refer to the process in which the robot cleans the designated work area. The cleaning mode is the cleaning method used by the robot during the cleaning process, and the motion mode may be the operating mode performed by the robot during the cleaning process. Preferably, the adjustment of the cleaning mode may be achieved by adjusting the cleaning parameters, such as the rotation speed of the side brush, the vibration frequency of the rag plate, and other parameters related to the robot's execution of the cleaning work, and the corresponding cleaning modes that can be achieved may be the side brush speed reduction, the rag plate stopping vibration, and the like. The adjustment of the motion mode may be achieved by adjusting the motion parameters of the robot, such as the roller rotation speed, the roller steering, and the like, and the corresponding motion modes that can be achieved are deceleration, steering, stopping movement, retreating, and the like. The first adjustment parameter may at least include cleaning parameters, motion parameters, and the like, so as to at least achieve the adjustment of the cleaning mode and the motion mode of the robot.

[0052] The adjustment parameters corresponding to different recognition results may be pre-set. For example, the adjustment parameters corresponding to the first abnormal sound and the second abnormal sound may be pre-set. In order to facilitate the distinction of expressions, the adjustment parameter corresponding to the first abnormal sound may be described as the first adjustment parameter, and the adjustment parameter corresponding to the second abnormal sound may be described as the second adjustment parameter. Of course, the adjustment parameters corresponding to different recognition results may also be adjusted in combination with other factors in the actual application scenario, which is not limited here.

[0053] The first adjustment parameter and the second adjustment parameter obtained according to the recognition result may include a parameter type and a parameter value or a parameter adjustment method (such as increase or decrease) corresponding to the corresponding parameter type. For example, after determining that the recognition result is the first abnormal sound, the side brush speed may be reduced, the roller speed may be reduced, or the roller may be turned, etc.; accordingly, the first adjustment parameter may be the side brush speed and the speed value to which the side brush speed is adjusted, the roller speed and the speed value to which the roller speed is adjusted, the roller turning and the turning value of the roller turning adjustment value, etc.

[0054] S206: Adjust one of the cleaning mode and the motion mode of the robot according to the first adjustment parameter.

[0055] The above-mentioned robot's exception handling method performs voice recognition on the sound information collected by the robot. After determining that the adopted sound information is an abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process, the robot's cleaning mode and one of the motion modes are adjusted according to the first adjustment parameter, such as reducing the side brush speed, turning the rollers, etc., so as to effectively reduce the possibility of the robot causing damage to living objects during the cleaning process, and realize the robot's autonomous response to abnormal situations.

[0056] In one embodiment, the parameter type corresponding to the first adjustment parameter may include the robot's roller speed and the speed value to which the roller speed is adjusted, the roller steering and the steering value of the roller steering adjustment value. Accordingly, the robot can be controlled to slow down, pause or change the moving direction according to the first adjustment parameter. After determining that the sound information used is an abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process, timely controlling the robot to slow down, pause or change the moving direction can effectively reduce the possibility of further causing damage to the target object.

[0057] In one embodiment, Figure 3 As shown, the step of obtaining the first adjustment parameter includes:

[0058] S302, when the recognition result indicates that the sound information is the first abnormal sound, and the sound information is obtained by the robot collecting sound information during the cleaning process, the operation parameters of the robot are detected to obtain the detection result.

[0059] Among them, the operating parameters may refer to parameters related to the operation of the robot, including the robot's posture and the speed of the side brush, the speed of the roller brush motor, or the speed of the fan motor. The parameter types of the operating parameters, cleaning parameters, and motion parameters may overlap. The detection result may refer to the judgment result of whether the robot causes damage to the target object. By analyzing the actual operation data of the robot, it is possible to more accurately confirm whether the robot causes damage to the target object that emits the sound information during the cleaning process. If it is determined that damage has occurred, the cleaning mode or motion mode of the robot can be further adjusted, which can effectively avoid misadjustment and improve the accuracy of the robot's autonomous response to abnormal situations.

[0060] In one embodiment, the operating parameters include at least one of the robot's roller brush current or machine posture. Among them, the roller brush current may refer to the current of the roller brush motor. The machine posture refers to the posture of the robot, which can be represented by the coordinates, orientation, etc. of the robot in the world map; of course, it can also be represented based on other types of maps, which are not limited here. During the cleaning process of the cleaning robot, if it causes squeezing or hair entanglement to pets such as cats and dogs or infants, the probability of the robot's roller brush current changing is relatively high, and during the twisting of pets or infants, the probability of the robot's posture changing accordingly is also relatively high. Therefore, further combining the robot's roller brush current or at least one of the machine postures to detect whether the robot causes damage to the target object that emits the sound information during the cleaning process can further improve the accuracy of determining whether damage is caused, effectively avoid misadjustment, and thereby improve the accuracy of the robot's autonomous response to abnormal situations.

[0061] In one embodiment, the machine posture can be compared with each sample posture in a preset posture sample set; wherein the sample posture is a robot posture whose probability of causing damage to the target object during the cleaning process is greater than a preset value; and whether the robot causes damage to the target object that emits sound information during the cleaning process is determined based on the comparison result. The preset posture sample set may refer to a preset set of sample postures. The sample posture robot has a robot posture whose probability of causing damage to the target object during the cleaning process is greater than a preset value. The preset value may refer to a preset probability value. The comparison result may refer to the result obtained after the machine posture is compared with the sample posture. By presetting the robot posture whose probability of causing damage to the target object is greater than a preset value as the sample posture, in actual scenarios, by comparing the actual machine posture with the sample posture, the accuracy and efficiency of confirming the damage caused to the target object can be further improved.

[0062] In one embodiment, when it is determined that the target object is in contact with the robot, a step of detecting operating parameters of the robot is performed.

[0063] For example, the target object can be tracked to obtain its position. When the distance between the position of the target object and the position of the robot is less than a contact distance threshold, it is determined that the target object is in contact with the robot, and the step of detecting the operating parameters of the robot is executed.

[0064] The contact distance threshold may refer to a threshold used to determine whether the target object is in contact with the robot. For example, the contact distance threshold may be 5 cm, 10 cm, and 20 cm.

[0065] Alternatively, the target object may be detected by a sensor on the robot. When the sensor on the robot senses the target object, it is determined that the target object is in contact with the robot, and the step of detecting the operating parameters of the robot is executed.

[0066] In the above embodiment, false detection can be reduced by determining whether the target object is in contact with the robot and then executing the step of detecting the operating parameters of the robot. For example, if the target object is far away, abnormal operating parameters may occur during the cleaning process of the robot, and there will be no harm at this time.

[0067] S304: When the detection result indicates that the robot causes damage to the target object that emits sound information during the cleaning process, obtain a first adjustment parameter according to the recognition result.

[0068] For example, the current operating parameters of the robot are: mode: sweeping mode, speed: 0.05m / s, direction: southwest, and the first adjustment parameter is speed: -0.02m / s, direction: north. The operating parameters of the robot are adjusted according to the first adjustment parameters, and the adjusted operating parameters are: mode: sweeping mode, speed: 0.03m / s, direction: north, thereby controlling the deceleration and moving direction of the robot after the operating parameters are adjusted.

[0069] In one embodiment, S304 includes if the roller brush current is less than a first current threshold, or greater than a second current threshold, then judging that the robot has caused damage to the target object that emits the sound information; or, if the machine posture matches a sample posture in a preset posture sample set, then judging that the robot has caused damage to the target object that emits the sound information.

[0070] The current threshold may be used to judge the roller brush current, the first current threshold and the second current threshold are different current thresholds, and the first current threshold is not greater than the second current threshold.

[0071] In one embodiment, if the robot does not cause harm to the target object that emits the sound information during the cleaning process, the robot can also be controlled to reduce the roller brush speed. The roller brush speed may refer to the rotation speed of the roller brush. Although further detection shows that the robot does not cause harm to the target object, the target object may be close to the robot at this time or the high cleaning frequency of the sweeper may make the target object feel scared. By controlling the robot to reduce the roller brush speed, the robot can be further effectively prevented from causing harm to the target object.

[0072] In the above embodiment, when the recognition result indicates that the sound information is the first abnormal sound and the sound information is obtained by the robot collecting sound information during the cleaning process, the operating parameters of the robot are detected to obtain the detection result; when the detection result indicates that the robot causes damage to the target object that emits the sound information during the cleaning process, the first adjustment parameter is obtained based on the recognition result, thereby achieving accurate judgment on whether the robot causes damage to the target object that emits the sound information, thereby accurately obtaining the first adjustment parameter based on the recognition result.

[0073] In one embodiment, when the recognition result indicates that the sound information is the second abnormal sound, the position of the target object that emits the sound information is tracked to obtain the position of the target object; the second abnormal sound is the abnormal sound emitted by the target object when the robot does not cause damage to the target object during the cleaning process; a reminder message carrying the position is sent to the terminal corresponding to the monitored object, so that the monitored object can interact with the target object through the home camera or the robot's camera. By judging the abnormal sound emitted by the target object when no damage is caused to the target object, and communicating with the target object that emits the abnormal sound in a timely manner, the robot's autonomous response and processing capabilities for abnormal situations can be further expanded, improving the user experience.

[0074] The guardian object may refer to the object that is guardian of the target object, including the guardian, spouse, and caregiver of the target object, etc. The reminder message may refer to a message used to remind the guardian object.

[0075] In one embodiment, tracking the position of the target object that emits the sound information to obtain the position of the target object includes: determining the relative direction of the target object that emits the sound information, where the relative direction is the direction of the target object relative to the robot.

[0076] In one embodiment, sending a reminder message of the carrying location to the terminal corresponding to the monitored object so that the monitored object can interact with the target object through a home camera or a robot's camera includes: sending the relative direction of the target object and the current position of the robot to the terminal corresponding to the monitored object, so that the terminal corresponding to the monitored object controls the home camera or the robot's camera to aim at the target object based on the relative direction of the target object and the current position of the robot, and the monitored object interacts with the target object through the home camera or the robot's camera.

[0077] In one embodiment, sound information is collected during the cleaning process to obtain sound information; or, sound information is collected when the robot is stationary at a robot base station to obtain sound information; or, sound information is collected when the robot is placed at a target position to obtain sound information; or, sound information is collected when the robot moves to a specified position to obtain sound information.

[0078] The target position may refer to a position for placing the robot. The designated position may refer to a pre-designated position. Both the target position and the designated position may be represented by coordinates.

[0079] As an example, this embodiment is as follows:

[0080] Scenario 1: Abnormal cleaning caused by a sweeping robot: When the sweeping robot recognizes the abnormal cry of a pet during the cleaning process, and the roller brush current or machine posture monitoring is also in an abnormal state, it is determined that the robot has caused harm to the pet. At this time, the motion device is decelerated, paused, or the direction is controlled.

[0081] Scenario 2: Special scene recognition: When the sweeping robot is stationary, it can also monitor the target sound, such as monitoring the crying of babies and the calls of the elderly, and track abnormal voice information to detect the target object that sends abnormal voice information. After retrieving the target object that sends abnormal voice information, it can remind the mobile phone (the abnormal reminder sent can include information such as the location of the target object), so that the user can interact with the target object through the camera on the sweeping robot or the camera at home. In this way, the recognition of special scenes can be realized, and users can be assisted in abnormal monitoring and improve the user experience. The robot can monitor at the base station, or start monitoring after being moved to a certain place, or start monitoring after moving to a certain place (patrol or fixed point).

[0082] In this embodiment, a speech recognition system is used to identify language or non-language sounds, such as cat calls, baby cries, painful groans, etc. (for example, special sound information to be identified can be collected in advance to build a speech recognition model, etc.; the speech recognition algorithm is not limited here). Afterwards, based on the identified sound information, the abnormal working scene of the robot is determined, and then the cleaning adjustment operation corresponding to the abnormal working scene is extracted, and then the cleaning adjustment is completed to reduce the damage that may be caused during the cleaning process; and the user can also be assisted in completing special scene monitoring.

[0083] Obviously, the embodiments described above are only some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, ordinary technicians in this field can make other different forms of changes or modifications without creative work, which should fall within the scope of protection of the present invention.

[0084] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0085] Based on the same inventive concept, the embodiment of the present application also provides a robot exception handling device for implementing the robot exception handling method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the embodiments of the exception handling device for one or more robots provided below can refer to the limitations of the robot exception handling method above, and will not be repeated here.

[0086] In one embodiment, Figure 4 As shown, a robot exception handling device is provided, including: an identification module 402, an acquisition module 404 and an adjustment module 406, wherein:

[0087] The recognition module 402 is used to perform speech recognition on the sound information collected by the robot to obtain a recognition result;

[0088] The acquisition module 404 is used to acquire the first adjustment parameter according to the recognition result when the recognition result indicates that the sound information is a first abnormal sound and the sound information is obtained by the robot during the cleaning process; the first abnormal sound refers to an abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process;

[0089] The adjustment module 406 is used to adjust one of the cleaning mode and the motion mode of the robot according to the first adjustment parameter. In one embodiment, the adjustment module 406 is also used to control the robot to decelerate, pause movement or change movement direction according to the first adjustment parameter.

[0090] In one embodiment, the acquisition module 404 is also used to detect the operating parameters of the robot and obtain the detection result when the recognition result indicates that the sound information is a first abnormal sound and the sound information is obtained by the robot collecting sound information during the cleaning process; when the detection result indicates that the robot causes damage to the target object that emits the sound information during the cleaning process, the first adjustment parameter is obtained according to the recognition result.

[0091] In one embodiment, the acquisition module 404 is further configured to operate the parameters including at least one of the roller brush current and the machine posture of the robot.

[0092] In one embodiment, the acquisition module 404 is further configured to execute a step of detecting the operating parameters of the robot when it is determined that the target object is in contact with the robot. Figure 5 As shown, the robot exception handling device also includes: a control module 608, a determination module 610 and an interaction module 612, wherein:

[0093] The control module 408 is used to control the robot to reduce the roller brush speed if the robot does not cause damage to the target object that emits the sound information during the cleaning process.

[0094] The determination module 410 is used to compare the machine posture with each sample posture in a preset posture sample set; wherein the sample posture is a robot posture in which the probability of the robot causing damage to the target object during the cleaning process is greater than a preset value; and determine whether the robot causes damage to the target object that emits sound information during the cleaning process based on the comparison result.

[0095] The interaction module 412 is used to track the position of the target object that emits the sound information to obtain the position of the target object when the recognition result indicates that the sound information is the second abnormal sound; the second abnormal sound is the abnormal sound emitted by the target object when the robot does not cause damage to the target object during the cleaning process; and send a reminder message of the carrying position to the terminal corresponding to the monitored object, so that the monitored object can interact with the target object through the home camera or the robot's camera.

[0096] In one embodiment, the interaction module 412 is further configured to determine a relative direction of a target object that emits sound information, where the relative direction is a direction of the target object relative to the robot.

[0097] In one embodiment, the interaction module 412 is also used to send the relative direction of the target object and the current position of the robot to the terminal corresponding to the monitored object, so that the terminal corresponding to the monitored object controls the home camera or the robot's camera to aim at the target object based on the relative direction of the target object and the current position of the robot, and the monitored object interacts with the target object through the home camera or the robot's camera.

[0098] In one embodiment, the interaction module 412 is also used to collect sound information during the cleaning process to obtain sound information; or, collect sound information when the robot is stationary at the robot base station to obtain sound information; or, collect sound information when the robot is placed at the target position to obtain sound information; or, collect sound information when the robot moves to a specified position to obtain sound information. In the above embodiment, the recognition result is obtained by performing voice recognition on the sound information collected by the robot; the collected sound information is accurately recognized, and when the recognition result indicates that the sound information is the first abnormal sound, and the sound information is obtained by the robot collecting sound information during the cleaning process, the first adjustment parameter is obtained according to the recognition result; the first abnormal sound refers to the abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process; and the cleaning mode and the motion mode of the robot are adjusted according to the first adjustment parameter. The corresponding first adjustment parameter is determined according to the recognition result, and the mode of the robot is adjusted according to the first adjustment parameter, so that the robot can respond flexibly in different scenarios, thereby avoiding damage to living objects, thereby improving the cleaning efficiency.

[0099] Each module in the above-mentioned exception handling device of the robot can be implemented in whole or in part by software, hardware and a combination thereof. Each of the above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0100] In one embodiment, a computer device is provided. The computer device may be a robot, and its internal structure diagram may be as follows: Figure 6As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a robot exception handling method is implemented. The display unit of the computer device is used to form a visually visible image, and can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer covered on the display screen, or a button, trackball or touchpad set on the computer device casing, or an external keyboard, touchpad or mouse, etc.

[0101] Those skilled in the art will understand that Figure 6 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0102] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above-mentioned method embodiments when executing the computer program.

[0103] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0104] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0105] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0106] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0107] The technical features of the above embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0108] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A robot exception handling method, characterized in that: The method comprises: Perform speech recognition on the sound information collected by the robot to obtain recognition results; When the recognition result indicates that the sound information is a first abnormal sound, and the sound information is obtained by the robot collecting sound information during the cleaning process, obtaining a first adjustment parameter according to the recognition result; the first abnormal sound refers to an abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process; One of the cleaning mode and the motion mode of the robot is adjusted according to the first adjustment parameter.

2. The method according to claim 1, characterized in that The step of adjusting one of the cleaning mode and the motion mode of the robot according to the first adjustment parameter includes: The robot is controlled to slow down, pause or change the moving direction according to the first adjustment parameter.

3. The method according to claim 1, characterized in that When the recognition result indicates that the sound information is the first abnormal sound, and the sound information is obtained by the robot collecting sound information during the cleaning process, obtaining the first adjustment parameter according to the recognition result includes: When the recognition result indicates that the sound information is the first abnormal sound, and the sound information is obtained by the robot collecting sound information during the cleaning process, detecting the operating parameters of the robot to obtain the detection result; When the detection result indicates that the robot causes damage to the target object that emits the sound information during the cleaning process, a first adjustment parameter is obtained according to the recognition result.

4. The method according to claim 3, characterized in that The operating parameters include at least one of a roller brush current and a machine posture of the robot.

5. The method according to claim 3, characterized in that: When it is determined that the target object is in contact with the robot, a step of detecting an operating parameter of the robot is performed.

6. The method according to claim 3, characterized in that The method further comprises: If the robot does not cause damage to the target object that emits the sound information during the cleaning process, the robot is controlled to reduce the speed of the rolling brush.

7. The method according to claim 4, characterized in that The method further comprises: Comparing the machine posture with each sample posture in a preset posture sample set; wherein the sample posture is a robot posture in which the probability of the robot causing damage to the target object during the cleaning process is greater than a preset value; It is determined based on the comparison result whether the robot causes damage to the target object that emits the sound information during the cleaning process.

8. The method according to claim 1, characterized in that: The method further comprises: When the recognition result indicates that the sound information is the second abnormal sound, the position of the target object that emits the sound information is tracked to obtain the position of the target object; the second abnormal sound is the abnormal sound emitted by the target object when the robot does not cause damage to the target object during the cleaning process; A reminder message carrying the location is sent to a terminal corresponding to the monitored object, so that the monitored object can interact with the target object through a home camera or a camera of the robot.

9. The method according to claim 8, characterized in that Tracking the position of the target object that emits the sound information to obtain the position of the target object includes: determining the relative direction of the target object that emits the sound information, where the relative direction is the direction of the target object relative to the robot.

10. The method according to claim 9, characterized in that The sending of a reminder message carrying the location to a terminal corresponding to the monitored object so that the monitored object interacts with the target object through a home camera or a camera of the robot includes: The relative direction of the target object and the current position of the robot are sent to the terminal corresponding to the monitored object, so that the terminal corresponding to the monitored object controls the home camera or the robot's camera to aim at the target object based on the relative direction of the target object and the current position of the robot, and the monitored object interacts with the target object through the home camera or the robot's camera.

11. The method according to claim 8, characterized in that The method further comprises: Collecting sound information during the cleaning process to obtain the sound information; or, When the robot is stationary at the robot base station, sound information is collected to obtain the sound information; or, When the robot is placed at a target position, sound information is collected to obtain the sound information; or, when the robot moves to a designated position, sound information is collected to obtain the sound information.

12. A robot abnormality handling device, characterized in that: The device comprises: The recognition module is used to perform speech recognition on the sound information collected by the robot to obtain the recognition result; an acquisition module, configured to acquire a first adjustment parameter according to the recognition result when the recognition result indicates that the sound information is a first abnormal sound and the sound information is obtained by the robot collecting sound information during the cleaning process; the first abnormal sound refers to an abnormal sound emitted by the target object when the robot causes damage to the target object during the cleaning process; An adjustment module is used to adjust one of the cleaning mode and the motion mode of the robot according to the first adjustment parameter.

13. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 11 are implemented.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 11 are implemented.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 11 are implemented.