Control method for autonomous moving device, and autonomous moving device
Through visual detection and preset condition judgment, the mobile device automatically passes from the work area through the transition area to the target area, solving the problem that the mowing robot needs users to move manually in the secondary area, and improving the degree of automation and user experience.
Patent Information
- Application Number
- PCT/CN2024/094351
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-25
- Filing Date
- 2024-05-21
- Publication Date
- 2024-11-28
AI Technical Summary
The mowing robot needs to be manually moved by the user in the secondary area outside the main workspace, resulting in low automation and affecting the user experience.
Through visual detection, the relationship between the working area, the transition area and the target area is judged, and the mobile device moves from the working area through the transition area to the opposite area, using preset status, ground height difference, area type and transition area width and other conditions. Determine whether cross-regional work is required.
It improves the degree of automation of self-mobile devices, reduces user participation, realizes automatic work in areas outside the work area, and improves user experience.
Smart Images

Figure CN2024094351_28112024_PF_FP_ABST
Abstract
Description
Self-moving device control method and self-moving device Technical Field
[0001] The present invention relates to the field of intelligent control, and in particular to a control method for a self-moving device and the self-moving device. Background Art
[0002] When mowing the lawn, the mowing robot generally works in a main working area. In some scenarios, outside the main mowing area, there are some secondary areas that are not directly adjacent to the main working area, such as across a pedestrian walkway. Although the demand for mowing in these secondary areas is not as frequent as that in the main mowing area, when they need to be mowed, the user needs to move the mowing robot to the secondary areas before starting to mow in these areas. After the mowing is completed, the user moves the mowing robot to the main working area. The process is cumbersome and the degree of automation is not high enough, which affects the user experience. Summary of the Invention
[0003] To solve at least one of the above-mentioned problems in the prior art, the present invention aims to provide a control method and a self-moving device that can control a self-moving device to automatically work in other secondary areas outside the main working area.
[0004] To achieve the above-mentioned object, an embodiment of the present invention provides a control method for a self-moving device, for controlling the self-moving device to move from a working area through a transition area to an opposite area, the control method comprising the following steps:
[0005] When the self-moving device is located at the edge of the working area, the relationship between the working area, the transition area and the opposite area is detected by vision to determine whether the opposite area is the target area;
[0006] When the opposite area is the target area, determining whether the self-moving device needs to move to the opposite area;
[0007] When the self-moving device needs to move to the opposite area, the self-moving device is controlled to move to the opposite area through the transition area.
[0008] As a further improvement of the present invention, the determining whether the self-moving device needs to move to the opposite area includes:
[0009] According to whether the working state of the self-moving device reaches a preset state, it is determined whether the self-moving device needs to be moved out of the working area to the opposite area.
[0010] To achieve one of the above-mentioned objectives, an embodiment of the present invention provides a method for controlling a self-moving device to move from a working area through a transition area to an opposite area. The method comprises the following steps:
[0011] Controlling the self-moving device to move within the working area and monitoring the working status of the self-moving device;
[0012] If the working state of the self-moving device reaches a preset state, the self-moving device needs to be moved out of the working area;
[0013] Detecting whether the self-moving device is located at the edge of the working area;
[0014] When the self-moving device is located at the edge of the working area, the relationship between the working area, the transition area and the opposite area is detected by vision to determine whether the opposite area is the target area;
[0015] When the opposite area is the target area, the self-moving device is controlled to move out of the working area to the opposite area.
[0016] As a further improvement of the present invention, the preset state includes a preset working time, and / or a preset number of working times, and / or a preset working area.
[0017] As a further improvement of the present invention, if the opposite area is determined to be the target area, at least one or all of the following conditions are met:
[0018] The difference in ground height between the working area and the transition area is in a first height range;
[0019] The difference in ground height between the transition area and the opposite area is in a second height range.
[0020] As a further improvement of the present invention, the ground height difference between the working area and the transition area, and the ground height difference between the transition area and the opposite area are respectively calculated based on depth images.
[0021] As a further improvement of the present invention, if the opposite area is determined to be the target area, at least the following conditions are met:
[0022] The type of the opposite area is consistent with the preset type.
[0023] As a further improvement of the present invention, the preset type includes a preset area and a preset ground type;
[0024] Check whether the type of the opposite area is consistent with the preset type by the following steps:
[0025] Acquire an opposite image of the opposite area;
[0026] Identify the color and texture of the opposite image and determine the ground type of the opposite area;
[0027] Calculating the area of the opposite region according to the area ratio of the pixels of the opposite image and the number of pixels occupied by the opposite region;
[0028] If the ground type is consistent with the preset ground type and the area of the opposite region is within the range of the preset area, the type of the opposite region is consistent with the preset type; otherwise, they are inconsistent.
[0029] As a further improvement of the present invention, if the opposite area is determined to be the target area, at least the following conditions are met:
[0030] The width of the transition area is within a preset width range.
[0031] As a further improvement of the present invention, the width of the transition region is obtained by the following steps:
[0032] Acquire a width image of the transition region in a full width direction;
[0033] The width of the transition area is calculated according to the length ratio of the pixels of the width image and the number of pixels occupied by the transition area in the width direction.
[0034] As a further improvement of the present invention, the control method further includes the steps of:
[0035] Creating a map while the self-mobile device is moving, the map including a movement trajectory of the self-mobile device;
[0036] The determining whether the opposite area is a target area further includes:
[0037] Determining whether the movement trajectory involves an opposite area;
[0038] If the movement trajectory does not involve the opposite area, determine whether the opposite area is the target area by visually detecting the relationship between the working area, the transition area and the opposite area;
[0039] If the movement track involves an opposite area, it is determined whether the self-moving device needs to move to the opposite area.
[0040] As a further improvement of the present invention, the control method further includes:
[0041] During the process of the self-moving device passing through the transition area and moving to the opposite area, continuously obtaining the positioning information of the current position of the self-moving device, and determining whether the self-moving device exceeds the set area according to the positioning information of the current position;
[0042] If the self-moving device exceeds the set area, the self-moving device is controlled to return to the set area.
[0043] To achieve one of the above-mentioned objectives, an embodiment of the present invention provides an electronic device, including:
[0044] a storage module storing a computer program;
[0045] The processing module can implement the steps in the above-mentioned control method of the mobile device when executing the computer program.
[0046] Compared with the existing technology, the present invention has the following beneficial effects: the self-moving device can judge whether it needs to be moved to other areas outside the working area based on visual detection and the relationship between the working area, transition area and opposite area. This judgment process is highly automated and does not require user participation, which solves the problem that the self-moving device cannot automatically work across areas. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] FIG1 is a schematic diagram of a self-moving device in operation according to a first embodiment of the present invention;
[0048] 2 is a flow chart of a method for controlling a self-moving device according to a first embodiment of the present invention;
[0049] FIG3 is a flowchart of determining whether the opposite area is a target area according to an embodiment of the present invention;
[0050] 4 is a flow chart of a method for controlling a self-moving device according to a second embodiment of the present invention;
[0051] 5 is a schematic diagram of a self-moving device in operation according to a third embodiment of the present invention;
[0052] FIG6 is a block diagram of a control device for a self-moving device according to an embodiment of the present invention;
[0053] 7 is a block diagram of a self-moving device according to an embodiment of the present invention;
[0054] Among them, 100 is a self-moving device; 10 is a camera module; 20 is a positioning module; 30 is a storage module; 40 is a processing module; and 50 is a communication bus. DETAILED DESCRIPTION
[0055] The present invention will be described in detail below with reference to the specific embodiments shown in the accompanying drawings. However, these embodiments do not limit the present invention, and any structural, methodological, or functional changes made by those skilled in the art based on these embodiments are all within the scope of protection of the present invention.
[0056] An embodiment of the present invention provides a control method for a self-moving device and a self-moving device, wherein the self-moving device can realize automatic movement across regions.
[0057] A self-moving device generally works within a working area. The self-moving device of this embodiment can refer to the background technology, which is a lawn mowing robot that can automatically move on the ground and is used to mow the lawn. Generally, the working area can be a lawn, and the working area is the main working area of the lawn mowing robot. In some scenarios, in addition to the main working area, there are some secondary areas that are not directly adjacent to the main working area, such as across a pedestrian walkway. The demand for mowing in these secondary areas is not as frequent as that in the main mowing area. These secondary areas of this embodiment can be opposite areas. The following uses the example that the self-moving device 100 can be a lawn mowing robot, the working area and the opposite area are both lawns, and the transition area is a pedestrian walkway to understand its control principle.
[0058] In addition, the working area and the opposite area are relative. When the mobile device 100 is located in the opposite area, the opposite area becomes the working area. At this time, the original working area is the opposite area.
[0059] The mobile device 100 may include a camera module 10 for acquiring images. The following control method is executed in combination with the images acquired by the mobile device 100 to enable the mobile device 100 to operate across regions.
[0060] This article introduces multiple embodiments. In embodiment 1, the activity range of the self-moving device 100 mainly includes a working area and a facing area; in embodiment 2, the difference from embodiment 1 is that the order of judgment is different; in embodiment 3, the difference from embodiment 1 is that the activity range mainly includes a working area and multiple facing areas. Example
[0061] The following describes a control method provided by an embodiment of the present invention in conjunction with Figures 1 to 3. Although this application provides the method operation steps shown in the following embodiments or flow charts, based on conventional knowledge or without the need for creative effort, the execution order of steps in the method that are not logically causally related is not limited to the execution order provided in the embodiments of this application. For example, the order of the four steps S31 to S34 below can be adjusted or performed simultaneously, without distinguishing the order in time.
[0062] Specifically, the control method of the mobile device 100 includes the following steps:
[0063] Step S10: Control the mobile device 100 to operate within the working area.
[0064] Operation herein may refer to the automatic lawn mower mowing within a working area, i.e., the main lawn. The boundary of the working area may be defined as a grass-free area or a manually demarcated area. For example, in FIG1 , the pedestrian walkway may be grass-free, and the working area may be defined as the main lawn. While the automatic lawn mower is operating, the camera module 10 may capture images.
[0065] Step S20: Determine whether the mobile device 100 is located at the edge of the working area.
[0066] Step S20 can detect whether the self-mobile device 100 is at the edge of the work area based on visual recognition using images captured by the self-mobile device 100. The edge of the lawn can be determined using methods such as image segmentation, color, texture, and other features, as well as deep learning-based object detection using neural networks. For example, the location of the self-mobile device 100 in Figure 1 is the edge of the work area.
[0067] Step S30: Determine whether the opposite area is the target area.
[0068] The opposite area can be the edge of the working area across the other side of the transition area. Step S30 is to visually detect the relationship between the working area, the transition area, and the opposite area, and then determine whether it is the target area. As shown in FIG3 , step S30 specifically includes the following multiple implementations.
[0069] In one embodiment, if the opposite area is determined to be the target area, at least one or all of the following conditions are met:
[0070] The difference in ground height between the working area and the transition area is in a first height range;
[0071] The difference in ground height between the transition area and the opposite area is in a second height range.
[0072] In this case, if any height difference condition in the first height interval and / or the second height interval is not met, the opposite area is not the target area.
[0073] In addition, if the opposite area is determined to be the target area, at least the following conditions may be met:
[0074] The type of the opposite area is consistent with the preset type.
[0075] In this case, if the type of the opposite area is inconsistent with the preset type, the opposite area is not the target area.
[0076] In addition, if the opposite area is determined to be the target area, at least the following conditions may be met:
[0077] The width of the transition area is within a preset width range.
[0078] In this case, if the width of the transition area is not within the preset width range, the opposite area is not the target area.
[0079] In another embodiment, step S30 specifically includes the following steps:
[0080] Step S31: Detecting whether the ground height difference between the working area and the transition area is within a first height interval;
[0081] Step S32: Detecting whether the width of the transition area is within a preset width range;
[0082] Step S33: Detecting whether the ground height difference between the transition area and the opposite area is within a second height interval;
[0083] Step S34: Detect whether the type of the opposite area is consistent with the preset type;
[0084] Step S35: According to the preset conditions, one or more of the above four tests are selected to run several tests. If the results of the selected tests are all yes, the opposite area is the target area; otherwise, the opposite area is not the target area.
[0085] Furthermore, the order of the four detections from step S31 to step S34 can be adjusted as needed, or even run simultaneously.
[0086] The preset conditions can be pre-set as needed. For example, the preset conditions can be selected based on the performance of the hardware at the time of exiting the device, or the user can select the required detection conditions on a corresponding client, such as an app, or the preset conditions can be determined by the mobile device 100 based on the current operating state. The preset conditions can be selected one or more. Preferably, the preset condition can be that all four tests are run. In this way, if the results of the four tests in steps S31, S32, S33, and S34 are all yes, the opposite area is confirmed to be the target area; otherwise, it is not.
[0087] In other embodiments, only a few of the multiple tests may be selected, for example, steps S31 and S33 may be selected to run, and then the results of these two tests may be judged in step S35, or only the results of steps S31, S33 and S34 may be tested, and then the results of these three tests may be judged in step S35.
[0088] The detection conditions that are not selected by the preset conditions may not be detected, or their detection results may be ignored in step S35.
[0089] Steps S31 and S33 may calculate the height difference based on the following steps:
[0090] Acquire a depth image for determining depth;
[0091] According to the depth image, a ground height difference between the working area and the transition area, and a ground height difference between the transition area and the opposite area are calculated.
[0092] The robot mower's camera module 10 can be a binocular camera, capable of determining the depth of different objects in the captured image. Based on this depth image, the height difference of each surface can be determined. The binocular depth map can be used to determine whether the lawn and road surface are flush, convex, or concave. Alternatively, a monocular camera can be used to continuously capture multiple images while the robot mower is in operation. The depth difference in space can be calculated based on the robot's speed and the changes in the image content. Depth information can also be obtained through methods such as time-of-flight cameras and laser rangefinders.
[0093] The first and second height intervals can be identical. Within these two height intervals, the height difference between the pedestrian walkway and the main lawn or sub-lawn can be determined to be within an acceptable range, allowing the robot mower to move from the work area to the transition area and then to the target area. Conversely, if the detected height difference is outside the first and / or second height intervals, the robot mower may be unable to cross the transition area or the opposite area, posing a risk of being unable to climb or falling. By detecting this height difference, the robot mower can ensure smooth operation and meet cross-zone requirements.
[0094] Step S32 may calculate the width based on the following steps:
[0095] Acquire a width image of the transition region in a full width direction;
[0096] The width of the transition area is calculated according to the length ratio of the pixels of the width image and the number of pixels occupied by the transition area in the width direction.
[0097] The width image at this time includes the entire transition area in the width direction, that is, the transition area on the image is not interrupted in the width direction, and the working area and the target area also appear.
[0098] Assuming that the length ratio is p1 and the number of pixels occupied in the width direction is n, the width of the transition area is n*p1.
[0099] When the width of the transition area exceeds the preset width, the transition area may be too wide, such as a road. In this case, the mobile device 100 will no longer cross the transition area. Only when the transition area is within the preset width and the cross-domain object is judged to be a path between lawns, can the mobile device 100 cross the transition area.
[0100] Step S34 can determine the type of the opposite area based on the following steps:
[0101] Step S341: Acquire the opposite image of the opposite area;
[0102] Step S342: Identify the color and texture of the opposite image and determine the ground type of the opposite area;
[0103] Step S343: Calculating the area of the opposite region according to the area ratio of the pixels of the opposite image and the number of pixels occupied by the opposite region;
[0104] Step S344: If the ground type is consistent with the preset ground type and the area of the opposite area is within the range of the preset area, the type of the opposite area is consistent with the preset type; otherwise, they are inconsistent.
[0105] Here, the opposite image in step S341 includes the complete content of the opposite area without interruption, for example, includes the complete boundary of the opposite area, so that the area of the opposite area can be calculated.
[0106] In step S342, if the ground type of the opposite area is also lawn, the opposite area is also within the range of the mowing robot. If the opposite area is determined to be cement, asphalt or other types based on color and texture, it is not considered as an area to be mowed.
[0107] Step S343 determines the area. Assuming the area ratio is p2 and the number of pixels occupied by the opposite area is m, the area of the opposite area is m*p2. If the calculated area is smaller than the preset area, the opposite area is considered a sub-lawn and is within the permitted range. Conversely, if the preset area is larger than the preset area, the opposite area may be another lawn and not within the intended mowing range. Step S343 primarily determines whether the opposite area is permitted based on its area.
[0108] In step S344, the preset type includes a preset area and a preset ground type, and these two parameters are compared to finally determine whether the type is consistent with the preset type.
[0109] In addition, the depth image, width image, and opposite image used in the above steps S31 to S34 may be the same set of images captured by the same camera module 10.
[0110] Based on the judgment of multiple dimensions above, it is determined whether the opposite area is the target area.
[0111] Step S40: Determine whether the mobile device 100 needs to move out of the working area to an opposite area.
[0112] Step S40 may be based on step S30. If the opposite area is the target area, whether the self-mobile device 100 needs to be moved out of the working area to the opposite area is determined according to whether the working state of the self-mobile device 100 reaches a preset state.
[0113] The preset state includes a preset working time, and / or a preset number of working times, and / or a preset working area, and is related to factors such as the proportion of the total mowing time of the mowing robot in the current working area, the cut area, the proportion of the total number of mowing times, the proportion of the total working days, etc. For example, if the working time in the current working area exceeds a certain time, the requirements of the preset state are met and cross-area mowing can be performed.
[0114] In addition, step S40 can also be implemented in the following way: if the opposite area is the target area, then according to instructions, preset conditions, etc., for example, the mobile device 100 sends instructions at this location, and the operator determines whether it is necessary to go to the opposite area. If a cross-area instruction is received, the operator moves out of the working area to the opposite area.
[0115] Step S50: When the self-moving device 100 needs to move to the target area, the self-moving device 100 is controlled to move through the transition area to the opposite area.
[0116] The mowing robot can work across areas, passing through the pedestrian walkway and reaching the opposite lawn to start mowing.
[0117] The control method also includes:
[0118] When the self-moving device moves through the transition area to the opposite area, the positioning information of the current position of the self-moving device is continuously obtained, and it is determined whether the self-moving device exceeds the set area range according to the positioning information of the current position.
[0119] If the self-moving device exceeds the set area, the self-moving device is controlled to return to the set area.
[0120] Here, the process in which the self-moving device passes through the transition area and moves to the opposite area means that the self-moving device is still on the transition area, that is, the steps may also be included:
[0121] Determining the location of the self-moving device;
[0122] If the self-mobile device 100 is located in the transition area, the positioning information of the current position of the self-mobile device is continuously obtained, and it is determined whether the self-mobile device exceeds the set area range based on the positioning information of the current position; if the self-mobile device exceeds the set area range, the self-mobile device is controlled to return to the set area range.
[0123] If the self-mobile device is located in the opposite area, stop acquiring the real-time positioning data.
[0124] The location of the mobile device can be determined based on vision. Taking a lawn mower robot as an example, it can be determined based on vision whether the mobile device is on the opposite lawn or on the pedestrian walkway, that is, whether it is in the transition area or the opposite area.
[0125] The set area range is a user-defined area range, for example, a user-defined area range pre-edited by the user on the client. Alternatively, it can be an area within the maximum distance range between the mobile device 100 and the set location. For example, the set area range includes an area within the maximum distance radius from a positioning point selected in the working area before the mobile device 100 passes through the transition area.
[0126] The real-time positioning data may be a GPS signal from the mobile device 100 and / or a Beidou navigation signal.
[0127] When the real-time positioning data is not within the set area, the mobile device 100 may issue an alarm signal.
[0128] The step controls the movement of the mobile device 100 until the real-time positioning data includes:
[0129] Step S521: Control the mobile device 100 to move back along the original path;
[0130] Alternatively, step S522: controlling the self-moving device 100 to move by rotating at a random angle;
[0131] Alternatively, step S523: controlling the self-moving device 100 to move along the planned path.
[0132] In step S521, the following steps may be specifically included:
[0133] Step S5211: When the mobile device 100 reaches the transition area, start to continuously record the running trajectory;
[0134] Step S5212: During the movement of the mobile device 100, when an arrival signal is received indicating that the mobile device 100 is approaching or arriving at the boundary of the set area, the movement trajectory is read and the mobile device 100 returns to the set area along the original path.
[0135] Among them, in step S522, the steps may specifically include:
[0136] Step S5221: When an arrival signal is received indicating that the mobile device 100 is approaching or has reached the boundary of the set area, the mobile device 100 is controlled to retreat a preset distance;
[0137] Step S5222: Control the mobile device 100 to rotate toward a preset direction and at a preset angle.
[0138] Among them, in step S523, the steps may specifically include:
[0139] Step S5231: Recording the initial position of the mobile device 100 when entering the transition area;
[0140] Step S5232: During the movement of the mobile device 100 , when an arrival signal is received indicating that the mobile device 100 is approaching or arriving at the boundary of the set area, the mobile device 100 is controlled to move to the initial position.
[0141] In step S53, since the mobile device 100 has passed through the transition area and reached the opposite area, the acquisition of the real-time positioning data can be stopped, that is, the determination in step S52 is stopped after reaching the opposite area.
[0142] Compared with the prior art, this embodiment has the following beneficial effects:
[0143] The self-moving device 100 can judge whether it needs to be moved to other areas outside the working area based on visual detection and the relationship between the working area, transition area and opposite area. This judgment process is highly automated and does not require user participation, which solves the problem that the self-moving device 100 cannot automatically work across areas. Example
[0144] The difference from Example 1 is that the order of judgment is different. Other unexplained parts are consistent with Example 1. As shown in FIG. 4 , the initial step S10 and the ending step S50 are the same as those in Example 1.
[0145] During step S10 , the mobile device 100 monitors its own working status.
[0146] The following mainly describes the steps that have different orders. Specifically, Example 2 further includes the following steps:
[0147] Step S60: Determine whether the working state of the mobile device 100 reaches a preset state.
[0148] The determination of the working state is consistent with step S40 in embodiment 1, and can be the determination of the preset working time, and / or the preset working times, and / or the preset working area.
[0149] If the working state of the self-moving device 100 reaches a preset state, the self-moving device 100 needs to move out of the working area; otherwise, it continues to operate in the working area.
[0150] That is to say, if the working state of the mobile device 100 has not reached the preset state, even if it reaches the edge of the working area, it will not trigger subsequent judgment. Only when the working area has been mowed to meet the preset state, will it be triggered when it reaches the edge of the working area.
[0151] Step S70: Detect whether the mobile device 100 is located at the edge of the working area.
[0152] Here, the judgment of the edge of the working area is the same as step S20 above. If the edge has not been reached, continue mowing until the edge is reached next time.
[0153] Step S80: Determine whether the opposite area is the target area.
[0154] When the self-moving device 100 is located at the edge of the working area and the opposite area is the target area, the self-moving device 100 needs to move out of the working area to the opposite area.
[0155] After the mobile device 100 reaches the edge, it is directly determined whether the opposite area is the target area. The determination method is the same as step S30 above. Thereafter, the preset state is no longer determined. Once the opposite area is the target area, step S50 above is started. Example
[0156] The difference between Example 3 and Example 1 is that the activity range mainly includes a working area and multiple opposite areas, as shown in FIG5 . Specifically, multiple opposite areas are adjacent to the working area via different transition areas.
[0157] Specifically, the control method further includes the steps of:
[0158] Creating a map while the self-mobile device 100 moves, the map including a movement trajectory of the self-mobile device;
[0159] The determining whether the opposite area is a target area further includes:
[0160] Determining whether the movement trajectory involves an opposite area;
[0161] If the movement trajectory does not involve the opposite area, determine whether the opposite area is the target area by visually detecting the relationship between the working area, the transition area and the opposite area;
[0162] If the movement track involves an opposite area, it is determined whether the self-moving device needs to move to the opposite area.
[0163] Here, to create a map, you can draw a raster map while moving.
[0164] Based on the movement trajectory, it is possible to determine whether the opposite area is an area that the mobile device 100 has visited, or the time of the last visit, so that when there are multiple opposite areas, it is possible to determine which opposite areas should be visited and which ones should be avoided from being visited repeatedly.
[0165] After visiting sub-lawn 1 in Figure 5 , it can be determined whether the next time a person crosses the pedestrian path, they will go to sub-lawn 3 or return to the main lawn. For example, after mowing sub-lawn 1, the next time they reach sub-lawn 2, if the movement trajectory indicates that they have not yet entered sub-lawn 2, the method described in Example 1 or Example 2 can be used to determine whether they need to mow sub-lawn 2. If the movement trajectory indicates that they have already entered sub-lawn 2, the decision of whether to return to sub-lawn 2 can be made based on instructions, mowing frequency, and other factors.
[0166] Control device for mobile equipment
[0167] In one embodiment, a control device for a self-moving device is provided, as shown in FIG6 . The control device for the self-moving device includes modules, and the specific functions of each module are as follows:
[0168] A visual inspection module, used for visually inspecting whether the edge of the working area is separated from the transition area by the opposite area, and for visually inspecting the relationship between the working area, the transition area, and the opposite area;
[0169] A first judgment module is configured to, when the self-moving device 100 is located at an edge of the working area, determine whether the opposite area is a target area by visually detecting a relationship between the working area, the transition area, and the opposite area if the other side of the edge of the working area across the transition area is an opposite area;
[0170] A second determination module is configured to determine whether the mobile device 100 needs to be moved out of the working area;
[0171] The control module is configured to control the self-moving device 100 to move through the transition area to the opposite area when the self-moving device 100 needs to move to the target area.
[0172] In addition, the mobile device 100 may include a positioning module 20, which is used to obtain the location of the mobile device 100. The positioning module 20 may be a module with positioning capabilities such as GPS or Beidou. It can be used to obtain the above-mentioned real-time positioning data and determine the location of the mobile device 100 on the map.
[0173] It should be noted that for details not disclosed in the control device of the self-moving device according to the embodiment of the present invention, please refer to the details disclosed in the control method of the self-moving device 100 according to the embodiment of the present invention.
[0174] Those skilled in the art will understand that the module diagram is merely an example of a control device for a self-mobile device and does not constitute a limitation on the terminal device of the control device for the self-mobile device. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the control device for the self-mobile device may also include input and output devices, network access devices, buses, etc.
[0175] The control device of the mobile device can be part of the mobile device 100, or it can be a computing device such as a computer, laptop, PDA, or cloud server, and includes, but is not limited to, a processing module 40, a storage module 30, and a computer program stored in the storage module 30 and executable on the processing module 40, such as the aforementioned control method program for the mobile device 100. If the control device of the mobile device is part of the mobile device 100, the mobile device 100 performs all the necessary operations. If it is an external computer, cloud server, etc., the mobile device 100 uploads data, which is then analyzed by the external computing device to control the operation of the mobile device 100. When the processing module 40 executes the computer program, it implements the steps of each of the aforementioned control method embodiments for the mobile device 100, such as the steps shown in Figures 2, 3, and 4.
[0176] This embodiment is further described by assuming that the control device of the mobile device is a part of the mobile device 100 .
[0177] The mobile device 100 can refer to Figure 7. In addition to the camera module 10 and positioning module 20 mentioned above, it can also include a signal transmission module and a communication bus 50. The communication bus 50 may include a path to establish a connection between the camera module 10, the positioning module 20, the processing module 40 and the storage module 30 to transmit information to each other.
[0178] In addition, the present invention also proposes an electronic device, which includes a storage module 30 and a processing module 40. When the processing module 40 executes the computer program, it can implement the steps in the above-mentioned control method of the self-mobile device 100, that is, implement the steps in any one of the technical solutions in the above-mentioned control method of the self-mobile device 100.
[0179] The electronic device may be a part integrated into the mobile device 100, or a local terminal device, or a part of a cloud server.
[0180] The processing module 40 can be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), off-the-shelf programmable gate arrays (FPGAs), other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor. The processing module 40 is the control center of the mobile device 100, connecting all components of the mobile device 100 using various interfaces and circuits.
[0181] The storage module 30 can be used to store the computer programs and / or modules. The processing module 40 implements various functions of the mobile device 100 by running or executing the computer programs and / or modules stored in the storage module 30 and accessing the data stored in the storage module 30. The storage module 30 may primarily include a program storage area and a data storage area. The program storage area may store an operating system, at least one application required for a function, and the like. Furthermore, the storage module 30 may include high-speed random access memory and non-volatile memory, such as a hard disk, internal memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash card, at least one disk storage device, a flash memory device, or other volatile solid-state storage device.
[0182] For example, the computer program may be divided into one or more modules / units, which are stored in the storage module 30 and executed by the processing module 40 to implement the present invention. The one or more modules / units may be a series of computer program instruction segments capable of implementing specific functions, and the instruction segments are used to describe the execution process of the computer program in the mobile device 100.
[0183] Furthermore, an embodiment of the present invention provides a readable storage medium storing a computer program, which, when executed by the processing module 40, can implement the steps in the above-mentioned method for controlling the self-mobile device 100, that is, implement the steps in any one of the technical solutions in the above-mentioned method for controlling the self-mobile device 100.
[0184] If the module integrated with the control method of the mobile device 100 is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention can also implement all or part of the processes in the above-mentioned method embodiments by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When executed by the processing module 40, the computer program can implement the steps of each of the above-mentioned method embodiments.
[0185] The computer program includes computer program code, which may be in source code form, object code form, executable file, or some intermediate form. The computer-readable medium may include any entity or device capable of carrying the computer program code, recording medium, disk, removable hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal, and software distribution medium. It should be noted that the content of the computer-readable medium may be appropriately increased or decreased based on the requirements of legislation and patent practice within a jurisdiction. For example, in some jurisdictions, based on legislation and patent practice, computer-readable media does not include electric carrier signals and telecommunication signals.
[0186] It should be understood that although this specification is described in terms of implementation methods, not every implementation method contains only one independent technical solution. This narrative method of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each implementation method can also be appropriately combined to form other implementation methods that can be understood by those skilled in the art.
[0187] The series of detailed descriptions listed above are only specific descriptions of feasible implementation methods of the present invention. They are not intended to limit the scope of protection of the present invention. Any equivalent implementation methods or changes that do not deviate from the technical spirit of the present invention should be included in the scope of protection of the present invention.
Claims
1. A control method for a self-moving device, used to control the self-moving device to move from a working area through a transition area to an opposite area, characterized in that: The control method comprises the following steps: When the self-moving device is located at the edge of the working area, determining whether the opposite area is the target area by visually detecting the relationship between the working area, the transition area and the opposite area; When the opposite area is the target area, determining whether the self-moving device needs to move to the opposite area; When the self-moving device needs to move to the opposite area, the self-moving device is controlled to move to the opposite area through the transition area.
2. The control method of the self-moving device according to claim 1, characterized in that: The determining whether the self-moving device needs to be moved to the opposite area includes: According to whether the working state of the self-moving device reaches a preset state, it is determined whether the self-moving device needs to be moved out of the working area to the opposite area.
3. A control method for a self-moving device, for controlling the self-moving device to move from a working area through a transition area to an opposite area, characterized in that: The control method comprises the following steps: Controlling the self-moving device to move within the working area and monitoring the working status of the self-moving device; If the working state of the self-moving device reaches a preset state, the self-moving device needs to be moved out of the working area; Detecting whether the self-moving device is located at the edge of the working area; When the self-moving device is located at the edge of the working area, the relationship between the working area, the transition area and the opposite area is detected by vision to determine whether the opposite area is the target area; When the opposite area is the target area, the self-moving device is controlled to move from the working area to the opposite area.
4. The control method of the self-moving device according to claim 2 or 3, characterized in that: The preset state includes a preset working time, and / or a preset working number, and / or a preset working area.
5. The control method of the self-moving device according to claim 1 or 3, characterized in that: If the opposite area is determined to be the target area, at least one or all of the following conditions are met: The difference in ground height between the working area and the transition area is in a first height interval; The difference in ground height between the transition area and the opposite area is in a second height interval.
6. The control method of the self-moving device according to claim 5, characterized in that: The ground height difference between the working area and the transition area, and the ground height difference between the transition area and the opposite area are respectively obtained by calculation based on the depth image.
7. The control method of the self-moving device according to claim 1 or 3, characterized in that: If the opposite area is determined to be the target area, at least the following conditions are met: The type of the opposite area is consistent with the preset type.
8. The control method of the self-moving device according to claim 7, characterized in that: The preset type includes a preset area and a preset ground type; The following steps are used to detect whether the type of the opposite area is consistent with the preset type: Acquire an opposite image of the opposite area; Identify the color and texture of the opposite image and determine the ground type of the opposite area; Calculating the area of the opposite region according to the area ratio of the pixels of the opposite image and the number of pixels occupied by the opposite region; If the ground type is consistent with the preset ground type and the area of the opposite region is within the range of the preset area, the type of the opposite region is consistent with the preset type; otherwise, they are inconsistent.
9. The control method of the self-moving device according to claim 1 or 3, characterized in that: If the opposite area is determined to be the target area, at least the following conditions are met: The width of the transition area is within a preset width range.
10. The control method of the self-moving device according to claim 7, characterized in that: The width of the transition region is obtained by the following steps: Acquire a width image of the transition area in a full width direction; The width of the transition area is calculated according to the length ratio of the pixels of the width image and the number of pixels occupied by the transition area in the width direction.
11. The control method of the self-moving device according to claim 1 or 3, characterized in that: The control method further comprises the steps of: Creating a map while the self-mobile device is moving, the map including a movement track of the self-mobile device; The determining whether the opposite area is a target area further includes: Determining whether the movement trajectory involves an opposite area; If the moving track does not involve the opposite area, determine whether the opposite area is the target area by visually detecting the relationship between the working area, the transition area and the opposite area; If the movement track involves an opposite area, it is determined whether the self-moving device needs to move to the opposite area.
12. The control method of the self-moving device according to claim 1, characterized in that: The control method further comprises: In the process of the self-moving device passing through the transition area and moving to the opposite area, continuously obtaining the positioning information of the current position of the self-moving device, and judging whether the self-moving device exceeds the set area according to the positioning information of the current position; If the self-moving device exceeds the set area range, the self-moving device is controlled to return to the set area range.
13. A self-propelled device, characterized in that: include: A storage module storing a computer program; The processing module can implement the steps of the control method of the self-moving device as described in any one of claims 1 to 12 when executing the computer program.
Citation Information
Patent Citations
Multi-lawn working method used for intelligent lawn mover
CN110083152A
Automatic working system and control method of automatic working system
CN112147992A
Path forming method and device of self-moving equipment and automatic working system
CN113296495A
Automatic working system
CN114545915A
Mapping method and device, computer readable storage medium and self-moving equipment
CN114756018A
