Control method and automatic working system
By placing identification objects in the work area and using mobile terminals to determine channel information, the self-mobile device can cross the work area dividing line, solving the problem that the visual component-based device cannot work across the area, and improving work efficiency and user experience.
Patent Information
- Application Number
- CN202410661537.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-06-17
- Filing Date
- 2024-05-27
- Publication Date
- 2024-12-03
AI Technical Summary
Vision-based components-based self-mobile devices cannot cross the dividing line between work areas and non-work areas, resulting in the inability to achieve cross-regional work and reduce work efficiency.
By placing identification objects in the work area, moving from the mobile device along the boundary of the work area and identifying the identification objects, the channel information is determined to achieve cross-regional work. The mobile terminal obtains the correspondence between the working areas and the correspondence between the identification objects, determines the channel information and sends it to the mobile device, so that it moves across the region according to the channel information.
It realizes efficient movement of self-mobile devices between multiple working areas, improves work efficiency, and reduces the edge confirmation process that users need to perform before using the device, improving user experience.
Smart Images

Figure CN119065279A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of cross-region control technology, and in particular to a control method and an automatic working system for realizing cross-region work. Background Art
[0002] With the continuous advancement of computer technology and artificial intelligence technology, the application of self-mobile equipment (such as lawn mowers, sweepers, etc.) is becoming more and more widespread. For example, smart lawn mowers can automatically help people maintain lawns, freeing people from the boring, time-consuming and laborious housework of lawn maintenance, and are therefore very popular.
[0003] Currently, after completing work in one working area, the self-moving equipment on the market needs to cross the non-working area to work in another working area. For example, when there are multiple lawn areas and each lawn area is separated by a non-working area (such as cement), if the smart lawn mower wants to complete the cutting of multiple lawn areas, it needs to cross the non-working area to reach the lawn area to work.
[0004] However, for self-moving devices that work based on visual components, since the visual components can only identify the dividing line between the working area and the non-working area, the self-moving devices can only move within the working area and cannot cross the dividing line between the working area and the non-working area to reach the non-working area, and thus cannot achieve cross-area work, which reduces work efficiency. Summary of the invention
[0005] In order to overcome the defects of the prior art, the present application provides a control method and an automatic working system, which can effectively realize cross-regional work and improve work efficiency for self-moving equipment that works based on visual components.
[0006] According to a first aspect of an embodiment of the present application, a method for realizing cross-regional operation is provided, which is applied to a mobile terminal, and the method includes: obtaining a correspondence between working areas; obtaining a correspondence between working areas and identification objects; determining channel information between working areas according to the correspondence between the working areas and the correspondence between the working areas and the identification objects; and sending the channel information to a self-mobile device so that the self-mobile device realizes cross-regional operation according to the channel information.
[0007] In one embodiment, channel information between the working areas is determined based on the correspondence between the working areas and the correspondence between the working areas and the identification objects, including: scanning the identification objects in the first area and the second area respectively according to the correspondence between the first area and the second area; and determining the channel information between the working areas based on the scanning results.
[0008] In one embodiment, the channel information includes an area identifier of a first area, a first identification object, an area identifier of a second area, a second identification object, and a connectivity relationship between the first identification object and the second identification object; the first identification object corresponds to the first area, and the second identification object corresponds to the second area.
[0009] In one embodiment, before sending the channel information to the self-mobile device, the method further includes: determining whether the channel information is valid; and sending the channel information to the self-mobile device if the channel information is confirmed to be valid.
[0010] In one embodiment, the method further includes: allocating a charging station identifier to a designated work area in response to a user operation.
[0011] According to a second aspect of the implementation of the present application, a control method is also provided, which is applied to a self-moving device, wherein the self-moving device is configured to move and / or work in multiple working areas within a specified range, and the self-moving device is provided with an image acquisition device, and the method comprises: receiving channel information sent by a mobile terminal; wherein the channel information is determined according to the correspondence between the working areas and the correspondence between the working areas and the identification objects; when it is determined that it is necessary to move to a target working area, based on the image acquired by the image acquisition device, moving along the edge in the current working area, and identifying the identification object during the moving along the edge; when a first identification object is identified, changing the moving direction; the first identification object is the identification object in the current working area in the target channel information; the target channel information represents the channel information between the current working area and the target working area; based on the target channel information and the changed moving direction, moving to the target working area.
[0012] In one embodiment, the method further includes: when the identified identification object is not the first identification object, continuing to move along the edge and identifying identification objects during the movement along the edge until the first identification object is identified.
[0013] In one embodiment, when a first identification object is identified, the moving direction is changed, including: when the first identification object is identified, determining the angular relationship between the central axis and the boundary of the self-moving device; based on the angular relationship, controlling the self-moving device to turn so that the central axis and the boundary of the self-moving device are basically perpendicular after turning.
[0014] In one embodiment, the process of moving toward the target working area includes: identifying an identification object; if a second identification object is identified, changing the moving direction; the second identification object is an identification object within the target working area in the target channel information; and performing work in the target working area based on the changed moving direction.
[0015] In one embodiment, the method further includes: if the second identification object is not identified within a preset time or a preset distance, an alarm is issued and / or the machine is shut down.
[0016] In one embodiment, the self-moving device is provided with a sensor for collecting the moving direction of the self-moving device; during the movement to the target working area, it also includes: controlling the moving direction of the self-moving device based on the data collected by the sensor.
[0017] In one embodiment, the identification object is set on the boundary of the work area to which it belongs; or, the identification object is set at a preset distance from the boundary of the work area to which it belongs.
[0018] In one embodiment, the identification object includes at least one of the following: an RFID tag; a digital tag; a color tag; an image tag; or an NFC tag.
[0019] In one embodiment, after the image acquisition device acquires the image of the working area, the self-moving device can also detect and process the image based on a first detection model to determine a detection result, wherein the detection object of the first detection model includes an identification object, and the identification object includes an identification object set on the ground; when the detection result is that the identification object is detected, the target working area in the image is determined; the self-moving device is controlled to travel and / or work in a spatial area corresponding to the target area, and the target area includes an area corresponding to the identification object.
[0020] According to the third aspect of the implementation of the present application, a mobile terminal is also provided, characterized in that it includes: a processor; a memory for storing instructions executable by the processor; the processor is used to execute the method for implementing cross-regional work as described in any embodiment of the present application.
[0021] According to the fourth aspect of the implementation of the present application, a self-moving device is also provided, including: a processor; a memory for storing instructions executable by the processor; the processor is used to execute the control method described in any embodiment of the present application.
[0022] According to a fifth aspect of the implementation of the present application, there is also provided a computer-readable storage medium, wherein the storage medium stores a computer program, and the computer program is used to execute the method described in any one of the embodiments of the present application.
[0023] According to a sixth aspect of the present application, there is also provided an automatic working system, comprising a self-moving device and a mobile terminal, wherein the self-moving device is configured to move and / or work in a plurality of working areas within a specified range, and the self-moving device is provided with an image acquisition device,
[0024] The mobile terminal is configured to obtain a correspondence between working areas; obtain a correspondence between working areas and identification objects; determine channel information between working areas according to the correspondence between working areas and the correspondence between working areas and identification objects; and is further configured to send the channel information to a mobile device;
[0025] The self-mobile device is configured to receive channel information sent by a mobile terminal; wherein the channel information is determined based on the corresponding relationship between the working areas; when it is determined that it is necessary to move to the target working area, based on the image captured by the image acquisition device, move along the edge in the current working area, and identify the identification object during the along-the-edge movement; when a first identification object is identified, change the moving direction; the first identification object is the identification object in the current working area in the target channel information; the target channel information represents the channel information between the current working area and the target working area; based on the target channel information and the changed moving direction, move to the target working area.
[0026] In one embodiment, after the image acquisition device acquires the image of the working area, the self-moving device may further perform detection processing on the image based on a first detection model to determine a detection result, wherein the detection object of the first detection model includes an identification object, and the identification object includes an identification object set on the ground;
[0027] In a case where the detection result is that the identification object is detected, determining a target working area in the image;
[0028] The self-moving device is controlled to travel and / or work in a spatial area corresponding to the target area, wherein the target area includes an area corresponding to the identification object.
[0029] In the technical solution provided in the embodiment of the present application, the mobile terminal determines the channel information between the working areas according to the correspondence between the working areas and the correspondence between the working areas and the identification objects. This can not only ensure that there must be identification objects in each area and that there must be channel information between areas, but also reduce the process of confirmation by the user when working with the mobile device, thereby ensuring the smooth completion of cross-area work while improving the user experience.
[0030] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] The objectives, technical solutions and beneficial effects of the present application described above can be clearly obtained through the following detailed description of specific embodiments that can implement the present application, combined with the description of the accompanying drawings.
[0032] The same reference numerals and symbols in the drawings and the description are used to designate the same or equivalent elements.
[0033] Figure 1 A schematic diagram of a working scenario provided by an embodiment of the present application;
[0034] Figure 2 A schematic diagram of an automatic working system provided by an embodiment of the present application;
[0035] Figure 3 A schematic diagram of the structure of a self-moving device provided in one embodiment of the present application;
[0036] Figure 4 A schematic diagram of the structure of a self-moving device provided in one embodiment of the present application;
[0037] Figure 5 A schematic diagram of a setting interface of a mobile terminal provided in an embodiment of the present application;
[0038] Figure 6 A schematic diagram of a setting interface of a mobile terminal provided in an embodiment of the present application;
[0039] Figure 7 A schematic diagram of a setting interface of a mobile terminal provided in an embodiment of the present application;
[0040] Figure 8 A schematic diagram of a setting interface of a mobile terminal provided in an embodiment of the present application;
[0041] Fig. 9 A schematic diagram of a setting interface of a mobile terminal provided in an embodiment of the present application;
[0042] Fig.10A schematic diagram of a setting interface of a mobile terminal provided in an embodiment of the present application;
[0043] Fig.11 A schematic diagram of a setting interface of a mobile terminal provided in an embodiment of the present application;
[0044] Fig.12 A schematic diagram of a setting interface of a mobile terminal provided in an embodiment of the present application;
[0045] Fig.13 A flowchart of a method for implementing cross-regional work provided in one embodiment of the present application;
[0046] Fig.14 A flow chart of a control method provided in one embodiment of the present application;
[0047] Fig.15 It is a schematic diagram of the composition of a computer device according to an embodiment of the present application. DETAILED DESCRIPTION
[0048] In order to facilitate the understanding of this application, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this application, not all of them. The purpose of providing these implementation methods is to understand the disclosure of this application more thoroughly and comprehensively. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work belong to the scope of protection of this application.
[0049] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present application described here can be implemented in an order other than those illustrated or described here. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are only examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices. In addition, in the absence of explicit special instructions, the various technical features in the various embodiments of the present application can be regarded as being able to be combined or combined with each other, as long as the combination or combination is not impossible to implement due to technical reasons.
[0050] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. The term "and / or" used herein includes any and all combinations of one or more of the related listed items.
[0051] With the rapid development of science and technology, the application of intelligent control technology in people's lives is becoming more and more extensive. As a smart product derived from intelligent control technology, self-moving devices with autonomous working capabilities can bring convenience and speed to people's lives. Therefore, self-moving devices are frequently used in people's lives. At present, after completing work in one working area, self-moving devices need to cross the non-working area to work in another working area, such as Figure 1 As shown, when there are two lawn areas A and B within the specified range and the lawn areas A and B are separated by a non-working area C (such as cement), the smart lawn mower needs to cross the boundary between the working area and the non-working area to reach the non-working area C, and further pass through the non-working area C to reach the next working area.
[0052] At present, many robots are only equipped with visual components (such as cameras), and the visual components can only identify the boundary between the working area and the non-working area, such as the boundary between the lawn area and the non-lawn area, that is, the robot can only move within the working area. In this way, when there are multiple working areas separated by non-working areas that need to be processed, for the self-moving device that works based on the visual component, it can only move within the working area, and cannot cross the boundary between the working area and the non-working area to reach the non-working area, and thus cannot achieve cross-area work, which reduces work efficiency.
[0053] Based on the above problems, the embodiment of the present application provides a control method for realizing cross-region work. The control method first requires the user to place an identification object (such as an RFID tag) in each working area, and then control the self-mobile device to move along the boundary of working area A (the working area where the charging station is located) and identify the identification object during the movement, turn after identifying the identification object, and then control the self-mobile device to move to working area B based on the sensor for collecting the moving direction set on the self-mobile device, and identify the identification object during the movement, turn after identifying the identification object, and then move along the boundary of working area B and identify the identification object during the movement. Repeat the above steps until all working areas are walked around and all identification objects are identified, and after obtaining the identification object information corresponding to each working area and the identification object information crossing from one working area to another, the self-mobile device is controlled to realize cross-region work based on the above-mentioned information.
[0054] It can be seen that when there are multiple working areas separated by non-working areas that need to be processed, for a self-moving device that works based on a visual component, the above method can be used to achieve cross-area work and improve work efficiency.
[0055] However, although the above method can realize cross-region work, before processing each work area, the self-moving device needs to control the self-moving device to move along the boundary of each work area to determine the identification object information corresponding to each work area and the channel information from one work area to another. In this way, if the user does not place the identification object in a certain work area or the machine sensor has low accuracy, the identification object cannot be identified during the edge process, and the above information cannot be obtained, which affects subsequent work and reduces user experience.
[0056] Based on the above problems, the present application embodiment provides an automatic working system, such as Figure 2 As shown, the automatic working system provided by the present application includes a self-moving device and a mobile terminal, wherein the self-moving device is configured to move and / or work in multiple working areas within a specified range, and the self-moving device is provided with an image acquisition device, wherein:
[0057] The mobile terminal is configured to obtain a correspondence between working areas; obtain a correspondence between working areas and identification objects; determine channel information between working areas according to the correspondence between working areas and the correspondence between working areas and identification objects; and is further configured to send the channel information to a mobile device;
[0058] The self-mobile device is configured to receive channel information sent by a mobile terminal; wherein the channel information is determined based on the corresponding relationship between the working areas; when it is determined that it is necessary to move to the target working area, based on the image captured by the image acquisition device, move along the edge in the current working area, and identify the identification object during the along-the-edge movement; when a first identification object is identified, change the moving direction; the first identification object is the identification object in the current working area in the target channel information; the target channel information represents the channel information between the current working area and the target working area; based on the target channel information and the changed moving direction, move to the target working area.
[0059] In this embodiment, the mobile terminal may be an intelligent terminal including a communication module, such as a mobile phone, a computer, a tablet, etc., which can communicate with other mobile devices and interact with users, such as receiving user input and performing corresponding processing based on user operations. In addition, the mobile terminal may also include an identification object recognition component for identifying an identification object.
[0060] In this embodiment, the self-moving device can be an automatic vacuum cleaner, an automatic spraying device, an automatic monitoring device, or other unattended device that automatically moves on the ground or surface of the work area to complete the corresponding work. It should be noted that in this embodiment, the self-moving device is an intelligent lawn mower as an example for explanation, and other implementation scenarios are not limited.
[0061] like Figure 3 As shown, the self-moving device 1 includes a control module 20 , a working module 21 , a walking module 22 , an energy module 23 , and an image acquisition device 24 .
[0062] The control module 20 is used to control the self-moving device 1 to move and work automatically, and is the core component of the self-moving device 1. The functions it performs include controlling the working module 21 to start or stop working, controlling the walking module 22 to start or stop, and controlling the moving direction, judging the energy of the energy module 23 and timely instructing the self-moving device 1 to return to the charging station for automatic docking and charging, etc. The control module usually includes a single-chip microcomputer, a memory, and other peripheral circuits.
[0063] The working module 21 is used to perform the main working tasks of the self-moving device 1. If the self-moving device 1 is an intelligent lawn mower, the working module includes a mowing blade, a cutting motor, etc., and may also include components such as a mowing height adjustment mechanism to optimize or adjust the mowing effect. If the self-moving device 1 is an automatic vacuum cleaner, the working module includes a vacuum motor, a vacuum port, a vacuum pipe, a vacuum chamber, a dust collection device, and other working components for performing the vacuum task.
[0064] The walking module 23 is used to drive the self-moving device 1 to walk in the working area 7, and is usually composed of a wheel set installed on the self-moving device 1 and a walking motor for driving the wheel set. The wheel set includes a driving wheel connected to the walking motor and an auxiliary wheel that mainly plays an auxiliary supporting role. In this embodiment, there are two driving wheels, which are located at the rear of the self-moving device 1, and each driving wheel is connected to a walking motor. There are one or two auxiliary wheels, which are located at the front of the self-moving device 1.
[0065] The energy module 23 is used to provide energy for various operations of the self-moving device 1, and includes a rechargeable battery and a charging connection structure, and the charging connection structure is usually a charging electrode.
[0066] The image acquisition device 24 is used to acquire an image in the forward direction of the fuselage, and at least part of the image is an image of the working surface in the forward direction. The acquired image is within the field of view of the image acquisition device. Figure 4As shown, the image acquisition device can be a camera or laser radar commonly used in the industry. Generally, the image acquisition device is installed at the upper front part of the fuselage 100, preferably centered, with the viewing angle facing the front and bottom to acquire images of the working surface. The size of its field of view 210 can be adjusted according to actual needs. The larger the field of view, the more images captured in the forward direction of the fuselage, and vice versa. There can be multiple forward directions of the fuselage, such as normal forward, backward, turning, etc. In this embodiment, the forward direction of the fuselage refers to the normal forward direction, that is, the direction of the central axis of the fuselage. Preferably, in this embodiment, the image acquisition device is exemplified as a camera, which does not constitute a limitation on other implementation scenarios.
[0067] In addition to the above modules, the self-moving device 1 also includes a housing for accommodating and installing each module, a control panel for user operation, etc. The self-moving device 1 may also include various environmental sensors, such as humidity sensors, temperature sensors, acceleration sensors, light sensors, position sensors, etc. The position sensor may include an inertial sensor IMU or an odometer ODO, etc. These sensors can help the self-moving device determine the working environment to execute the corresponding program. Among them, the position sensor can be used to collect the moving direction of the self-moving device.
[0068] In this embodiment, before working on multiple working areas within the specified range, the mobile terminal will first determine the channel information between the working areas based on the correspondence between the working areas and the correspondence between the working areas and the identification objects, and then send it to the self-mobile device, so that the self-mobile device can work in multiple working areas according to the received information. The specified range includes multiple working areas, and the working areas are separated by non-working areas.
[0069] In some embodiments, the mobile terminal can generate a correspondence between the work area and the identification object in response to the work area information input by the user. The work area information may include the area identification of each work area within the specified range and the identification object set in each work area. The correspondence between the work area and the identification object may include one-to-one or one-to-many, which can be set according to the actual scenario.
[0070] In some implementation scenarios, the user can add work area information in the mobile terminal according to the number of work areas that need to be processed within the specified range, such as the number of areas, the identification of each area, the identification objects that need to be set in each area, and the number of identification objects. After receiving the above information, the mobile terminal can establish and store the corresponding relationship between the work area and the identification object. Figure 5 , Figure 6As shown, the user can add 4 zones in the mobile terminal, and the distinguishing mark of each zone can be recorded as Zone1, Zone2, Zone3, and Zone4. In Zone1, the identification object Tag with the attribute of 8868-7633 is set, and in Zone2, the identification object Tag with the attribute of 8868-4602 is set. Further, the mobile terminal can store the above information in association. Of course, the above identification, identification object attributes, identification object quantity, etc. can be set according to the actual scenario, and this application does not limit this.
[0071] In some embodiments, the mobile terminal may generate a correspondence between the working areas in response to the area connectivity information input by the user, wherein the area connectivity information includes a connection relationship between different areas, and the connection relationship may be represented by identification objects in different areas.
[0072] In some implementation scenarios, the user can set which work areas are to be connected according to the actual scenario, and then input the corresponding relationship between the work areas into the mobile terminal. After receiving the corresponding relationship, the mobile terminal can establish and store the corresponding relationship between the work areas. Figure 5 As shown, the user can input the connection relationship between two zones, such as Zones: 1-2, Zones: 2-3, Zones: 3-4, Zones: 1-4, and further, the mobile terminal can store the above information in association. Among them, Zones: 1-2 indicates that Zone 1 and Zone 2 are connected, and Zones: 2-3 indicates that Zone 2 and Zone 3 are connected.
[0073] It should be noted that the order of establishing the correspondence between the above-mentioned working areas and identification objects and the correspondence between working areas can be set according to the actual scenario, and this application does not limit this. For example, the correspondence between working areas can be determined first, and then the correspondence between the working area and the identification object can be set for the two working areas with corresponding relationships. For another example, the correspondence between the working area and the identification object can be determined first, and then the correspondence between the working areas can be determined.
[0074] Of course, the correspondence between the above-mentioned working areas and the correspondence between the working areas and the identification objects can also be generated by other devices, and the device can communicate with the mobile terminal.
[0075] In this embodiment, after the correspondence between the working areas and the correspondence between the working areas and the identification objects are acquired, the channel information between the working areas can be determined according to the correspondence between the working areas and the correspondence between the working areas and the identification objects.
[0076] In some embodiments, the channel information includes a region identifier of a first region, a first identification object, a region identifier of a second region, a second identification object, and a connectivity relationship between the first identification object and the second identification object; the first identification object corresponds to the first region, and the second identification object corresponds to the second region. In actual application scenarios, the horizontal coordinate or vertical coordinate of the position of the first identification object and the position of the second identification object are substantially the same, so that after the machine identifies the identification object in the current region and turns, it can identify the identification object corresponding to another region by moving in the same direction. The identification objects included in each channel information are different, that is, the same identification object cannot appear in multiple channel information.
[0077] In some embodiments, channel information between the working areas is determined based on the correspondence between the working areas and the correspondence between the working areas and the identification objects, including: scanning the identification objects in the first area and the second area respectively according to the correspondence between the first area and the second area; and determining the channel information between the working areas based on the scanning results.
[0078] Specifically, Figure 5-Figure 11 As shown, in some implementation scenarios, the user can add the required working areas Zone1, Zone2, Zone3, and Zone4 in the APP page according to the actual situation, and enter the corresponding relationship between the two areas, such as Zones: 1-2, Zones: 2-3, Zones: 3-4, Zones: 1-4 (such as Figure 5 Next, assign identification objects to the two corresponding work zones. For example, for Zones: 1-2, assign an identification object Tag with an attribute of 8868-7633 to Zone1 and an identification object Tag with an attribute of 8868-4602 to Zone2 (as shown in the figure). Figure 6 Further, two working areas with corresponding relationship are selected, such as Zone1 and Zone2 (as shown in FIG. Figure 7 Then move the APP to the tag position of the identification object with the attribute of 8868-7633 in Zone1 and scan the identification object tag (as shown in Figure 8 , Fig. 9 As shown), move the APP to the tag position of the identification object with the attribute of 8868-4602 in Zone2, and scan the identification object tag (as shown Fig.10 , Fig.11 As shown), a connectivity relationship between the identification objects of Zone1 and Zone2 is established, that is, channel information between Zone1 and Zone2 is obtained.
[0079] In some embodiments, other work area information can be set through the mobile terminal, such as the perimeter and area of the work area, whether it is cross-edge cutting, the height of the cutter head, whether there is a charging station, etc. Fig.12 As shown, the size of Zone 1 can be set to 70m through the APP. 2 , the perimeter is 100m, etc.
[0080] In some embodiments, after determining the channel information for cross-regional movement, the user can also carry a mobile terminal to scan the identification object in the channel information to confirm that cross-regional work can be achieved based on the channel information. Specifically, for example, the user can use a mobile phone to scan and identify the identification object (such as an RFID identification object, also known as an RFID card) to confirm whether the configured correspondence is established. Among them, it is possible to scan first and then install the RFID identification object or install first and then scan the RFID identification object. Since it is less prone to errors to install first and then scan the RFID identification object, in this embodiment, it is preferred to install first and then scan the RFID identification object. In this embodiment, the user only needs to carry a mobile terminal to walk in the work area and identify each identification object to complete the APP setting. In this way, the cross-regional work can be completed smoothly while improving the user experience. Of course, since the channel information is determined by the mobile terminal, it can be guaranteed that there must be identification objects in each area and channel information between areas, so the above process of confirming whether the corresponding relationship of the configuration is established is not a necessary step.
[0081] In this embodiment, after the channel information between the working areas is determined, it can be sent to the self-mobile device so that the self-mobile device can perform cross-area work based on it.
[0082] In some embodiments, before sending the channel information to the self-mobile device, it can be determined whether the channel information is valid; if confirmed to be valid, the channel information is sent to the self-mobile device.
[0083] In some embodiments, when the confirmation is invalid, the channel information can be re-determined through the above steps.
[0084] In some implementation scenarios, determining whether the channel information is valid may include at least one of the following: detecting whether the same identification object appears in multiple channel information, detecting whether the area identification in the channel information is unique, detecting whether there is an isolated working area (that is, there is no reachable channel information for an area among multiple areas, or the area identification of a working area does not appear in any channel information), the number of channels between any two working areas is greater than 1, etc.
[0085] In some implementation scenarios, under the control of the user, the user can move in each working area according to the determined channel information. During the movement, it can be detected whether the same RFID is set in multiple channels, whether the area ID (area identification) appears repeatedly, whether there is an isolated area (multiple areas, but a certain area has no channel to reach), the number of channels connecting any two areas is greater than 1, etc. As long as it is detected that one of the above conditions is met, the obtained channel information is confirmed to be invalid. For example, if at least one of the following is detected: the same RFID is set in multiple channels, the area ID appears repeatedly, there is an isolated area, and the number of channels connecting any two areas is greater than 1, the obtained channel information is confirmed to be invalid. It should be noted that in some implementation scenarios, in order to ensure that cross-regional operations can be successfully implemented, the user can also conduct further checks when confirming that the channel information is valid. For example, the user configuration error cannot be detected by the above method. At this time, the user needs to make his own judgment, for example, the actual scene is 3 areas, but the user sets only one area on the APP.
[0086] In some embodiments, determining whether the channel information is valid may also be done by a mobile device. For example, in some implementation scenarios, after the mobile terminal generates the channel information, it may send it to the mobile device. Before the mobile device performs cross-region work, it may move in each working area according to the channel information under the control of the user to determine the validity of the channel information.
[0087] In some embodiments, a charging station identifier may be assigned to a designated work area in response to a user operation.
[0088] In this embodiment, the channel information between the working areas is determined based on the correspondence between the working areas and the correspondence between the working areas and the identification objects. This can not only ensure that there is an identification object in each area and that there is channel information between areas, but also reduce the process of users confirming while working on their own mobile devices, thereby ensuring the smooth completion of cross-area work while improving the user experience.
[0089] In some embodiments, in order to solve the technical problems of how to improve the cutting coverage, accurately control the moving path, and improve user satisfaction, the image acquisition device 24 of this embodiment is also configured to shoot the working area to obtain an image of the working area; further, the control module 20 and / or the image acquisition device 24 can detect and process the image based on the first detection model to determine the detection result, and the detection object of the first detection model includes an identification object, wherein the identification object includes a label set on the ground; when the detection result is that the identification object is detected, the target working area in the image is determined; the self-mobile device is controlled to travel and / or work in the spatial area corresponding to the target working area, and the target working area includes the area corresponding to the identification object.
[0090] In this embodiment, the identification object on the ground can be detected. Although the identification object is not grass, the image area corresponding to the identification object can be processed as a drivable target working area in this embodiment, so that the self-moving device can be controlled to move and cut above the identification object, and the grass around the identification object can be cleanly cut to avoid missing grass, thereby improving cutting efficiency and cutting coverage.
[0091] As mentioned above, in this embodiment, the identification object is configured to indicate the moving direction or moving path of the self-mobile device. Exemplarily, the identification object can be a signboard, a marker, a sensing facility, etc. Specifically, the identification object can be an RFID tag; a digital tag; a color tag; an image tag; an NFC tag, etc. Usually, the volume of the identification object is relatively small, and the height of the identification object is usually lower than the cutting height of the blade of the lawn mower, so when the blade cuts above the identification object, the blade will not damage the identification object.
[0092] In this embodiment, the working area image includes a first identification area corresponding to the identification object; when the detection result is that the identification object is detected, the self-mobile device is controlled to travel and / or work in the spatial area corresponding to the target working area, including: when the detection result is that the identification object is detected, the working area image is converted to generate a reference image, the reference image includes a second identification area corresponding to the identification object, and the image features of the second identification area match the image features of the grass; image segmentation processing is performed on the reference image based on the image segmentation model to determine the grass area and the non-grass area; the self-mobile device is controlled to travel and / or work in the spatial area corresponding to the target working area, and the target working area includes the grass area.
[0093] In this embodiment, when the first detection model detects the identification object, the identification object can be framed in the image to determine the first identification area, which can be a circumscribed polygonal area (such as a circumscribed rectangular area) of the identification object in the image. Further, the working area image can be adjusted to replace the image features of the first identification area with the image features of the grass to obtain a reference image.
[0094] For example, the color of the first identification area may be adjusted to the color of grass, or the image of the first identification area may be replaced with an image of grass, or the first identification area may be directly marked as a grass area.
[0095] In this embodiment, when the image segmentation model performs image segmentation processing on the reference image, since the image features of the image area corresponding to the identification object (the second identification area) match the grass, the image segmentation model can directly determine the image area corresponding to the identification object as the grass area. Subsequently, the grass area can be directly determined as the target working area, and the self-mobile device can be controlled to travel and / or work in the space corresponding to the target working area.
[0096] If the marked object is regarded as an obstacle, the self-moving device will bypass the marked object, resulting in the inability to cut the grass around the marked object, causing adverse effects such as missing grass.
[0097] In this embodiment, the target working area includes a grass area, which includes not only the area where the real grass is located, but also the area where the identification object is located. Therefore, the self-mobile device can cleanly cut the grass around the identification object during cutting, thereby improving the cutting coverage rate.
[0098] In a preferred implementation of this embodiment, the working area image is converted to generate a reference image, including: coloring the first identification area of the working area image to generate a reference image, and the RGB value of the second identification area matches the RGB value of the grass.
[0099] In this embodiment, the reference image can be obtained by adjusting the RGB values of the first identification area.
[0100] For example, the G value in the RGB value of the first identification area may be adjusted to 255.
[0101] In addition, before identifying the target working area through an image and controlling the mobile device to travel and / or work in the spatial area corresponding to the target working area, the control device 20 can also determine a candidate area in the identified non-grass area; and determine the grass area and the candidate area as the target working area.
[0102] Specifically, both grass areas and non-grass areas that meet certain conditions can be determined as target working areas. In this embodiment, the area types of non-grass areas may include fences, ditches, stone slabs, fallen leaves, fallen flowers, mud, irrigation devices, soft soil, etc., and safe non-grass areas can be used as target working areas. Safe non-grass areas refer to areas where the self-moving device will not be damaged, stuck, entangled, forced to pause, etc. when moving over or around the area.
[0103] For example, stone slabs, fallen leaves, fallen flowers, and soil that are not grass can be used as target working areas.
[0104] It should be noted that, in the non-grass area, determining the candidate area includes: determining the candidate area according to the area type, area position and / or area geometric features of each non-grass area.
[0105] In this embodiment, the non-grass area can be screened according to the type, location, area, shape, etc. of the non-grass area to obtain candidate areas that meet the conditions, and both the grass area and the candidate areas are determined as target working areas.
[0106] Exemplarily, a stone slab with a smaller area, fallen leaves and flowers with a smaller area, soil in a non-strip shape, and a stone slab in a non-strip shape may be determined as candidate areas.
[0107] Furthermore, the detection object of the first detection model in the present application also includes a charging station; specifically, when the mode of the self-moving device is the regression charging mode, and the detection result is that the charging station is detected, the image of the working area is processed by image recognition based on the charging station recognition model to determine the position and posture of the charging station; according to the position and posture of the charging station, the self-moving device is controlled to move and dock with the charging station.
[0108] When the self-mobile device completes its work or runs out of power, the self-mobile device needs to return to the charging station to charge. The first detection model in this embodiment can also detect the charging station. After the self-mobile device detects the charging station in the regression charging mode, it can detect the real-time image based on a more accurate charging station recognition model to determine the charging station posture and the relative posture relationship between the charging station and the self-mobile device. Then, according to the charging station posture and the relative posture relationship between the charging station and the self-mobile device, the moving direction, moving angle and moving distance are determined to achieve precise docking between the self-mobile device and the charging station. The recognition accuracy, accuracy and contour recognition performance of the charging station recognition model are better than those of the first detection model.
[0109] When the mode of the self-mobile device is not the return charging mode and the detection result is that a charging station is detected, the detection result of the charging station is ignored.
[0110] Since the charging station is a type of non-grass, and the mobile device needs to avoid the charging station during movement or work. In this embodiment, in other modes except the regression charging mode, the first detection model can still detect the charging station, but since the detection accuracy of the first detection model for the charging station is low, the non-grass area cannot be determined based on the circumscribed polygonal area of the charging station determined by the first detection model, otherwise collision and missed cutting may occur; therefore, in this embodiment, after the first detection model detects the charging station, the detection result of the first detection model for the charging station can be ignored in subsequent processing.
[0111] In this embodiment, the reference image can be segmented based on the image segmentation model, and the non-grass area can be determined according to the area segmentation result of the image segmentation model. The processing precision, accuracy, and contour recognition performance of the image segmentation model are all better than those of the first detection model.
[0112] In this embodiment, the identification object in the image is identified based on the first detection model, and the charging station is preliminarily identified; when the recognition accuracy requirement is higher, the image is processed based on a model with better performance, which can save computing power, make full use of the advantages of each model, and reduce costs.
[0113] Based on the same inventive concept, in order to improve user experience while completing cross-region work, this embodiment provides a method for implementing cross-region work, which is applied to a mobile terminal. Fig.13 As shown, the method for implementing cross-region work provided in this embodiment may include the following steps.
[0114] S100, obtaining the corresponding relationship between the working areas;
[0115] S102, obtaining the corresponding relationship between the working area and the identification object;
[0116] S104, determining channel information between the working areas according to the correspondence between the working areas and the correspondence between the working areas and the identification objects;
[0117] S106: Send the channel information to the self-mobile device, so that the self-mobile device can achieve cross-region work according to the channel information.
[0118] In this embodiment, channel information between the working areas is determined based on the correspondence between the working areas and the correspondence between the working areas and the identification objects, including: scanning the identification objects in the first area and the second area respectively according to the correspondence between the first area and the second area; and determining the channel information between the working areas based on the scanning results.
[0119] In this embodiment, the channel information includes the area identifier of the first area, the first identification object, the area identifier of the second area, the second identification object, and the connectivity relationship between the first identification object and the second identification object; the first identification object corresponds to the first area, and the second identification object corresponds to the second area.
[0120] In this embodiment, before sending the channel information to the self-equipment device, the method further includes: determining whether the channel information is valid; and sending the channel information to the self-equipment device if the channel information is confirmed to be valid.
[0121] In this embodiment, the method further includes: in response to a user operation, allocating a charging station identifier to the designated work area.
[0122] It should be noted that the specific implementation process of the method for realizing cross-regional work provided in this embodiment is similar to the implementation scheme recorded in the above-mentioned system. Therefore, the specific limitations in the above-mentioned method embodiment can be found in the above description and will not be repeated here.
[0123] Based on the same inventive concept, in order to improve the user experience while completing cross-regional work, this embodiment provides a control method, which is applied to a self-moving device, specifically, it can be applied to a control module in a self-moving device, the self-moving device is configured to move and / or work in multiple working areas within a specified range, and the self-moving device is provided with an image acquisition device. Of course, in some cases, it can also be applied to a server arranged on the network side and capable of controlling the operation process of the self-moving device. Fig.14 As shown, the control method provided in this embodiment may include the following steps.
[0124] S200, receiving channel information sent by a mobile terminal; wherein the channel information is determined according to the correspondence between the working areas and the correspondence between the working areas and the identification objects;
[0125] S202: When it is determined that the target working area needs to be moved, based on the images captured by the image acquisition device, the current working area is moved along the edge, and the marked object is recognized during the movement along the edge;
[0126] S204, when a first identification object is identified, changing the moving direction; the first identification object is an identification object in the current working area in the target channel information; the target channel information represents channel information between the current working area and the target working area;
[0127] S206: Move toward the target working area based on the target channel information and the changed moving direction.
[0128] In this embodiment, the front end of the self-moving device may be provided with an image acquisition device, such as a visual sensor (such as a camera), for acquiring images of the field of view coverage during movement. Further, obstacles and / or boundaries may be detected based on the visual sensor; when obstacles are detected, the device may move around the obstacles; it may also move along the boundaries according to the detected boundaries; it may also determine the moving direction based on the images acquired by the visual sensor, and move and / or work based on the moving direction.
[0129] In this embodiment, the camera can capture an image of the working area, and the self-moving device can determine the direction of movement based on the image of the working area. Specifically, the self-moving device can move and / or work in the working area formed by the boundary. When the self-moving device is in the edge mode, it can move along the boundary. When the self-moving device is out of power, the moving direction can be determined based on the image of the working area, and it can be moved to the charging station for charging. After charging is completed, it can exit from the charging station based on the image captured by the camera, that is, exit the station. Among them, the boundary can be the outer boundary of the working area, and the outer boundary is the periphery of the entire working area, usually connected end to end, and the working area is closed. The boundary can be physical or electronic. This application does not limit this. The charging station is usually located within the working range, such as on or within the boundary, and is connected to the mains or other power supply system for the self-moving device to return to charge. The charging station is provided with charging electrodes for docking with the corresponding electrodes of the self-moving device. Optionally, the charging station is not provided with charging electrodes, but a wireless charging module is provided, which is mutually inductive with the wireless charging module of the self-moving device to achieve wireless charging.
[0130] In this embodiment, the self-mobile device may be provided with a marker object recognition component for recognizing the marker object. Of course, the marker object may also be recognized by an image acquisition device, such as a visual sensor.
[0131] In this embodiment, after receiving the channel information sent by the mobile terminal, the mobile device can achieve cross-region movement based on the channel information.
[0132] In some embodiments, when it is determined that the device needs to move to the target working area, the self-moving device can move along the edge of the current working area based on the image captured by the image acquisition device, and identify the identified object during the moving along the edge. The identified object recognition can be performed based on the image captured by the image acquisition device, or based on the identified object recognition component, and this application does not limit this.
[0133] In some implementation scenarios, the situation where it is determined that the target work area needs to be moved may include one of the following: detecting that the working time in the current work area reaches a preset time; or detecting that the status of the current work area is completed; or detecting that the current power is lower than a preset power threshold. Of course, the above is only an exemplary description and is not limited to this.
[0134] In some embodiments, when a first identification object is identified, the moving direction may be changed. The first identification object is an identification object in the current working area in the target channel information; the target channel information indicates the channel information between the current working area and the target working area.
[0135] In some implementation scenarios, since the self-mobile device knows the next work area to work in the process of working, when it needs to move from the current work area to the next work area, the self-mobile device can obtain the target channel information based on the correspondence between the work areas and the channel information received from the mobile terminal.
[0136] In some implementation scenarios, the target channel information can also be determined in the following manner: first, the correspondence between the working area and the identification object is obtained, and then the self-mobile device is controlled to move along the edge in the current working area and identify the identification object. When the third identification object is identified, the current working area is determined according to the correspondence between the working area and the identification object. Further, the target channel information is determined based on the distinguishing mark of the current working area, the area mark of the target working area, and the channel information. Among them, the third identification object represents the identification object that is first identified during the process of moving along the edge. Specifically, the self-mobile device is controlled to move along the edge in the current working area and identify the identification object. When the identification object is first identified, the current working area can be determined according to the correspondence between the working area and the identification object. Further, since the working area to be worked next is known, the target channel information can be obtained according to the correspondence between the working areas and the channel information received from the mobile terminal.
[0137] In some implementation scenarios, when the identified identification object is not the first identification object, the edge movement is continued and identification objects are identified during the edge movement until the first identification object is identified.
[0138] Specifically, for example, the channel information includes Zone1, Tag1 in Zone1, Zone2, Tag2 in Zone2, and the connectivity between Tag1 and Tag2. When it is necessary to move from the current zone Zone1 to the target zone Zone2, it is possible to move along the edge in Zone1 and identify the identified object. If Tag1 is identified during the process of moving along the edge, the self-moving device is controlled to change the moving direction and then move to Zone2.
[0139] If Tag3 is identified during the edge movement, the device will continue to move along the edge in Zone1 and identify the identified object until Tag1 is identified, and then the self-moving device will be controlled to change its moving direction and move to Zone2. Tag3 is an identified object different from Tag1 in Zone1. Since the channel information of Zone1 and Zone2 is determined in advance by the App, Tag1 must exist in Zone1. One or more edge movement identifications can be performed until Tag1 is identified, and the self-moving device can be controlled to change its moving direction and move to Zone2.
[0140] In some implementation scenarios, when the first identification object is identified, the self-mobile device may turn to the first preset angle in the first preset direction at the first identification object and then go straight. In other implementation scenarios, when the first identification object is identified, the self-mobile device may continue to move forward for a distance at the first identification object and then turn to the first preset angle in the first preset direction and go straight. The first preset direction is clockwise or counterclockwise. The first preset angle is any value between 70 degrees and 110 degrees.
[0141] In some implementation scenarios, changing the moving direction when a first identification object is identified may include: determining the angular relationship between the central axis and the boundary of the self-moving device when the first identification object is identified; and controlling the self-moving device to turn according to the angular relationship so that the central axis and the boundary of the self-moving device are basically perpendicular after the turn.
[0142] Specifically, for example, taking the right edge as an example (i.e., during the edge process, the boundary is located on the right side of the machine), when Tag1 is identified, if the center axis of the self-moving device is parallel to the boundary, the self-moving device can be controlled to rotate 90° in a clockwise direction, and then move to Zone2 in the rotated direction. For another example, when Tag1 is identified, if the center axis of the self-moving device and the boundary have an angle of 20°, the self-moving device can be controlled to rotate 70° in a clockwise direction, so that the center axis of the self-moving device and the boundary are basically perpendicular after the turn, and then move to Zone2 in the rotated direction. Of course, the above is only an exemplary description, and this application is not limited to this.
[0143] In some embodiments, after recognizing that the first identification object changes its moving direction, it can move toward the target working area based on the target channel information and the changed moving direction.
[0144] In some implementation scenarios, during the movement toward the target working area, identification object recognition can be performed; if a second identification object is recognized, the moving direction is changed; the second identification object is the identification object within the target working area in the target channel information; further, based on the changed moving direction, work is performed in the target working area.
[0145] In some implementation scenarios, if the second identification object is not identified within a preset time / preset distance, an alarm and / or shutdown is triggered.
[0146] In some implementation scenarios, the self-moving device is provided with a sensor for collecting the moving direction of the self-moving device. During the movement to the target working area, the moving direction of the self-moving device can be controlled based on the data collected by the sensor. Among them, the sensor for collecting the moving direction of the self-moving device can be an IMU, which can be used to collect the heading data of the self-moving device. In some implementation scenarios, during the movement to the target working area, the posture of the self-moving device can be controlled based on the heading data collected by the IMU so that it moves in a substantially unchanged direction.
[0147] Specifically, the channel information includes Zone1, Tag1 in Zone1, Zone2, Tag2 in Zone2, and the connectivity between Tag1 and Tag2. When it is necessary to move from the current zone Zone1 to the target zone Zone2, you can move along the edge in Zone1 and identify the identified object. If Tag1 is identified during the process of moving along the edge, the self-moving device is controlled to change the moving direction and then move to Zone2. In the process of moving to Zone2, the machine can be controlled to move in the same direction based on the IMU on the self-moving device, and the identified object recognition component can be used to identify the identified object. If Tag2 is identified within a preset time or a preset distance, it is controlled to change the moving direction and then work in Zone2. If Tag2 is not identified within the preset time or the preset distance, an alarm and / or shutdown is triggered.
[0148] Among them, in actual application scenarios, the horizontal coordinates or vertical coordinates of the Tag1 position and the Tag2 position are basically the same, so that it can be ensured that after the machine recognizes the identification object in the current area and turns, it can recognize the identification object corresponding to another area by moving in the same direction. It should be noted that the step of changing the moving direction after identifying Tag2 is similar to the step of changing the moving direction after identifying Tag1, and they can be referenced to each other, so it will not be described in detail.
[0149] In some implementation scenarios, the identification object can be set on the boundary of the work area to which it belongs, or can be set at a preset distance from the boundary of the work area to which it belongs. It can be set according to the actual scenario and is not limited to this.
[0150] In some implementation scenarios, the identification object may be at least one of the following: an RFID tag; a digital tag; a color tag; an image tag; or an NFC tag. Of course, in some implementation scenarios, the identification object is not limited to the above types, and this application does not limit this.
[0151] In some embodiments, it is also possible to determine whether the regression condition is met; when it is confirmed that the regression condition is met, the regression channel information for moving to the designated working area is determined based on the channel information sent by the mobile terminal; a charging station is set in the designated working area. Further, according to the regression channel information, the self-mobile device is controlled to move to the designated working area and identify the identification object during the movement; wherein at least one cross-region movement is performed during the movement to the designated working area. When it is confirmed that the fourth identification object is identified, the self-mobile device is controlled to move to the charging station along the boundary of the designated working area; wherein the fourth identification object is the identification object in the designated working area in the regression channel information.
[0152] In this embodiment, the self-mobile device first receives the channel information sent by the mobile terminal, and when it is determined that it needs to move to the target working area, it moves along the edge in the current working area based on the image captured by the image acquisition device, and identifies the identification object during the moving along the edge, and then changes the moving direction when the first identification object is identified, and moves to the target working area based on the target channel information and the changed moving direction. Since the mobile terminal determines the channel information between the working areas based on the correspondence between the working areas and the correspondence between the working areas and the identification objects, it can not only ensure that there are identification objects in each area and that there are channel information between areas, but also reduce the process of users confirming while using the self-mobile device, thereby ensuring the smooth completion of cross-area work while improving the user experience.
[0153] Of course, the above description only describes an embodiment different from the aforementioned method. The same embodiment can refer to the aforementioned method, and no limitation is made to this.
[0154] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the accompanying drawings may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a portion of the steps or stages in other steps.
[0155] Based on the same inventive concept, an embodiment of the present application also provides a mobile terminal. The implementation solution for solving the problem provided by the mobile terminal is similar to the implementation solution recorded in the above-mentioned method for implementing cross-regional work. Therefore, the specific limitations in the mobile terminal embodiment provided below can be referred to the limitations on the method above and will not be repeated here.
[0156] A mobile terminal provided in an embodiment of the present application includes: a processor; a memory for storing instructions executable by the processor; and the processor is configured to execute any one of the above-mentioned methods for implementing cross-regional work.
[0157] Based on the same inventive concept, the embodiment of the present application also provides a self-moving device. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above control method, so the specific limitations in the device embodiment provided below can refer to the limitations of the method above, and will not be repeated here.
[0158] An embodiment of the present application provides a self-moving device, comprising: a processor; a memory for storing instructions executable by the processor; and the processor is used to execute any one of the above control methods.
[0159] It should be noted that each module in the above device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module above.
[0160] In another embodiment, the present application also provides a computer device, which may be a terminal or a system, such as a software control system of a mobile device, and its internal structure diagram may be as shown in FIG. Fig.15 As shown. The computer device includes a processor, a memory, a communication interface, a display screen and an input device connected by a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, the method of any method embodiment of the present application is implemented. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covered on the display screen, or a button, a trackball or a touch pad set on the housing of the computer device, or an external keyboard, touch pad or mouse, etc.
[0161] Those skilled in the art will understand that Fig.15The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0162] In one embodiment, the present application further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.
[0163] In one embodiment, the present application further provides a computer program product, including a computer program, which implements the steps in the above method embodiments when executed by a processor.
[0164] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.
[0165] It should be noted that in this application, when an element is referred to as being "fixed to" another element, it may be directly on the other element or there may be an intermediate element. When an element is considered to be "connected" to another element or one element is "connected" to another element, it may be directly connected to the other element or there may be an intermediate element at the same time, and it should be understood in a broad sense, for example, it may be a fixed connection, a detachable connection, or an integral connection; it may be a mechanical connection or an electrical connection. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0166] The terms "vertical", "horizontal", "left", "right", "up", "down", "front", "rear", "circumferential", "direction of travel" and similar expressions used in this document are based on the orientation or position relationship shown in the drawings and are only for the convenience of describing the present invention and simplifying the description. They do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation, and therefore cannot be understood as limiting the present invention.
[0167] Unless otherwise defined, the technical and scientific terms used herein may be identical to the meanings generally understood by those skilled in the art of the present invention. The terms used herein in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The terms "and / or", "and / or", "at least one of..." used herein include any and all combinations of one or more related listed items.
[0168] The technical features of the above embodiments may also be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0169] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be construed as limiting the scope of the present application. It should be noted that, for a person of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A control method, applied to a self-moving device, wherein the self-moving device is configured to move and / or work in a plurality of working areas within a specified range, and the self-moving device is provided with an image acquisition device, characterized in that: The method comprises: Receiving channel information sent by a mobile terminal; wherein the channel information is determined according to the correspondence between the working areas and the correspondence between the working areas and the identification objects; When it is determined that it is necessary to move to the target working area, based on the images captured by the image acquisition device, the current working area is moved along the edge, and the marked object is recognized during the moving along the edge; When a first identification object is identified, the moving direction is changed; the first identification object is an identification object in the current working area in the target channel information; the target channel information represents the channel information between the current working area and the target working area; Based on the target channel information and the changed moving direction, move toward the target working area.
2. The method according to claim 1, characterized in that Also includes: When the identified identification object is not the first identification object, the edge-moving is continued and identification objects are identified during the edge-moving process until the first identification object is identified.
3. The method according to claim 1, characterized in that When the first identification object is identified, the moving direction is changed, including: When the first identification object is identified, determining an angular relationship between a central axis and a boundary of the self-moving device; According to the angle relationship, the self-moving device is controlled to turn so that the center axis and the boundary of the self-moving device are substantially perpendicular after the turning.
4. The method according to claim 1, characterized in that The process of moving to the target working area includes: Perform identification of objects; If a second identification object is identified, the moving direction is changed; the second identification object is an identification object within the target working area in the target channel information; Based on the changed moving direction, work is performed in the target work area.
5. The method according to claim 3, characterized in that Also includes: If the second identification object is not identified within a preset time / preset distance, an alarm is issued and / or the machine is shut down.
6. The method according to claim 3, characterized in that The self-moving device is provided with a sensor for collecting the moving direction of the self-moving device; during the movement to the target working area, the method further includes: The moving direction of the self-moving device is controlled based on the data collected by the sensor.
7. The method according to claim 1, characterized in that The identification object is set on the boundary of the work area to which it belongs; or, the identification object is set at a preset distance from the boundary of the work area to which it belongs.
8. The method according to claim 1, characterized in that After the image acquisition device acquires the image of the working area, the self-moving device may also perform detection processing on the image based on a first detection model to determine a detection result, wherein the detection object of the first detection model includes an identification object, and the identification object includes an identification object set on the ground; In a case where the detection result is that the identification object is detected, determining a target working area in the image; The self-moving device is controlled to travel and / or work in a spatial area corresponding to the target area, wherein the target area includes an area corresponding to the identification object.
9. An automatic working system, comprising a self-moving device and a mobile terminal, wherein the self-moving device is configured to move and / or work in a plurality of working areas within a specified range, and the self-moving device is provided with an image acquisition device, characterized in that: The mobile terminal is configured to obtain a correspondence between working areas; obtain a correspondence between working areas and identification objects; determine channel information between working areas according to the correspondence between working areas and the correspondence between working areas and identification objects; and is further configured to send the channel information to a mobile device; The self-mobile device is configured to receive channel information sent by the mobile terminal; wherein the channel information is determined based on the corresponding relationship between the working areas; When it is determined that it is necessary to move to the target working area, based on the image captured by the image acquisition device, move along the edge in the current working area, and identify the marked object during the moving along the edge; when the first marked object is identified, change the moving direction; The first identification object is an identification object in the current working area in the target channel information; the target channel information represents channel information between the current working area and the target working area; based on the target channel information and the changed moving direction, the moving direction is moved to the target working area.
10. The automatic working system according to claim 9, characterized in that: After the image acquisition device acquires the image of the working area, the self-moving device may also perform detection processing on the image based on a first detection model to determine a detection result, wherein the detection object of the first detection model includes an identification object, and the identification object includes an identification object set on the ground; In a case where the detection result is that the identification object is detected, determining a target working area in the image; The self-moving device is controlled to travel and / or work in a spatial area corresponding to the target area, wherein the target area includes an area corresponding to the identification object.
