Control method of mobile device and related device
By using a camera to identify areas of the sky on the lawnmower to determine its location, the problem of inaccurate satellite positioning caused by obstruction is solved, ensuring accurate positioning of the lawnmower in obstructed areas and restoring satellite positioning signals.
Patent Information
- Application Number
- CN202410802877.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-20
- Publication Date
- 2026-01-27
- Estimated Expiration
- 2044-06-20
AI Technical Summary
The lawnmower robot's satellite positioning signal was poor due to obstruction by houses and trees on the lawn, affecting its positioning accuracy and walking path.
When the satellite positioning signal does not meet the preset conditions, the mobile device continues to move along the preset path for a certain distance or time, then uses the camera to collect environmental images to identify the sky area, determine the first location, and moves to that location to restore the satellite positioning signal.
When satellite positioning signals are insufficient, the location is determined by identifying the sky area through environmental images, ensuring accurate positioning of mobile devices within a certain distance. This solves the problem of inaccurate positioning caused by obstruction and allows satellite positioning to be used again in open areas.
Smart Images

Figure CN118642497B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of robotics technology, specifically to a control method for a mobile device and related equipment. Background Technology
[0002] In existing technologies, during the operation of lawn mowing robots, the satellite positioning signal is poor due to obstructions from houses, trees, etc. on the lawn, which affects the accuracy of satellite positioning. Therefore, it is urgent to solve the problem of inaccurate satellite positioning when obstructed, which affects the movement of lawn mowing robots. Summary of the Invention
[0003] This application provides a control method and related equipment for a mobile device, which can solve the problem of inaccurate satellite positioning when obstructed, affecting the movement of the lawnmower robot.
[0004] In a first aspect, embodiments of this application provide a method for controlling a mobile device, the method comprising:
[0005] Control the mobile device to move along a preset path;
[0006] When the mobile device moves to a location where the satellite positioning signal does not meet the preset conditions, the mobile device is controlled to continue moving along the preset path for a first mileage or a first duration.
[0007] After continuing to move the first mileage or the first duration along the preset path, if it is detected that the satellite positioning signal does not meet the preset conditions, the mobile device is controlled to stop moving, and environmental images in at least one direction are captured by the camera, the sky area in the environmental image is identified, and the first position corresponding to the sky area is determined.
[0008] The mobile device is controlled to move to the first position, so that the mobile device detects a satellite positioning signal at the new position, which satisfies the preset condition.
[0009] Secondly, embodiments of this application provide a control device for a mobile device, the device comprising: a first control unit, a determining unit, and a second control unit, wherein...
[0010] The first control unit is configured to control the mobile device to move along a preset path; and when the mobile device moves to a position where the satellite positioning signal does not meet the preset conditions, control the mobile device to continue moving along the preset path for a first mile or a first duration.
[0011] The determining unit is configured to, after continuing to move the first mileage or the first duration along the preset path, if it detects that the satellite positioning signal does not meet the preset conditions, control the mobile device to stop moving, and acquire environmental images in at least one direction through the camera, identify the sky region in the environmental images, and determine the first position corresponding to the sky region.
[0012] The second control unit is used to control the mobile device to move to the first position, so that the mobile device detects a satellite positioning signal at the position after the movement and meets the preset condition.
[0013] Thirdly, embodiments of this application provide a mobile device, including a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for performing the steps in the first aspect of embodiments of this application.
[0014] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program for electronic data interchange, wherein the computer program causes a computer to perform some or all of the steps described in the first aspect of embodiments of this application.
[0015] Fifthly, embodiments of this application provide a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps described in the first aspect of embodiments of this application. The computer program product may be a software installation package.
[0016] Implementing the embodiments of this application has the following beneficial effects:
[0017] The mobile device control method and related equipment described in this application control the mobile device to move along a preset path. When the mobile device moves to a position where the satellite positioning signal does not meet the preset conditions, the mobile device continues to move along the preset path for a first mile or a first time. After moving along the preset path for a first mile or a first time, if the satellite positioning signal is detected to not meet the preset conditions, the mobile device stops moving and acquires environmental images in at least one direction through a camera, identifies the sky area in the environmental images, and determines the first position corresponding to the sky area. The mobile device is then controlled to move towards the first position so that the mobile device detects that the satellite positioning signal meets the preset conditions at the new position. This allows the mobile device to maintain accurate positioning within a certain distance even when the satellite positioning signal does not meet the conditions. After continuing to move along the preset path within this certain distance, if the satellite positioning signal still does not meet the preset conditions, the mobile device stops moving. The first position is determined by the sky area in the environmental images, and the first position is used to guide the mobile device to an open area (an area where the satellite positioning signal meets the preset conditions). In other words, satellite positioning can be used again in the open area, which can solve the problem of inaccurate satellite positioning when obstructed, affecting the movement of the lawnmower robot. Attached Figure Description
[0018] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0019] Figure 1A This is a flowchart illustrating a control method for a mobile device provided in an embodiment of this application;
[0020] Figure 1B This is a schematic diagram illustrating the sky region in an environmental image provided in an embodiment of this application;
[0021] Figure 1C This is a schematic diagram illustrating a maximum inscribed circle provided in an embodiment of this application;
[0022] Figure 1D This is a schematic diagram illustrating a first position provided in an embodiment of this application;
[0023] Figure 1E This is another illustrative diagram of a first position provided in an embodiment of this application;
[0024] Figure 1F This is a schematic diagram illustrating a scenario of a mobile device control method provided in an embodiment of this application;
[0025] Figure 2 This is a flowchart illustrating another mobile device control method provided in an embodiment of this application;
[0026] Figure 3 This is a schematic diagram of the structure of a mobile device provided in an embodiment of this application;
[0027] Figure 4 This is a block diagram of the functional units of a control device for a mobile device provided in an embodiment of this application. Detailed Implementation
[0028] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present application.
[0029] The terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.
[0030] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.
[0031] In this embodiment, the mobile device may be equipped with a satellite positioning device, a non-satellite positioning device, and a camera. The satellite positioning device can be used to achieve positioning using satellite positioning technology, such as real-time kinematic (RTK) technology. The non-satellite positioning device can be used to achieve positioning using non-satellite positioning technology. Specifically, when the satellite positioning signal does not meet preset conditions, positioning can be achieved using non-satellite positioning technology via the non-satellite positioning device; conversely, when the satellite positioning signal meets preset conditions, positioning can be achieved using satellite positioning technology via the satellite positioning device. The camera can be used to capture environmental images. The camera may include a rear-view camera with its lens facing the upper rear of the mobile device.
[0032] Among them, non-satellite positioning technologies may include at least one of the following: visual positioning, inertial measurement unit (IMU) positioning, visual-inertial odometry (VIO) positioning, etc., without limitation.
[0033] The embodiments of this application will be described in detail below.
[0034] Please see Figure 1A , Figure 1A This is a flowchart illustrating a control method for a mobile device provided in an embodiment of this application. As shown in the figure, the control method for this mobile device includes:
[0035] 101. Control the mobile device to move along a preset path.
[0036] The preset path can be a pre-planned path or a system default path.
[0037] In practice, the mobile device may include a lawnmower robot, which can be controlled to move along a planned path and perform lawnmowing operations. When the mobile device moves to a location where the satellite positioning signal meets preset conditions, satellite positioning technology is used to control the mobile device to move along the preset path. When the mobile device moves to a location where the satellite positioning signal does not meet preset conditions, non-satellite positioning technology is used to control the mobile device to move along the preset path.
[0038] 102. When the mobile device moves to a location where the satellite positioning signal does not meet the preset conditions, the mobile device is controlled to continue moving along the preset path for a first mileage or a first duration.
[0039] In this embodiment, the preset conditions can be pre-set or defaulted to by the system. The signal quality of the satellite positioning signal affects the accuracy of satellite positioning, and the preset conditions are used to evaluate the signal quality. For example, if the signal strength of the satellite positioning signal is greater than a preset signal strength threshold, it means that the signal quality of the satellite positioning signal meets the preset conditions; conversely, if the signal strength of the satellite positioning signal is less than or equal to the preset signal strength threshold, it means that the signal quality of the satellite positioning signal does not meet the preset conditions. The preset signal strength threshold can be pre-set or defaulted to by the system.
[0040] Among them, satellite positioning signals can include real-time kinematic (RTK) signals.
[0041] In practice, mobile devices may include lawnmower robots, which can be controlled to walk along a planned path and perform lawnmower operations.
[0042] The first mileage can be preset or set by the system default, and the first duration can also be preset or set by the system default. The first mileage can be understood as the distance the mobile device continues to travel within the preset extended mileage. The first duration can be understood as the duration of continued travel; specifically, it can be preset that the distance traveled within the first duration does not exceed the preset extended mileage.
[0043] The preset endurance range can be set in advance or set by the system default. It can be assumed that within the preset endurance range, accurate positioning can be guaranteed using non-satellite positioning technology. For example, the preset endurance range can be determined to be 100 meters based on the performance of the IMU or VIO device.
[0044] Optionally, step 102 above, controlling the mobile device to continue moving along the preset path for a first mileage or a first duration, may include the following steps:
[0045] The mobile device is controlled to continue moving along the preset path for the first mileage or the first duration using non-satellite positioning technology.
[0046] In this embodiment, non-satellite positioning technology can be used to control the mobile device to continue moving along a preset path for a first mileage or a first duration, that is, to move within a preset extendable mileage, so as to complete the movement and perform the lawn mowing operation, which helps to ensure that the mobile device moves accurately along the preset path.
[0047] 103. After continuing to move the first mileage or the first duration along the preset path, if it is detected that the satellite positioning signal does not meet the preset conditions, the mobile device is controlled to stop moving, and environmental images in at least one direction are collected by the camera, the sky area in the environmental image is identified, and the first position corresponding to the sky area is determined.
[0048] In practice, after moving along the preset path for a first mile or a first duration, if the satellite positioning signal is detected to be not in compliance with the preset conditions, the mobile device is controlled to stop moving. The camera then captures environmental images in at least one direction, identifies the sky region in the environmental images, and determines the first position corresponding to the sky region. This first position can be used to guide the mobile device to an open area (an area where the satellite positioning signal meets the preset conditions). In other words, satellite positioning can be used again in the open area, which can solve the problem of inaccurate satellite positioning when obstructed, which affects the movement of the lawnmower robot.
[0049] Optionally, the first position is the projected coordinates of the sky region in the environmental image onto the ground.
[0050] The mobile device may include a rear-view camera with its lens facing the upper rear of the mobile device, which can be used to find a location with open airspace that does not obstruct satellite signals.
[0051] In this embodiment, the camera of the mobile device can be controlled to take pictures at preset time intervals to obtain environmental images, and the projection coordinates of the sky area in the environmental image on the ground are used as the first position, so as to guide the mobile device to an open area, that is, satellite positioning can be used again in the open area.
[0052] The preset time interval can be set in advance or set by the system default.
[0053] Optionally, the first position is the projected coordinates of the center of the largest inscribed circle of the sky region in the environmental image on the ground.
[0054] In the specific implementation, there can be k sky regions in the environment image. A first position is extracted for each of these sky regions. Furthermore, there can be one or more first positions, where k is a natural number, such as 0, 1, 2, etc. The largest inscribed circle of the sky region in the environment image is taken, and the coordinates of the center of this largest inscribed circle projected onto the ground are used as the first position. The largest inscribed circle helps ensure that a given independent sky region in the environment image is large and expansive enough.
[0055] The first location can be the location corresponding to a sky region identified from any environmental image. Taking environmental images from multiple directions can increase the probability of finding the sky region.
[0056] Optionally, determining the first location corresponding to the sky region includes:
[0057] When the radius of the largest inscribed circle in the sky region of the environmental image is greater than a preset radius, the coordinates of at least one pixel within the largest inscribed circle projected onto the ground are determined as the first position.
[0058] The preset radius can be pre-set or set by system default. The preset radius is to ensure that the sky area is large and open enough, while eliminating some smaller sky areas. In specific implementation, as the mobile device moves along the preset path, it can capture at least one environmental image through the camera. Each environmental image can contain k sky areas. For each environmental image, a first position is extracted. Furthermore, there can be one or more first positions, where k is a natural number, such as k = 0, 1, 2, etc. The largest inscribed circle of the sky area in the environmental image is taken. When the radius of the largest inscribed circle is greater than the preset radius, the coordinates of at least one pixel within the largest inscribed circle projected onto the ground can be used to determine the first position. That is, there can be one or more first positions. For example, the coordinates of the center of the largest inscribed circle projected onto the ground can be used to determine the first position.
[0059] For example, if there are no objects obstructing the view, the entire area in the environment image will be the sky. However, due to the presence of other objects (such as houses or trees), a single sky area will be divided into multiple sky areas by these objects. Figure 1B As shown, multiple sky regions can exist in an environmental image.
[0060] The reason for choosing the center point is that the satellite signal at the center point is considered to be the best. Since the area around the sky is the non-sky area, satellite positioning is poor in this area due to the obstruction of surrounding obstacles. Choosing the center point can be understood to some extent as the location corresponding to the point is less affected by surrounding obstacles, and therefore has the best satellite signal.
[0061] For example, Figure 1C As shown, rectangles can represent the environment image, ellipses represent the sky region, and circles can represent the largest inscribed circle of the sky region. Furthermore, as... Figure 1D As shown, the mobile device may include a rear-view camera, which takes a picture of the sky to obtain an environmental image. The coordinates O' of the projection of the center O of the inscribed circle of the sky region of the environmental image onto the ground are taken as the first position.
[0062] For example, in the specific implementation, after the mobile device stops moving, the rear-view camera can continuously capture environmental images to obtain the largest inscribed circle of the sky region in the environmental image. That is, the sky region in the environmental image is identified, and then the largest inscribed circle of the sky region is determined. When the radius of the largest inscribed circle is greater than a preset radius, the center coordinates of the largest inscribed circle projected onto the grass are determined as the first position. Conversely, when the radius of the largest inscribed circle is less than or equal to the preset radius, the center coordinates of the largest inscribed circle projected onto the grass do not need to be recorded.
[0063] In specific implementation, the projected coordinates of the center of the tangent circle in the sky region on the ground can be determined as follows: The method for determining the projected coordinates of the center of the tangent circle in the sky region on the ground is as follows: By recognizing the spatial coordinates (X1, Y1, Z1) of the obstacle from the image, calculate the offset (ΔX, ΔY) between the pixel coordinates of the obstacle and the pixel coordinates of the center of the inscribed circle in the sky region. Based on the offset and the spatial coordinates (X1, Y1, Z1) of the obstacle, determine the projected coordinates (X1+ΔX', Y1+ΔY') of the center of the inscribed circle on the ground. X1 and Y1 are ground coordinates, and Z1 is the altitude coordinate. (ΔX', ΔY') and the offset (ΔX, ΔY) have a preset mapping relationship.
[0064] For example, in Figure 1D Based on this, please refer to Figure 1E Point T represents the location of the obstacle, with spatial coordinates (X1, Y1, Z1); T' represents the projection of the obstacle's location onto the ground, i.e., (X1, Y1, 0). Since projection processing is required, height can be ignored. The spatial coordinates of point O are (X2, Y2), and therefore, the spatial coordinates of point O' are also (X2, Y2). The offsets (ΔX, ΔY) can be calculated as follows: ΔX = X component of pixel coordinates of point O - X component of pixel coordinates of point T, ΔY = Y component of pixel coordinates of point O - Y component of pixel coordinates of point T. Furthermore, through a preset mapping relationship, the spatial coordinate offsets (ΔX', ΔY') can be obtained from the pixel coordinate offsets (ΔX, ΔY). Then, the coordinates of point O' can be obtained as (X1 + ΔX', Y1 + ΔY').
[0065] Optionally, when trees and houses exist in the operating area of the mobile device, the following steps may also be included:
[0066] Obtain the tree height and building height in the work area;
[0067] The preset radius is determined based on the height of the trees and the height of the houses.
[0068] When trees and houses are present in the operating area of a mobile device, tree height can refer to the average height of all trees, or it can refer to the height of a single tree. House height can refer to the average height of all houses, or it can refer to the height of a single house.
[0069] In this embodiment, when there are trees and houses in the working area of the mobile device, a preset radius can be determined based on the height of the trees and the height of the houses. In this way, the corresponding preset radius can be determined based on the actual environment, which helps to improve the accuracy of identifying open areas.
[0070] Optionally, the above step of determining the preset radius based on the tree height and the house height can be implemented in the following manner:
[0071] The preset radius is determined according to the following formula:
[0072] Preset radius = tree height / house height × π / 4.
[0073] In practice, the preset radius is calculated as (tree height / house height) × π / 4. For example, the heights of trees or houses that might affect the signal within the work area can be pre-obtained, and the average height of these objects can be used to calculate the preset radius. In this way, the corresponding preset radius can be determined based on the actual environment, which helps improve the accuracy of identifying open areas.
[0074] Optionally, step 103 above, which involves acquiring environmental images in at least one direction using a camera, can be implemented as follows:
[0075] The camera is rotated to capture images of the environment in at least one direction.
[0076] In a specific implementation, the camera can be a rotatable camera, which can rotate to capture images of the environment in at least one direction. Alternatively, the mobile device can be controlled to rotate in place, and the camera can follow the camera's rotation to capture images of the environment in at least one direction. In this way, environmental images can be captured from all directions to find open areas that meet the requirements.
[0077] 104. Control the mobile device to move to the first position, so that the mobile device detects a satellite positioning signal at the moved position and meets the preset condition.
[0078] In practice, the mobile device is controlled to move to a first position so that the mobile device can detect that the satellite positioning signal meets the preset conditions at the new position. This first position can be used to guide the mobile device to an open area (an area where the satellite positioning signal meets the preset conditions). In other words, satellite positioning can be used again in the open area, which can solve the problem of inaccurate satellite positioning when obstructed, which affects the movement of the lawnmower robot.
[0079] Optionally, the following steps may also be included:
[0080] After the mobile device detects that the satellite positioning signal meets the preset conditions at its new location, it controls the mobile device to return to the initial point. During the return process, the mobile device is located. When the mobile device moves to a location where the satellite positioning signal meets the preset conditions, satellite positioning technology is used for positioning. When the mobile device moves to a location where the satellite positioning signal does not meet the preset conditions, non-satellite positioning technology is used for positioning. The initial point is the location where the mobile device stops moving.
[0081] The initial point is the position where the mobile device stops moving.
[0082] In practice, after the mobile device detects that the satellite positioning signal meets the preset conditions at the new location, it controls the mobile device to return to the initial point. During the return process, the mobile device is located. Specifically, when the mobile device moves to a location where the satellite positioning signal meets the preset conditions, satellite positioning technology is used for positioning. When the mobile device moves to a location where the satellite positioning signal does not meet the preset conditions, non-satellite positioning technology is used for positioning. In this way, the problem of inaccurate satellite positioning when obstructed, which affects the movement of the mobile device, can be solved.
[0083] Optionally, the following steps may also be included:
[0084] After the mobile device returns to the initial point, the step of controlling the mobile device to move along the preset path is executed again.
[0085] In practice, after the mobile device returns to the initial point, the position of the initial point is obtained by combining the position of the open area. Then, the mobile device can continue to move along the preset path, that is, starting from the initial point, steps 101-104 are executed. This solves the problem of inaccurate satellite positioning affecting the movement of the mobile device when obstructed.
[0086] Optionally, the above steps, controlling the mobile device to move to the first position, can be implemented in the following manner:
[0087] The mobile device is controlled to move to the projection range of the largest inscribed circle corresponding to the first position on the ground. When the mobile device enters the projection range of the largest inscribed circle on the ground, the moving speed is reduced to a preset moving speed, and the device moves a first preset distance at the preset moving speed. The movement is then stopped to wait for the satellite positioning signal of the mobile device to meet the preset condition. If the satellite positioning signal of the mobile device meets the preset condition within a preset time period, the device returns to the initial point. If the satellite positioning signal of the mobile device does not meet the preset condition within the preset time period, the device continues to move a second preset distance and waits again for the satellite positioning signal of the mobile device to meet the preset condition. The initial point is the position where the mobile device stops moving.
[0088] The preset movement speed can be set in advance or left as the system default. The preset time period can also be set in advance or left as the system default.
[0089] In practical implementation, the mobile device can be controlled to move to the projection range of the largest inscribed circle corresponding to the first position on the ground. Once the mobile device enters the projection range of the largest inscribed circle, its movement speed is reduced to a preset speed, and it moves a first preset distance at that speed before stopping to wait for the mobile device's satellite positioning signal to meet preset conditions. If the satellite positioning signal meets the preset conditions within a preset time period, the device returns to the initial point. If the satellite positioning signal does not meet the preset conditions within the preset time period, the device continues to move a second preset distance and waits again for the satellite positioning signal to meet the preset conditions. For example, the mobile device can be controlled to quickly move to the projection range of the inscribed circle (the inscribed circle where the first position is located) on the ground. After entering the projection range, the speed is slowed down, and the device moves a certain distance before stopping to wait for the satellite signal to meet the preset conditions. If the satellite signal meets the preset conditions, the device returns to the initial point; otherwise, it continues to move a certain distance and waits again for the satellite signal to meet the preset conditions. This first position guides the mobile device to an open area (an area where the satellite positioning signal meets the preset conditions), where satellite positioning can be used again. This solves the problem of inaccurate satellite positioning when obstructed, which affects the movement of the lawnmower robot.
[0090] Optionally, the following steps may also be included:
[0091] If the satellite positioning signal does not meet the preset conditions, the mobile device is located using non-satellite positioning technology to control the mobile device to continue moving along the preset path.
[0092] In this embodiment, if the satellite positioning signal does not meet the preset conditions, it indicates that the satellite positioning signal is weak and the satellite positioning may be inaccurate. Therefore, non-satellite positioning technology can be used to locate the mobile device and control the mobile device to continue moving along the preset path. In this way, accurate positioning can be guaranteed and accurate positioning can be achieved within the preset lifespan. This can solve the problem of inaccurate satellite positioning when obstructed, which affects the walking of the lawnmower robot.
[0093] Optionally, the following steps may also be included:
[0094] If the distance between the location of the mobile device and the first location is less than or equal to the remaining range, the step of controlling the mobile device to move towards the first location is executed, wherein the remaining range is obtained based on a preset range and the mileage by which the mobile device continues to move along the preset path, the mileage by which the mobile device continues to move along the preset path is the first mileage or the mileage by which the mobile device travels during the first time period, and the mileage by which the mobile device continues to move along the preset path is less than the preset range.
[0095] In specific implementation, the first mileage is less than or equal to the preset extendable mileage, or the mileage traveled in the first duration is less than or equal to the preset extendable mileage, so as to ensure that the mobile device can reach the first position within the remaining extendable mileage. The remaining extendable mileage is obtained based on the preset extendable mileage and the mileage that the mobile device continues to move along the preset path. In this way, the accuracy of the first position can be guaranteed.
[0096] In practice, if the distance between the mobile device's location and the first location is less than or equal to the remaining range of operation, it means that within the preset range of operation, non-satellite positioning technology can ensure accurate positioning within the preset range of operation. In this way, the mobile device can be controlled to move towards the first location with high precision, and safety is ensured during the movement, so as not to collide with obstacles, not to enter restricted areas, and not to go beyond the grass boundary.
[0097] The obstacles may include at least one of the following: stones, trees, shrubs, steps, sculptures, stone tablets, signs, etc., without limitation.
[0098] Optionally, the remaining extendable mileage is equal to the difference between the preset extendable mileage and the mileage by which the mobile device continues to move along the preset path.
[0099] For example, the remaining remaining range can be calculated using the following formula:
[0100] Remaining extendable range = Preset extendable range - Distance the mobile device will travel along the preset path
[0101] If the remaining range is greater than or equal to 0, and since the remaining range is within the preset range, the mobile device's location can be considered accurate.
[0102] Optionally, the following steps may also be included:
[0103] If the distance between the location of the mobile device and the first location is greater than the remaining range, the mobile device is controlled to continue moving along a preset path until a satellite positioning signal is detected that meets the preset condition.
[0104] In practice, if the distance between the mobile device's location and the first location is greater than the remaining range of available mileage, it means that the preset range of available mileage has been exceeded, and accurate positioning is not possible. It may not be able to accurately reach the first location, and safety cannot be guaranteed. In this case, the mobile device can be controlled to move along a preset path until the satellite positioning signal is detected and the preset conditions are met. That is, the mobile device can be waited for to move to the point where the satellite positioning signal meets the preset conditions, and then accurate positioning can be achieved again.
[0105] Optionally, the following steps may also be included:
[0106] After the mobile device continues to move along the preset path for the first mileage or the first duration, if the satellite positioning signal is detected to meet the preset conditions, the mobile device is controlled to move along the preset path using satellite positioning technology.
[0107] In practice, after the mobile device continues to move along the preset path for a first mile or a first period of time, and is still within the preset endurance range, it can ensure accurate positioning within the preset endurance range through non-satellite positioning technology. Once a satellite positioning signal is detected that meets the preset conditions, its own satellite positioning becomes more accurate. Therefore, it can choose to control the mobile device to move along the preset path through satellite positioning technology. In this way, the accurate positioning of the mobile device can be guaranteed, solving the problem of inaccurate satellite positioning when obstructed, which affects the movement of the lawnmower robot.
[0108] For example, taking a mobile device as a lawnmower robot, the lawnmower robot is equipped with a rear camera whose lens faces the upper rear of the robot. This can include the following steps:
[0109] S1. When the lawn mowing robot is performing lawn mowing operations along the planned path, if the satellite positioning signal meets the preset conditions, it will use satellite positioning technology to locate itself so that the lawn mowing robot can walk along the planned path.
[0110] S2. If the satellite positioning signal fails to meet the preset conditions during the journey along the planned path, the robot will continue its operation via visual positioning or IMU or VIO positioning. This means that even after the satellite positioning signal fails, the robot can still travel a preset distance of 100 meters. Within this preset distance, the robot can obtain accurate positioning through VIO or other methods. Specifically, if the satellite positioning signal fails, the robot will continue to travel a preset distance, for example, 50 meters. The remaining 50 meters will be used as a breathing distance.
[0111] S3. After completing the preset mileage (50 meters) of extended service range, the lawnmower robot stops and begins to rotate in place. The rear camera follows the robot's rotation to capture environmental images from different directions. It identifies targets in each image. If the sky is detected in an image, the largest inscribed circle of the sky area is taken. If the radius of this inscribed circle is greater than a preset radius, and the distance from the lawnmower robot to the center of the inscribed circle (projected on the ground) is less than or equal to the remaining extended service range (e.g., 50 meters), the lawnmower robot moves towards the center of the inscribed circle, reaching an open area. Because the robot is still within the remaining extended service range while moving towards the center's projection coordinates, it can still accurately locate itself to reach the center's projection coordinates.
[0112] S4. After the lawnmower reaches the open area, it uses satellite positioning to obtain its absolute position within the open area. Then, it controls the lawnmower to return to the initial point (the position of rotation in place). During the return process, satellite positioning is used first. If the accuracy of satellite positioning is insufficient, visual positioning, IMU, or VIO positioning is used. Combined with the obtained absolute position of the open area, the absolute position of the initial point is obtained.
[0113] S5. Starting from the initial point, continue walking along the planned path to perform lawn mowing. If the satellite positioning signal does not meet the preset conditions, visual positioning, IMU, or VIO positioning will be used during the process. Combined with the absolute position of the initial point, the lawn mowing robot will be positioned to control it to walk along the planned path. If the satellite positioning signal meets the preset conditions during the continued operation, satellite positioning technology will be used for positioning. If, starting from the initial point, the satellite positioning signal is again detected to not meet the preset conditions, return to step S2 and subsequent steps.
[0114] For example, Figure 1FAs shown, during the lawnmower's operation along the planned path, if the satellite positioning signal fails to meet preset conditions (i.e., at position A), it can continue for the first mile. Once it reaches position B, the robot stops and begins to rotate in place. The rear camera then follows the robot's rotation to capture environmental images from different directions, identifying targets in each image. If the sky is detected in an image, the largest inscribed circle of the sky region is taken. If the radius of the inscribed circle is greater than the preset radius, and the distance from the lawnmower robot to the projected coordinates of the center of the inscribed circle on the ground is less than or equal to the remaining range, then control the lawnmower robot to move towards the projected coordinates (position C) of the center of the inscribed circle on the ground, so that the lawnmower robot reaches the open area. After reaching the open area, the lawnmower robot uses satellite positioning technology to obtain the absolute position of the lawnmower robot in the open area, and controls the lawnmower robot to return to position B. Combined with the obtained position of the open area, the precise position of the initial point is obtained. Starting from position B, the lawnmower robot continues to walk along the planned path to perform lawnmowing operations.
[0115] The mobile device control method described in this application controls the mobile device to move along a preset path. When the mobile device moves to a position where the satellite positioning signal does not meet the preset conditions, the mobile device continues to move along the preset path for a first mile or a first time. After moving along the preset path for a first mile or a first time, if the satellite positioning signal is detected to not meet the preset conditions, the mobile device stops moving and acquires environmental images in at least one direction through a camera, identifies the sky region in the environmental images, and determines the first position corresponding to the sky region. The mobile device is then controlled to move towards the first position so that the mobile device detects that the satellite positioning signal meets the preset conditions at the new position. This allows the mobile device to maintain accurate positioning within a certain distance even when the satellite positioning signal does not meet the conditions. After continuing to move along the preset path within this certain distance, if the satellite positioning signal still does not meet the preset conditions, the mobile device stops moving. The first position is determined by the sky region in the environmental images, and the mobile device is guided to an open area (an area where the satellite positioning signal meets the preset conditions) using this first position. In other words, satellite positioning can be used again in the open area, which solves the problem of inaccurate satellite positioning when obstructed, affecting the movement of the lawnmower robot.
[0116] Please see Figure 2 , Figure 2 This is a flowchart illustrating another control method for a mobile device provided in an embodiment of this application. As shown in the figure, the control method for this mobile device includes:
[0117] 201. Control the mobile device to move along a preset path.
[0118] 202. When the mobile device moves to a location where the satellite positioning signal does not meet the preset conditions, the mobile device is controlled to continue moving along the preset path for a first mileage or a first duration, where the first mileage is less than the preset extendable mileage, or the mileage traveled during the first duration is less than the preset extendable mileage.
[0119] 203. After continuing to move the first mileage or the first duration along the preset path, if it is detected that the satellite positioning signal does not meet the preset conditions, the mobile device is controlled to stop moving, and environmental images in at least one direction are collected by the camera, the sky area in the environmental image is identified, and the first position corresponding to the sky area is determined.
[0120] 204. When the distance between the location of the mobile device and the first location is less than or equal to the remaining range, the mobile device is controlled to move towards the first location so that the mobile device detects a satellite positioning signal at the location after the movement, which satisfies the preset condition. The remaining range is obtained based on the preset range and the mileage by which the mobile device continues to move along the preset path.
[0121] For a detailed description of steps 201-204 above, please refer to [link to relevant documentation]. Figure 1A The steps involved in the control method for a mobile device described herein will not be repeated here.
[0122] The mobile device control method described in this application controls the mobile device to move along a preset path. When the mobile device moves to a position where the satellite positioning signal does not meet preset conditions, the mobile device continues to move along the preset path for a first mile or a first time. After moving along the preset path for the first mile or a first time, if the satellite positioning signal is detected to not meet the preset conditions, the mobile device stops moving and acquires environmental images in at least one direction using a camera, identifies the sky region in the environmental images, and determines the first position corresponding to the sky region. When the distance between the mobile device's current position and the first position is less than or equal to the remaining usable mileage, the mobile device moves towards the first position so that the mobile device detects a satellite positioning signal that meets the preset conditions at the new position. The remaining range is determined by the preset range and the distance the mobile device travels along the preset path. Even when the satellite positioning signal does not meet the conditions, the mobile device can still maintain accurate positioning within a certain distance. After continuing to move along the preset path within this certain distance, if the satellite positioning signal still does not meet the preset conditions, the movement stops. The first position is determined by the sky area in the environmental image. Since the first position is still maintained within a certain distance, it can still be accurately located and reach the first position. The first position is then used to guide the mobile device to an open area (an area where the satellite positioning signal meets the preset conditions). In other words, satellite positioning can be used again in an open area, which can solve the problem of inaccurate satellite positioning when obstructed, which affects the movement of the lawnmower robot.
[0123] Consistent with the above embodiments, please refer to Figure 3 , Figure 3 This is a schematic diagram of the structure of a mobile device provided in an embodiment of this application. As shown in the figure, the mobile device includes a processor, a memory, a communication interface, and one or more programs. The one or more programs are stored in the memory and configured to be executed by the processor. In this embodiment, the programs include instructions for performing the following steps:
[0124] Control the mobile device to move along a preset path;
[0125] When the mobile device moves to a location where the satellite positioning signal does not meet the preset conditions, the mobile device is controlled to continue moving along the preset path for a first mileage or a first duration.
[0126] After continuing to move the first mileage or the first duration along the preset path, if it is detected that the satellite positioning signal does not meet the preset conditions, the mobile device is controlled to stop moving, and environmental images in at least one direction are captured by the camera, the sky area in the environmental image is identified, and the first position corresponding to the sky area is determined.
[0127] The mobile device is controlled to move to the first position, so that the mobile device detects a satellite positioning signal at the new position, which satisfies the preset condition.
[0128] Optionally, the first position is the projected coordinates of the sky region in the environmental image onto the ground.
[0129] Optionally, the first position is the projected coordinates of the center of the largest inscribed circle of the sky region in the environmental image on the ground.
[0130] Optionally, in determining the first location corresponding to the sky region, the above procedure includes instructions for performing the following steps:
[0131] When the radius of the largest inscribed circle in the sky region of the environmental image is greater than a preset radius, the coordinates of at least one pixel within the largest inscribed circle projected onto the ground are determined as the first position.
[0132] Optionally, regarding the acquisition of environmental images in at least one direction via the camera, the above-described procedure includes instructions for performing the following steps:
[0133] The camera is rotated to capture images of the environment in at least one direction.
[0134] Optionally, the above procedure may also include instructions for performing the following steps:
[0135] After the mobile device detects that the satellite positioning signal meets the preset conditions at its new location, it controls the mobile device to return to the initial point. During the return process, the mobile device is located. When the mobile device moves to a location where the satellite positioning signal meets the preset conditions, satellite positioning technology is used for positioning. When the mobile device moves to a location where the satellite positioning signal does not meet the preset conditions, non-satellite positioning technology is used for positioning. The initial point is the location where the mobile device stops moving.
[0136] Optionally, the above procedure may also include instructions for performing the following steps:
[0137] After the mobile device returns to the initial point, the step of controlling the mobile device to move along the preset path is executed again.
[0138] Optionally, in controlling the mobile device to move to the first location, the above procedure includes instructions for performing the following steps:
[0139] The mobile device is controlled to move to the projection range of the largest inscribed circle corresponding to the first position on the ground. When the mobile device enters the projection range of the largest inscribed circle on the ground, the moving speed is reduced to a preset moving speed, and the device moves a first preset distance at the preset moving speed. The movement is then stopped to wait for the satellite positioning signal of the mobile device to meet the preset condition. If the satellite positioning signal of the mobile device meets the preset condition within a preset time period, the device returns to the initial point. If the satellite positioning signal of the mobile device does not meet the preset condition within the preset time period, the device continues to move a second preset distance and waits again for the satellite positioning signal of the mobile device to meet the preset condition. The initial point is the position where the mobile device stops moving.
[0140] Optionally, the above procedure may also include instructions for performing the following steps:
[0141] If the satellite positioning signal does not meet the preset conditions, the mobile device is located using non-satellite positioning technology to control the mobile device to continue moving along the preset path.
[0142] Optionally, the above procedure may also include instructions for performing the following steps:
[0143] If the distance between the location of the mobile device and the first location is less than or equal to the remaining range, the step of controlling the mobile device to move towards the first location is executed, wherein the remaining range is obtained based on a preset range and the mileage by which the mobile device continues to move along the preset path, the mileage by which the mobile device continues to move along the preset path is the first mileage or the mileage by which the mobile device travels during the first time period, and the mileage by which the mobile device continues to move along the preset path is less than the preset range.
[0144] Optionally, the remaining extendable mileage is equal to the difference between the preset extendable mileage and the mileage by which the mobile device continues to move along the preset path.
[0145] Optionally, the above procedure may also include instructions for performing the following steps:
[0146] If the distance between the location of the mobile device and the first location is greater than the remaining range, the mobile device is controlled to continue moving along a preset path until a satellite positioning signal is detected that meets the preset condition.
[0147] Optionally, the above procedure may also include instructions for performing the following steps:
[0148] After the mobile device continues to move along the preset path for the first mileage or the first duration, if the satellite positioning signal is detected to meet the preset conditions, the mobile device is controlled to move along the preset path using satellite positioning technology.
[0149] Optionally, the mobile device also includes a rear-view camera, the lens of which is positioned diagonally upward and rearward of the mobile device.
[0150] The mobile device described in this application is controlled to move along a preset path. When the mobile device moves to a position where the satellite positioning signal does not meet the preset conditions, the mobile device continues to move along the preset path for a first mile or a first time. After moving along the preset path for a first mile or a first time, if the satellite positioning signal is detected to not meet the preset conditions, the mobile device stops moving and acquires environmental images in at least one direction through a camera, identifies the sky area in the environmental images, and determines the first position corresponding to the sky area. The mobile device is then controlled to move towards the first position so that the mobile device detects that the satellite positioning signal meets the preset conditions at the new position. This allows the mobile device to maintain accurate positioning within a certain distance even when the satellite positioning signal does not meet the conditions. After continuing to move along the preset path within this certain distance, if the satellite positioning signal still does not meet the preset conditions, the mobile device stops moving. The first position is determined by the sky area in the environmental images, and the first position is used to guide the mobile device to an open area (an area where the satellite positioning signal meets the preset conditions). In other words, satellite positioning can be used again in the open area, which can solve the problem of inaccurate satellite positioning when obstructed, affecting the movement of the lawnmower robot.
[0151] Figure 4 This is a functional unit block diagram of a control device 400 for a mobile device according to an embodiment of this application. The control device 400 for the mobile device includes: a first control unit 401, a determining unit 402, and a second control unit 403, wherein...
[0152] The first control unit is configured to control the mobile device to move along a preset path; and when the mobile device moves to a position where the satellite positioning signal does not meet the preset conditions, control the mobile device to continue moving along the preset path for a first mile or a first duration.
[0153] The determining unit 402 is configured to, after continuing to move the first mileage or the first duration along the preset path, if it detects that the satellite positioning signal does not meet the preset conditions, control the mobile device to stop moving, and collect environmental images in at least one direction through the camera, identify the sky region in the environmental images, and determine the first position corresponding to the sky region.
[0154] The second control unit 403 is used to control the mobile device to move to the first position, so that the mobile device can detect a satellite positioning signal at the new position and meet the preset conditions.
[0155] Optionally, the first position is the projected coordinates of the sky region in the environmental image onto the ground.
[0156] Optionally, the first position is the projected coordinates of the center of the largest inscribed circle of the sky region in the environmental image on the ground.
[0157] Optionally, in determining the first location corresponding to the sky region, the determining unit 402 is specifically used for:
[0158] When the radius of the largest inscribed circle in the sky region of the environmental image is greater than a preset radius, the coordinates of at least one pixel within the largest inscribed circle projected onto the ground are determined as the first position.
[0159] Optionally, in terms of acquiring environmental images in at least one direction via the camera, the determining unit 402 is specifically used for:
[0160] The camera is rotated to capture images of the environment in at least one direction.
[0161] Optionally, the control device 400 of the mobile device is further specifically used for:
[0162] After the mobile device detects that the satellite positioning signal meets the preset conditions at its new location, it controls the mobile device to return to the initial point. During the return process, the mobile device is located. When the mobile device moves to a location where the satellite positioning signal meets the preset conditions, satellite positioning technology is used for positioning. When the mobile device moves to a location where the satellite positioning signal does not meet the preset conditions, non-satellite positioning technology is used for positioning. The initial point is the location where the mobile device stops moving.
[0163] Optionally, the control device 400 of the mobile device is further specifically used for:
[0164] After the mobile device returns to the initial point, the step of controlling the mobile device to move along the preset path is executed again.
[0165] Optionally, in controlling the mobile device to move to the first position, the second control unit 403 is specifically configured to:
[0166] The mobile device is controlled to move to the projection range of the largest inscribed circle corresponding to the first position on the ground. When the mobile device enters the projection range of the largest inscribed circle on the ground, the moving speed is reduced to a preset moving speed, and the device moves a first preset distance at the preset moving speed. The movement is then stopped to wait for the satellite positioning signal of the mobile device to meet the preset condition. If the satellite positioning signal of the mobile device meets the preset condition within a preset time period, the device returns to the initial point. If the satellite positioning signal of the mobile device does not meet the preset condition within the preset time period, the device continues to move a second preset distance and waits again for the satellite positioning signal of the mobile device to meet the preset condition. The initial point is the position where the mobile device stops moving.
[0167] Optionally, the control device 400 of the mobile device is further specifically used for:
[0168] If the satellite positioning signal does not meet the preset conditions, the mobile device is located using non-satellite positioning technology to control the mobile device to continue moving along the preset path.
[0169] Optionally, the control device 400 of the mobile device is further specifically used for:
[0170] If the distance between the location of the mobile device and the first location is less than or equal to the remaining range, the step of controlling the mobile device to move towards the first location is executed, wherein the remaining range is obtained based on a preset range and the mileage by which the mobile device continues to move along the preset path, the mileage by which the mobile device continues to move along the preset path is the first mileage or the mileage by which the mobile device travels during the first time period, and the mileage by which the mobile device continues to move along the preset path is less than the preset range.
[0171] Optionally, the remaining extendable mileage is equal to the difference between the preset extendable mileage and the mileage by which the mobile device continues to move along the preset path.
[0172] Optionally, the control device 400 of the mobile device is further specifically used for:
[0173] If the distance between the location of the mobile device and the first location is greater than the remaining range, the mobile device is controlled to continue moving along a preset path until a satellite positioning signal is detected that meets the preset condition.
[0174] Optionally, the control device 400 of the mobile device is further specifically used for:
[0175] After the mobile device continues to move along the preset path for the first mileage or the first duration, if the satellite positioning signal is detected to meet the preset conditions, the mobile device is controlled to move along the preset path using satellite positioning technology.
[0176] The control device for the mobile device described in this application controls the mobile device to move along a preset path. When the mobile device moves to a position where the satellite positioning signal does not meet the preset conditions, it controls the mobile device to continue moving along the preset path for a first mile or a first time. After moving along the preset path for a first mile or a first time, if the satellite positioning signal is detected to not meet the preset conditions, the mobile device is controlled to stop moving. An environmental image in at least one direction is acquired through a camera, the sky area in the environmental image is identified, and the first position corresponding to the sky area is determined. The mobile device is then controlled to move to the first position so that the mobile device detects that the satellite positioning signal meets the preset conditions at the new position. This allows the mobile device to maintain accurate positioning within a certain distance even when the satellite positioning signal does not meet the conditions. After continuing to move along the preset path within this certain distance, if the satellite positioning signal still does not meet the preset conditions, the movement stops. The first position is determined by the sky area in the environmental image, and the first position is used to guide the mobile device to an open area (an area where the satellite positioning signal meets the preset conditions). In other words, satellite positioning can be used again in the open area, which can solve the problem of inaccurate satellite positioning when obstructed, affecting the movement of the lawnmower robot.
[0177] It is understood that the functions of each program module of the control device of the mobile device in this embodiment can be specifically implemented according to the methods in the above method embodiments. The specific implementation process can be referred to the relevant descriptions in the above method embodiments, which will not be repeated here.
[0178] This application also provides a computer storage medium storing a computer program for electronic data interchange, which causes a computer to perform some or all of the steps of any of the methods described in the above method embodiments, wherein the computer includes a mobile device.
[0179] This application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods described in the above method embodiments. The computer program product may be a software installation package, and the computer may include a mobile device.
[0180] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.
[0181] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.
[0182] In the embodiments provided in this application, it should be understood that the disclosed system can be implemented in other ways. For example, the system embodiments described above are merely illustrative; for instance, the division of the units described above is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between systems or units may be electrical or other forms.
[0183] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0184] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0185] If the integrated units described above are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage device (CMD). Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned memory includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.
[0186] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, which may include: flash drive, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.
[0187] The embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.
Claims
1. A control method for a mobile device, characterized in that, The method includes: Control the mobile device to move along a preset path; When the mobile device moves to a location where the satellite positioning signal does not meet the preset conditions, the mobile device is controlled to continue moving along the preset path for a first mileage or a first duration. After continuing to move the first mileage or the first duration along the preset path, if it is detected that the satellite positioning signal does not meet the preset conditions, the mobile device is controlled to stop moving, and environmental images in at least one direction are captured by the camera, the sky area in the environmental image is identified, and the first position corresponding to the sky area is determined; the camera is installed on the mobile device; The mobile device is controlled to move to the first location using non-satellite positioning technology, so that the mobile device can detect a satellite positioning signal at the new location and meet the preset conditions.
2. The method according to claim 1, characterized in that, The first position is the projection coordinate of the sky region in the environmental image onto the ground.
3. The method according to claim 2, characterized in that, The first position is the projection coordinate of the center of the largest inscribed circle of the sky region in the environmental image onto the ground.
4. The method according to claim 2, characterized in that, Determining the first location corresponding to the sky region includes: When the radius of the largest inscribed circle in the sky region of the environmental image is greater than a preset radius, the coordinates of at least one pixel within the largest inscribed circle projected onto the ground are determined as the first position.
5. The method according to any one of claims 1-4, characterized in that, The acquisition of environmental images from at least one direction via a camera includes: The camera is rotated to capture images of the environment in at least one direction.
6. The method according to any one of claims 1-4, characterized in that, The method further includes: After the mobile device detects that the satellite positioning signal meets the preset conditions at its new location, it controls the mobile device to return to the initial point. During the return process, the mobile device is located. When the mobile device moves to a location where the satellite positioning signal meets the preset conditions, satellite positioning technology is used for positioning. When the mobile device moves to a location where the satellite positioning signal does not meet the preset conditions, non-satellite positioning technology is used for positioning. The initial point is the location where the mobile device stops moving.
7. The method according to claim 6, characterized in that, The method further includes: After the mobile device returns to the initial point, the step of controlling the mobile device to move along the preset path is executed again.
8. The method according to claim 3 or 4, characterized in that, The control of the mobile device to move to the first position includes: The mobile device is controlled to move to the projection range of the largest inscribed circle corresponding to the first position on the ground. When the mobile device enters the projection range of the largest inscribed circle on the ground, the moving speed is reduced to a preset moving speed, and the device moves a first preset distance at the preset moving speed. The movement is then stopped to wait for the satellite positioning signal of the mobile device to meet the preset condition. If the satellite positioning signal of the mobile device meets the preset condition within a preset time period, the device returns to the initial point. If the satellite positioning signal of the mobile device does not meet the preset condition within the preset time period, the device continues to move a second preset distance and waits again for the satellite positioning signal of the mobile device to meet the preset condition. The initial point is the position where the mobile device stops moving.
9. The method according to any one of claims 1-4, characterized in that, The method further includes: If the satellite positioning signal does not meet the preset conditions, the mobile device is located using non-satellite positioning technology to control the mobile device to continue moving along the preset path.
10. The method according to any one of claims 1-4, characterized in that, The method further includes: If the distance between the location of the mobile device and the first location is less than or equal to the remaining range, the step of controlling the mobile device to move towards the first location is executed, wherein the remaining range is obtained based on a preset range and the mileage by which the mobile device continues to move along the preset path, the mileage by which the mobile device continues to move along the preset path is the first mileage or the mileage by which the mobile device travels during the first time period, and the mileage by which the mobile device continues to move along the preset path is less than the preset range.
11. The method according to claim 10, characterized in that, The remaining usable mileage is equal to the preset usable mileage minus the mileage the mobile device continues to travel along the preset path.
12. The method according to claim 11, characterized in that, The method further includes: If the distance between the location of the mobile device and the first location is greater than the remaining range, the mobile device is controlled to continue moving along a preset path until a satellite positioning signal is detected that meets the preset condition.
13. The method according to any one of claims 1-4, characterized in that, The method further includes: After the mobile device continues to move along the preset path for the first mileage or the first duration, if the satellite positioning signal is detected to meet the preset conditions, the mobile device is controlled to move along the preset path using satellite positioning technology.
14. A mobile device, characterized in that, It includes a processor and a memory, the memory being used to store one or more programs and configured to be executed by the processor, the programs including instructions for performing the steps of the method as described in any one of claims 1-13.
15. A computer-readable storage medium, characterized in that, A computer program for storing electronic data interchange is provided, wherein the computer program causes a computer to perform the method as described in any one of claims 1-13.
Citation Information
Patent Citations
Enhanced gnss signal processing
CN101160535A
Automatic working system, self-moving equipment and control method thereof
CN107291077A
Charging control method and system for pure-electric sanitation sweeping vehicle in automatic driving process
CN110015147A