Mobile equipment docking method and device, equipment and storage medium

Image and mileage information are obtained through the image acquisition device, and the positioning model is used to calculate the position compensation value, which solves the problem of interference in the docking accuracy of the automatic guide trolley in the closed environment, and realizes high-precision docking control.

CN118981207APending Publication Date: 2024-11-19GUANGDONG LEAD INTELLIGENT LOGISTICS TECH CO LTD

Patent Information

Application Number
CN202411045867.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

When the automatic guide car is connected to the equipment in a closed environment, the positioning system signal may be disturbed, affecting the docking accuracy.

Method used

The image information of the device to be connected and the mileage information of the mobile device are obtained through the image acquisition device, determine the position information of the center point of the device to be connected, and input this information into the positioning model, calculate the position compensation value to control the position of the mobile device. , achieve the improvement of docking accuracy.

Benefits of technology

High-precision positioning and control of mobile devices can be achieved without communication means, effectively improving the accuracy of mobile devices and devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118981207A_ABST
    Figure CN118981207A_ABST
Patent Text Reader

Abstract

The invention relates to a docking method, device and equipment of mobile equipment and a storage medium, and belongs to the technical field of automatic guide trolleys, the method comprises the following steps: through an image acquisition device configured by the mobile equipment, acquiring image information marked on equipment to be docked, and acquiring mileage information of the mobile equipment; according to the image information, determining position information of a central point of the to-be-docked equipment; inputting the position information and the mileage information into a preset positioning model to obtain pose compensation of the mobile equipment; wherein the positioning model is used for taking the position information as an observed value, taking the mileage information as a predicted value, and determining a deviation value between the predicted value and the observed value as pose compensation of the mobile equipment; and regulating and controlling the mobile equipment according to the pose compensation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the technical field of automatic guided vehicles, and more specifically, to a method, apparatus, device and storage medium for docking a mobile device. Background Art

[0002] With the rapid development of Automated Guided Vehicle (AGV), AGV is widely used in material handling and transportation. The AGV can travel along a specified navigation path and has safety protection and various transplanting functions.

[0003] At present, for the positioning of automatic guided vehicles, positioning systems such as laser SLAM or GPS can be used. However, when the automatic guided vehicle needs to dock with some equipment in a closed environment, the signals of these positioning systems may be interfered, affecting the docking accuracy. Summary of the invention

[0004] One purpose of the embodiments of the present disclosure is to provide a new technical solution for docking of mobile devices.

[0005] According to a first aspect of the present disclosure, a method for docking a mobile device is provided, the method comprising:

[0006] Acquire the image information marked on the device to be docked and the mileage information of the mobile device through the image acquisition device configured by the mobile device;

[0007] Determine the position information of the center point of the device to be docked according to the image information;

[0008] Inputting the position information and the mileage information into a preset positioning model to obtain the posture compensation of the mobile device; wherein the positioning model is used to use the position information as an observed value and the mileage information as a predicted value, and determine the deviation between the predicted value and the observed value as the posture compensation of the mobile device;

[0009] According to the posture compensation, the posture of the mobile device is adjusted.

[0010] Optionally, the mark on the device to be docked is a reflective mark, and a geometric center of the reflective mark is associated with a center point of the device to be docked.

[0011] Optionally, obtaining the image information marked on the device to be docked includes:

[0012] Determine a target area in the point cloud image output by the image acquisition device where the point cloud intensity exceeds a set threshold;

[0013] The target area is used as the reflective mark, and image information of the target area is determined.

[0014] Optionally, the location information of the center point of the device to be docked includes a first coordinate of the device to be docked in a first set coordinate system; before using the mileage information as a predicted value of the positioning model, the method further includes:

[0015] Determine a third coordinate of the mobile device in the first set coordinate system according to the second coordinate of the mobile device in the second set coordinate system represented by the mileage information and a set conversion relationship; wherein the conversion relationship reflects that different points of the first set coordinate system correspond to different points of the second set coordinate system;

[0016] The using the mileage information as a predicted value of the positioning model includes:

[0017] The third coordinate is used as a predicted value of the positioning model.

[0018] Optionally, the mileage information includes an angular velocity and a linear velocity of the mobile device at a first sampling moment; before using the mileage information as a predicted value of the positioning model, the method further includes:

[0019] Determine the fifth coordinate and the first angle value of the mobile device at the first sampling time according to the angular velocity, the linear velocity, the fourth coordinate and the second angle value of the mobile device at the second sampling time; wherein the second sampling time is before the first sampling time;

[0020] The using the mileage information as a predicted value of the positioning model includes:

[0021] The fifth coordinate and the first angle value are used as predicted values ​​of the positioning model.

[0022] Optionally, the positioning model includes a positioning prediction algorithm and a positioning update algorithm;

[0023] The step of inputting the location information and the mileage information into a preset positioning model to obtain a posture compensation of the mobile device includes:

[0024] Inputting the position information as an observation value of a preset positioning model into the positioning prediction algorithm to obtain a state estimation covariance matrix;

[0025] The mileage information is input into the positioning update algorithm as the predicted value of the positioning model and the state estimation covariance matrix to obtain the posture compensation of the mobile device.

[0026] According to a second aspect of the present disclosure, there is also provided a docking device for a mobile device, comprising:

[0027] An acquisition module, used to acquire image information marked on the device to be docked and to acquire mileage information of the mobile device through an image acquisition device configured on the mobile device;

[0028] A determination module, used to determine the position information of the center point of the device to be docked according to the image information;

[0029] An obtaining module is used to input the position information and the mileage information into a preset positioning model to obtain the posture compensation of the mobile device; wherein the positioning model is used to use the position information as an observed value and the mileage information as a predicted value, and determine the deviation between the predicted value and the observed value as the posture compensation of the mobile device;

[0030] A control module is used to control the posture of the mobile device according to the posture compensation.

[0031] According to a third aspect of the present disclosure, an electronic device is also provided, including a processor, wherein the processor is connected to a memory, and the memory is used to store a computer program; the processor is used to execute the computer program to implement the method described in the first aspect of the present disclosure.

[0032] According to a fourth aspect of the present disclosure, a mobile device is further provided, comprising the mobile device as described in the second aspect or the electronic device as described in the third aspect.

[0033] According to a fifth aspect of the present disclosure, a computer storage medium is further provided, on which a computer program is stored. When the computer program is executed by a processor, the method according to the first aspect of the present disclosure is implemented.

[0034] One beneficial effect of the embodiments of the present disclosure is that by acquiring image information through an image acquisition device, acquiring mileage information of a mobile device, and then determining the position information of a center point of a device to be docked based on the image information, and inputting the position information and mileage information into a positioning model, the posture compensation of the mobile device can be obtained, and the mobile device can be regulated by the posture compensation, without the need to use communication means to achieve positioning and control of the mobile device, thereby effectively improving the accuracy of docking between mobile devices.

[0035] Other features and advantages of the embodiments of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of the embodiments of the present disclosure.

[0037] Figure 1 is a schematic diagram of the composition structure of a docking system for a mobile device to which a docking method for a mobile device according to an embodiment can be applied;

[0038] Figure 2 is a flow chart of a method for docking a mobile device according to an embodiment;

[0039] Figure 3 is a schematic diagram of the hardware structure of a docking device for a mobile device according to an embodiment;

[0040] Figure 4 is a block schematic diagram of an electronic device according to an embodiment. DETAILED DESCRIPTION

[0041] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present invention unless otherwise specifically stated.

[0042] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.

[0043] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.

[0044] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0045] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0046] <System Embodiment>

[0047] Figure 1 FIG. 1 is a schematic diagram of the structure of a docking system for a mobile device to which a docking method for a mobile device according to an embodiment of the present invention can be applied. Figure 1 As shown, the docking system for mobile devices includes a mobile device 10 and a device to be docked 20 .

[0048] The mobile device 10 may be an automated guided vehicle (AGV), and the mobile device 10 is equipped with a corresponding image acquisition device, such as a camera or a laser radar.

[0049] The above-mentioned device to be docked 20 is, for example, a production line or a cache rack. The device to be docked 20 is provided with a corresponding docking position for the above-mentioned mobile device 10 to dock. The docking position can be an output port or an input port.

[0050] As used in the embodiments of the present disclosure, the memory of the mobile device 10 is used to store a computer program, which is used to control the processor of the mobile device 10 to operate according to the docking method of the mobile device of any embodiment. A technician can design a computer program according to the scheme of the embodiments of the present disclosure. How the computer program controls the processor to operate is well known in the art, so it will not be described in detail here.

[0051] <Method Example>

[0052] Figure 2 is a flow chart of a method for docking a mobile device according to an embodiment. Figure 1 The mobile device 10.

[0053] like Figure 2 As shown, the docking method of the mobile device of this embodiment may include the following steps S210 to S240:

[0054] Step S210: acquiring image information marked on the device to be docked and acquiring mileage information of the mobile device through an image acquisition device configured in the mobile device.

[0055] In the present application, the image acquisition device can acquire an image directly in front of the mobile device in the direction of travel. The image acquisition device can be a laser radar, which can scan the surrounding environment and obtain a point cloud image of the surrounding environment of the mobile device. The logo on the device to be docked is, for example, a reflective logo, a raised pattern logo, etc., so that the image acquisition device of the mobile device can recognize it.

[0056] In the present application, the mobile device may be configured with an odometer, which may provide continuous displacement and rotation of the mobile device, and then determine the linear velocity and angular velocity of the mobile device through the configured integral wheel speed odometer.

[0057] In some embodiments, the mark on the device to be docked is a reflective mark, and the geometric center of the reflective mark is associated with the center point of the device to be docked.

[0058] In the present application, one or more reflective markers may be provided. When there is one reflective marker, the geometric center of the reflective marker coincides with the center point of the device to be docked. When there are two reflective markers, the midpoint of the line connecting the geometric centers of the two reflective markers coincides with the center point of the device to be docked. When there are multiple reflective markers, the center point of the graphic formed by the geometric centers of the multiple reflective markers coincides with the center point of the device to be docked. In other words, by providing reflective markers, the image acquisition device of the mobile device can quickly identify them with higher accuracy, so as to achieve precise docking between the mobile device and the device to be docked.

[0059] In some examples, such as Figure 1 As shown, the mobile device 10 can capture two reflective markers 21 located on the device to be docked 20 through the configured image acquisition device, and determine the midpoint of the line connecting the geometric centers of the two reflective markers 21 to determine the center point of the device to be docked 20.

[0060] In some embodiments, step S210 may include the following steps S310 and S320:

[0061] Step S310, determining a target area in the point cloud image output by the image acquisition device where the point cloud intensity exceeds a set threshold.

[0062] In some examples, the expression for setting the intensity threshold may be:

[0063] intensity threshold=α*σ (1)

[0064] In formula (1), α is a set fixed value, and σ is the standard deviation of the point cloud intensity of the point cloud image.

[0065] The specific expression of the standard deviation σ is as follows:

[0066]

[0067] In formula (2), N represents all the points in the point cloud image. Represents the average point cloud intensity of all points in the point cloud image.

[0068] In other words, by configuring a dynamic threshold, you can filter out point clouds with high reflective intensity without manual parameter adjustment according to the changes in the intensity perception capabilities of different lidars, effectively improving the efficiency of algorithm deployment.

[0069] Step S320: taking the target area as a reflective mark and determining image information of the target area.

[0070] In some examples, such as Figure 1As shown, the mobile device can identify the area where the reflective mark 21 is located, that is, the target area, and determine the range and geometric center of the target area as the image information of the target area.

[0071] Step S220: Determine the position information of the center point of the device to be docked according to the image information.

[0072] In some examples, such as Figure 1 As shown, according to the geometric centers of the two reflective marks 21, the midpoint of the line connecting the two geometric centers can be determined as the center point of the device to be docked.

[0073] Step S230, input the location information and mileage information into a preset positioning model to obtain the posture compensation of the mobile device; wherein the positioning model is used to use the location information as the observation value and the mileage information as the prediction value, and determine the deviation between the prediction value and the observation value as the posture compensation of the mobile device.

[0074] In some embodiments, the location information of the center point of the device to be docked includes the first coordinates of the device to be docked in the first set coordinate system. Before step S230, the method further includes the following step S410:

[0075] Step S410, determining the third coordinate of the mobile device in the first set coordinate system according to the second coordinate of the mobile device in the second set coordinate system represented by the mileage information and the set conversion relationship; wherein the conversion relationship reflects that different points of the first set coordinate system correspond to different points of the second set coordinate system.

[0076] In the present application, the odometer configured on the mobile device can record the entire process of the mobile device moving from the starting point. The process can be a coordinate system constructed with the starting point as the origin, that is, the second set coordinate system. The real-time position of the mobile device can be represented as a coordinate in the second set coordinate system, that is, the second coordinate.

[0077] In some examples, such as Figure 1 As shown, the first set coordinate system can be a coordinate system constructed with the midpoint of the line connecting the two reflective marks 21 as the origin. The set conversion relationship can be calculated by determining the relative position relationship between the mobile device and the device to be docked through the image information of the image acquisition device, the second coordinate of the mobile device in the second set coordinate system, and the first coordinate of the device to be docked in the first set coordinate system. And through this conversion relationship, the third coordinate of the mobile device in the first coordinate system can be determined.

[0078] Based on this, step S230 may include the following step S2301:

[0079] Step S2301, taking the third coordinate as the predicted value of the positioning model.

[0080] In other words, through the cooperation of the image acquisition device and the wheel speed odometer, high-precision positioning of the mobile device in the first set coordinate system can be achieved, and the mobile device can then be docked with the device with high precision.

[0081] In some embodiments, the mileage information includes the angular velocity and linear velocity of the mobile device at the first sampling moment. Before step S230, the method further includes the following step S510:

[0082] Step S510, determining the fifth coordinate and the first angle value of the mobile device at the first sampling moment according to the angular velocity, the linear velocity, the fourth coordinate and the second angle value of the mobile device at the second sampling moment; wherein the second sampling moment is before the first sampling moment.

[0083] In some examples, the motion equation of the mobile device may vary according to the chassis type. Taking the dual differential model as an example, at the first sampling time k-1, the fifth coordinate (x k ,y k ) and the first angle value θ k The specific expression is as follows:

[0084]

[0085] In formula (3) to formula (5), x k-1 represents the horizontal coordinate at the second sampling time k-1, y k-1 represents the ordinate at the second sampling time k-1, θ k-1 represents the second angle value at the second sampling time k-1, V l is the left wheel speed, V r is the right wheel speed, the linear speed of the mobile device Angular velocity of the mobile device

[0086] Based on this, step S230 may include the following step S2302:

[0087] Step S2302: Use the fifth coordinate and the first angle value as the predicted values ​​of the positioning model.

[0088] In other words, the linear velocity and angular velocity are obtained through the configured wheel speed odometer, and the fifth coordinate and the first angle value are obtained to achieve the predicted value of the positioning model.

[0089] In some embodiments, the positioning model includes a positioning prediction algorithm and a positioning update algorithm. Step S230 may include the following steps S610 and S620:

[0090] Step S610: input the position information into the positioning prediction algorithm as the observation value of the preset positioning model to obtain the state estimation covariance matrix.

[0091] In the present application, the positioning model can be an extended Kalman filter algorithm, which fuses the position information obtained from the reflective markings observed by the lidar with the mileage information predicted by the wheel speed odometer to obtain more accurate and smoother positioning information, effectively reduce positioning jumps, and facilitate path tracking of motion control of mobile devices.

[0092] The extended Kalman filter algorithm mainly includes the following algorithms: positioning prediction algorithm and positioning update algorithm. In addition, the initialization state estimation is performed based on the position information of the first observation of the laser radar. and the state estimation covariance matrix P 0 , due to the initial state, it can be observed that P 0 =Q 0 .

[0093] Among them, the positioning prediction algorithm includes the prediction state algorithm and the prediction covariance matrix algorithm, which are specifically expressed as follows:

[0094]

[0095] Formula (6) is the prediction state algorithm, f is the state transfer function, that is, the motion equation of the mobile device, which can be obtained from the above mileage information, u k To control the input quantity, i.e., the left and right wheel speeds of the mobile device.

[0096]

[0097] Formula (7) is the prediction covariance matrix algorithm, F k is the Jacobian matrix of the state transfer equation, Q k is the process noise covariance matrix, that is, the noise covariance matrix of the wheel speed odometer integral prediction.

[0098]

[0099] Formula (8) to Formula (10) are F k It is the solution formula of the Jacobian matrix of the state transfer equation.

[0100] Step S620, inputting the mileage information into the positioning update algorithm as the prediction value of the positioning model and the state estimation covariance matrix to obtain the posture compensation of the mobile device.

[0101]

[0102] P k =(IK k ·H k )·P k(13)

[0103] In equations (11) to (13), h is the observation model function, i.e., the position information obtained by the laser radar from observing the marker; H k is the Jacobian matrix of the observation model function. Since the first set coordinate system positioning is directly obtained by observation in the present invention, H k Can be regarded as the unit matrix; R k It is the observation noise covariance matrix, that is, the laser radar observation positioning noise covariance matrix, which is generally provided by the laser radar manufacturer or calculated by statistically analyzing the physical measurement observation and true value errors at different distances. k is the actual observation value, that is, the location information.

[0104] Step S240: adjusting the posture of the mobile device according to the posture compensation.

[0105] In the present application, the posture of a mobile device refers to the position and posture of the mobile device, wherein the position of the mobile device may be the actual position of the mobile device, and the posture of the mobile device may be the deviation angle of the mobile device relative to the device to be docked.

[0106] In the present application, when posture compensation indicates that the position of a mobile device is offset, the mobile device can control the movement and / or steering of the mobile device so that the mobile device is realigned with the device to be docked. Calibrating the moving path of the mobile device based on posture compensation is a prior art and will not be elaborated herein.

[0107] <Equipment Example 1>

[0108] Figure 3 FIG. 1 is a block diagram of a docking device for a mobile device according to an embodiment. Figure 3 As shown, the docking device 300 of the mobile device may include:

[0109] The acquisition module 310 is used to acquire the image information marked on the device to be docked and the mileage information of the mobile device through the image acquisition device configured in the mobile device;

[0110] A determination module 320, configured to determine the location information of the center point of the device to be docked according to the image information;

[0111] An obtaining module 330 is used to use the location information as an observation value of a preset positioning model and the mileage information as a prediction value of the positioning model to obtain a posture compensation of the mobile device;

[0112] The control module 340 is used to control the mobile device according to the posture compensation.

[0113] Optionally, the acquisition module 310 is further used to determine a target area in the point cloud image output by the image acquisition device where the point cloud intensity exceeds a set threshold; use the target area as a reflective mark, and determine image information of the target area.

[0114] Optionally, the docking device 300 of the mobile device further includes a coordinate determination module, which is used to determine a third coordinate of the mobile device in the first set coordinate system according to the second coordinate of the mobile device in the second set coordinate system represented by the mileage information and a set conversion relationship; wherein the conversion relationship reflects that different points of the first set coordinate system correspond to different points of the second set coordinate system;

[0115] The module 330 is obtained, and is also used to use the third coordinate as a predicted value of the positioning model.

[0116] Optionally, the docking device 300 of the mobile device further includes an angle determination module, which is used to determine the fifth coordinate and the first angle value of the mobile device at the first sampling time according to the angular velocity, the linear velocity, the fourth coordinate and the second angle value of the mobile device at the second sampling time; wherein the second sampling time is before the first sampling time;

[0117] The obtaining module 330 is further used to use the fifth coordinate and the first angle value as predicted values ​​of the positioning model.

[0118] Optionally, module 330 is obtained, and is also used to input the location information as the observation value of the preset positioning model into the positioning prediction algorithm to obtain the state estimation covariance matrix; and input the mileage information as the prediction value of the positioning model and the state estimation covariance matrix into the positioning update algorithm to obtain the posture compensation of the mobile device.

[0119] The docking device 300 of the mobile device may be Figure 1 A mobile device 10 is provided.

[0120] <Equipment Example 2>

[0121] Figure 4 is a schematic diagram of the hardware structure of an electronic device according to an embodiment.

[0122] like Figure 4 As shown, the electronic device 400 includes a processor 410 and a memory 420, wherein the memory 420 is used to store an executable computer program, and the processor 410 is used to execute a method such as any of the above method embodiments under the control of the computer program.

[0123] The electronic device 400 may be Figure 1 A mobile device 10 is provided.

[0124] Each module of the above-mentioned docking device 300 for mobile device may be implemented by the processor 410 in this embodiment executing a computer program stored in the memory 420, or may be implemented by other structures, which is not limited here.

[0125] The present invention may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present invention.

[0126] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (a non-exhaustive list) include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the foregoing. As used herein, a computer-readable storage medium is not to be interpreted as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.

[0127] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0128] The computer program instructions for performing the operation of the present invention may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be personalized by utilizing the state information of the computer-readable program instructions, and the electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present invention.

[0129] Various aspects of the present invention are described herein with reference to the flow charts and / or block diagrams of the methods, devices (systems) and computer program products according to embodiments of the present invention. It should be understood that each box of the flow chart and / or block diagram and the combination of each box in the flow chart and / or block diagram can be implemented by computer-readable program instructions.

[0130] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0131] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0132] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a part of a module, a program segment or an instruction, and a part of the module, a program segment or an instruction contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented by a dedicated hardware-based system that performs the specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that it is equivalent to implement it by hardware, implement it by software, and implement it by combining software and hardware.

[0133] Embodiments of the present invention have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements in the marketplace, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the present invention is defined by the appended claims.

Claims

1. A method for docking a mobile device, characterized in that: The method comprises: Acquire the image information marked on the device to be docked and the mileage information of the mobile device through the image acquisition device configured by the mobile device; Determine the position information of the center point of the device to be docked according to the image information; Inputting the position information and the mileage information into a preset positioning model to obtain the posture compensation of the mobile device; wherein the positioning model is used to use the position information as an observed value and the mileage information as a predicted value, and determine the deviation between the predicted value and the observed value as the posture compensation of the mobile device; According to the posture compensation, the posture of the mobile device is adjusted.

2. The method according to claim 1, characterized in that: The mark on the device to be docked is a reflective mark, and the geometric center of the reflective mark is associated with the center point of the device to be docked.

3. The method according to claim 2, characterized in that The step of obtaining the image information marked on the device to be connected includes: Determine a target area in the point cloud image output by the image acquisition device where the point cloud intensity exceeds a set threshold; The target area is used as the reflective mark, and image information of the target area is determined.

4. The method according to claim 1, characterized in that: The location information of the center point of the device to be docked includes the first coordinate of the device to be docked in the first set coordinate system; before using the mileage information as the predicted value of the positioning model, the method further includes: Determine a third coordinate of the mobile device in the first set coordinate system according to the second coordinate of the mobile device in the second set coordinate system represented by the mileage information and a set conversion relationship; wherein the conversion relationship reflects that different points of the first set coordinate system correspond to different points of the second set coordinate system; The using the mileage information as a predicted value of the positioning model includes: The third coordinate is used as a predicted value of the positioning model.

5. The method according to claim 1, characterized in that The mileage information includes the angular velocity and linear velocity of the mobile device at the first sampling moment; before using the mileage information as the predicted value of the positioning model, the method further includes: Determine the fifth coordinate and the first angle value of the mobile device at the first sampling time according to the angular velocity, the linear velocity, the fourth coordinate and the second angle value of the mobile device at the second sampling time; wherein the second sampling time is before the first sampling time; The using the mileage information as a predicted value of the positioning model includes: The fifth coordinate and the first angle value are used as predicted values ​​of the positioning model.

6. The method according to any one of claims 1 to 5, characterized in that: The positioning model includes a positioning prediction algorithm and a positioning update algorithm; The step of inputting the location information and the mileage information into a preset positioning model to obtain a posture compensation of the mobile device includes: Inputting the position information as an observation value of a preset positioning model into the positioning prediction algorithm to obtain a state estimation covariance matrix; The mileage information is input into the positioning update algorithm as the predicted value of the positioning model and the state estimation covariance matrix to obtain the posture compensation of the mobile device.

7. A docking device for a mobile device, characterized in that: include: An acquisition module, used to acquire image information marked on the device to be docked and to acquire mileage information of the mobile device through an image acquisition device configured on the mobile device; A determination module, used to determine the position information of the center point of the device to be docked according to the image information; An obtaining module is used to input the position information and the mileage information into a preset positioning model to obtain the posture compensation of the mobile device; wherein the positioning model is used to use the position information as an observed value and the mileage information as a predicted value, and determine the deviation between the predicted value and the observed value as the posture compensation of the mobile device; A control module is used to control the posture of the mobile device according to the posture compensation.

8. An electronic device, characterized in that: The method comprises a processor connected to a memory, wherein the memory is used to store a computer program; the processor is used to execute the computer program to implement the method according to any one of claims 1 to 6.

9. A mobile device, characterized in that: Comprising the mobile device as claimed in claim 7 or the electronic device as claimed in claim 8.

10. A computer storage medium, characterized in that: The computer storage medium stores a computer-readable program, and the computer-readable program is executed by a processor to perform the steps of the method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Heavy guided vehicle positioning method based on vision sensor and heavy guided vehicle

    CN109189076A

  • Automated driving systems and control logic for cloud-based scenario planning of autonomous vehicles

    CN110271556A

  • Robot charging method, robot charging control device and storage medium

    CN111625005A

  • Positioning method and device, computer equipment and storage medium

    CN114494330A

  • Robot pose information correction method and device, electronic device and robot

    CN114859881A

Cited By

  • Gluing control method and device and electronic equipment

    CN120346952A

  • Glue coating control method, device and electronic equipment

    CN120346952B