Control method of underwater robot, underwater robot and storage medium

By adjusting the control coordinate system in the underwater robot control terminal to match the display view angle, the operation difficulty caused by camera view angle switching in underwater operations is solved, and the operation efficiency and controllability of the underwater robot in anti-flow scenarios are improved.

CN119002525APending Publication Date: 2024-11-22SHENZHEN QYSEA TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410960796.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-17
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

In underwater operations, the difficulty of operating underwater robots increases, especially in flow-resistant scenarios. The difficulty of control and misoperation frequency caused by camera viewing angle switching is high, which reduces the operation efficiency.

Method used

When switching the display view angle of the control terminal, the orientation of the current display view angle relative to the underwater robot is determined, and the control coordinate system is adjusted according to the orientation to make it consistent with the display view angle, so that the water is controlled based on the received control command and the coordinate system. The movement of the robot includes obstacle avoidance and adapting to the direction of water flow.

Benefits of technology

It reduces the difficulty of underwater robot operation, improves operating efficiency, ensures the correspondence between operating instructions and robot movement, reduces erroneous operations, and improves the controllability of operation in anti-flow scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119002525A_ABST
    Figure CN119002525A_ABST
Patent Text Reader

Abstract

The invention discloses an underwater robot control method, an underwater robot and a storage medium, and the method comprises the steps: determining the orientation of a current display visual angle relative to a controlled underwater robot when the display visual angle of a control terminal is switched; the current control coordinate system of the underwater robot is determined according to the orientation, and the main direction of the control coordinate system is consistent with the orientation; and controlling the underwater robot based on a received control instruction and the control coordinate system. According to the underwater robot, the operation difficulty of the underwater robot is reduced, and the underwater operation efficiency is improved. The invention aims to reduce the operation difficulty of the underwater robot and improve the underwater operation efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of underwater operations, and in particular to a control method for an underwater robot, an underwater robot and a storage medium. Background Art

[0002] When an underwater robot is working underwater, the movement of the underwater robot is generally controlled by a control terminal. The speed of the underwater robot moving forward and backward is fast, while the speed of left and right translation is slow. Therefore, in an environment with a large water flow, the underwater robot will choose to move in the forward direction to resist the flow, and the machine needs to be operated frequently to adapt to the changes in the water flow.

[0003] In the relevant underwater robot control scheme, the robot is generally controlled from a first-person perspective based on the data collected by the main camera set in front of the underwater robot. However, since the operator switches the camera when observing the target on the side of the underwater robot, the image displayed is not the data collected by the main camera. Especially in the anti-current operation scene, the difficulty of operating the underwater robot will increase, which is easy to cause misoperation and reduce the operation efficiency.

[0004] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of the present invention is to provide a control method of an underwater robot, an underwater robot and a computer-readable storage medium, aiming to achieve the effect of reducing the difficulty of operating the underwater robot.

[0006] To achieve the above object, the present invention provides a control method for an underwater robot, the control method for the underwater robot comprising:

[0007] When the display viewing angle of the control terminal is switched, determining the orientation of the current display viewing angle relative to the controlled underwater robot;

[0008] Determining a current control coordinate system of the underwater robot according to the orientation, wherein a main direction of the control coordinate system is consistent with the orientation;

[0009] Controlling the underwater robot based on the received control instruction and the control coordinate system;

[0010] The step of controlling the underwater robot based on the received control instruction and the control coordinate system comprises: determining an obstacle avoidance distance between the underwater robot and an obstacle; determining a target position for movement of the underwater robot according to the control coordinate system and the control instruction, and determining a spacing distance between the robot and the obstacle according to the target position; when the spacing distance is greater than or equal to the obstacle avoidance distance, controlling the movement of the underwater robot with the control instruction; when the spacing distance is less than the obstacle avoidance distance, controlling the underwater robot with the obstacle avoidance distance; or

[0011] The step of controlling the underwater robot based on the received control instructions and the control coordinate system includes: determining the target moving direction of the underwater robot according to the control instructions and the control coordinate system; obtaining the water flow direction and water flow speed in the water area where the underwater robot is located; determining the moving direction and driving power of the underwater robot according to the target moving direction, the water flow direction and the water flow speed; and controlling the underwater robot according to the moving direction and the driving power.

[0012] Optionally, the step of determining the moving direction and driving power of the underwater robot according to the target moving direction, the water flow direction and the water flow speed includes:

[0013] By obtaining the water flow speed and water flow direction, the moving direction and driving power of the underwater robot that can offset the water flow effect are calculated;

[0014] The step of controlling the underwater robot according to the moving direction and the driving power comprises:

[0015] The underwater robot is controlled to move so that the actual moving direction of the underwater robot is consistent with the target moving direction.

[0016] Optionally, each coordinate point on the control coordinate system corresponds to a different movement control instruction, and different movement control instructions correspond to different target movement directions and / or target movement distances. The control coordinate system includes multiple axes, and the direction of each axis corresponds to a target movement direction of the movement control instruction.

[0017] Optionally, the step of determining the orientation of the current display viewing angle relative to the controlled robot includes:

[0018] Determine the camera corresponding to the current display viewing angle;

[0019] If the camera is fixedly installed, obtaining the installation position of the camera on the underwater robot;

[0020] The orientation is determined based on the installation location.

[0021] Optionally, the step of determining the orientation of the current display viewing angle relative to the controlled robot includes:

[0022] Determine the camera corresponding to the current display viewing angle;

[0023] If the camera is installed on a supporting component, obtaining angle information of the supporting component;

[0024] The orientation is determined according to the angle information.

[0025] Optionally, the step of determining the current control coordinate system of the underwater robot according to the orientation comprises:

[0026] Determine a display mode corresponding to the current display viewing angle;

[0027] adjusting the body posture of the underwater robot according to the display mode;

[0028] The control coordinate system is determined according to the fuselage posture and the orientation.

[0029] Optionally, when the display viewing angle of the control terminal is switched, before the step of determining the orientation of the current display viewing angle relative to the controlled underwater robot, the step further includes:

[0030] Dividing the display screen of the control terminal into multiple display areas, and determining a target display area among the multiple display areas;

[0031] When an instruction to switch the display screen of the target display area is received, it is determined whether the shooting angle corresponding to the switched display screen is switched. If so, it is correspondingly determined that the display angle is switched.

[0032] In addition, to achieve the above-mentioned purpose, the present invention also provides an underwater robot, which includes a memory, a processor, and a control program of the underwater robot stored in the memory and executable on the processor, and the control program of the underwater robot, when executed by the processor, implements the steps of the control method of the underwater robot as described above.

[0033] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, on which a control program of an underwater robot is stored. When the control program of the underwater robot is executed by a processor, the steps of the control method of the underwater robot as described above are implemented.

[0034] The embodiments of the present invention provide a control method for an underwater robot, an underwater robot, and a computer-readable storage medium. When the display viewing angle of a control terminal is switched, the method determines the orientation of the current display viewing angle relative to the controlled underwater robot; determines the current control coordinate system of the underwater robot according to the orientation, wherein the main direction of the control coordinate system is consistent with the orientation; controls the underwater robot based on a received control instruction and the control coordinate system, wherein the steps of controlling the underwater robot based on the received control instruction and the control coordinate system include: determining an obstacle avoidance distance between the underwater robot and an obstacle; determining a target position of the underwater robot according to the control coordinate system and the control instruction, and determining the target position according to the target position. The interval distance between the robot and the obstacle; when the interval distance is greater than or equal to the obstacle avoidance distance, the movement of the underwater robot is controlled by the control instruction; when the interval distance is less than the obstacle avoidance distance, the underwater robot is controlled by the obstacle avoidance distance; or the step of controlling the underwater robot based on the received control instruction and the control coordinate system includes: determining the target moving direction of the underwater robot according to the control instruction and the control coordinate system; obtaining the water flow direction and water flow speed in the water area where the underwater robot is located; determining the moving direction and driving power of the underwater robot according to the target moving direction, the water flow direction and the water flow speed; and controlling the underwater robot according to the moving direction and the driving power. In this way, when the display perspective is switched, the control coordinate system is changed accordingly, so that the main direction of the control coordinate system is consistent with the current perspective and the orientation of the controlled underwater device robot, so as to realize the control of the underwater robot with the current display perspective as the first-person perspective, so that the operation instruction corresponds to the movement of the underwater robot, thereby reducing the difficulty of operating the underwater robot and improving the operation efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 It is a schematic diagram of the terminal structure of the hardware operating environment involved in the embodiment of the present invention;

[0036] Figure 2 A schematic diagram of a flow chart of an embodiment of a method for controlling an underwater robot of the present invention;

[0037] Figure 3 A schematic flow chart of another embodiment of a method for controlling an underwater robot according to the present invention;

[0038] Figure 4 A schematic diagram of control coordinate switching involved in an embodiment of the present invention;

[0039] Figure 5 The present invention is a simplified animated diagram illustrating the working environment of the embodiment of the present invention.

[0040] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0041] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0042] In the relevant underwater robot control scheme, the robot is generally controlled from a first-person perspective based on the data collected by the main camera set in front of the underwater robot. However, since the operator switches the camera when observing the target on the side of the underwater robot, the image displayed is not the data collected by the main camera. Especially in the anti-current operation scene, the difficulty of operating the underwater robot will increase, which is easy to cause misoperation and reduce the operation efficiency.

[0043] In order to increase the difficulty of operating an underwater robot, an embodiment of the present invention provides a control method of an underwater robot, an underwater robot and a computer-readable storage medium, wherein the main steps of the method include:

[0044] When the display viewing angle of the control terminal is switched, determining the orientation of the current display viewing angle relative to the controlled underwater robot;

[0045] Determining a current control coordinate system of the underwater robot according to the orientation, wherein a main direction of the control coordinate system is consistent with the orientation;

[0046] The underwater robot is controlled based on the received control instruction and the control coordinate system.

[0047] In this way, when the display perspective switches, the control coordinate system is changed accordingly so that the main direction of the control coordinate system is consistent with the current perspective and the orientation of the controlled underwater equipment robot, so that the underwater robot can be controlled with the current display perspective as the first-person perspective, and the operation instructions and the movement of the underwater robot correspond, thereby reducing the difficulty of operating the underwater robot and improving work efficiency.

[0048] The content to be protected by the claims of the present invention will be described in detail below with reference to the accompanying drawings.

[0049] like Figure 1 As shown, Figure 1 It is a schematic diagram of the terminal structure of the hardware operating environment involved in the embodiment of the present invention.

[0050] The terminal in the embodiment of the present invention may be an underwater robot or a control terminal of the underwater robot.

[0051] like Figure 1 As shown, the terminal may include: a processor 1001 , such as a CPU, a memory 1003 , and a communication bus 1002 .

[0052] The communication bus 1002 is used to realize the connection and communication between these components. The memory 1003 can be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1003 can also be a storage device independent of the aforementioned processor 1001.

[0053] Those skilled in the art will understand that Figure 1 The terminal structure shown in the figure does not constitute a limitation on the terminal, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0054] like Figure 1 As shown, the memory 1003 as a computer storage medium may include an operating system and a control program of the underwater robot.

[0055] exist Figure 1 In the terminal shown, the processor 1001 can be used to call the control program of the underwater robot stored in the memory 1003 and perform the following operations:

[0056] When the display viewing angle of the control terminal is switched, determining the orientation of the current display viewing angle relative to the controlled underwater robot;

[0057] Determining a current control coordinate system of the underwater robot according to the orientation, wherein a main direction of the control coordinate system is consistent with the orientation;

[0058] The underwater robot is controlled based on the received control instruction and the control coordinate system.

[0059] Further, the processor 1001 may call the control program of the underwater robot stored in the memory 1003, and further perform the following operations:

[0060] Determine the camera corresponding to the current display viewing angle;

[0061] If the camera is fixedly installed, obtaining the installation position of the camera on the underwater robot;

[0062] The orientation is determined based on the installation location.

[0063] Further, the processor 1001 may call the control program of the underwater robot stored in the memory 1003, and further perform the following operations:

[0064] Determine the camera corresponding to the current display viewing angle;

[0065] If the camera is installed on a supporting component, obtaining angle information of the supporting component;

[0066] The orientation is determined according to the angle information.

[0067] Further, the processor 1001 may call the control program of the underwater robot stored in the memory 1003, and further perform the following operations:

[0068] Determine a display mode corresponding to the current display viewing angle;

[0069] adjusting the body posture of the underwater robot according to the display mode;

[0070] The control coordinate system is determined according to the fuselage posture and the orientation.

[0071] Further, the processor 1001 may call the control program of the underwater robot stored in the memory 1003, and further perform the following operations:

[0072] When it is determined that a target locking instruction is received, determining a forward distance between the underwater robot and the tracking target according to the target locking instruction;

[0073] Determine the target position of the underwater robot according to the control coordinate system and the control instruction;

[0074] When the distance between the target position and the tracking target is greater than the forward distance, controlling the movement of the underwater robot with the forward distance;

[0075] When the distance between the target position and the tracking target is less than or equal to the forward distance, the underwater robot is controlled at the target position.

[0076] Further, the processor 1001 may call the control program of the underwater robot stored in the memory 1003, and further perform the following operations:

[0077] Determining an obstacle avoidance distance between the underwater robot and an obstacle;

[0078] Determine a target position of the underwater robot according to the control coordinate system and the control instruction, and determine a spacing distance between the robot and the obstacle according to the target position;

[0079] When the interval distance is greater than or equal to the obstacle avoidance distance, controlling the movement of the underwater robot with the control instruction;

[0080] When the interval distance is smaller than the obstacle avoidance distance, the underwater robot is controlled at the obstacle avoidance distance.

[0081] Further, the processor 1001 may call the control program of the underwater robot stored in the memory 1003, and further perform the following operations:

[0082] Determining a target moving direction of the underwater robot according to the control instruction and the control coordinate system;

[0083] Obtaining the water flow direction and water flow speed in the water area where the underwater robot is located;

[0084] Determining the moving direction and driving power of the underwater robot according to the target moving direction, the water flow direction and the water flow speed;

[0085] The underwater robot is controlled according to the moving direction and the driving power.

[0086] Further, the processor 1001 may call the control program of the underwater robot stored in the memory 1003, and further perform the following operations:

[0087] Obtaining the water flow direction and water flow speed in the water area where the underwater robot is located;

[0088] Generate a working environment demonstration animation according to the control coordinate system, the water flow direction and the water flow speed;

[0089] The working environment demonstration animation is displayed on the control terminal.

[0090] The following is an explanation of the content claimed in the claims of the present invention through specific exemplary schemes, so that those skilled in the art can better understand the scope of protection of the claims of the present invention. It is understood that the following exemplary schemes do not limit the scope of protection of the present invention, but are only used to explain the present invention.

[0091] For example, refer to Figure 2 In one embodiment of the control method of the underwater robot of the present invention, the control method of the underwater robot comprises the following steps:

[0092] Step S10: when the display viewing angle of the control terminal is switched, determining the orientation of the current display viewing angle relative to the controlled underwater robot;

[0093] In this embodiment, the subject that executes the control method of the underwater robot can be the underwater robot or the control terminal of the underwater robot. The control terminal establishes a communication connection with the underwater robot. Based on the communication connection, the control terminal can send the control instruction triggered by the operator to the underwater robot. After receiving the control instruction, the underwater robot can perform the corresponding action. The control instruction can be a variety of instructions for controlling the movement of the robot, including but not limited to movement control instructions, body posture adjustment control instructions, etc. When receiving the control instruction, the underwater robot moves or adjusts the body state accordingly. For example, when receiving a forward movement control instruction, the underwater robot moves forward, and when receiving a 180-degree rotation instruction, the underwater robot rotates 180 degrees accordingly.

[0094] The control terminal also includes a display screen, which can display images collected by the camera of the underwater robot and is used to display the underwater environment so that the operator can operate the underwater robot according to the underwater environment.

[0095] The underwater robot may have one or more cameras, including but not limited to optical cameras, acoustic cameras, etc., which can shoot at different positions relative to the controlled underwater robot to obtain display images with different shooting angles. The display angle of the control terminal is the shooting angle of the camera that captures the corresponding display image.

[0096] The display view switching of the control terminal can be triggered by the operator triggering the display view switching instruction, or it can be triggered automatically. For example, when the radar device determines that objects such as moving objects, set tracking targets, etc. appear in other directions other than the current display view relative to the controlled underwater robot, it can automatically switch to the display view corresponding to the direction of the object. The switching instruction can include the corresponding instruction of switching the camera of the shooting display screen, which is equivalent to the operator directly switching the camera of the shooting display screen; it can also include the corresponding instruction of switching the shooting direction of the display camera, which is equivalent to the operator adjusting the shooting direction of the camera shooting the display screen, such as changing the shooting direction of the camera by adjusting the pan / tilt; it can also include the instruction of switching the display screen of the target display area in the display screen, etc.

[0097] It should be noted that the display angle of view is also the shooting angle of view corresponding to the display screen that operators are most concerned about.

[0098] In some optional implementations, the display area of ​​the display screen only displays a display image captured by a camera, and this only display area is the target display area, and the shooting angle corresponding to this display image is the display angle. In other optional implementations, the display screen can be divided into multiple display areas, which can respectively display display images of different shooting angles.

[0099] Among them, the display area that the operator is most concerned about is considered to be the target display area. The target display area can be the largest display area, the most front display area, or the display area preset by the operator. When receiving an instruction to switch the display screen of the target display area, it is determined whether the shooting angle corresponding to the switched display screen is switched. If it is switched, it is determined that the display angle is switched, such as the display screen in the target display area is switched to the display screen of other display areas, and the shooting angle corresponding to the display screen of other display areas is different from the shooting angle of the target display area before switching. Exchange; if it is not switched, it is determined that the display angle is switched, such as the display screen in the target display area is switched to the display screen of other display areas, and the display screen of other display areas is a partial enlarged view of the display screen of the target display area, and the shooting angles of the two are the same.

[0100] For better understanding, a specific embodiment is provided: the display screen of the control terminal includes the largest display area 1, and other display areas 2, 3, and 4, wherein display area 1 is the target display area and is the display area that the operator is most concerned about. Display areas 1, 2, 3, and 4 currently display the display images a, b, c, and d captured by the front, rear, left, and right cameras A, B, C, and D installed on the underwater robot, respectively. If the operator wants to observe the underwater environment on the left side of the underwater robot, it is necessary to switch the left display image c to display area 1. The operator can click on display area 3 to trigger the display image switching instruction of display area 3 and display area 1. The display image of display area 1 is switched to display image c, and the display image of display area 3 is switched to display image a. It is determined that the display image of the target display area is switched and the corresponding shooting angle is also switched, and then it is determined that the display angle of the control terminal is switched.

[0101] Optionally, there are many ways to trigger the display perspective of the control terminal to switch, but the final result is that the display screen in the target display area switches. Therefore, it is possible to detect whether the shooting perspective corresponding to the display screen in the target display area switches. When the switch occurs, the orientation of the current display perspective relative to the controlled underwater robot is determined, thereby simplifying the program flow.

[0102] When the display angle of the display screen of the control terminal switches, the current display angle can be determined according to the shooting angle corresponding to the current display screen of the target display area, or according to the shooting angle corresponding to the switching instruction. The current display angle is the shooting angle of the camera that collects the display screen after the switching. The underwater robot camera is used to collect the underwater environment. It is a camera that collects the display screen radially from the underwater robot to the outside environment. Therefore, the orientation can be determined according to the shooting angle corresponding to the current display angle. Specifically, the shooting angle can be fitted into a visual cone, and the axis of the visual cone is used as the orientation of the display angle relative to the controlled underwater robot.

[0103] Step S20, determining a current control coordinate system of the underwater robot according to the orientation, wherein a main direction of the control coordinate system is consistent with the orientation;

[0104] In this embodiment, the current control coordinate system of the underwater robot is determined according to the orientation. The control coordinate system is the basis for the actual movement of the underwater robot. The underwater robot is driven to move according to the coordinate points in the control coordinate system. The control coordinate system is a coordinate system with the center of the underwater robot or the center of the camera that collects the display image corresponding to the current display angle as the origin. Each coordinate point on the control coordinate system corresponds to a different mobile control instruction. Different mobile control instructions correspond to different target moving directions and / or target moving distances. The control coordinate system includes multiple axes. The direction of each axis corresponds to the target moving direction of a mobile control instruction. Each axis also corresponds to different fuselage posture adjustment control instructions. Different fuselage posture adjustment control instructions correspond to different target rotation angles and target rotation directions. The axial direction of each axis corresponds to a target rotation direction corresponding to a fuselage posture adjustment control instruction. The direction corresponding to one of the axes is the main direction of the control coordinate system, which is also the main target moving direction of the control instruction. Generally, the control coordinate system includes three mutually perpendicular axes, and the three target moving directions corresponding to the three axes are also mutually perpendicular. The target moving direction corresponding to the control instruction for controlling forward movement is forward, and the control forward is taken as the main target moving direction, and the axis direction corresponding to the control instruction for controlling forward movement is taken as the main direction of the control coordinate line. When determining the control coordinate system, the main direction of the control coordinate system is set to be consistent with the orientation of the current display view angle relative to the controlled underwater robot, that is, the axis of the current display view angle corresponding to the shooting view angle is taken as the axis corresponding to the main direction of the control coordinate system.

[0105] For better understanding, refer to Figure 4The underwater robot includes two cameras A and B whose axes of shooting angle of view are perpendicular to each other. When the display angle of view of the control terminal corresponding to the camera switches from A to B, the control coordinate system switches from ① to ②, where the axis corresponding to the control instruction of the forward control is x, and the axis direction corresponding to x is the main direction of the control coordinate system. When the control coordinate system is ①, when the control instruction of the forward control is received, the underwater robot will go north, and when the control coordinate system is ②, when the control instruction of the forward control is received, the underwater robot will go east.

[0106] Step S30: Control the underwater robot based on the received control instruction and the control coordinate system.

[0107] In this embodiment, when a control instruction is received, the target moving direction and target moving distance, or the target rotation angle or target rotation direction corresponding to the control instruction are determined, and the target moving direction and target moving distance, or the target rotation angle or target rotation direction are mapped to the control coordinate system, and the corresponding coordinate point or rotation axis is found. The underwater robot moves according to the corresponding coordinate point, and performs body posture adjustment that conforms to the target rotation angle or target rotation direction according to the corresponding rotation axis. If the control coordinate system is different, then the same coordinate point or rotation axis will correspond to different motion results, and the control coordinate system can correspond to the current display perspective, so that the operator can control the underwater robot from the first-person perspective he sees, thereby reducing the difficulty of control.

[0108] In the technical solution disclosed in this embodiment, when the display perspective of the control terminal is switched, the current display perspective is determined relative to the position of the controlled underwater robot; the current control coordinate system of the underwater robot is determined according to the position, wherein the main direction of the control coordinate system is consistent with the position; and the underwater robot is controlled based on the received control instructions and the control coordinate system. In this way, when the display perspective is switched, the control coordinate system is changed accordingly, so that the main direction of the control coordinate system is consistent with the current perspective and the position of the controlled underwater device robot, so that the underwater robot is controlled with the current display perspective as the first-person perspective, so that the operation instructions and the movement of the underwater robot correspond. In the operation scene of the underwater robot, especially in the scene such as the anti-current scene where the operator needs to operate in real time and the operator has insufficient reaction time, it is very important to use the current display perspective as the first-person perspective, so as to reduce the difficulty of operating the underwater robot in underwater operation and improve the efficiency of underwater operation.

[0109] Further, step S10 includes:

[0110] Determine the camera corresponding to the current display viewing angle;

[0111] If the camera is fixedly installed, obtaining the installation position of the camera on the underwater robot;

[0112] The orientation is determined based on the installation location.

[0113] First, determine that the camera that collects the display screen of the current display angle is the camera corresponding to the current display angle. The camera can be a fixed underwater robot. If the camera corresponding to the current display angle is fixedly installed on the underwater robot, the relative position of the two will not change, and the shooting angle will not change. The installation position of the fixed camera can be determined by pre-storage and other methods, and then determine its shooting angle according to the installation position of the camera that collects the display screen of the current display angle, and then determine the position of the current display angle relative to the controlled underwater robot. There is still a risk of certain operating difficulty during the interval time of switching the control coordinate system. In this way, the position can be quickly determined, the time of switching the control coordinate system can be reduced, the operating difficulty of the underwater robot can be reduced, and the operation efficiency can be improved.

[0114] Further, step S10 includes:

[0115] Determine the camera corresponding to the current display viewing angle;

[0116] If the camera is installed on a supporting component, obtaining angle information of the supporting component;

[0117] The orientation is determined according to the angle information.

[0118] The camera can be an underwater robot that is not fixedly installed, and can be connected to the underwater robot through a support assembly, such as a horizontal pan-tilt, a vertical pan-tilt, a multi-axis pan-tilt, etc. By changing the angle of the support assembly angle, the relative position of the camera and the underwater robot can be changed, and the shooting angle will change with the support assembly. The shooting angle of the camera that collects the current display angle display image can be determined by combining the current angle information of the support assembly with the relative position relationship between the support assembly angle and the camera and the underwater robot, and then the current display angle relative to the controlled underwater robot is determined. The angle information of the support assembly is the relative angle between each vector support element in the support assembly, and the angle information of the support assembly can also become the structural information of the support assembly. There is still a risk of certain operating difficulty during the interval time of switching the control coordinate system. In this way, the orientation can be quickly determined and the time of switching the control coordinate system can be reduced. In addition, the adjustment of the support assembly can be synchronized with the control instruction, so that the adjustment of the two is consistent, which can reduce the difficulty of operation of the underwater robot and improve the working efficiency. In addition, changing the shooting angle by the support assembly can save the cost of installing the camera, and the diversity of the shooting angle can also be increased.

[0119] Further, step S20 includes:

[0120] Determine a display mode corresponding to the current display viewing angle;

[0121] adjusting the body posture of the underwater robot according to the display mode;

[0122] The control coordinate system is determined according to the fuselage posture and the orientation.

[0123] The display screen corresponding to the current display viewing angle has multiple display modes on the display screen, and the underwater robot's body posture is different for different display modes. In particular, in order to collect the display screen that meets the display mode, the underwater robot collects the display screen in different postures, such as vertical screen mode, horizontal screen mode, etc., and the frame of the display screen collected by the camera is generally fixed. Therefore, in order to make the collected display screen more suitable for the display mode, the body posture in the vertical screen mode is vertical, and the body posture in the horizontal screen mode is horizontal. For another example, when the operator turns on the local zoom mode of the display screen, the fuselage is required not to shake, so as to avoid instability of the local screen, then the fuselage posture can be a posture such as a slight tilt to buffer the water flow pressure. If the fuselage posture is different, the corresponding control coordinate system may also need to be changed. Therefore, after adjusting the fuselage posture according to the display mode, it is necessary to determine the control coordinate system according to the current fuselage posture and orientation.

[0124] For a better understanding, let's explain it in conjunction with a specific application scenario. Underwater operations often require underwater photography. Since the camera is generally horizontal, when the underwater robot moves in a horizontal posture, it can only take horizontal photos. If a vertical photo is required, it is necessary to crop it based on the horizontal photo, but this will result in a decrease in photo quality. When the operator needs to take a vertical picture, in order to preview the effect, the display mode of the control terminal will also be adjusted to the vertical screen mode. Therefore, according to the current display mode of the control terminal screen, the body posture is adjusted to a vertical state to obtain a high-quality vertical picture, and the control coordinate system is adjusted at the same time to reduce the difficulty of operation.

[0125] In this way, while changing the body posture through the display mode, the coordinate system can also be controlled, so that the underwater robot can still be controlled from the operator's first-person perspective, and the display mode can be changed as needed to better meet the operator's operating needs, reduce the operator's operating difficulty, and improve underwater operation efficiency.

[0126] Further, step S30 includes:

[0127] When it is determined that a target locking instruction is received, determining a forward distance between the underwater robot and the tracking target according to the target locking instruction;

[0128] Determine the target position of the underwater robot according to the control main direction and the control instruction;

[0129] When the distance between the target position and the tracking target is greater than the forward distance, controlling the movement of the underwater robot with the forward distance;

[0130] When the distance between the target position and the tracking target is less than or equal to the forward distance, the underwater robot is controlled at the target position.

[0131] In this embodiment, the target tracking mode can be started according to the target locking instruction, that is, the target is moved within a certain range from the tracking target. When the target locking instruction is received, the forward distance between the underwater robot and the tracking target is determined according to the target locking instruction. The forward distance is the maximum distance threshold between the underwater robot and the tracking target. The distance between the underwater robot and the tracking target cannot exceed the forward distance to achieve tracking of the target. The target moving direction and target moving distance of the underwater robot are determined according to the control coordinate system and the control instruction, and the target position is determined according to the target moving direction and the target moving distance. When the distance between the target position and the tracking target is greater than the forward distance, the target moving direction is used as the actual moving direction of the robot, and the forward distance is used as the final actual distance between the underwater robot and the tracking target to control the movement of the underwater robot. When the distance between the target position and the tracking target is less than or equal to the forward distance, the underwater robot can be directly controlled to move by the control instruction. The underwater robot can also measure the distance between it and the tracking target in real time through a multi-beam sonar or a single-beam sonar. When the distance is greater than the forward distance, the underwater robot can be controlled to move according to the difference between the real-time measured distance and the forward distance.

[0132] This can ensure that the underwater robot always moves within the forward distance of the tracking target, reduce the difficulty of target tracking and moving the underwater robot for operators, and improve operational efficiency.

[0133] Further, step S30 includes:

[0134] Determining an obstacle avoidance distance between the underwater robot and an obstacle;

[0135] Determine a target position of the underwater robot according to the control coordinate system and the control instruction, and determine a spacing distance between the robot and the obstacle according to the target position;

[0136] When the interval distance is greater than or equal to the obstacle avoidance distance, controlling the movement of the underwater robot with the control instruction;

[0137] When the interval distance is smaller than the obstacle avoidance distance, the underwater robot is controlled at the obstacle avoidance distance.

[0138] In this embodiment, the obstacle avoidance mode can be activated, that is, after the obstacle is determined, the robot moves outside a certain range from the obstacle. When the obstacle avoidance mode activation command is received, it is determined whether there is an obstacle nearby. When the position of the obstacle is determined, the obstacle avoidance distance between the underwater robot and the obstacle set in the obstacle avoidance mode is determined. The distance between the underwater robot and the obstacle cannot be less than the obstacle avoidance distance to achieve obstacle avoidance. The target position of the underwater robot movement is determined according to the control coordinate system and the control command, and the interval distance between the robot and the obstacle is determined according to the target position; when the interval distance is greater than or equal to the obstacle avoidance distance, the movement of the underwater robot is controlled by the control command; when the interval distance is less than the obstacle avoidance distance, the movement of the underwater robot is controlled by the obstacle avoidance distance. In this way, it can be ensured that the underwater robot always moves outside the obstacle avoidance range corresponding to the obstacle, reducing the difficulty of the operator to avoid obstacles and move the underwater robot, and improving the working efficiency.

[0139] Optionally, refer to Figure 3 Based on any of the above embodiments, in another embodiment of the control method of the underwater robot of the present invention, the step S30 includes:

[0140] Step S31, determining the target moving direction of the underwater robot according to the control instruction and the control coordinate system;

[0141] Step S32, obtaining the water flow direction and water flow speed in the water area where the underwater robot is located;

[0142] Step S33, determining the moving direction and driving power of the underwater robot according to the target moving direction, the water flow direction and the water flow speed;

[0143] Step S34: controlling the underwater robot according to the moving direction and the driving power.

[0144] In this embodiment, since there is a certain impulse in the water flow, the moving trajectory of the underwater robot will be changed, so that the actual moving direction of the underwater robot is not the moving path expected by the operator, which makes the operator's controllability of the underwater robot lower. Therefore, after the target moving direction of the underwater robot is determined by the control instructions and the control coordinate system, the water flow direction and water flow speed of the water area where the underwater robot is located are also obtained, and the water flow effect can be offset according to the correspondence between the water flow direction, water flow speed and target moving direction, and the actual movement of the robot can be kept in the target moving direction, the moving direction and the driving power, wherein the moving direction is the moving direction of the robot, and the driving power can represent the power provided by the underwater robot to the movement, and the underwater robot is controlled according to the moving direction and the driving power.

[0145] In the disclosed scheme of this embodiment, by obtaining the water flow velocity and direction, the moving direction and driving power that can offset the effect of the water flow are calculated to control the movement of the robot, so that the actual moving direction of the underwater robot is consistent with the target moving direction expected by the operator, thereby improving the operator's controllability of the underwater robot, reducing the difficulty of operation, and improving work efficiency.

[0146] Optionally, based on any of the above embodiments, in another embodiment of the control method of the underwater robot of the present invention, before step S30, the method further includes:

[0147] Obtaining the water flow direction and water flow speed in the water area where the underwater robot is located;

[0148] Generate a working environment demonstration animation according to the control coordinate system, the water flow direction and the water flow speed;

[0149] The working environment demonstration animation is displayed on the control terminal.

[0150] In this embodiment, refer to Figure 5 , obtain the water flow direction and water flow speed of the water area where the underwater robot is located, and generate an operating environment demonstration animation according to the current display perspective relative to the current control coordinate system, water flow direction and water flow speed of the controlled underwater robot. The operating environment demonstration animation can show the effect of water flow and the current first-person control perspective of the underwater robot. The operating environment demonstration animation is displayed on the control terminal. The operating environment demonstration animation can be overlapped and displayed on the display screen corresponding to the current display perspective, so that the operator can view the display screen and the operating environment demonstration animation at the same time to understand the water flow situation, which is convenient for the operator to actively offset the effect of water flow during operation, and it is easier to achieve the operation purpose, reduce the difficulty of operation, and improve the operation efficiency.

[0151] In addition, an embodiment of the present invention also proposes an underwater robot, which includes a memory, a processor, and a control program of the underwater robot stored in the memory and runnable on the processor. When the control program of the underwater robot is executed by the processor, the steps of the underwater robot control method described in the above embodiments are implemented.

[0152] In addition, an embodiment of the present invention further proposes a computer-readable storage medium, on which a control program of an underwater robot is stored. When the control program of the underwater robot is executed by a processor, the steps of the control method of the underwater robot described in the above embodiments are implemented.

[0153] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0154] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0155] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for enabling the underwater robot or the control terminal corresponding to the underwater robot to execute the methods described in each embodiment of the present invention.

[0156] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A control method for an underwater robot, It is characterized in that The control method of the underwater robot comprises: When the display viewing angle of the control terminal is switched, determining the orientation of the current display viewing angle relative to the controlled underwater robot; Determining a current control coordinate system of the underwater robot according to the orientation, wherein a main direction of the control coordinate system is consistent with the orientation; Controlling the underwater robot based on the received control instruction and the control coordinate system; The step of controlling the underwater robot based on the received control instruction and the control coordinate system comprises: determining an obstacle avoidance distance between the underwater robot and an obstacle; determining a target position for movement of the underwater robot according to the control coordinate system and the control instruction, and determining a spacing distance between the robot and the obstacle according to the target position; when the spacing distance is greater than or equal to the obstacle avoidance distance, controlling the movement of the underwater robot with the control instruction; when the spacing distance is less than the obstacle avoidance distance, controlling the underwater robot with the obstacle avoidance distance; or The step of controlling the underwater robot based on the received control instructions and the control coordinate system includes: determining the target moving direction of the underwater robot according to the control instructions and the control coordinate system; obtaining the water flow direction and water flow speed in the water area where the underwater robot is located; determining the moving direction and driving power of the underwater robot according to the target moving direction, the water flow direction and the water flow speed; and controlling the underwater robot according to the moving direction and the driving power.

2. The control method of the underwater robot according to claim 1, It is characterized in that The step of determining the moving direction and driving power of the underwater robot according to the target moving direction, the water flow direction and the water flow speed comprises: By obtaining the water flow speed and water flow direction, the moving direction and driving power of the underwater robot that can offset the water flow effect are calculated; The step of controlling the underwater robot according to the moving direction and the driving power comprises: The underwater robot is controlled to move so that the actual moving direction of the underwater robot is consistent with the target moving direction.

3. The control method of the underwater robot according to claim 1, It is characterized in that Each coordinate point on the control coordinate system corresponds to a different movement control instruction, and different movement control instructions correspond to different target movement directions and / or target movement distances. The control coordinate system includes multiple axes, and the direction of each axis corresponds to a target movement direction of the movement control instruction.

4. The control method of the underwater robot according to claim 1, It is characterized in that The step of determining the position of the current display viewing angle relative to the controlled robot comprises: Determine the camera corresponding to the current display viewing angle; If the camera is fixedly installed, obtaining the installation position of the camera on the underwater robot; The orientation is determined based on the installation location.

5. The control method of the underwater robot according to claim 1, It is characterized in that The step of determining the position of the current display viewing angle relative to the controlled robot comprises: Determine the camera corresponding to the current display viewing angle; If the camera is installed on a supporting component, obtaining angle information of the supporting component; The orientation is determined according to the angle information.

6. The control method of the underwater robot according to claim 1, It is characterized in that The step of determining the current control coordinate system of the underwater robot according to the orientation comprises: Determine a display mode corresponding to the current display viewing angle; adjusting the body posture of the underwater robot according to the display mode; The control coordinate system is determined according to the fuselage posture and the orientation.

7. The control method of the underwater robot according to claim 1, It is characterized in that Before the step of determining the position of the current display viewing angle relative to the controlled underwater robot when the display viewing angle of the control terminal is switched, the method further includes: Dividing the display screen of the control terminal into multiple display areas, and determining a target display area among the multiple display areas; When an instruction to switch the display screen of the target display area is received, it is determined whether the shooting angle corresponding to the switched display screen is switched. If so, it is correspondingly determined that the display angle is switched.

8. An underwater robot, It is characterized in that The underwater robot comprises: a memory, a processor, and a control program of the underwater robot stored in the memory and executable on the processor. When the control program of the underwater robot is executed by the processor, the steps of the control method of the underwater robot as described in any one of claims 1 to 7 are implemented.

9. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a control program of the underwater robot, and when the control program of the underwater robot is executed by the processor, the steps of the control method of the underwater robot according to any one of claims 1 to 7 are implemented.