Three-dimensional color map building robot

By combining lidar with monocular camera and using the gimbal mechanism rotation control, the problem of solid-state lidar with small coverage in indoor map construction is solved, and the full perception of mobile robots is realized, and the flexibility and universality of map construction are improved. reduces sensor requirements.

CN222079274UActive Publication Date: 2024-11-29SOUTH CHINA UNIV OF TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202420388190.8
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2024-02-29
Publication Date
2024-11-29
Estimated Expiration
2034-02-28

AI Technical Summary

Technical Problem

In the prior art, solid-state lidar has a problem of small coverage in indoor map construction and cannot achieve full coverage of 360 degrees, resulting in blind spots around mobile robots. Adding sensors or motions to make up for perceived blind spots but increasing cost and efficiency differences, lack of general Adaptability.

Method used

Design a three-dimensional color map construction robot, combining lidar and monocular camera, and realize rotation control of lidar, monocular camera and IMU sensor through a gimbal mechanism, improve data acquisition flexibility, reduce sensor needs, and achieve all-round perception.

Benefits of technology

It realizes all-terrain coverage scanning of mobile robots in complex environments, reduces the requirements for sensors and chassis construction in color maps, improves flexibility and universality, and improves intelligence.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN222079274U_ABST
    Figure CN222079274U_ABST
Patent Text Reader

Abstract

The utility model discloses a three-dimensional color map building robot which comprises a computer for integral control, a mobile robot chassis module, a man-machine interaction module, a holder module and a map building module. The map building robot is arranged on a four-wheel differential moving chassis; in the cradle head module, a cradle head motor is connected with a movable chassis through a cradle head bracket; the laser radar, the industrial camera and the IMU sensor are fixed to the free end of the holder motor through aluminum alloy plates. According to the utility model, environment information acquired by the laser radar and the monocular camera is combined, and rotation control of the laser radar, the monocular camera and the IMU sensor is realized through the holder mechanism, so that data acquisition flexibility is improved, and requirements of the color map building robot on the sensor are reduced; and meanwhile, the problem that all-terrain coverage scanning cannot be achieved due to the fact that the mobile robot is difficult to steer in a complex environment is solved, and the intelligent degree of warehousing, parks and public service industries is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The utility model relates to the field of robots, in particular to a three-dimensional color map building robot. Background Art

[0002] Driven by the continuous progress of mobile robots and intelligent driving technology, intelligent unmanned systems are becoming more and more widely used in modern applications, such as sweeping robots in smart homes, delivery vehicles in smart logistics, and unmanned combat vehicles in smart battlefields. The research on unmanned mobile robots and related technologies has an important impact on improving the quality of life and military operations.

[0003] Map construction provides the basis for positioning and navigation of mobile robots. By constructing an environmental map, mobile robots can accurately determine their own position and plan the optimal path for navigation. Map construction technology can help mobile robots achieve autonomous positioning and navigation, and improve their mobility and flexibility in complex environments (Gomez-Ojeda R, Zuiga-Nol D, Moreno FA, et al. PL-SLAM: a Stereo SLAM System through the Combination of Points and Line Segments [J]. arXiv, 2017. DOI: 10.1109 / TRO.2019.2899783.). The more map information a mobile robot obtains, the higher its ability and freedom of movement in the map. Attaching color to the map can provide more information for the mobile robot. At the same time, in a fixed field, it can further realize functions such as object search through an external server. However, most of the maps currently on the market use laser radar to complete map construction, and the resulting maps only have distance features but no color features.

[0004] At present, most map construction modules in indoor environments use mechanical laser radars. Solid-state laser radars have higher reliability and response speed than traditional mechanical laser radars (Wang Z, Wang Q, Han X, et al. A Low-Cost High-Resolution Solid-State Lidar With Wavelength Division Multiplexed Components and Interleaved Orthogonal Polarization Grating Couplers [J]. Journal of Lightwave Technology, 40 [2024-02-27]. DOI: 10.1109 / JLT.2021.3133462.), but solid-state laser radars have a small coverage range and cannot achieve 360-degree full coverage, resulting in blind spots around the mobile robot, which brings inconvenience to the map construction of the mobile robot. To address this problem, there are currently two main solutions for outdoor map construction. One is to add sensor devices to increase the perception range of the mobile robot and improve a map with the information obtained, but adding sensors undoubtedly increases the cost of the mobile robot. The second method is to make up for the blind spots in perception by moving the mobile robot itself, but since the mobile robot needs to move, the efficiency of map building is inevitably reduced. At the same time, due to the limitation of the movement mode of the mobile robot, the efficiency impact is also quite different and not universal. Utility Model Content

[0005] The main purpose of the utility model is to overcome the shortcomings and deficiencies of the prior art and design a three-dimensional color map construction robot. The environmental information obtained by the laser radar and the monocular camera is combined, and a pan-tilt mechanism is innovatively designed. The rotation control of the laser radar, monocular camera and IMU sensor is realized through the pan-tilt mechanism, which improves the flexibility of data collection and reduces the demand for sensors of the color map construction robot. At the same time, it improves the problem of the difficulty of turning the mobile robot in complex environments, which leads to the inability to cover the entire terrain and scan. At the same time, it is universal for robots with different mobile modes, and improves the intelligence level of warehousing, parks, and public service industries.

[0006] The utility model is implemented by at least one of the following technical solutions.

[0007] A three-dimensional color map construction robot, comprising a mobile robot chassis module, a human-machine interaction module, a pan-tilt module, and a map construction module;

[0008] The mobile robot chassis module is used to carry various modules of the robot and realize the mobile function;

[0009] The mobile robot is equipped with a computer for controlling the movement of the mobile robot, the pan / tilt module, the map construction module and the human-computer interaction module;

[0010] The human-machine interaction module includes multiple input and output devices, which are installed on the vehicle chassis to complete the interaction between the operator and the robot;

[0011] The pan / tilt module is used to control the rotation of the map construction module;

[0012] The map construction module is installed at the free end of the pan-tilt module, and includes a laser radar, an industrial camera, and an IMU sensor, which are used to obtain environmental information around the robot and construct a color map.

[0013] Furthermore, the mobile robot chassis module includes a body, an aluminum alloy plate, a wheel set, a power control module, and an external expansion module, wherein the movement of the robot is a four-wheel differential drive; the power control module realizes power supply to various electrical equipment of the robot through voltage transformation, including computers, motors, and various sensors; and each module is installed on the body through an aluminum plate.

[0014] Furthermore, the computer is installed on the rear half of the robot body and is used to control the movement of the mobile robot, process the information obtained by the sensor, and control corresponding equipment, including the motor and the display screen.

[0015] Furthermore, the human-computer interaction module includes a touch display screen, a speaker, a microphone or a microphone array.

[0016] Furthermore, the pan-tilt module includes a pan-tilt motor, and the pan-tilt module is fixed to the vehicle chassis via a pan-tilt bracket, wherein the fixed end of the pan-tilt motor is connected to the pan-tilt bracket via a plate.

[0017] Furthermore, the map construction module includes a laser radar, an industrial camera, and an IMU sensor. The sensor is fixed to the free end of the gimbal motor through a fixing part and rotates with the free end of the gimbal motor.

[0018] Furthermore, the external expansion module includes an emergency stop switch, a power switch, an external control switch, a power display, a charging interface, a power output interface, and a communication interface.

[0019] Furthermore, the display screen is connected to the computer bracket via a multi-degree-of-freedom fixed bracket to achieve free rotation at three angles.

[0020] Furthermore, the laser radar adopts a solid-state laser radar, and the laser radar and the industrial camera can achieve full coverage scanning of the surrounding environment of the mobile robot through the rotation of the pan-tilt platform.

[0021] Furthermore, the mobile robot chassis module is configured with a large area of ​​aluminum alloy plate, which has sufficient space for expanding external sensors or configuring related equipment.

[0022] Compared with the prior art, the utility model has the following advantages and beneficial effects:

[0023] 1. The utility model greatly reduces the space required for the sensor and the overall mass through a compact spatial arrangement, which is beneficial to the lightweight design of the robot.

[0024] 2. The pan / tilt module of the utility model can realize all-round perception of the robot while maintaining the advantages of solid-state laser radar, improve the flexibility of mobile robot map construction, and reduce the requirements of color map construction on sensors and mobile robot chassis. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 It is a structural schematic diagram of the three-dimensional color map construction robot in the utility model;

[0026] Figure 2 It is a partial structural diagram of the robot pan-tilt and map building module in the utility model;

[0027] Figure 3 It is a schematic diagram of the human-computer interaction module of the utility model;

[0028] Figure 4 This is a schematic diagram of the external expansion module of the chassis of the mobile robot of the utility model;

[0029] Explanation of the figure numbers: 1-touch screen; 2-wheel set; 3-chassis external expansion module; 4-body; 5-aluminum alloy plate; 6-pan head fixing parts; 7-pan head bracket; 8-power control module; 9-computer; 10-computer bracket; 11-computer fixing parts; 12-IMU sensor; 13-industrial camera; 14-radar expansion board; 15-laser radar; 16-radar fixing plate; 17-pan head motor; 18-bracket expansion board; 19-motor fixing plate; 20-microphone; 21-speaker; 22-multi-degree-of-freedom fixed bracket; 23-emergency stop switch; 24-communication interface; 25-power display; 26-external control switch; 27-power switch; 28-charging interface; 29-power output interface. DETAILED DESCRIPTION

[0030] The present invention is further described in detail below in conjunction with embodiments and drawings, but the implementation manner of the present invention is not limited thereto.

[0031] This section will describe in detail the specific embodiments of the utility model. The preferred embodiments of the utility model are shown in the accompanying drawings. The purpose of the accompanying drawings is to supplement the description of the text part of the specification with graphics, so that people can intuitively and vividly understand each technical feature and the overall technical solution of the utility model, but it cannot be understood as a limitation on the protection scope of the utility model.

[0032] In the description of the present invention, it should be understood that descriptions involving orientation, such as up, down, front, back, left, right, etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention.

[0033] In the description of the present utility model, "several" means one or more, "more" means more than two, "greater than", "less than", "exceed" etc. are understood to exclude the number itself, and "above", "below", "within" etc. are understood to include the number itself. If there is a description of "first" or "second", it is only used for the purpose of distinguishing the technical features, and cannot be understood as indicating or implying the relative importance or implicitly indicating the number of the indicated technical features or implicitly indicating the order of the indicated technical features.

[0034] In the description of the present invention, unless otherwise clearly defined, terms such as setting, installing, connecting, etc. should be understood in a broad sense, and technicians in the relevant technical field can reasonably determine the specific meanings of the above terms in the present invention based on the specific content of the technical solution.

[0035] like Figure 1 As shown, a three-dimensional color map building robot of this embodiment includes a computer 9 for overall control, a mobile robot chassis module, a human-computer interaction module, a pan-tilt module and a map building module.

[0036] like Figure 1 As shown, the computer 9 for overall control is fixed to a computer bracket 10 and is connected to the aluminum alloy plate 5 via a computer fixing part 11 .

[0037] like Figure 1 , Figure 2 and Figure 3 As shown, the mobile robot chassis module includes a wheel set 2, a chassis external expansion module 3, a vehicle body 4, an aluminum alloy plate 5 and a power control module 8;

[0038] The human-computer interaction module includes a plurality of input and output devices, specifically including a touch screen 1, a microphone 20 and a speaker 21 integrated in the screen 1;

[0039] The pan-tilt module includes a pan-tilt fixing member 6, a pan-tilt bracket 7, a motor fixing plate 19, a bracket expansion plate 18, and a pan-tilt motor 17; the pan-tilt module is fixed to the vehicle body aluminum alloy plate 5 through the pan-tilt fixing member 6 and the pan-tilt bracket 7, wherein the fixed end of the pan-tilt motor 17 is connected to the pan-tilt bracket 7 through the motor fixing plate 19. The motor fixing plate 19 is located on the bracket expansion plate 18.

[0040] The map construction module includes an IMU sensor 12 , an industrial camera 13 , a laser radar 15 , a radar expansion board 14 , and a radar fixing board 16 .

[0041] The computer fixing part 11 and the pan / tilt fixing part 6 are metal plates with screw holes, and are used to fix the corresponding components.

[0042] In this embodiment, the chassis of the mobile robot is used to carry the remaining functional modules of the robot and realize the mobile function. The chassis includes four sets of drive wheels 1, and through the differential drive of the four sets of drive wheels, the mobile robot can realize the rotational motion, linear motion, and curved motion of a certain arc. The power control module 8 is used for the power distribution of external sensors other than the chassis, and also includes the power distribution of the human-computer interaction module, the computer 9, the pan-tilt module and the map construction module. The aluminum alloy plate 5 provides a fixed position for the external expansion equipment, is located on the upper part of the vehicle body 4, and can be used to expand external sensor equipment, storage devices or other available service devices.

[0043] like Figure 4 As shown, in this embodiment, the chassis external expansion module 3 includes an emergency stop switch 23, a power switch 27, an external control switch 26, a power display 25, a charging interface 28, a power output interface 29, and a communication interface 24. More external functions can be expanded through the chassis external expansion module.

[0044] like Figure 3 As shown, the touch screen 1 in the human-computer interaction module is connected to the computer bracket 10 through a multi-degree-of-freedom fixing bracket 22. The multi-degree-of-freedom fixing bracket can realize three-angle rotation and fixation at any position. The microphone and speaker are installed on the touch display, and the touch screen 1 can adjust the tilt angle for people to touch and control to realize the interactive function. At the same time, the microphone 20 is used to collect voice information, realize the corresponding function after computer processing, and complete the corresponding feedback through the speaker 21.

[0045] As an embodiment, the computer is equipped with an AMD Ryzen 3 3200G CPU, 8G memory, more than 100G hard disk space, an Ubuntu 18.04 operating system, and a DELL-430-E5-2603v3 data storage server. It is used to control the movement of the mobile robot, process the information obtained by the sensor, and control the corresponding equipment.

[0046] The laser radar 15 adopts Livox Mid-70 solid-state laser radar. The laser radar 15 is installed on the free end of the pan-tilt motor 17 through the radar fixing plate 16. The detection angle in the horizontal direction is 70.4°, and the detection angle in the vertical direction is 70.4°. The radar fixing plate 16 is used to connect the laser radar 15 and the pan-tilt motor 17. The radar fixing plate 16 is an aluminum alloy plate with a thickness of not less than 4mm, which ensures sufficient rigidity and good followability when the pan-tilt motor rotates. The IMU sensor 12 and the industrial camera 13 are installed above the laser radar through the radar expansion board 14. The radar expansion board 14 is installed with the laser radar housing fixed threaded hole through fixing screws. The industrial camera 13 and the laser radar 15 are in the same direction. The detection angle of the industrial camera 13 in the horizontal direction is 100°, and the vertical detection angle is 72°. The pan-tilt module realizes the motion control of the map construction module through the drive of the pan-tilt motor 17, and drives the laser radar 15, the industrial camera 13 and the IMU sensor 12 through rotation. The flexible rotation of the map building module can complete all-round detection of the robot's surrounding environment without moving the mobile robot chassis.

[0047] As an embodiment, the three-dimensional color map construction robot can also be applied to virtual reality scenes. The three-dimensional information of the scene can be saved by the color map construction robot, and its color characteristics can be obtained through the camera. The obtained three-dimensional color map may have resolution problems due to the particle nature of the laser radar. A high-resolution color map can be obtained by smoothing the obtained map through filtering. The combination of high-resolution color maps and virtual reality technology can allow more people to experience scenes that are difficult to reach. At the same time, the color map construction module can be configured on a drone, and the map construction module and the gimbal module can be installed on the drone, and a device for controlling pitch can be added as needed to achieve map construction for more scenes.

[0048] In some 3D color map construction robots, if the application scenario is not for the traditional flat environment, but for the outdoor rugged road scene. For such cases, the chassis of the mobile robot can be replaced with off-road tires, and the corresponding drive mode can be changed to the Ackerman structure. The active steering function of the front wheels can greatly improve the flexibility of the robot's movement, while reducing the slippage between the tires and the ground during rotation, reducing tire wear, and improving the movement performance of the mobile robot in rugged environments. Four-wheel drive or rear-wheel drive can be selected according to the requirements of the external site.

[0049] The structure of the remaining three-dimensional color map building robot is consistent with the above. Through the above improvements, the three-dimensional color map building robot provided by the utility model can be applied to outdoor rugged road scenes, that is, the driving mode and tires of the mobile robot chassis are replaced, and the method can still effectively complete the map building work.

[0050] For scenic spots, hotels and other places with display or publicity needs, the three-dimensional color map construction robot can be configured with a corresponding display module on the aluminum alloy plate 5, and the robot can build a color map to restore the three-dimensional color map in the corresponding display module. At the same time, combined with relevant publicity animations, a more intuitive browsing effect can be achieved. At the same time, the corresponding publicity device or storage device can be configured on the aluminum alloy plate 5 to make it better in display and practicality.

[0051] It should also be noted that in this specification, terms such as "comprises", "includes" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of more restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0052] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A three-dimensional color map construction robot, It is characterized in that It includes mobile robot chassis module, human-computer interaction module, gimbal module, and map construction module; The mobile robot chassis module is used to carry various modules of the robot and realize the mobile function; The mobile robot is equipped with a computer for controlling the movement of the mobile robot, the pan / tilt module, the map construction module and the human-computer interaction module; The human-machine interaction module includes multiple input and output devices, which are installed on the vehicle chassis to complete the interaction between the operator and the robot; The pan / tilt module is used to control the rotation of the map construction module; The map construction module is installed at the free end of the pan-tilt module, and includes a laser radar, an industrial camera, and an IMU sensor, which are used to obtain environmental information around the robot and construct a color map.

2. A three-dimensional color map construction robot according to claim 1, It is characterized in that The mobile robot chassis module includes a body, an aluminum alloy plate, a wheel set, a power control module, and an external expansion module, wherein the movement of the robot is driven by a four-wheel differential; the power control module supplies power to the robot's electrical equipment through voltage conversion, including computers, motors, and various sensors; and each module is mounted on the body through an aluminum plate.

3. A three-dimensional color map construction robot according to claim 1, It is characterized in that The computer is installed on the rear half of the robot body and is used to control the movement of the mobile robot, process information obtained by sensors, and control corresponding equipment, including motors and display screens.

4. A three-dimensional color map construction robot according to claim 1, It is characterized in that The human-computer interaction module includes a touch display screen, a speaker, a microphone or a microphone array.

5. A three-dimensional color map construction robot according to claim 1, It is characterized in that The pan-tilt module includes a pan-tilt motor, and the pan-tilt module is fixed to the vehicle chassis through a pan-tilt bracket, wherein the fixed end of the pan-tilt motor is connected to the pan-tilt bracket through a plate.

6. A three-dimensional color map construction robot according to claim 1, It is characterized in that The map construction module includes a laser radar, an industrial camera, and an IMU sensor. The sensor is fixed to the free end of the gimbal motor through a fixing part and rotates with the free end of the gimbal motor.

7. A three-dimensional color map construction robot according to claim 2, It is characterized in that The external expansion module includes an emergency stop switch, a power switch, an external control switch, a power display, a charging interface, a power output interface, and a communication interface.

8. A three-dimensional color map construction robot according to claim 4, It is characterized in that The display screen is connected to the computer bracket via a multi-freedom fixed bracket to achieve free rotation at three angles.

9. A three-dimensional color map construction robot according to claim 6, It is characterized in that The laser radar adopts a solid-state laser radar, and the laser radar and industrial camera achieve full coverage scanning of the surrounding environment of the mobile robot through the rotation of the pan-tilt platform.

10. A three-dimensional color map construction robot according to claim 1, It is characterized in that The mobile robot chassis module is configured with aluminum alloy plates and has sufficient space for expanding external sensors or configuring related equipment.