Information processing device, information processing method, and information processing program
By using the map creation unit on the autonomous mobile body to generate a map with angle information based on the obstacle position and angle information, the problem of 2D-LiDAR misidentifying obstacles in a slope environment is solved, low-cost travel control is achieved, and the improvement of Mobility of moving bodies.
Patent Information
- Application Number
- CN202380023387.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-16
- Filing Date
- 2023-02-21
- Publication Date
- 2024-11-01
AI Technical Summary
When existing autonomous moving bodies through map matching through 2D-LiDAR travel in a slope environment, obstacles are easily misidentified and obstacles are caused. The three-dimensional LiDAR and depth camera devices are costly or are greatly affected by the environment.
Using an information processing device, a map with angle information is created through a map creation unit based on obstacle position information and angle information, and a map with angle information is generated using 2D-LiDAR to detect the environment and combine the posture information of the IMU to generate a map with angle information to improve the travel of autonomous moving bodies. Control ability.
Without increasing costs, the ability of autonomous moving bodies to travel in a slope environment will be improved, the occurrence of misidentified obstacles will be reduced, and mobility will be enhanced.
Smart Images

Figure CN118891664A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an information processing device, an information processing method, and an information processing program. Background Art
[0002] An autonomous mobile body that moves autonomously using an estimation of its own position by map matching is known. In an autonomous mobile body, autonomous movement is achieved by estimating its own position based on an environmental reference map detected using a sensor and controlling the travel speed, travel direction, etc. according to the estimated own position. As a sensor for such an autonomous mobile body, two dimensions-laser imaging detection and ranging (2D-LiDAR) that acquires the environment as two-dimensional information is generally used. Patent document 1 discloses a technology for estimating the position of a mobile device based on a ranging result.
[0003] Citation List
[0004] Patent Literature
[0005] Patent Document 1: JP 2009-294104 A Summary of the invention
[0006] Technical issues
[0007] In conventional own position estimation by map matching using 2D-LiDAR, in many cases, it is assumed that a cart-type autonomous mobile body whose posture does not change travels on a horizontal surface. In such a system, there are cases where a slope is determined as an obstacle site and travel is impeded. There are also cases where the appearance of the surrounding environment changes due to a change in the posture of the own device and an erroneous determination occurs in map matching.
[0008] On the contrary, it is also conceivable to install a sensor such as a three-dimensional (3D) LiDAR or a depth camera device capable of acquiring three-dimensional information on an autonomous mobile body and recognize the environment as three-dimensional information. However, 3D-LiDAR has the following problems: it has many restrictions on the attachment position and its cost increases. The depth camera device has a problem that the measurable distance is relatively short and is easily affected by changes in the environment such as brightness.
[0009] An object of the present disclosure is to provide an information processing device, an information processing method, and an information processing program that can improve the mobility of an autonomous mobile body at low cost.
[0010] Solution to the problem
[0011] In order to solve the above-mentioned problems, according to one aspect of the present disclosure, an information processing device has a map creation unit, which creates a map based on obstacle position information and angle information, wherein the obstacle position information indicates the location of an obstacle that hinders the travel of a mobile device, and the angle information indicates the angle of the mobile device at each travel position of the mobile device. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Figure 1 is a schematic diagram showing an example of a map according to the related art.
[0013] Figure 2 1 is a schematic diagram for describing a first example in the case of recognizing a surrounding environment using 2D-LiDAR according to the prior art.
[0014] Figure 3 2 is a schematic diagram for describing a second example in the case of recognizing a surrounding environment using 2D-LiDAR according to the related art.
[0015] Figure 4 is a block diagram showing a configuration of an example of a mobile device as an autonomous mobile body applicable to each embodiment.
[0016] Figure 5 is a block diagram showing a configuration of an example of an information processing device applicable to each embodiment.
[0017] Figure 6 is a functional block diagram for describing an example of the functions of the information processing apparatus according to each embodiment.
[0018] Fig. 7A This is a functional block diagram for describing an example of functions used in map creation in an information processing device.
[0019] Figure 7B is a functional block diagram for describing an example of functions in an information processing device that are used when the mobile device is traveling.
[0020] Figure 8 is a flowchart showing an example of a map creation process applicable to each embodiment.
[0021] Fig. 9 is a schematic diagram showing an example of a map with angle information created in the first embodiment.
[0022] Fig.10 : is a schematic diagram showing an example of the data structure of a map with angle information according to the first embodiment.
[0023] Fig.11 is a schematic diagram showing a specific example of a map with angle information according to the first embodiment.
[0024] Fig.12 is a schematic diagram showing a specific example of a map with angle information according to the first embodiment.
[0025] Fig.13 is a schematic diagram for describing a method of acquiring normal information applicable to the second embodiment.
[0026] Fig.14 : is a schematic diagram showing an example of a map having an angle according to a normal vector according to the second embodiment.
[0027] Fig.15 : is a schematic diagram showing an example of the data structure of a map with angle information according to the second embodiment.
[0028] Fig.16 is a schematic diagram showing an example of the data structure of a map with angle information according to the third embodiment.
[0029] Fig.17 is a schematic diagram showing an example of a map with angle information created by the method according to the fourth embodiment. DETAILED DESCRIPTION
[0030] Hereinafter, embodiments of the present disclosure are described in detail with reference to the accompanying drawings. Note that in the following embodiments, the same parts are denoted by the same reference numerals, and redundant descriptions are omitted.
[0031] Hereinafter, embodiments of the present disclosure will be described in the following order.
[0032] 1. About the prior art
[0033] 2. Overview of implementation methods
[0034] 2-1. Configuration applicable to each embodiment
[0035] 2-2. Map creation process applicable to each embodiment
[0036] 3. First Implementation
[0037] 4. Second Implementation
[0038] 5. Third Implementation
[0039] 6. Fourth embodiment
[0040] (1. About the prior art)
[0041] Before describing each embodiment of the present disclosure, the prior art will be described for the purpose of understanding.
[0042] Regarding the operation of a mobile device that travels autonomously (hereinafter, an autonomous mobile body), generally known is a technology for controlling the travel of the autonomous mobile body by using a pre-created obstacle location map in which obstacle locations that hinder the travel of the autonomous mobile body are described.
[0043] Figure 1 FIG. 1 is a schematic diagram showing an example of an obstacle location map according to the prior art. Figure 1 In the obstacle point map 500 shown, obstacle points 501 (shaded) are specified in units of areas divided by a grid. For example, in the case where the probability of existence of an obstacle point that hinders the travel of the autonomous moving body is a predetermined value or greater, a value indicating the probability is described in each obstacle point 501. Figure 1 In FIG. 5 , the non-shaded area 502 indicates a location where the probability of existence of the obstacle location is less than a predetermined value.
[0044] In a cart-type autonomous mobile body, as a sensor for performing self-position estimation, two-dimensional laser imaging detection and ranging (2D-LiDAR) is generally used. For example, 2D-LiDAR emits laser light in a direction parallel to the travel surface on which the autonomous mobile body travels to scan a predetermined angle range, performs ranging based on its reflected light, and calculates the two-dimensional coordinates of each point of the reflected light. Based on the calculated coordinates, the autonomous mobile body performs map matching with a pre-prepared obstacle location map and estimates its own position.
[0045] In conventional own position estimation by map matching using 2D-LiDAR, in many cases, it is assumed that a cart whose posture (tilt, etc.) does not change travels on a horizontal surface. In such a system, there are cases where a slope is determined as an obstacle site and travel is prohibited. There are also cases where the appearance of the surrounding environment changes due to a change in the posture of the own device and map matching goes wrong.
[0046] Note that a horizontal surface is assumed to be a surface that is orthogonal to the direction of gravity.
[0047] Figure 2 2 is a schematic diagram for describing a first example of using 2D-LiDAR to recognize the surrounding environment according to the prior art. Figure 2 In parts (a) and (b), a cart-type autonomous mobile body 510 travels on a traveling surface by means of wheels 512 driven by a motor. A distance measuring device 511 as a 2D-LiDAR is attached to the autonomous mobile body 510 at a predetermined position (predetermined height) on the front surface (surface in the traveling direction).
[0048] Figure 2Part (a) of FIG. 5 shows an example in which an autonomous mobile body 510 travels on a horizontal surface 520a in the direction indicated by a white arrow in the figure, and there is an ascending slope 520b at the travel destination. In the case of this example, a position A corresponding to the attachment height of the distance measuring device 511 is detected on the slope 520b by the distance measuring device 511. In this case, even when the angle formed by the slope 520b and the horizontal surface 520a is an angle that the autonomous mobile body 510 can climb, the slope 520b may be identified as an obstacle location for the autonomous mobile body 510 to travel, and the travel of the autonomous mobile body 510 may be prohibited.
[0049] Figure 2 Part (b) of FIG. 5 shows an example in which the autonomous mobile body 510 travels on the slope 520b in the direction indicated by the white arrow (downward on the slope 520b) to travel toward the horizontal surface 520a. In the case of this example, a position B corresponding to the attachment height of the distance measuring device 511 relative to the slope 520b is detected on the horizontal surface 520a by the distance measuring device 511. In this case, even when the angle formed by the slope 520b and the horizontal surface 520a is an angle at which the autonomous mobile body 510 can travel, the horizontal surface 520a may be recognized as an obstacle place for the autonomous mobile body 510 to travel, and the travel of the autonomous mobile body 510 may be prohibited.
[0050] Figure 3 2 is a schematic diagram for describing a second example of using 2D-LiDAR to recognize the surrounding environment according to the prior art. Figure 3 , an inverted pendulum type autonomous moving body 530 travels on a traveling surface by a wheel 532 driven by a motor, and the angle of the autonomous moving body 530 is variable around the wheel 532. A distance measuring device 531 as a 2D-LiDAR is attached to the autonomous moving body 530 at a predetermined position (predetermined height) on the front surface (surface in the traveling direction).
[0051] exist Figure 3 In the case of the example of , when the autonomous mobile body 530 is in the posture indicated by the solid line in the figure, the position C on the front side and at the upper end as seen from the autonomous mobile body 530 of the object 541 is detected by the distance measuring device 531, and the object 540 located on the front side relative to the object 541 is not detected. On the other hand, Figure 3In the example of FIG. 5 , in a case where the autonomous mobile body 530 takes a posture indicated by a dotted line in the figure, which is tilted forward in the traveling direction at an angle α relative to the posture indicated by a solid line, the position D of the object 540 is detected, and the object 541 is not detected. In this way, the appearance of the surrounding environment may change according to the posture of the autonomous mobile body 530. In this example, in a case where the autonomous mobile body 530 takes a posture indicated by a solid line, the object 540 cannot be recognized, so that when the autonomous mobile body 530 travels in the direction of the object 540, the autonomous mobile body 530 collides with the object 540.
[0052] On the contrary, it is also conceivable to install a sensor such as a three-dimensional (3D) LiDAR or a depth camera capable of acquiring three-dimensional information on an autonomous mobile body and recognize the environment as three-dimensional information. However, 3D-LiDAR has many restrictions on the attachment position, and its cost is also increased. The depth camera has a relatively short measurable distance and is easily affected by changes in the environment such as brightness.
[0053] (2. Overview of Implementation Methods)
[0054] Next, an overview of an embodiment according to the present disclosure will be described.
[0055] In each embodiment according to the present disclosure, the obstacle location map is provided with angle information indicating the angle at each position and the existence probability of the obstacle location. For example, the angle information may be a normal vector of the travel surface. Alternatively, the angle information may be information indicating the posture of the autonomous mobile body.
[0056] In this way, in each embodiment according to the present disclosure, the obstacle location map is provided with angle information at each position. Therefore, by applying the present disclosure, it is possible to facilitate travel control in an environment including a slope or travel control regarding changes in the posture of the autonomous mobile body itself by an autonomous mobile body using only 2D-LiDAR as a sensor for detecting the environment, and improve the mobility of the autonomous mobile body at a low cost.
[0057] (2-1. Configuration applicable to each embodiment)
[0058] A configuration applicable to each embodiment of the present disclosure will be described.
[0059] Figure 4 1 is a block diagram showing a configuration of an example of a mobile device as an autonomous mobile body applicable to each embodiment. In the following, unless otherwise described, description is made assuming that the mobile device is a cart-type mobile device.
[0060] exist Figure 4In the embodiment, the mobile device 10 applicable to each embodiment includes an information processing device 100 , a distance measuring device 101 , an inertial measurement unit (IMU) 102 , a motor driver 103 , and a communication interface (I / F) 104 .
[0061] The information processing device 100 has a configuration as a general-purpose computer, for example, and includes a central processing unit (CPU), a read-only memory (ROM), a random access memory (RAM), a storage device, an input device, a display, and various I / Fs.
[0062] The distance measuring device 101 is a device that performs distance measurement in a two-dimensional plane shape. In the following, 2D-LiDAR is adopted as the distance measuring device 101. The distance measuring device 101 is attached at a predetermined height of the mobile device 10, emits laser in a direction parallel to the travel surface on which the mobile device 10 travels to scan a predetermined angle range, performs distance measurement based on its reflected light, and calculates the two-dimensional coordinates at each point where the reflected light is obtained. The distance measuring device 101 outputs a point group (2D point group) each having a two-dimensional coordinate as a distance measurement result.
[0063] The IMU 102 detects angles or angular velocities of three axes related to motion and acceleration. For example, the IMU 102 includes a three-axis gyroscope and a three-way accelerometer, and outputs three-dimensional angular velocity and acceleration. Based on the output of the IMU 102, posture information indicating the posture of the mobile device 10 can be acquired. For example, the posture information includes angle information of each component of the xyz component in the case where the direction of gravity is the z-axis, and rotation information according to roll, pitch, and yaw.
[0064] The motor driver 103 operates a motor (not shown) for driving the traveling unit 120 according to a control signal output from the information processing device 100 to make the mobile device 10 travel. The communication I / F 104 communicates with an external device using, for example, wireless communication. There is no limitation, and the communication I / F 104 can communicate with the external device by using wired communication. For example, by communicating with an external controller via the communication I / F 104, the travel of the mobile device 10 can be controlled from the controller.
[0065] Figure 5 is a block diagram showing a configuration of an example of an information processing device 100 applicable to each embodiment. Figure 5 , the information processing device 100 includes a CPU 1000, a ROM 1001, a RAM 1002, a display control unit 1003, a storage device 1004, an input device 1005, a data I / F 1006, an external device I / F 1007 and a communication I / F 1008 which are connected to each other via a bus 1020 to enable communication.
[0066] The storage device 1004 is a nonvolatile storage medium such as a hard disk drive or a flash memory. The CPU 1000 controls the entire operation of the information processing device 100 according to a program stored in the ROM 1001 or the storage device 1004 by using the RAM 1002 as a working memory.
[0067] The display control unit 1003 converts the display control signal generated by the CPU 1000 into a display signal in a format displayable by the display 1030, and outputs it to the display 1030. The input device 1005 receives input by user operation, and a keyboard, a pointing device, a touch panel, etc. can be applied to the input device 1005.
[0068] The data I / F 1006 is an interface for transmitting and receiving data to and from an external device. The external device I / F 1007 outputs a control signal to an external device and receives information (status information, etc.) transmitted from the external device. For example, the information processing device 100 is connected to the motor driver 103 via the external device I / F 1007 and transmits a control signal to the motor driver 103. The communication I / F 1008 performs communication via an external communication network, for example, by wireless communication.
[0069] Figure 6 is a functional block diagram for describing an example of the function of the information processing device 100 according to each embodiment.
[0070] exist Figure 6 In the example, the information processing device 100 includes a map creating unit 110, a map storing unit 111, a self-position estimating unit 112, an obstacle location identifying unit 113, and an action planning unit 114.
[0071] Among these units, the map storage unit 111 is, for example, a predetermined storage area in the storage device 1004. The map creation unit 110, the own position estimation unit 112, the obstacle place identification unit 113, and the action planning unit 114 are configured by, for example, the operation of the information processing program according to the embodiment on the CPU 1000. There is no limitation, and some or all of the map creation unit 110, the own position estimation unit 112, the obstacle place identification unit 113, and the action planning unit 114 may be configured by hardware circuits that operate in cooperation with each other.
[0072] The map creation unit 110 receives input of distance measurement information (2D point group) output from the distance measuring device 101 , posture information indicating the posture of the mobile device 10 output from the IMU 102 , and movement amount information indicating the movement amount of the mobile device 10 output from the odometer processing unit 105 .
[0073] Note that the odometer processing unit 105 obtains the moving direction, moving distance, etc. of the mobile device 10 using, for example, an acceleration sensor, etc., and acquires movement amount information. For example, the odometer processing unit 105 can estimate the current position of the mobile device 10 by integrating the rotation angle of the axis in the travel unit 120. The odometer processing unit 105 can obtain the moving distance by accumulating the estimated current position in the time series.
[0074] The map creation unit 110 creates a map with angle information including angle information at each position based on the 2D point group and the posture information. The map creation unit 110 stores the created obstacle location map and the map with angle information in the map storage unit 111 .
[0075] That is, the map creation unit 110 functions as a map creation unit that creates a map based on obstacle position information indicating the position of an obstacle site that impedes travel of the mobile device and angle information indicating the angle of the mobile device at each travel position where the mobile device travels.
[0076] The own position estimating unit 112 estimates the own position of the mobile device 10 based on the distance measurement information, posture information, movement amount information, and the map with angle information stored in the map storage unit 111. The obstacle location identifying unit 113 identifies obstacle locations that may be obstacles to the movement of the mobile device 10 based on the distance measurement information, posture information, movement amount information, and the map with angle information stored in the map storage unit 111.
[0077] The action planning unit 114 creates a travel plan for the mobile device 10 based on the own position estimated by the own position estimating unit 112 and the obstacle location identified by the obstacle location identifying unit 113. For example, when the own position moves toward the obstacle location, the action planning unit 114 creates a travel plan to avoid the obstacle location. The action planning unit 114 generates a control command based on the created travel plan for controlling the driving of the motor driver 103.
[0078] Note that in the above description, for example, Figure 4 As shown, the information processing device 100 is shown as being built in the mobile device 10, but this is not limited to this example. For example, some functions of the information processing device 100 may be configured outside the mobile device 10. For example, among the functions of the information processing device 100, the map creation unit 110 may be configured outside the mobile device 10. On the other hand, among the functions of the information processing device 100, functions other than the map creation unit 110, namely, the own position estimation unit 112, the obstacle location recognition unit 113, the action plan unit 114, and the map storage unit 111 are preferably built in the mobile device 10.
[0079] When a map is created by the map creation unit 110 and when the mobile device 10 travels based on the action plan created by the action planning unit 114, Figure 6 The information processing device 100 shown uses different functions.
[0080] Fig. 7A 1 is a functional block diagram for describing an example of functions used in map creation in the information processing device 100. Fig. 7A As shown, when the map is created, only Figure 6 Among the functions shown is a map creation unit 110. When creating a map, the map creation unit 110 uses the outputs of the distance measuring device 101 and the IMU 102 to create a map having angle information.
[0081] Figure 7B 1 is a functional block diagram for describing an example of functions in the information processing device 100 that are used when the mobile device 10 is traveling. Figure 7B As shown, when the mobile device 10 is traveling, the use Figure 6 Among the functions shown are a self-position estimation unit 112, an obstacle location identification unit 113, and an action planning unit 114. The self-position estimation unit 112 and the obstacle location identification unit 113 obtain the self-position and the obstacle location using the outputs of the distance measuring device 101 and the IMU 102, respectively, and the map with angle information stored in the map storage unit 111. Note that the self-position estimation unit 112 can also estimate the self-position by using the movement amount information output from the odometer processing unit 105.
[0082] In the information processing device 100, the CPU 1000 configures the above-mentioned map creation unit 110 as a module, for example, in the main storage area in the RAM 1002 by executing the information processing program for realizing the functions according to the embodiment. In addition, the CPU 1000 can configure the above-mentioned self-position estimation unit 112, obstacle location recognition unit 113, and action planning unit 114 as modules, for example, in the main storage area in the RAM 1002 by executing the information processing program for realizing the functions according to the embodiment.
[0083] For example, the information processing program may be acquired from the outside via a network not shown by communication via the communication I / F 1008, and may be installed on the information processing apparatus 100. There is no limitation, and the information processing program may be provided by being stored in a removable storage medium such as a compact disc (CD), a digital versatile disc (DVD), or a universal serial bus (USB) memory.
[0084] (2-2. Map Creation Process Applicable to Each Embodiment)
[0085] Next, a map creation process applicable to each embodiment will be schematically described. Hereinafter, a case where the map creation unit 110 creates a map with angle information will be described.
[0086] Figure 8 is a flowchart showing an example of a map creation process applicable to each embodiment. At step S100, the mobile device 10 is caused to travel. For example, at step S100, the mobile device 10 may be caused to travel in a direction indicated by an external controller. There is no limitation, and for example, at step S100, the mobile device 10 may be caused to travel in a random direction.
[0087] At the next step S101, the information processing device 100 determines whether the mobile device 10 has traveled a certain distance. For example, under the assumption that the travel surface on which the mobile device 10 travels is a flat surface, the map creation unit 110 sets a grid of a predetermined size with respect to the flat surface. At step S101, the information processing device 100 determines whether the mobile device 10 has traveled one block in the grid.
[0088] In the case where the information processing device 100 determines that the mobile device 10 has not traveled the predetermined distance (step S101 is "No"), this returns the process to step S100. On the other hand, in the case where the information processing device 100 determines that the mobile device 10 has traveled the predetermined distance (step S101 is "Yes"), this transfers the process to step S102.
[0089] At step S102, the information processing device 100 acquires the measurement results (ranging information and posture information) of the measurement performed by the ranging device 101 and the IMU 102. At the next step S103, the information processing device 100 stores the measurement results acquired at step S102. The information processing device 100 may store the acquired measurement results in the RAM 1002 or the storage device 1004.
[0090] At the next step S104, the information processing device 100 determines whether the mobile device 10 has traveled a certain range. In the case where the information processing device 100 determines that the mobile device 10 has not traveled a predetermined range (step S104 is "No"), this returns the process to step S100. On the other hand, in the case where the information processing device 100 determines at step S104 that the mobile device 10 has traveled a predetermined range (step S104 is "Yes"), this transfers the process to step S105.
[0091] At step S105 , the information processing device 100 creates a map with angle information by using each measurement result stored at step S103 .
[0092] (3. First embodiment)
[0093] Next, the first embodiment of the present disclosure will be described. The first embodiment is an example of creating a map having posture information indicating the posture at that time as a channel when creating a map based on a grid. That is, in the first embodiment, a map having angle information having posture information as angle information of each grid is created.
[0094] Fig. 9 is a schematic diagram showing an example of a map with angle information created in the first embodiment. Fig. 9 Part (a) of FIG. 1 shows an example of a map 200 having angle information in a certain posture (angle). In the map 200 having angle information shown in part (a), Figure 1 Similar to the obstacle location map 500 of the related art, obstacle locations 201 (shaded parts) are specified in units of areas divided by a grid. The obstacle location 201 is a location where the probability of existence of the obstacle location is a predetermined value or greater when the angle indicated by the posture information of the mobile device 10 is the angle specified in the map 200 having angle information. On the other hand, for example, Fig. 9 In the example, a location where the probability of existence of an obstacle location is less than a predetermined value at the angle is indicated as a non-shadow area 202.
[0095] In a first embodiment, if Fig. 9 As shown in part (b) of the figure, for each angle θ indicated by the posture information of the mobile device 10, maps 2001, 2002, 2003, ... with angle information are created. In part (b), the map 2001 with angle information is a map in the case where the posture information of the mobile device 10 is an angle θ1, and the position of the angle θ1 is indicated as an obstacle location 2011. Similarly, the maps 2002 and 2003 with angle information are maps in the case where the posture information of the mobile device 10 is an angle θ2 (>θ1) and θ3 (>θ2), and the positions at the angles θ2 and θ3 indicate obstacle locations 2012 and 2013, respectively.
[0096] Fig.102 is a diagram showing an example of the data structure of the map 200 with angle information according to the first embodiment. In the map 200 with angle information, the value of the probability of existence of the obstacle point is described using the coordinates (x, y) of the grid position indicating the probability of existence of the obstacle point detected and the angle θ (pitch) at the position where the obstacle point is detected as parameters (doubleoccupancy_grid_map). For example, in the case where the probability of existence of the obstacle point is a predetermined value or greater, the mobile device 10 can determine that its coordinates are an obstacle point.
[0097] Fig.11 and Fig.12 : is a schematic diagram showing a specific example of the map 200 with angle information according to the first embodiment. Fig.11 An example of a hypothetical traveling environment is shown as an overhead view. Note that for ease of description, it is assumed that Fig.11 North (N) is located at the upper right. Assume that the north (N)-south (S) axis corresponds to the x-axis, and the west (W)-east (E) axis corresponds to the y-axis.
[0098] exist Fig.11 In the example of FIG. 3 , a wall 305 perpendicular to the horizontal surface 300 exists at the west (W) end and the north (N) end of the horizontal surface 300. A horizontal platform 301 connected to the horizontal surface 300 from the west (W) by a ramp 302 exists in the southeast (SE) portion of the figure. The east (E) end of the platform 301 is a wall 304 perpendicular to the platform 301, and the north end of the platform 301 is a vertical portion 306 perpendicular to the platform 301 and the horizontal surface 300. Note that the ramp 302 is inclined at an angle β relative to the horizontal surface 300.
[0099] Fig.12 The map creation unit 110 is schematically shown based on Fig.11 Examples of maps 2001 and 2002 with angle information created for the traveling environment shown in FIG. Fig.11 The bird's-eye view compared to the top view.
[0100] Fig.12 Part (a) of FIG. 2 shows an example of a map 2001 with angle information in a case where the angle θ1 indicated by the posture information is 0°. For example, part (a) shows an example of a case where the mobile device 10 travels in a direction parallel to the horizontal surface 300 .
[0101] exist Fig.12 In part (a), Fig.11The position where the wall 305 is detected is indicated as the obstacle point 201a, and the position where the wall 304 is detected is indicated as the obstacle point 201c. The position where the slope 302 is detected is indicated as the obstacle point 201b. In addition, the position where the vertical portion 306 is detected is indicated as the obstacle point 201d.
[0102] Fig.12 Part (b) of FIG. 2 shows an example of a map 2002 with angle information in a case where the angle θ2 indicated by the posture information is equal to β. For example, part (b) shows an example of a case where the mobile device 10 travels on a slope 302 .
[0103] exist Fig.12 In part (b), for example, when the mobile device 10 goes down the slope 302 (travels westward), the area of the horizontal surface 300 at the travel destination of the slope 302 is detected and indicated as the obstacle location 201e. In the example of part (b), for example, when the mobile device 10 climbs the slope 302 (travels eastward), the wall 304 at the travel destination of the slope 302 is detected and indicated as the obstacle location 201f.
[0104] The map creating unit 110 stores the maps 2001 and 2002 with angle information created in this manner in the map storing unit 111 .
[0105] The processing when using these maps 2001 and 2002 having angle information will be schematically described. In the mobile device 10, the own position estimation unit 112 estimates the own position based on, for example, the movement amount information, the ranging information, and the posture information acquired by the ranging device 101, the IMU 102, and the odometer processing unit 105, respectively. The own position estimation unit 112 transmits information indicating the estimated own position to the action planning unit 114.
[0106] The obstacle place identification unit 113 obtains an angle θ of the mobile device 10 relative to, for example, the horizontal surface 300 based on the posture information obtained by the IMU 102. The obstacle place identification unit 113 obtains a map 200 having angle information corresponding to the obtained angle θ from each of the maps 2001 and 2002 having angle information stored in the map storage unit 111. The obstacle place identification unit 113 identifies an obstacle place 201 based on the acquired map 200 having angle information, and passes information indicating the identified obstacle place 201 to the action planning unit 114.
[0107] The action planning unit 114 creates a travel plan for the mobile device 10 based on the information indicating the own position transmitted from the own position estimation unit 112 and the information indicating the obstacle location 201 transmitted from the obstacle location recognition unit 113. For example, in a case where the position of the mobile device 10 is close to the position indicated at the obstacle location 201 based on these information, the action planning unit 114 creates a travel plan for instructing travel to avoid the obstacle location 201, and transmits a control instruction according to the created travel plan to the motor driver 103.
[0108] In this way, in the first embodiment, by providing angle information to a map based on two-dimensional information, it is possible to detect the slope 302 and the like without using a sensor capable of acquiring three-dimensional information, and create a travel plan based on the detection result. Therefore, by applying the first embodiment, the mobility of the autonomous moving body can be improved at a low cost.
[0109] Note that in the above description, a map corresponding to the posture of the mobile device 10 is selected from the plurality of maps 2001, 2002, ... having angle information, but this is not limited to this example. For example, the information processing device 100 may integrate the maps 200 having angle information of the plurality of channels and use them as one map in such a manner that the position of the obstacle place 201 becomes highly reliable information based on the travel position of the mobile device 10 when the obstacle place 201 is detected in each map. As a method of integration processing in this case, known Bayesian updating may be used.
[0110] (4. Second Embodiment)
[0111] Next, a second embodiment of the present disclosure will be described. The second embodiment is an example of obtaining normal information of each mesh when creating a map based on the meshes and creating a map in which the normal information is added to the information indicating the position of the mesh for each mesh. That is, in the second embodiment, a map with angle information is created, which has normal information as angle information for each mesh. It can also be said that the map with angle information is a normal information map with normal information for each mesh.
[0112] Fig.131 is a schematic diagram for describing a method of acquiring normal information applicable to the second embodiment. The angle (inclination) of the travel surface on which the mobile device 10 travels can be acquired based on the velocity vector of the travel of the mobile device 10 or the posture information indicating the posture of the mobile device 10. For example, the map creation unit 110 acquires the angle of the mobile device 10 relative to the gravity direction based on the posture information acquired from the IMU 102. The map creation unit 110 acquires the acquired angle as the normal information at the current position of the mobile device 10 of the travel surface on which the mobile device 10 travels.
[0113] exist Fig.13 In the example of FIG. 1 , the mobile device 10 is shown traveling on the traveling surface in the direction indicated by the arrow in the figure, descending from the horizontal surface 210 along the slope 211 and moving toward the horizontal surface 212. Note that in Fig.13 , the right end of the horizontal surface 212 is a vertical wall 213 .
[0114] In this case, it is assumed that the map creation unit 110 acquires posture information from the IMU 102 at a position 401 such as the slope 211. The map creation unit 110 obtains an angle of the mobile device 10 relative to the gravity direction based on the acquired posture information. Based on the angle, the map creation unit 110 can acquire a normal vector 400 as normal information at the position 401.
[0115] Note that the map creation unit 110 obtains the normal vector 400 as a vector with the center of a unit sphere of radius = 1 as the origin, and acquires the x component and y component at that time as numerical values. Fig.13 In the example, the direction 410 of the velocity vector of the mobile device 10 on the slope 211 is parallel to the surface of the slope 211 .
[0116] Fig.14 : is a schematic diagram showing an example of a map having angle information according to a normal vector according to the second embodiment.
[0117] exist Fig.14 , the map 250 with angle information includes the value of the normal vector for each mesh. In this example, the value of the x component of the x component and the y component of the normal vector is indicated for each mesh. In the example in the figure, it is shown that each mesh on the horizontal surfaces 210 and 212 has a value = 0.0, the x component is 0, and each mesh is horizontal. On the other hand, it is shown that each mesh on the slope 211 has a value = 0.1, the x component is 0.1, and each mesh has an inclination corresponding to x = 0.1.
[0118] Note that Fig.14 In area 214, Fig.13The area on the right side of the wall 213 in FIG. Since the mobile device 10 cannot move in this area 214 , the posture information and the like are not acquired.
[0119] Fig.15 2 is a diagram showing an example of the data structure of the map 250 with angle information according to the second embodiment. The map 250 with angle information includes a value (double occupancy_grid_map) of the probability of existence of an obstacle point described using the coordinates (x, y) of the grid position indicating the probability of existence of the obstacle point as a parameter, and data (Vector3d normal_vec_map) indicating the normal vector described by using the coordinates (x, y) as a parameter. That is, the map 250 with angle information according to the second embodiment includes a map indicating the obstacle point for each grid and a map indicating the normal vector for each grid.
[0120] The map creating unit 110 stores the map 250 with angle information created in this manner in the map storing unit 111 .
[0121] The processing when the map 250 with angle information is used will be schematically described. In the mobile device 10, the own position estimation unit 112 estimates the own position based on, for example, the movement amount information, the ranging information, and the posture information acquired by the ranging device 101, the IMU 102, and the odometer processing unit 105, respectively. The own position estimation unit 112 passes information indicating the estimated own position to the action planning unit 114.
[0122] The obstacle point recognition unit 113 recognizes an obstacle point with reference to the map 250 with angle information stored in the map storage unit 111. The obstacle point recognition unit 113 transfers information indicating the recognized obstacle point to the action planning unit 114.
[0123] The action planning unit 114 refers to the data indicating the normal vector of the map 250 with angle information stored in the map storage unit 111, and obtains the normal vector at the current position, based on the information indicating the own position transmitted from the own position estimating unit 112. For example, the action planning unit 114 creates a travel plan for the mobile device 10 based on the normal vector at the current position and the information indicating the obstacle location transmitted from the obstacle location identifying unit 113.
[0124] The position information indicating the position of the normal vector and the position information indicating the obstacle location have coordinates that correspond one to one. Therefore, for example, the action planning unit 114 can obtain the inclination at the current position of the mobile device 10 based on the information indicating the estimated own position. The action planning unit 114 can calculate the obstacle location detected at the obtained inclination based on the position information indicating the position of the normal vector and the position information indicating the obstacle location.
[0125] As a specific example, for example, in Fig.13 , for the mobile device 10 at the position 401 on the slope 211, the predetermined position on the horizontal surface 212 in the direction of travel is regarded as an obstacle place. On the other hand, for example, when referring to the data indicating the normal vector of the map 250 with angle information, the obstacle place identification unit 113 recognizes that the predetermined position on the horizontal surface 212 is a horizontal surface. Based on the distance to the obstacle place and the current inclination of the mobile device 10, the obstacle place identification unit 113 can calculate that the predetermined position on the horizontal surface 212 is not an obstacle place, but a surface on which the mobile device can travel. In this way, the obstacle place identification unit 113 can perform matching based on the value of the existence probability of the obstacle place included in the map 250 with angle information and the normal vector, and extract the obstacle place that may actually hinder the travel.
[0126] The action planning unit 114 may create a travel plan for the mobile device 10 according to the obstacle locations detected in this manner.
[0127] For example, in a case where the position of the mobile device 10 approaches the position indicated at the obstacle location 201 based on the information indicating the obstacle location, or in a case where the mobile device 10 approaches a position that is difficult to climb based on the normal vector, the action planning unit 114 may create a travel plan for instructing travel to avoid the obstacle location 201. There is no limitation, and the action planning unit 114 may create a travel plan for instructing travel at a reduced travel speed in a case where the mobile device 10 approaches the slope 211 based on the normal vector.
[0128] The action planning unit 114 transmits a control command according to the created travel plan to the motor driver 103 .
[0129] In this way, in the second embodiment, by providing angle information to a map based on two-dimensional information, it is possible to detect the slope 211 and the like without using a sensor capable of acquiring three-dimensional information, and create a travel plan based on the detection result. Therefore, by applying the second embodiment, the mobility of the autonomous moving body can be improved at a low cost.
[0130] Note that it is not limited to the above example, and the information processing device 100 can integrate the values of multiple normal vectors obtained by multiple measurements on the same traveling surface to obtain the value in each grid. As a method of integrating the values of the normal vector, the known Bayesian update can be used. The information processing device 100 can detect obstacle locations from multiple traveling surfaces (for example, a horizontal surface 210, a slope 211, and a horizontal surface 212), and integrate multiple information obtained from multiple traveling surfaces to improve the reliability of the detected obstacle locations. In addition, the information processing device 100 can perform matching by extracting an obstacle location consistent with the current posture of the mobile device 10 or the inclination of the traveling surface based on the normal vector.
[0131] (5. Third Embodiment)
[0132] Next, a third embodiment of the present disclosure will be described. The third embodiment is an example of including coordinate information and posture information in one data structure in a map with angle information.
[0133] Fig.16 : is a schematic diagram showing an example of the data structure of a map with angle information according to the third embodiment. Fig.16 , part (a) shows an example of a data structure including obstacle location information 220 indicating the location of an obstacle location and own device location information 221 indicating the location of the mobile device 10 when the obstacle location information 220 was acquired in one data. More specifically, the obstacle location information 220 includes coordinates (x, y, z) detected as an obstacle location. Note that the value of the coordinate z is fixed to 0. The own device location information 221 includes coordinates (normal_x, normal_y, normal_z) indicating the location of the mobile device 10.
[0134] There is no limitation, and the coordinates (normal_x, normal_y, normal_z) included in the own device position information 221 may be information (eg, a normal vector) indicating the inclination at the position indicated by the obstacle location information 220 in the same data.
[0135] Here, the mobile device 10 acquires a 2D point group by performing measurement at the coordinates (normal_x, normal_y, normal_z) by the ranging device 101. Each point included in the 2D point group has a coordinate (x, y, z). Therefore, the data structure shown in part (a) may have a plurality of coordinates (x, y, z) for one coordinate (normal_x, normal_y, normal_z). Each coordinate (normal_x, normal_y, normal_z) and coordinate (x, y, z) is not limited to the coordinates of the grid, and may be the coordinates of a point.
[0136] exist Fig.16 , part (b) shows an example of a data structure including obstacle location information 220 indicating the position of an obstacle location and posture information 222 indicating the posture of the mobile device 10 when the obstacle location information is acquired in one data. More specifically, the obstacle location information 220 includes the coordinates (x, y, z) of the grid detected as the obstacle location. Note that the value of the coordinate z is fixed to 0. The posture information 222 includes roll, pitch, and yaw indicating the posture of the mobile device 10.
[0137] In the information processing device 100, for example, in the case of using a map with angle information based on these data structures, the obstacle location recognition unit 113 can project each data onto the xy plane and perform clustering processing or filtering processing to create two-dimensional map information. The action planning unit 114 can create a travel plan for the mobile device 10 using the two-dimensional map information.
[0138] There is no limitation, and for example, the obstacle location identification unit 113 can perform three-dimensional to six-dimensional matching processing based on the map with angle information of these data structures. For the matching processing, an algorithm based on the known generalized iterative closest point (GICP) can be adopted. In the matching processing, the position search is basically performed in a way that the points are consistent with each other or are similar to each other. In this case, for example, the obstacle location identification unit 113 can perform matching of positions, wherein not only the coordinates (x, y, z) of the points are consistent, but also the posture information is consistent or approximate. In addition, for example, the obstacle location identification unit 113 can perform matching of the position that overlaps the most with the extracted points in which the posture information is consistent or approximate.
[0139] In this way, in the third embodiment, a slope or the like can be detected without using a sensor capable of acquiring three-dimensional information, and a travel plan can be created based on the detection result. Therefore, by applying the third embodiment, the mobility of the autonomous moving body can be improved at low cost.
[0140] (6. Fourth Embodiment)
[0141] Next, a fourth embodiment of the present disclosure will be described. The fourth embodiment is an example of creating a map with angle information by adding the angle information to, for example, an obstacle location map that has been created by the related art or the like by manual operation.
[0142] Schematic diagram for describing creation of a map with angle information according to the fourth embodiment. For example, in the information processing device 100, the map creation unit 110 generates an image by using the input device 1005 (refer to Figure 5 ) adds angle information etc. to the reference Figure 1 A prior art obstacle location map 500 is described.
[0143] For example, the map creation unit 110 generates a graphical user interface (GUI) screen for inputting angle information to a pre-prepared obstacle location map through user operation, and displays it on the display 1030 (see FIG. Figure 5 ) on the GUI screen. The GUI screen displays, for example, a pre-prepared obstacle location map and various tools for adding angle information to the obstacle location map.
[0144] For example, the user specifies the position where the angle information is desired to be added to the displayed obstacle location map using the tool displayed on the GUI screen by operating the input device 1005, and inputs the angle information to the specified position. The map creation unit 110 may configure the GUI to collectively input the angle information to the specified range by specifying the range relative to the obstacle location map, or may configure the GUI to input the angle information for each grid. The map creation unit 110 creates a map with the angle information by reflecting the input angle information on the displayed obstacle location map.
[0145] Fig.17 is a schematic diagram showing an example of a map with angle information created by the method according to the fourth embodiment. Fig.17 The map 230 with angle information shown in FIG. Figure 1 The user will target the obstacle location map 500 described by Fig.17 The angle information of the area indicated by the area 240 in the area 240 is input to the above-mentioned obstacle place map 500. The map creation unit 110 creates a map 230 with angle information in which the information of the area 240 is overwritten with the input angle information, and stores the created map 230 with angle information in the map storage unit 111. The angle information may be a normal vector of each mesh in the area 240 or posture information of the mobile device 10 in each mesh. Information indicating the state of the travel surface such as a slope may be added to each position.
[0146] Note that the map creation unit 110 can add effects such as color coding of each angle according to the angle information to the map 230 with angle information through a GUI screen, for example. Therefore, the angle of the traveling surface at each position can be visualized. For example, by visualizing the angle information, when the user creates an application for traveling control of the mobile device 10 using the GUI tool or the like, the burden of work can be reduced. For example, by visualizing the angle information in the map 230 with angle information, the map 230 with angle information can be corrected more easily.
[0147] Note that the effects described in this specification are merely examples and are not restrictive, and there may be other effects.
[0148] Note that the present technology may also have the following configurations. (1)
[0150] An information processing device, comprising:
[0151] A map creation unit creates a map based on obstacle position information indicating the position of an obstacle location that hinders the travel of a mobile device and angle information indicating an angle of the mobile device at each travel position of the mobile device. (2)
[0153] The information processing device according to (1) above, wherein:
[0154] The map creation unit:
[0155] A map including the obstacle position information and the angle information at each travel position is created. (3)
[0157] The information processing device according to (1) or (2) above, wherein:
[0158] The map creation unit:
[0159] Posture information indicating a posture of the mobile device at each travel position is used as the angle information, and the map is created for each of the angle information indicating different angles. (4)
[0161] The information processing device according to (3) above, wherein:
[0162] The map creation unit:
[0163] Based on the travel position, maps for each piece of angle information in the angle information are integrated to create one map. (5)
[0165] The information processing device according to (3) or (4) above, wherein:
[0166] The map creation unit:
[0167] The angle information is obtained according to user input. (6)
[0169] The information processing device according to (1) or (2) above, wherein:
[0170] The map creation unit:
[0171] The map is created using normal information at each travel position of a travel surface on which the mobile device travels as the angle information. (7)
[0173] The information processing device according to (6) above, wherein:
[0174] The map creation unit creates the following as the map:
[0175] The normal information is used as a normal information map of the angle information and an obstacle location map based on the obstacle position information. (8)
[0177] The information processing device according to any one of (1) to (7) above, wherein:
[0178] The map creation unit:
[0179] The position where the obstacle place is detected, posture information indicating the posture of the mobile device at the position where the obstacle place is detected, or inclination information about the travel surface on which the mobile device at the position where the obstacle place is detected travels is added to the obstacle position information. (9)
[0181] The information processing device according to any one of (1) to (8) above, further comprising:
[0182] A travel control unit that controls travel of the mobile device based on the map created by the map creation unit. (10)
[0184] An information processing method comprising:
[0185] a map creation step of creating a map based on obstacle position information indicating the position of an obstacle location that hinders the travel of the mobile device and angle information indicating the angle of the mobile device at each travel position of the mobile device,
[0186] The map creation step is performed by a computer. (11)
[0188] An information processing program, the information processing program uses
[0189] The computer does the following:
[0190] A map creation step of creating a map based on obstacle position information indicating the position of an obstacle location that hinders the travel of the mobile device and angle information indicating the angle of the mobile device at each travel position of the mobile device.
[0191] Reference numerals list
[0192] 10 Mobile Devices
[0193] 100 Information processing device
[0194] 101 Distance Measuring Device
[0195] 102IMU
[0196] 103 Motor Driver
[0197] 105 Odometer processing unit
[0198] 110 Map Creation Unit
[0199] 111 map storage unit
[0200] 112 Self-position estimation unit
[0201] 113 Obstacle Location Recognition Unit
[0202] 114 Action Planning Unit
[0203] 200, 2001, 2002, 2003, 230, 250 maps with angle information
[0204] 2011, 2012, 2013, 201, 201a, 201b, 201c, 201d, 201e, 201f obstacle locations
[0205] 210, 212 horizontal surface
[0206] 211 Slope
[0207] 220 Obstacle location information
[0208] 221 Own device location information
[0209] 222 Posture Information
[0210] 400 Normal Vector
[0211] 1000CPU
[0212] 1002 RAM
[0213] 1005 Input device
[0214] 1030 Display
Claims
1. An information processing device, comprising: A map creation unit creates a map based on obstacle position information indicating the position of an obstacle location that hinders the travel of a mobile device and angle information indicating an angle of the mobile device at each travel position of the mobile device.
2. The information processing device according to claim 1, wherein: The map creation unit: A map including the obstacle position information and the angle information at each travel position is created.
3. The information processing device according to claim 1, wherein: The map creation unit: Posture information indicating a posture of the mobile device at each travel position is used as the angle information, and the map is created for each of the angle information indicating different angles.
4. The information processing device according to claim 3, wherein: The map creation unit: Based on the travel position, maps for each piece of angle information in the angle information are integrated to create one map.
5. The information processing device according to claim 3, wherein: The map creation unit: The angle information is obtained according to user input.
6. The information processing device according to claim 1, wherein: The map creation unit: The map is created using normal information at each travel position of a travel surface on which the mobile device travels as the angle information.
7. The information processing device according to claim 6, wherein: The map creation unit creates the following as the map: The normal information is used as a normal information map of the angle information and an obstacle location map based on the obstacle position information.
8. The information processing device according to claim 1, wherein: The map creation unit: The position where the obstacle place is detected, posture information indicating the posture of the mobile device at the position where the obstacle place is detected, or inclination information about the travel surface on which the mobile device at the position where the obstacle place is detected travels is added to the obstacle position information.
9. The information processing device according to claim 1, further comprising: A travel control unit that controls travel of the mobile device based on the map created by the map creation unit.
10. An information processing method, comprising: a map creation step of creating a map based on obstacle position information indicating the position of an obstacle location that hinders the travel of the mobile device and angle information indicating the angle of the mobile device at each travel position of the mobile device, The map creation step is performed by a computer.
11. An information processing program, the information processing program using The computer does the following: A map creating step of creating a map based on obstacle position information indicating the position of an obstacle location that hinders the travel of the mobile device and angle information indicating the angle of the mobile device at each travel position of the mobile device.
