Robot, method for correcting setting value of sensor mounted on robot, and computer program
The robot system addresses sensor setting inaccuracies by generating maps and display data for sensor corrections, allowing non-technical users to easily correct settings, thereby enhancing operational accuracy and usability.
Patent Information
- Application Number
- PCT/JP2024/014206
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-23
- Filing Date
- 2024-04-08
- Publication Date
- 2024-11-28
AI Technical Summary
Autonomous mobile robots equipped with sensors face operational inaccuracies due to sensor setting deviations, making it difficult for non-technical users to correct these settings, leading to potential operational issues.
A robot system that generates first and second maps representing sensor states before and after correction, along with display data, allowing users to select appropriate correction amounts for sensor settings, enabling easy correction by non-expert users.
Enables non-technical users to accurately correct sensor settings, improving robot operation by visualizing the correction process and selecting appropriate settings without requiring technical expertise.
Smart Images

Figure JP2024014206_28112024_PF_FP_ABST
Abstract
Description
Robot, method for correcting setting values of sensors mounted on the robot, and computer program
[0001] The present disclosure relates to a robot, a method for correcting setting values of sensors mounted on the robot, and a computer program.
[0002] Autonomous mobile robots are equipped with multiple sensors. If an abnormality (misalignment) occurs in the sensor settings, the information calculated based on the sensor measurements and settings becomes inaccurate, which can interfere with the robot's operation. In this case, if the robot user is a person without technical expertise, such as an office employee or a resident of the house where the robot operates, it is difficult for the user to correct the sensor settings.
[0003] JP 11-202928 A JP 2016-45852 A
[0004] The present disclosure aims to provide a robot that allows a user to correct the setting values of sensors, a method for correcting the setting values of sensors mounted on the robot, and a computer program.
[0005] In order to solve the above problems, the robot according to the present disclosure includes a sensor, a first map generation unit that generates a first map representing the state of each position on a two-dimensional coordinate plane based on the measurement values and setting values of the sensor, a candidate correction amount calculation unit that calculates candidate correction amounts for the setting values of the sensor, a second map generation unit that generates a second map representing the corrected state of each position on the two-dimensional coordinate plane based on the measurement values and setting values of the sensor and the candidate correction amounts, and a display data generation unit that generates display data representing the state before and after correction of the setting values of the sensor based on the first map and the second map.
[0006] In addition, a method for correcting the setting values of a sensor mounted on a robot according to the present disclosure includes the steps of generating a first map representing the state of each position on a two-dimensional coordinate plane based on the measurement values and setting values of the sensor, calculating candidate correction amounts for the setting values of the sensor, generating a second map representing the corrected state of each position on the two-dimensional coordinate plane based on the measurement values and setting values of the sensor and the candidate correction amounts, and generating display data representing the state before and after the correction of the setting values of the sensor based on the first map and the second map.
[0007] In addition, a computer program for correcting the setting values of a sensor mounted on a robot according to the present disclosure causes a computer to execute the steps of generating a first map representing the state of each position on a two-dimensional coordinate plane based on the measurement values and setting values of the sensor, calculating candidate correction amounts for the setting values of the sensor, generating a second map representing the corrected state of each position on the two-dimensional coordinate plane based on the measurement values and setting values of the sensor and the candidate correction amounts, and generating display data representing the state before and after the correction of the setting values of the sensor based on the first map and the second map.
[0008] 1 is a diagram illustrating a configuration of a robot according to embodiment 1. FIG. 2 is a diagram illustrating a detailed configuration of a correction amount candidate calculation unit. FIG. 3 is a diagram illustrating a detailed configuration of a display area determination unit. FIG. 4 is a flowchart illustrating details of the operation of the robot. FIG. 5 is a flowchart illustrating details of the processing of the correction amount candidate calculation unit. FIG. 6 is a diagram illustrating two examples of a third distributed map. FIG. 7 is a diagram illustrating a relationship between a provisional correction amount and an average value. FIG. 8 is a flowchart illustrating details of the processing of the display area determination unit. FIG. 9 is a diagram illustrating an example of display data. FIG. 10 is a diagram illustrating an example of display data. FIG. 11 is a diagram illustrating an example of display data. FIG. 12 is a diagram illustrating a configuration of a robot according to embodiment 2. FIG. 13 is a diagram illustrating a detailed configuration of the display area determination unit. FIG. 14 is a diagram illustrating an example of display data. FIG. 15 is a diagram illustrating an example of display data. FIG. 16 is a diagram illustrating an example of display data.
[0009] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the drawings, identical or corresponding elements are designated by the same reference numerals, and detailed descriptions thereof will be omitted as appropriate.
[0010] 1 is a diagram illustrating a configuration of a robot 100 according to a first embodiment of the present disclosure. The robot 100 is an autonomous mobile robot, and includes a sensor group 1, a storage unit 2, and an input / output interface 3.
[0011] The sensor group 1 includes multiple sensors that measure physical quantities related to the height of objects, such as floors and walls, present in the workspace in which the robot 100 operates. For example, the sensor group 1 includes a time of flight (ToF), a light detection and ranging (LIDAR), a stereo camera, odometry, an inertial measurement unit (IMU), and the like. Alternatively, a monocular camera may be used as a sensor to perform learning-based monocular depth estimation to acquire physical quantities related to the height of objects. The physical quantities acquired in this manner may also be included in the measurement values of the sensor group 1.
[0012] The storage unit 2 stores the measurement values of the sensor group 1 and the setting values such as the mounting position and angle of the sensor group 1. For example, the storage unit 2 is configured by a semiconductor memory or the like.
[0013] The input / output interface 3 enables the exchange of various information between the user and the robot 100. For example, the input / output interface 3 is configured with a liquid crystal touch panel or the like. The user in this disclosure includes not only those with technical expertise, but also those without technical expertise, such as employees of an office where the robot 100 operates or residents of a house.
[0014] The robot 100 also includes a first map generation unit 4, a correction amount candidate calculation unit 5, a second map generation unit 6, a display area determination unit 7, a display data generation unit 8, a correction amount acquisition unit 9, and a first correction unit 10.
[0015] The first map generation unit 4 calculates information including the height of each position in the work space, specifically, the x, y, and z coordinates corresponding to each position, based on the measurement values and setting values of the sensor group 1 stored in the storage unit 2, and generates a first map representing this information. In the first embodiment, the first map is a point cloud map representing the height of each position on the x, y coordinate plane in the work space. Hereinafter, the first map may be referred to as the point cloud map before correction.
[0016] The correction amount candidate calculation unit 5 calculates correction amount candidates for the setting values of the sensor group 1. The number of correction amount candidates may be one or more. For example, if the setting values of the ToF camera are expressed in the format of (x coordinate, y coordinate, z coordinate, roll angle, pitch angle, yaw angle), one of the correction amount candidates may be, for example, (0, 0, 0, +5, 0, 0). This means that the mounting roll angle of the ToF camera is corrected by +5 degrees.
[0017] 2 is a diagram showing a detailed configuration of the correction amount candidate calculation unit 5. The correction amount candidate calculation unit 5 includes a provisional correction amount generation unit 51, a third dispersion map generation unit 52, an average value calculation unit 53, and a correction amount candidate determination unit 54.
[0018] The provisional correction amount generator 51 generates a plurality of provisional correction amounts related to the setting values of the sensor group 1. For example, a method of comprehensively generating correction amounts can be used. The third dispersion map generator 52 generates a plurality of third dispersion maps corresponding to the plurality of provisional correction amounts based on the measurement values and setting values of the sensor group 1 and the plurality of provisional correction amounts stored in the storage unit 2. The dispersion map is information representing the dispersion of height for each cell obtained by dividing an xy coordinate plane (two-dimensional coordinate plane) in the workspace into a grid. Each cell may be identified, for example, by xy coordinates corresponding to the position of its center. While each position in the point cloud map (first map) described above is represented by coordinates that take continuous values, the coordinates of each cell in the dispersion map take discrete values.
[0019] The average value calculation unit 53 calculates a plurality of average values (average values of variances) corresponding to the plurality of third variance maps, respectively. The correction amount candidate determination unit 54 determines one or more correction amount candidates based on the plurality of average values. Noise removal may be performed before calculating the average value. This may make it possible to determine correction amount candidates that will produce better results.
[0020] Returning to FIG. 1 , the second map generation unit 6 calculates the corrected height of each position in the workspace, specifically, the corrected height (z coordinate) of each position on a two-dimensional coordinate (x-y coordinate) plane, based on the measurement values and setting values of the sensor group 1 stored in the memory unit 2 and the correction amount candidates calculated by the correction amount candidate calculation unit 5, and generates a second map representing this. If there are multiple correction amount candidates, multiple second maps corresponding to the correction amount candidates are generated. In the first embodiment, the second map is a point cloud map representing the corrected height of each position on the two-dimensional coordinate system. Hereinafter, the second map may be referred to as a corrected point cloud map.
[0021] The display area determination unit 7 determines the display area R on the two-dimensional coordinate system based on the measurement values and setting values of the sensor group 1 stored in the memory unit 2 and the correction amount candidates calculated by the correction amount candidate calculation unit 5.
[0022] 3 is a diagram showing a detailed configuration of the display area determination unit 7. The display area determination unit 7 includes a first distribution map generation unit 71, a second distribution map generation unit 72, and a first area detection unit 73.
[0023] The first dispersion map generator 71 calculates the variance of height at each position for each cell obtained by dividing the xy coordinate plane in the workspace into a grid based on the measurement values and setting values of the sensor group 1 stored in the memory unit 2, and generates a first dispersion map σ1(x, y) that represents this. (x, y) in the first dispersion map σ1(x, y) represents the position of the cell.
[0024] The second variance map generator 72 calculates the variance of corrected height for each cell obtained by dividing the xy coordinate plane in the workspace into a grid based on the measurement values and setting values of the sensor group 1 stored in the memory unit 2 and the correction amount candidates calculated by the correction amount candidate calculator 5, and generates a second variance map σ2 (x, y, correction amount candidate) that represents this. Even if there are multiple correction amount candidates, only one second variance map σ2 is generated.
[0025] The first region detection unit 73 detects the region on the two-dimensional coordinate plane where the difference between the first variance map σ1 and the second variance map σ2 is the largest, and outputs this as the display region R.
[0026] Returning to Figure 1 again, the display data generation unit 8 generates display data representing the state before and after correction of the setting values of the sensor group 1 based on the first map generated by the first map generation unit 4, the second map generated by the second map generation unit 6, and the display area R determined by the display area determination unit 7, and displays the data on the input / output interface 3.
[0027] The correction amount acquisition unit 9 acquires one correction amount selected by the user from among the candidate correction amounts via the input / output interface 3. The first correction unit 10 corrects the setting value of the sensor group 1 using the one correction amount acquired by the correction amount acquisition unit 9.
[0028] Next, the details of the operation of the robot 100 according to the first embodiment will be described with reference to the flowchart of FIG.
[0029] In step S101, the robot 100 moves around the workspace in which it operates multiple times without gaps. During this process, the sensor group 1 measures the height of each position in the workspace multiple times. In other words, multiple height measurement values are obtained for the same position. The measurement values and setting values of the sensor group 1 are stored in the memory unit 2.
[0030] In step 102, the first map generation unit 4 calculates the height of each position in the work space, specifically, the x, y, and z coordinates corresponding to each position, based on the measurement values and setting values of the sensor group 1 stored in the storage unit 2 in step S101, and generates a first map representing this. As described above, in the first embodiment, the first map is a point cloud map (point cloud map before correction) representing the height of each position on the x, y coordinate plane.
[0031] When the setting values of the sensor group 1 are set correctly, the heights of the same location calculated based on multiple measurement values will be approximately the same, and the heights of floors, obstacles, etc. represented by the point cloud map will be clear. However, if an abnormality (misalignment) occurs in the setting values of the sensor group 1, the heights calculated for the same location may differ. For example, the floor height calculated based on the measurement values when the robot 100 climbs up an inclined floor may differ from the floor height calculated based on the measurement values when the robot 100 descends. In this case, the floor heights represented by the point cloud map will be multiple.
[0032] In step S103 , the correction amount candidate calculation unit 5 calculates candidates for the correction amount related to the setting value of the sensor group 1 .
[0033] FIG. 5 is a flowchart illustrating the details of the process of the correction amount candidate calculation unit 5.
[0034] In step 1031, the provisional correction amount generator 51 generates a plurality of provisional correction amounts. Here, a plurality of provisional correction amounts Ctmp1, Ctmp2, ... are comprehensively generated. For example, when the setting values of the ToF camera are expressed in the format of (x coordinate, y coordinate, z coordinate, roll angle, pitch angle, yaw angle), the provisional correction amounts are generated as follows: Ctmp1 = (0, 0, 0, +1, 0, 0), Ctmp2 = (0, 0, 0, +2, 0, 0), ...
[0035] In step S1032, the third dispersion map generation unit 52 generates a plurality of third dispersion maps σ3(x, y, Ctmp1), σ3(x, y, Ctmp2), ... that represent the dispersion of height for each cell obtained by dividing a two-dimensional coordinate plane into a grid by x and y coordinates, based on the measurement values and set values of the sensor group 1 and the plurality of provisional correction amounts Ctmp1, Ctmp2, ... that correspond to the plurality of provisional correction amounts, respectively. In the third dispersion map, x and y represent the position of the cell.
[0036] For example, σ3(x, y, Ctmp1) is a map representing the variance of height for each cell calculated based on the set value corrected using the provisional correction amount Ctmp1. Similarly, σ3(x, y, Ctmp2) is a map representing the variance of height at each position for each cell calculated based on the set value corrected using the provisional correction amount Ctmp2.
[0037] When a certain provisional correction amount is appropriate, the variance of the height at each position for each cell calculated using that appropriate provisional correction amount will be small. That is, the variance at each position of the third dispersion map σ3 corresponding to the appropriate provisional correction amount will be small (left side of Figure 6). On the other hand, when a certain provisional correction amount is inappropriate, the variance at each position for each cell calculated using that inappropriate provisional correction amount will be large. That is, the variance at each position for each cell of the third dispersion map σ3 corresponding to the inappropriate provisional correction amount will be large (right side of Figure 6).
[0038] In step S1033, the average value calculation unit 53 calculates a plurality of average values M(Ctmp1), M(Ctmp2), ... corresponding to the plurality of third variance maps σ3(x, y, Ctmp1), σ3(x, y, Ctmp2), .... In detail, the average value calculation unit 53 calculates, for each third variance map σ3(x, y, Cmp*), the average value M(Ctmp*) of the variance at each position for each cell of the third variance map in question, according to the following formula:
[0039] where n is the number of positions for which heights were recorded.
[0040] As described above, the variance at each position on the third dispersion map σ3 corresponding to an appropriate provisional correction amount is small. Therefore, the average value M calculated based on the third dispersion map σ3 corresponding to the appropriate provisional correction amount is also small (left side of FIG. 6). In contrast, the variance at each position on each cell on the third dispersion map σ3 corresponding to an inappropriate provisional correction amount is large. Therefore, the average value M calculated based on the third dispersion map σ3 corresponding to the inappropriate provisional correction amount is also large (right side of FIG. 6).
[0041] In step S1034, the correction amount candidate determination unit 54 determines one or more correction amount candidates based on the multiple average values M(Ctmp1), M(Ctmp2), ... calculated in step S1033 above. In detail, the correction amount candidate determination unit 54 selects one or more smallest average values from the multiple average values M(Ctmp1), M(Ctmp2), ..., and determines the provisional correction amounts corresponding to these values as correction amount candidates.
[0042] As described above, an appropriate provisional correction amount corresponds to a small average value M, while an inappropriate provisional correction amount corresponds to a large average value M. Therefore, a provisional correction amount corresponding to a small average value M is an appropriate candidate for the correction amount (FIG. 7).
[0043] In step S104, the second map generation unit 6 calculates the corrected height of each position on the two-dimensional coordinate plane based on the measurement values and setting values of the sensor group 1 stored in the memory unit 2 in step S101 and the correction amount candidates calculated by the correction amount candidate calculation unit 5 in step S103, and generates a second map representing this. If there are multiple correction amount candidates, multiple second maps corresponding respectively to the correction amount candidates are generated. As described above, in the first embodiment, the second map is a point cloud map representing the corrected height of each position on the two-dimensional coordinate plane.
[0044] In step S105, the display area determination unit 7 determines the display area R on the two-dimensional coordinate plane based on the measurement values and setting values of the sensor group 1 stored in the memory unit 2 in step S101 above, and the correction amount candidates calculated by the correction amount candidate calculation unit 5 in step S103 above.
[0045] FIG. 8 is a flowchart illustrating the details of the processing of the display area determination unit 7.
[0046] In step S1051, the first dispersion map generation unit 71 calculates the dispersion of heights at each position on a two-dimensional coordinate plane based on the measurement values and setting values of the sensor group 1 stored in the memory unit 2 in the above step S101, and generates a first dispersion map σ1(x, y) representing this.
[0047] In step S1052, the second dispersion map generator 72 calculates the dispersion of the corrected heights at each position on the two-dimensional coordinate plane based on the measurement values and setting values of the sensor group 1 stored in the memory unit 2 in step S101 and the correction amount candidates calculated by the correction amount candidate calculator 5 in step S103, and generates a second dispersion map σ2 (x, y, correction amount candidate) that represents this. Even if there are multiple correction amount candidates, only one second dispersion map σ2 is generated.
[0048] In step S1053, the first region detection unit 73 detects the region on the two-dimensional coordinate plane where the difference between the first variance map σ1 and the second variance map σ2 is the largest, and outputs this as the display region R.
[0049] In step S106, the display data generation unit 8 generates display data to be presented to the user based on the first map generated by the first map generation unit 4 in step S102, the second map generated by the second map generation unit 6 in step S104, and the display area R determined by the display area determination unit 7 in step S105, and displays the data on the input / output interface 3.
[0050] The display region R is the region where the difference between the first variance map σ1 and the second variance map σ2 is greatest, and this is the region where the difference between the first map (point cloud map before correction) and the second map (point cloud map after correction) is most noticeable. The display data generator 8 generates display data including the point cloud map before correction for the display region R and displays it on the input / output interface 3 ( FIG. 9A ). The user can visually recognize that the floor surface is being measured multiple times due to an abnormality (error) in the setting values of the sensor group 1.
[0051] 9A , when the user selects "Yes," the display data generation unit 8 generates display data including a corrected point cloud map in the display area R, and displays it on the input / output interface 3 ( FIG. 9B ). By comparing multiple corrected point cloud maps corresponding to multiple correction amount candidates, the user can select an appropriate correction amount without having to be aware of the technical details of the setting values of the sensor group 1.
[0052] 9B, when the user selects "?", the display data generator 8 generates display data including details of the correction amount and displays it on the input / output interface 3 (FIG. 9C). If necessary, the user can check technical details regarding the setting values of the sensor group 1.
[0053] When the user selects "Cancel" in the state of FIG. 9B, the display data generating unit 8 generates display data that prompts the user to request maintenance, and displays the generated display data on the input / output interface 3 (FIG. 9D).
[0054] In the state shown in Figure 9B, when the user selects one of the multiple "Apply" options, the correction amount acquisition unit 9 acquires the one correction amount selected by the user from the multiple correction proposals via the input / output interface 3 (step S107).
[0055] In step S108, the first corrector 10 corrects the setting value of the sensor group 1 using the correction amount acquired by the correction amount acquirer 9 in step S107.
[0056] As described above, the robot 100 according to the first embodiment includes a first map generator 4 that generates a first map (a point cloud map before correction) that represents the height of each position on a two-dimensional coordinate plane, a second map generator 6 that generates a second map (a point cloud map after correction) that represents the corrected height of each position on the two-dimensional coordinate plane, and a display data generator 8 that generates display data that represents the states before and after correction of the setting values of the sensor group 1 based on the first map and the second map. These features enable even a user without technical expertise to correct the setting values of the sensor group 1 mounted on the robot 100.
[0057] Furthermore, the robot 100 according to the first embodiment includes a display area determination unit 7 that determines a display area R on a two-dimensional coordinate plane, and a display data generation unit 8 that generates display data including point cloud maps before and after correction in the display area R. These features allow the user to easily recognize the effect of correcting the setting values of the sensor group 1.
[0058] The first map and the second map are not limited to point cloud maps. For example, the first map and the second map may be a 3D grid map that represents the heights before and after correction on a two-dimensional coordinate plane. Alternatively, the first map and the second map may be a variance map that represents the variance of the heights before and after correction on a two-dimensional coordinate plane. In the case of a variance map, color coding may be performed according to the value of the variance so that the magnitude of the variance can be visually recognized. For example, the variance value may be color-coded using rainbow colors (red, orange, yellow, yellow-green, green, blue, and purple).
[0059] Furthermore, although the provisional correction amount generator 51 comprehensively generates correction amounts in the first embodiment, other methods may be used. For example, a method using mathematical optimization may be used. Mathematical optimization is a method in which an initial value is given and then the correction amount is gradually adjusted to improve the result. Although there is no guarantee that a better correction amount will be obtained than with the comprehensive method, a reasonably good result can be obtained with a smaller amount of calculation than with the comprehensive method.
[0060] 10 is a diagram illustrating a configuration of a robot 200 according to a second embodiment of the present disclosure. The robot 200 according to the second embodiment includes a first map generation unit 204, a correction amount candidate calculation unit 205, a second map generation unit 206, a display area determination unit 207, and a display data generation unit 208, instead of the first map generation unit 4, the second map generation unit 6, the display area determination unit 7, and the display data generation unit 8 of the robot 100 according to the first embodiment described above.
[0061] The first map generation unit 204 determines the presence or absence of an obstacle at each position in the work space, specifically, the state of each position on a two-dimensional coordinate plane (xy coordinate plane), based on the measurement values and setting values of the sensor group 1 stored in the memory unit 2, and generates a first map (obstacle map before correction) that represents this. An example of the state of each position is the presence or absence of an obstacle. Other examples include obstacle present, empty, unknown, etc. At least two types of state are sufficient for each position, and other examples besides those listed here are also possible. In the following description, the presence or absence of an obstacle is treated as the state of each position.
[0062] The second map generation unit 206 determines the presence or absence (TRUE or FALSE) of a corrected obstacle at each position in the working space, specifically, the presence or absence (TRUE or FALSE) of a corrected obstacle at each position on a two-dimensional coordinate plane (xy coordinate plane), based on the measurement values and setting values of the sensor group 1 stored in the memory unit 2 and the correction amount candidates calculated by the correction amount candidate calculation unit 205, and generates a second map (corrected obstacle map) that represents this.
[0063] The display area determination unit 207 determines the display area R on a two-dimensional coordinate plane based on the measurement values and setting values of the sensor group 1 stored in the memory unit 2 and the correction amount candidates calculated by the correction amount candidate calculation unit 205.
[0064] 11 is a diagram showing the detailed configuration of the display area determination unit 207. The display area determination unit 207 includes a first obstacle map generation unit 271, a second obstacle map generation unit 272, and a second area detection unit 273.
[0065] The first obstacle map generation unit 271 determines whether or not there is an obstacle at each position on the two-dimensional coordinate system based on the measurement values and setting values of the sensor group 1 stored in the memory unit 2, and generates a first obstacle map B1(x, y) that represents this.
[0066] The second obstacle map generation unit 272 determines whether or not there is a corrected obstacle at each position on the two-dimensional coordinate plane based on the measurement values and setting values of the sensor group 1 stored in the memory unit 2 and the correction amount candidates calculated by the correction amount candidate calculation unit 205, and generates a second obstacle map B2 (x, y, correction amount candidates) that represents this.
[0067] The second area detection unit 273 detects the area on the two-dimensional coordinate plane where the difference between the first obstacle map B1 and the second obstacle map B2 is greatest, and outputs this as the display area R.
[0068] 10 , the display data generation unit 208 generates display data representing the states before and after the correction of the setting values of the sensor group 1 based on the first map (obstacle map before correction) generated by the first map generation unit 204, the second map (obstacle map after correction) generated by the second map generation unit 206, and the display area R determined by the display area determination unit 207, and displays the display data on the input / output interface 3. Figures 12A to 12D are examples of display data displayed on the input / output interface, representing the states of a multiplexed measured obstacle (wall) before and after the correction.
[0069] As described above, the robot 200 according to the second embodiment includes a first map generation unit 204 that generates a first map (obstacle map before correction) that represents the presence or absence of obstacles at each position on a two-dimensional coordinate plane, a second map generation unit 206 that generates a second map (point cloud map after correction) that represents the corrected presence or absence of obstacles at each position on the two-dimensional coordinate plane, and a display data generation unit 208 that generates display data that represents the states before and after correction of the setting values of the sensor group 1 based on the first map and the second map. These features enable even a user without technical expertise to correct the setting values of the sensor group 1 mounted on the robot 200.
[0070] 13 is a diagram illustrating a configuration of a robot 300 according to a third embodiment of the present disclosure. The robot 300 according to the third embodiment includes a display data generating unit 308 and a second correcting unit 310 instead of the display data generating unit 8, the correction amount acquiring unit 9, and the first correcting unit 10 of the robot 100 according to the first embodiment.
[0071] The second correction unit 310 automatically corrects the setting values of the sensor group 1 using the candidate correction amounts calculated by the correction amount calculation unit 5. The display data generation unit 308 generates display data indicating that the setting values of the sensor group 1 have been automatically corrected, and displays the data on the input / output interface 3 ( FIG. 14A ).
[0072] 14A, when the user selects "Details", the display data generation unit 308 generates display data that expresses the results and effects of the correction of the setting values of the sensor group 1, and displays it on the input / output interface 3 (FIG. 14B). When the user selects "Restore" in the state of FIG. 14B, the second correction unit 310 restores the setting values of the sensor group 1 to the state before correction.
[0073] As described above, the robot 300 according to the third embodiment includes the second correction unit 310 that automatically corrects the setting values of the sensor group 1 using the correction amount candidates calculated by the correction amount candidate calculation unit 5. With this feature, the user only needs to visually check whether the state of the setting values of the sensor group 1 after automatic correction is appropriate.
[0074] (Conclusion) The technology disclosed herein is not limited to specific standards, and the illustrated settings may be modified as appropriate. Note that the above-described embodiments are merely examples for realizing the present disclosure, and the present disclosure can be implemented in various other forms. For example, various modifications, substitutions, omissions, combinations, etc. are possible without departing from the spirit of the present disclosure. Such modifications, substitutions, omissions, combinations, etc. are also within the scope of the present disclosure, as well as the scope of the inventions described in the claims and their equivalents.
[0075] The processing steps described in the present disclosure may be considered as a method having a series of these steps. Alternatively, they may be considered as a program for causing a computer to execute the series of steps, or as a recording medium storing the program. Furthermore, the above-described processing is executed by a processor such as a CPU of a computer. Furthermore, the type of recording medium is not particularly limited, as it does not affect the embodiments of the present disclosure.
[0076] Each component described in this disclosure may be implemented in software or hardware. For example, each component may be a software module implemented in software such as a microprogram, and each component may be implemented by a processor executing the software module. Alternatively, each component may be implemented by a circuit block on a semiconductor chip (die), such as an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array). The number of components does not have to match the number of pieces of hardware that implement the components. For example, one processor or circuit may implement multiple components. Conversely, one component may be implemented by multiple processors or circuits.
[0077] The processors described in this disclosure are not limited to specific types and may be, for example, a CPU, a microprocessing unit (MPU), or a graphics processing unit (GPU).
[0078] The present disclosure may also be configured as follows. [Item 1] (Real 1, Real 2, Real 3) A robot comprising: a sensor; a first map generation unit that generates a first map representing a state of each position on a two-dimensional coordinate plane based on measurement values and setting values of the sensor; a correction amount candidate calculation unit that calculates correction amount candidates for the setting value of the sensor; a second map generation unit that generates a second map representing a corrected state of each position on the two-dimensional coordinate plane based on the measurement values and setting values of the sensor and the correction amount candidates; and a display data generation unit that generates display data representing states before and after correction of the setting value of the sensor based on the first map and the second map. [Item 2] (Real 1, Real 3) The robot described in Item 1, wherein the first map is a point cloud map representing pre-correction heights of each position on the two-dimensional coordinate plane, and the second map is a point cloud map representing post-correction heights of each position on the two-dimensional coordinate plane. [Item 3] (Real 1 Variation) The robot according to item 1, wherein the first map is a 3D grid map representing the height of each position on a two-dimensional coordinate plane before correction, and the second map is a 3D grid map representing the height of each position on the two-dimensional coordinate plane after correction. [Item 4] (Real 2) The robot according to item 1, wherein the first map is an obstacle map representing the presence or absence of obstacles at each position on the two-dimensional coordinate plane before correction, and the second map is an obstacle map representing the presence or absence of obstacles at each position on the two-dimensional coordinate plane after correction. [Item 5] (Real 1 Variation) The robot according to item 1, wherein the first map is a variance map representing the variance of heights at each position on the two-dimensional coordinate plane before correction, and the second map is a variance map representing the variance of heights at each position on the two-dimensional coordinate plane after correction. [Item 6] (Real 1, Real 2, Real 3) The robot described in any one of Items 1 to 5, further comprising a display area determination unit that determines a display area on a two-dimensional coordinate plane based on the measurement values and the setting values of the sensors and the candidate correction amounts, and the display data generation unit generates display data including the first map and the second map in the display area.[Item 7] (Real 1, Real 3) The robot described in Item 6, wherein the display area determination unit includes: a first dispersion map generation unit that generates a first dispersion map representing the dispersion of heights at each position on a two-dimensional coordinate plane based on the measurement values and the setting values of the sensor; a second dispersion map generation unit that generates a second dispersion map representing the dispersion of corrected heights at each position on a two-dimensional coordinate plane based on the measurement values and the setting values of the sensor and the candidate correction amounts; and a first area detection unit that detects the area where the difference between the first dispersion map and the second dispersion map is greatest. [Item 8] (Example 2) The robot described in Item 6, wherein the display area determination unit includes: a first obstacle map generation unit that generates a first obstacle map that represents the presence or absence of an obstacle at each position on a two-dimensional coordinate plane based on the measurement values and the setting values of the sensor; a second obstacle map generation unit that generates a second obstacle map that represents the corrected presence or absence of an obstacle at each position on the two-dimensional coordinate plane based on the measurement values and the setting values of the sensor and the candidate correction amounts; and a second area detection unit that detects the area where the difference between the first obstacle map and the second obstacle map is greatest. [Item 9] (Real 1, Real 2, Real 3) The robot according to any one of items 1 to 8, wherein the correction amount candidate calculation unit includes: a provisional correction amount generation unit that generates a plurality of provisional correction amounts; a third dispersion map generation unit that generates a plurality of third dispersion maps corresponding to the plurality of provisional correction amounts based on the measurement values and the setting values of the sensor and the plurality of provisional correction amounts; an average value calculation unit that calculates a plurality of average values corresponding to the plurality of third dispersion maps; and a correction amount candidate determination unit that determines a correction amount candidate based on the plurality of average values. [Item 10] (Real 1, Real 2) The robot according to any one of items 1 to 9, further including: a correction amount acquisition unit that acquires one correction amount selected by a user from the correction amount candidates; and a first correction unit that corrects the setting value of the sensor using the one correction amount. [Item 11] (Real 3) The robot according to any one of items 1 to 9, further including a second correction unit that automatically corrects the setting value of the sensor using the correction amount candidates.[Item 12] A method for correcting a setting value of a sensor mounted on a robot, the method comprising: a step of generating a first map representing a state of each position on a two-dimensional coordinate plane based on the measurement value and setting value of the sensor; a step of calculating candidate correction amounts for the setting value of the sensor; a step of generating a second map representing a corrected state of each position on the two-dimensional coordinate plane based on the measurement value and setting value of the sensor and the candidate correction amounts; and a step of generating display data representing a state of the setting value of the sensor before and after correction based on the first map and the second map. [Item 13] A computer program for correcting setting values of a sensor mounted on a robot, the computer program causing a computer to execute the following steps: generating a first map representing a state of each position on a two-dimensional coordinate plane based on the measurement values and setting values of the sensor; calculating candidate correction amounts for the setting values of the sensor; generating a second map representing the corrected state of each position on the two-dimensional coordinate plane based on the measurement values and setting values of the sensor and the candidate correction amounts; and generating display data representing the state of the sensor before and after correction based on the first map and the second map.
[0079] REFERENCE SIGNS LIST 1 Sensor group (sensor) 2 Memory unit 3 Input / output interface 4 First map generation unit 5 Correction amount candidate calculation unit 6 Second map generation unit 7 Display area determination unit 8 Display data generation unit 9 Correction amount acquisition unit 10 Correction unit 51 Provisional correction amount generation unit 52 Third dispersion map generation unit 53 Average value calculation unit 54 Correction amount candidate determination unit 71 First dispersion map generation unit 72 Second dispersion map generation unit 73 First area detection unit 100 Robot 200 Robot 204 First map generation unit 205 Correction amount gallop calculation unit 206 Second map generation unit 207 Display area determination unit 208 Display data generation unit 271 First obstacle map generation unit 272 Second obstacle map generation unit 273 Second area detection unit 300 Robot 308 Display data generation unit 310 Second correction unit
Claims
1. A robot comprising: a sensor; a first map generation unit that generates a first map representing a state of each position on a two-dimensional coordinate plane based on measurement values and setting values of the sensor; a candidate correction amount calculation unit that calculates candidate correction amounts for the setting value of the sensor; a second map generation unit that generates a second map representing a corrected state of each position on the two-dimensional coordinate plane based on the measurement values and setting values of the sensor and the candidate correction amounts; and a display data generation unit that generates display data representing the state before and after correction of the setting value of the sensor based on the first map and the second map.
2. The robot described in claim 1, wherein the first map is a point cloud map representing the pre-corrected height of each position on a two-dimensional coordinate plane, and the second map is a point cloud map representing the post-corrected height of each position on the two-dimensional coordinate plane.
3. The robot described in claim 1, wherein the first map is a 3D grid map representing the pre-corrected height of each position on a two-dimensional coordinate plane, and the second map is a 3D grid map representing the post-corrected height of each position on the two-dimensional coordinate plane.
4. The robot described in claim 1, wherein the first map is an obstacle map that represents the presence or absence of obstacles at each position on a two-dimensional coordinate plane before correction, and the second map is an obstacle map that represents the presence or absence of obstacles at each position on the two-dimensional coordinate plane after correction.
5. The robot described in claim 1, wherein the first map is a variance map representing the variance of heights before correction for each position on a two-dimensional coordinate plane, and the second map is a variance map representing the variance of heights after correction for each position on the two-dimensional coordinate plane.
6. The robot described in claim 1, further comprising a display area determination unit that determines a display area on a two-dimensional coordinate plane based on the measurement values and setting values of the sensor and the candidate correction amounts, and the display data generation unit generates display data including the first map and the second map in the display area.
7. The robot described in claim 6, wherein the display area determination unit includes: a first dispersion map generation unit that generates a first dispersion map representing the variance of height at each position on a two-dimensional coordinate plane based on the measurement values and the setting values of the sensor; a second dispersion map generation unit that generates a second dispersion map representing the variance of corrected height at each position on a two-dimensional coordinate plane based on the measurement values and the setting values of the sensor and the candidate correction amounts; and a first area detection unit that detects the area in which the difference between the first dispersion map and the second dispersion map is greatest.
8. The robot described in claim 6, wherein the display area determination unit includes: a first obstacle map generation unit that generates a first obstacle map representing the presence or absence of an obstacle at each position on a two-dimensional coordinate plane based on the measurement values and the setting values of the sensor; a second obstacle map generation unit that generates a second obstacle map representing the corrected presence or absence of an obstacle at each position on the two-dimensional coordinate plane based on the measurement values and the setting values of the sensor and the candidate correction amounts; and a second area detection unit that detects the area where the difference between the first obstacle map and the second obstacle map is largest.
9. The robot described in claim 1, wherein the correction amount candidate calculation unit includes: a provisional correction amount generation unit that generates a plurality of provisional correction amounts; a third dispersion map generation unit that generates a plurality of third dispersion maps corresponding to the plurality of provisional correction amounts based on the measurement values and the set values of the sensor and the plurality of provisional correction amounts; an average value calculation unit that calculates a plurality of average values corresponding to the plurality of third dispersion maps; and a correction amount candidate determination unit that determines correction amount candidates based on the plurality of average values.
10. The robot described in claim 1, further comprising: a correction amount acquisition unit that acquires one correction amount selected by a user from the candidate correction amounts; and a first correction unit that corrects the setting value of the sensor using the one correction amount.
11. The robot according to claim 1, further comprising a second correction unit that automatically corrects the setting value of the sensor using the candidate correction amount.
12. A method for correcting a setting value of a sensor mounted on a robot, comprising: a step of generating a first map representing a state of each position on a two-dimensional coordinate plane based on the measurement values and setting values of the sensor; a step of calculating candidates for correction amounts for the setting values of the sensor; a step of generating a second map representing a corrected state of each position on the two-dimensional coordinate plane based on the measurement values and setting values of the sensor and the candidate correction amounts; and a step of generating display data representing the state before and after correction of the setting values of the sensor based on the first map and the second map.
13. A computer program for correcting the setting values of a sensor mounted on a robot, the computer program causing a computer to execute the following steps: generating a first map representing the state of each position on a two-dimensional coordinate plane based on the measurement values and setting values of the sensor; calculating candidates for correction amounts for the setting values of the sensor; generating a second map representing the corrected state of each position on the two-dimensional coordinate plane based on the measurement values and setting values of the sensor and the candidates for correction amounts; and generating display data representing the state before and after correction of the setting values of the sensor based on the first map and the second map.
Citation Information
Patent Citations
Autonomously acting robot and control method of autonomously acting robot
JP2016048464A
EXTRINSIC CALIBRATION METHOD OF MULTIPLE 3D LiDAR SENSORS FOR AUTONOMOUS NAVIGATION SYSTEM
US20210103040A1
Polyhedral sensor calibration target for calibrating multiple types of sensors
US20220402444A1
