Information processing device
The information processing device improves point cloud data reliability by integrating driving condition information into the data generation process, enhancing accuracy in self-position estimation and environmental mapping.
Patent Information
- Application Number
- JP2023124137
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-07-31
- Publication Date
- 2024-11-20
- Estimated Expiration
- 2038-10-12
AI Technical Summary
Conventional VSLAM methods using video cameras generate point cloud data with low reliability due to integration of point cloud data with varying reliability, which affects self-position estimation and environmental mapping accuracy.
An information processing device that acquires imaging and driving condition information, generates point cloud data, and adds driving condition information to improve the reliability of point cloud data by determining the contribution of each data set based on its conditions.
Enhances the reliability of integrated point cloud data by assessing and adjusting the contribution of each data set based on driving conditions, ensuring higher accuracy in self-position estimation and environmental mapping.
Smart Images

Figure 0007587645000001 
Figure 0007587645000002 
Figure 0007587645000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device. [Background technology]
[0002] Conventionally, a method (SLAM: Simultaneous Localization and Mapping) is known in which a moving object simultaneously performs self-location estimation and creates an environmental map. As one type of SLAM, a method (VSLAM: Visual SLAM) using a video camera instead of a laser device has been proposed (see, for example, Patent Document 1). In VSLAM as described in Patent Document 1, the use of a video camera aims to reduce costs. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2014-222550 A Summary of the Invention [Problem to be solved by the invention]
[0004] In a VSLAM such as that described in Patent Document 1, feature points are extracted from each image (frame) captured by a video camera, and self-location estimation and environmental map creation are performed based on changes in feature points between each image. Point cloud data included in such an environmental map is collected and integrated by a device such as an external server, and the integrated point cloud data may be used for self-location estimation, etc.
[0005] However, the generated point cloud data is not always highly accurate. Therefore, if the multiple point cloud data to be integrated include point cloud data with low reliability, the reliability of the integrated point cloud data may be reduced. If the reliability of the integrated point cloud data is low, it is difficult to use the data for self-location estimation or the like.
[0006] Therefore, an example of an object of the present invention is to provide an information processing device that can improve the reliability of integrated point cloud data. [Means for solving the problem]
[0007] In order to solve the above-mentioned problems and achieve the object, the information processing device of the present invention described in claim 1 is characterized by comprising an imaging information acquisition unit that acquires imaging information from an imaging unit mounted on a moving body, a driving condition acquisition unit that acquires driving condition information related to the driving conditions of the moving body at the time of imaging, a generation unit that generates point cloud data based on the imaging information, and an information assignment unit that assigns the driving condition information to the point cloud data.
[0008] The information processing device of the present invention described in claim 2 is characterized by comprising an imaging information acquisition unit that acquires imaging information from an imaging unit mounted on a moving body, a driving condition acquisition unit that acquires driving condition information related to the driving conditions of the moving body at the time of imaging, a generation unit that generates point cloud data based on the imaging information, and an information assignment unit that assigns reliability information based on the driving condition information to the point cloud data.
[0009] The information processing method of the present invention described in claim 5 is characterized by including an imaging information acquisition step of acquiring imaging information from an imaging unit mounted on a moving body, a driving condition acquisition step of acquiring driving condition information related to the driving conditions of the moving body at the time of imaging, a generation step of generating point cloud data based on the imaging information, and an information assignment step of assigning the driving condition information to the point cloud data.
[0010] The information processing method of the present invention described in claim 6 is characterized by including an imaging information acquisition step of acquiring imaging information from an imaging unit mounted on a moving body, a driving condition acquisition step of acquiring driving condition information related to the driving conditions of the moving body at the time of imaging, a generation step of generating point cloud data based on the imaging information, and an information assignment step of assigning reliability information based on the driving condition information to the point cloud data. [Brief description of the drawings]
[0011] [Figure 1] 1 is a block diagram showing an outline of an information processing device according to an embodiment of the present invention; [Diagram 2] 3 is a plan view showing an example of a frame of imaging information acquired by the information processing device; FIG. [Diagram 3] 11 is a plan view showing another example of a frame of imaging information acquired by the information processing device. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] An information processing device according to an embodiment of the present invention includes an imaging information acquisition unit that acquires imaging information from an imaging unit mounted on a moving object, a driving condition acquisition unit that acquires driving condition information related to the driving conditions of the moving object at the time of imaging, a generation unit that generates point cloud data based on the imaging information, and an information assignment unit that assigns the driving condition information to the point cloud data.
[0013] According to the information processing device of this embodiment, by adding driving condition information to the point cloud data, when collecting and integrating the point cloud data, the contribution degree of each point cloud data can be determined based on the driving condition information. If the driving conditions are such that highly reliable point cloud data can be obtained, the contribution degree of this point cloud data can be increased, and if the driving conditions are such that only unreliable point cloud data can be obtained, the contribution degree of this point cloud data can be decreased. Therefore, when integrating multiple point cloud data, the contribution degree of each point cloud data can be determined based on the driving condition information, thereby improving the reliability of the integrated point cloud data.
[0014] The imaging information acquisition unit, the driving condition acquisition unit, the generation unit, and the information provision unit do not have to be mounted on the same target, and may be mounted on different devices or apparatuses. That is, each component of the information processing device may be located across multiple physically separated devices.
[0015] An information processing device according to another embodiment of the present invention includes an imaging information acquisition unit that acquires imaging information from an imaging unit mounted on a moving body, a driving condition acquisition unit that acquires driving condition information related to the driving conditions of the moving body at the time of imaging, a generation unit that generates point cloud data based on the imaging information, and an information assignment unit that assigns reliability information based on the driving condition information to the point cloud data.
[0016] According to the information processing device of this embodiment, by adding reliability information based on driving condition information to the point cloud data, when collecting and integrating point cloud data, the contribution of each point cloud data can be determined based on the reliability information, thereby improving the reliability of the integrated point cloud data.
[0017] The driving condition acquisition unit preferably acquires at least one of self-information related to the state or behavior of the moving body and external information related to the environment around the moving body as the driving condition information. The self-information includes, for example, driving stability. The lower the speed of the moving body, the smaller the acceleration (acceleration / deceleration), and the less the wobble, the higher the driving stability. The higher the driving stability, the easier it is to generate highly reliable point cloud data.
[0018] The external information includes, for example, the difficulty of imaging and the degree of travel obstruction. When the surroundings of the moving body are dark or in rainy weather, imaging becomes difficult or clear imaging information cannot be obtained, and the difficulty of imaging increases. When there is a traffic jam, when the distance to the moving body in front is close, or when the moving body in front is large, features around the moving body are hidden by the shadow of the other moving body, and the difficulty of imaging increases. In addition, when the surroundings of the moving body are dark or in rainy weather, the stability of the traveling may decrease, and the degree of travel obstruction increases. When the difficulty of imaging or the degree of travel obstruction is high, the reliability of the generated point cloud data is likely to decrease.
[0019] The driving condition acquisition unit may directly acquire driving condition information, or may calculate or estimate the driving condition information by acquiring other parameters. For example, the brightness around the mobile object may be detected by a sensor, or may be estimated based on time information and date information. Information on whether or not there are street lights on the road along which the mobile object is traveling may also be taken into consideration. Information on the weather may be detected by a sensor to detect rain, or may be acquired from outside the mobile object via a network or the like.
[0020] In any of the information processing devices according to the above embodiments, it is preferable that the information processing device further includes an output unit that outputs the point cloud data, thereby making it possible to utilize the point cloud data at the output destination.
[0021] An information processing method according to an embodiment of the present invention includes an imaging information acquiring step of acquiring imaging information from an imaging unit mounted on a moving body, a driving condition acquiring step of acquiring driving condition information related to the driving conditions of the moving body at the time of imaging, a generating step of generating point cloud data based on the imaging information, and an information assigning step of assigning the driving condition information to the point cloud data. According to this information processing method, the reliability of the integrated point cloud data can be improved by assigning the driving condition information to the point cloud data.
[0022] An information processing method according to another embodiment of the present invention includes an imaging information acquiring step of acquiring imaging information from an imaging unit mounted on a moving body, a driving condition acquiring step of acquiring driving condition information related to the driving conditions of the moving body at the time of imaging, a generating step of generating point cloud data based on the imaging information, and an information assigning step of assigning reliability information based on the driving condition information to the point cloud data. According to this information processing method, the reliability of the integrated point cloud data can be improved by assigning the reliability information based on the driving condition information to the point cloud data.
[0023] Moreover, the above-described information processing method may be implemented as an information processing program that causes a computer to execute the information processing method, thereby making it possible to improve the reliability of the integrated point cloud data using a computer.
[0024] The information processing program may be stored in a computer-readable recording medium. In this way, the program can be distributed as a standalone program in addition to being incorporated into a device, and version upgrades can be easily performed. EXAMPLES
[0025] An embodiment of the present invention will be specifically described below. As shown in Fig. 1, the information processing unit 1 of this embodiment is composed of a first information processing device 1A, which is a VSLAM device mounted on a moving body 10, and a second information processing device 1B mounted on an external server 100. The first information processing device 1A includes an information acquisition unit 2, a generation unit 3, and an output unit 4. The moving body 10 is, for example, a vehicle, and is equipped with an imaging unit 20, a map information storage unit 30, a self-position estimation unit 40, a driving information sensor 50, and a date and time information management unit 60.
[0026] The second information processing device 1B includes a collection unit 11 and a generation unit 12. The external server 100 includes a communication unit 101 and a storage unit main body 102. The external server 100 is configured to communicate with a plurality of first information processing devices 1A.
[0027] The imaging unit 20 is, for example, a video camera, and is arranged to capture an image of the front side in the traveling direction of the moving object 10. The moving image captured by the imaging unit 20 is composed of a plurality of pieces of imaging information (frames), and is transmitted to the information acquisition unit 2. The imaging unit may be capable of capturing still images continuously at a predetermined time interval.
[0028] The map information storage unit 30 is composed of, for example, a hard disk or a non-volatile memory, and stores existing map information. The map information stored in the map information storage unit 30 needs to include at least information about features. Note that information about features includes not only numerical values about the positions and sizes of features, but also information about the attributes and types of features (such as distinction between residential and commercial facilities, and the type of business of commercial facilities).
[0029] The self-position estimation unit 40 estimates the current position (absolute position) of the moving body 10, and may be, for example, a GPS receiving unit that receives radio waves transmitted from a plurality of GPS (Global Positioning System) satellites. The current position estimated by the self-position estimation unit 40 is transmitted to the information acquisition unit 2 as position information indicating the imaging position of the imaging information captured by the imaging unit 20.
[0030] The travel information sensor 50 is a sensor for measuring the amount of displacement of the moving body 10, and is composed of, for example, a vehicle speed pulse acquisition unit for acquiring the vehicle speed pulse of the moving body 10, a gyro sensor for measuring the amount of directional displacement of the moving body 10, and an acceleration sensor for acquiring the acceleration of the moving body 10. The traveling direction of the moving body 10 is estimated by the amount of displacement acquired by the travel information sensor 50. Image capture orientation information regarding the orientation of the image capture unit 20 at the time of image capture is determined by the traveling direction of the moving body 10 and the mounting direction of the image capture unit 20 in the moving body 10. When the image capture unit 20 is directed to the front of the moving body, the traveling direction and the image capture orientation are approximately the same. Therefore, the image capture orientation information is transmitted from the travel information sensor 50 to the information acquisition unit 2. It is sufficient that the travel information sensor 50 is capable of estimating at least the traveling direction of the moving body 10.
[0031] The date and time information management unit 60 has a calendar function and a clock function. The clock function is preferably a radio-controlled clock function that receives standard radio waves and automatically corrects errors. Date information and time information are transmitted from the date and time information management unit 60 to the information acquisition unit 2. Based on the date information and time information, solar altitude information and solar azimuth information can be identified. Therefore, the information acquisition unit 2 that acquires date information and time information can be considered to have acquired solar altitude information and solar azimuth information.
[0032] The information acquisition unit 2 functions as an imaging information acquisition unit by acquiring imaging information from the imaging unit 20 as described above, functions as a position information acquisition unit by acquiring position information from the self-position estimation unit 40 as described above, functions as a map information acquisition unit by acquiring map information from the map information storage unit 30, functions as an imaging orientation information acquisition unit by acquiring imaging orientation information from the driving information sensor 50 as described above, and functions as a solar information acquisition unit by acquiring solar altitude information and solar orientation information from the date and time information management unit 60 as described above. The information acquisition unit 2 may acquire other information from a data center or the like via a network such as the Internet or a public line.
[0033] The generating unit 3 extracts feature points from the imaging information acquired by the information acquiring unit 2 to generate a two-dimensional feature point group, and further generates point group data based on the plurality of feature point groups. The point group data generated by the generating unit 3 may be, for example, three-dimensional point group data. For example, an ORB (Oriented fast and Rotated Brief) algorithm may be used to extract the feature points. , other algorithms may be used.
[0034] The output unit 4 is composed of a circuit, an antenna, and the like for communicating with a network such as the Internet or a public line, and transmits the information (point cloud data) generated by the generation unit 3 by communicating with a communication unit 101 of the external server 100. As a result, the information is stored in the storage unit main body 102 of the external server 100.
[0035] The collection unit 11 of the second information processing device 1B acquires the point cloud data (individual point cloud data) generated by the first information processing device 1A via the communication unit 101. The collection unit 11 collects the individual point cloud data by acquiring the individual point cloud data from a plurality of moving objects or acquiring the individual point cloud data from one moving object multiple times.
[0036] The generating unit 12 generates integrated point cloud data based on the plurality of individual point cloud data collected by the collecting unit 11. The integrated point cloud data may be a combination of the plurality of individual point cloud data, or may indicate the average position of the constituent points of the plurality of individual point cloud data.
[0037] The thus generated comprehensive point cloud data is used, for example, to estimate the self-position of a moving object. That is, when a feature is detected by an optical sensor (so-called LIDAR; Laser Imaging Detection and Ranging) mounted on the moving object, the self-position of the moving object can be estimated by comparing it with the comprehensive point cloud data.
[0038] [Get driving condition information] The information acquisition unit 2 acquires driving condition information related to the driving conditions of the moving body 10 at the time of imaging, and functions as a driving condition acquisition unit. The timing at which the information acquisition unit 2 acquires the driving condition information is arbitrary, and for example, the imaging information and the driving condition information may be acquired simultaneously, or the driving condition information may be acquired after acquiring the imaging information and generating the point cloud data.
[0039] The traveling condition information includes self-information related to the state or behavior of the moving body 10 and external information related to the environment around the moving body 10. Note that the traveling condition information may include only either the self-information or the external information.
[0040] The self-information includes, for example, driving stability. The lower the speed, the lower the acceleration (less acceleration / deceleration), and the less the sway of the moving body 10, the higher the driving stability. The higher the driving stability, the easier it is to generate highly reliable point cloud data. The driving stability may be calculated based on the speed, acceleration, and sway at the time of imaging, or may be calculated based on the past driving history. In other words, if the stability was high during past driving, it can be estimated that the driving stability is also high at the time of imaging. In addition, the driving stability may be calculated based on the past driving history of the moving body, or based on the past driving history of the driver.
[0041] The self-information may also include information about the performance and maintenance state of the moving object 10. For example, if the acceleration performance and braking performance of the moving object 10 are high, there is a possibility that large acceleration and deceleration will occur. Also, the likelihood of wobbling will change depending on the power steering settings. That is, the performance and maintenance state of the moving object 10 may change the responsiveness of the moving object to the driver's operation, which may affect the driving stability.
[0042] The external information includes, for example, the degree of difficulty in capturing images and the degree of travel obstruction. When it is dark around the moving body 10 or when it is raining, it becomes difficult for the imaging unit 20 to capture images or clear imaging information cannot be obtained, and the degree of difficulty in capturing images increases. When there is a traffic jam, when the distance to the moving body ahead is close, or when the moving body ahead is large, the features around the moving body are hidden by the other moving bodies, and the degree of difficulty in capturing images increases.
[0043] For example, when a large vehicle C such as a truck is traveling ahead as shown in Figure 2, part or all of building B located on the forward left side of road R as shown in Figure 3 will be hidden by the shadow of the large vehicle C, making it impossible to extract the feature points of building B.
[0044] In addition, when the surroundings of the moving body 10 are dark or in rainy weather, the stability of the moving body 10 may decrease, and the degree of obstacles to the moving body 10 may increase. When the difficulty of capturing an image is high or the degree of obstacles to the moving body 10 is high, the reliability of the generated point cloud data is likely to decrease.
[0045] The driving condition information may be directly acquired, or may be calculated or estimated by acquiring other parameters. For example, the brightness around the mobile object 10 may be detected by a sensor, or may be estimated by acquiring time information and date information from the date and time information management unit 60. Furthermore, by acquiring map information from the map information storage unit 30, the brightness may be estimated taking into consideration whether or not there are street lights on the road along which the mobile object 10 is traveling. Furthermore, information on the weather may be detected by rain by a sensor, or may be acquired by the information acquisition unit 2 from outside the mobile object 10 via a network or the like.
[0046] [Adding information to point cloud data] The generating unit 3 functions as an information adding unit by adding the driving condition information acquired as described above to the generated point cloud data. That is, the output unit 4 outputs the point cloud data to which the driving condition information has been added.
[0047] The generating unit 3 may function as an information adding unit by adding reliability information to the point cloud data instead of the driving condition information. That is, the generating unit 3 may determine the reliability based on the driving condition information and add the information about the reliability to the point cloud data.
[0048] [Integration of individual point cloud data with information added] As described above, in the second information processing device 1B, the collection unit 11 collects individual point cloud data, and the generation unit 12 generates integrated point cloud data based on a plurality of individual point cloud data. At this time, if driving condition information is added to the individual point cloud data, the generation unit 12 determines the contribution degree of the individual point cloud data based on the driving condition information, and generates integrated point cloud data.
[0049] At this time, since the reliability of the individual point cloud data changes depending on the driving conditions as described above, the contribution degree of the individual point cloud data with high reliability may be increased based on the driving condition information. Note that the contribution degree includes 0, and by setting the contribution degree to 0, the individual point cloud data can be removed. In addition, when reliability information is added to the individual point cloud data instead of the driving condition information, the generation unit 12 may determine the contribution degree of the point cloud data based on the reliability information.
[0050] The generating unit 12 may also generate comprehensive point cloud data based on the individual point cloud data for each driving condition. For example, the individual point cloud data may be classified according to weather, and comprehensive point cloud data for fine weather, comprehensive point cloud data for cloudy weather, and comprehensive point cloud data for rainy weather may be generated. In addition, comprehensive point cloud data may be generated for each driver or vehicle type, or for each driving speed.
[0051] As described above, if the comprehensive point cloud data is generated for each driving condition, the reliability of the comprehensive point cloud data can be improved. That is, when the comprehensive point cloud data is used, the comprehensive point cloud data corresponding to the conditions at that time can be selected, thereby reducing the discrepancy between the conditions at the time of generating the point cloud data and the conditions at the time of use. In the above example, if it is raining when the comprehensive point cloud data is used, the comprehensive point cloud data generated based on the individual point cloud data for rainy weather can be used.
[0052] [Acquisition of driving condition information in second information processing device] In the above example, the first information processing device 1A acquires driving condition information and assigns the information to the individual point cloud data, but the collection unit 11 of the second information processing device 1B may acquire individual point cloud data to which no information is assigned and driving condition information. That is, the collection unit 11 may function as a driving condition acquisition unit. In this case, the driving condition information acquired by the collection unit 11 may include at least one of self information and external information, for example, as in the above example.
[0053] The generating unit 12 determines the contribution of the individual point cloud data based on the driving condition information and generates the integrated point cloud data. At this time, the contribution of the individual point cloud data with high reliability may be increased based on the driving condition information. The generating unit 12 may generate the integrated point cloud data based on the individual point cloud data for each driving condition, as described above.
[0054] With the above configuration, by adding driving condition information or reliability information to the point cloud data, when collecting and integrating individual point cloud data, the contribution of each individual point cloud data can be determined based on the driving condition information or reliability information, thereby improving the reliability of the overall point cloud data.
[0055] Furthermore, by outputting the point cloud data to the external server 100 by the output unit 4, the point cloud data can be utilized in the external server 100 as the output destination.
[0056] Furthermore, even if the collection unit 11 of the second information processing device 1B acquires individual point cloud data to which no information is attached and driving condition information, when collecting and integrating the individual point cloud data, the contribution degree of each individual point cloud data can be determined based on the driving condition information, thereby improving the reliability of the overall point cloud data.
[0057] It should be noted that the present invention is not limited to the above-described embodiment, but includes other configurations that can achieve the object of the present invention, and the following modifications are also included in the present invention.
[0058] For example, in the above embodiment, the information acquisition unit 2 and the generation unit 3 are mounted on the moving body 10, but the imaging information acquisition unit, the driving condition acquisition unit, the generation unit, and the information provision unit constituting the first information processing device may not be mounted on the moving body, and may be mounted on different devices or equipment. That is, each component of the information processing device may span multiple devices that are physically separated.
[0059] In the above embodiment, the collection unit 11 and the generation unit 12 are mounted on the external server 100, but the collection unit, the generation unit, and the driving condition acquisition unit constituting the second information processing device may not be mounted on the external server, and may be mounted on different devices or equipment. That is, each component of the information processing device may be located across multiple physically separated devices.
[0060] In addition, the best configurations and methods for implementing the present invention are disclosed in the above description, but the present invention is not limited thereto. That is, the present invention has been mainly illustrated and described with reference to specific embodiments, but those skilled in the art can make various modifications to the above-described embodiments in terms of shape, material, quantity, and other detailed configurations without departing from the scope of the technical idea and purpose of the present invention. Therefore, the descriptions limiting the shapes, materials, etc. disclosed above are illustrative descriptions for the purpose of facilitating understanding of the present invention, and do not limit the present invention, and therefore descriptions of the names of components that are free of some or all of the limitations on the shapes, materials, etc. are included in the present invention. [Explanation of symbols]
[0061] 1A First information processing device 2 Information acquisition unit (imaging information acquisition unit, driving condition acquisition unit) 3. Generation section (information adding section) 4 Output section 10 Mobile 20 Imaging unit 1B Second information processing device 11 Collection unit (driving condition acquisition unit) 12 Generation part
Claims
1. An information processing device that generates point cloud data to be integrated into comprehensive point cloud data together with other point cloud data, an imaging information acquisition unit that acquires imaging information from an imaging unit mounted on the moving object; a driving condition acquisition unit that acquires driving condition information regarding a driving condition of the moving object at the time of imaging; a generation unit that generates a two-dimensional feature point group based on the imaging information, and further generates the point cloud data based on a plurality of the feature point groups; an information adding unit that adds the driving condition information to the point cloud data, The information processing apparatus, wherein the point cloud data is three-dimensional point cloud data.
2. An information processing device that generates point cloud data to be integrated into comprehensive point cloud data together with other point cloud data, an imaging information acquisition unit that acquires imaging information from an imaging unit mounted on the moving object; a driving condition acquisition unit that acquires driving condition information regarding a driving condition of the moving object at the time of imaging; a generation unit that generates a two-dimensional feature point group based on the imaging information, and further generates the point cloud data based on a plurality of the feature point groups; an information providing unit that provides reliability information based on the driving condition information to the point cloud data, The information processing apparatus, wherein the point cloud data is three-dimensional point cloud data.
3. 3. The information processing device according to claim 1, wherein the driving condition acquisition unit acquires, as the driving condition information, at least one of self-information relating to a state or behavior of the moving body and external information relating to an environment surrounding the moving body.
4. 4. The information processing apparatus according to claim 1, further comprising an output unit that outputs the point cloud data.
5. 1. An information processing method executed by an information processing device for generating point cloud data to be integrated with other point cloud data into comprehensive point cloud data, comprising: an imaging information acquisition step of acquiring imaging information from an imaging unit mounted on the moving object; a driving condition acquisition step of acquiring driving condition information regarding a driving condition of the moving object at the time of imaging; a generating step of generating a two-dimensional feature point group based on the imaging information, and further generating the point cloud data based on a plurality of the feature point groups; and an information imparting step of imparting the driving condition information to the point cloud data, The information processing method, wherein the point cloud data is three-dimensional point cloud data.
6. 1. An information processing method executed by an information processing device for generating point cloud data to be integrated with other point cloud data into comprehensive point cloud data, comprising: an imaging information acquisition step of acquiring imaging information from an imaging unit mounted on the moving object; a driving condition acquisition step of acquiring driving condition information regarding a driving condition of the moving object at the time of imaging; a generating step of generating a two-dimensional feature point group based on the imaging information, and further generating the point cloud data based on a plurality of the feature point groups; and an information assignment step of assigning reliability information based on the driving condition information to the point cloud data, The information processing method, wherein the point cloud data is three-dimensional point cloud data.
7. 7. An information processing program for causing a computer to execute the information processing method according to claim 5.
8. 8. A computer-readable recording medium storing the information processing program according to claim 7.
Citation Information
Patent Citations
One's own vehicle position detection system using scenery image recognition
JP2011215055A
Data management system, data management method and data management program
JP2012159373A
Method for vslam optimization
JP2014222550A
Image processor, image processing method and program
JP2017130049A
Information processing device
JP2018032333A
