Photographing condition determination method, photographing condition determination system, photographing condition determination device, and program
The method and system for determining LiDAR imaging conditions address the challenge of positional dependencies in LiDAR data capture by calculating optimal photographing positions and postures, enhancing the accuracy and completeness of point cloud data.
Patent Information
- Application Number
- JP2023522017
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-05-17
- Publication Date
- 2024-11-13
- Estimated Expiration
- 2041-05-17
AI Technical Summary
Existing LiDAR technologies do not provide methods for determining appropriate imaging conditions, which are crucial for accurately capturing point cloud data due to dependencies on positional relationships and shielding objects, affecting reflected brightness and acquisition range.
A method and system for determining LiDAR imaging conditions by holding reference data and instruction objects, calculating optimal photographing positions and postures, and outputting these conditions to adjust LiDAR settings for accurate imaging.
Enables the determination of appropriate imaging conditions for LiDAR, ensuring effective data capture by accounting for positional relationships and obstructions, thereby improving the quality of point cloud data acquisition.
Smart Images

Figure 0007582460000001 
Figure 0007582460000002 
Figure 0007582460000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a shooting condition determination method, a shooting condition determination system, a shooting condition determination device, and a computer-readable medium. [Background technology]
[0002] LiDAR (Light Detection And Ranging) is a technology that can measure the shape of an object by photographing the shooting scene and measuring the distance to the object present at the shooting scene. For example, the ToF (Time of Flight) method is an example of a method for measuring the distance to an object using LiDAR. LiDAR is used for facility inspections, etc., because it can measure the shape of an object over a wide range.
[0003] In detail, when shooting at a shooting location, the LiDAR measures the distance to the object and the shape of the object by irradiating the object with light. At this time, the LiDAR obtains point cloud data, which is a set of three-dimensional coordinates of measurement points on the object measured by the LiDAR.
[0004] As a related technique for inspecting a facility using point cloud data, for example, there is a technique disclosed in Patent Document 1. In the technique disclosed in Patent Document 1, point cloud data is used to detect changed parts among parts in a facility. In detail, first, sparse point cloud data is acquired by a three-dimensional measuring device such as a laser scanner. Next, pre-stored three-dimensional detailed data and the acquired sparse point cloud data are aligned. Next, a space in the target space area where the sparse point cloud data exists is set as a judgment target space, and the difference amount between the three-dimensional detailed data and the sparse point cloud data in the judgment target space is calculated. Next, based on the calculation result of the difference amount, the changed parts are detected from the three-dimensional detailed data. After that, the three-dimensional measuring device is moved within the judgment target space, and the sparse point cloud data is acquired and the changed parts are detected in the same manner as described above. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2016-217941 A Summary of the Invention [Problem to be solved by the invention]
[0006] Incidentally, the point cloud data acquired by the LiDAR includes data on the 3D coordinates of the measurement points on the object as well as data on the reflection luminance of the measurement points (the intensity of reflected light at the measurement points). However, the point cloud data acquired by the LiDAR depends on the shooting conditions of the LiDAR (e.g., the shooting position, the shooting attitude, etc.).
[0007] For example, reflected luminance data included in point cloud data acquired by a LiDAR depends on the positional relationship (e.g., distance, incident angle, etc.) between the LiDAR and an object. In addition, the range in which the LiDAR can acquire point cloud data depends on the positional relationship between the LiDAR and obstructions due to the linearity of light. In addition, the content contained in the point cloud data acquired by the LiDAR at a fixed angle of view depends on the shooting position and shooting attitude of the LiDAR.
[0008] Therefore, in order to properly capture an object using LiDAR, it is necessary to determine the appropriate LiDAR capture conditions. However, the technology disclosed in Patent Document 1 is a technology in which a three-dimensional measuring device is moved within a space to be determined in order to detect changed parts within a facility. Therefore, Patent Document 1 does not disclose anything about a method for determining appropriate shooting conditions for appropriately shooting an object.
[0009] Therefore, an object of the present disclosure is to provide a shooting condition determination method, a shooting condition determination system, a shooting condition determination device, and a computer-readable medium that can solve the above problems and determine appropriate shooting conditions for LiDAR. [Means for solving the problem]
[0010] A method for determining shooting conditions according to one aspect includes the steps of: A method for determining a photographing condition performed by a photographing condition determination device, comprising: A first step of storing reference data representative of the position of an object; a second step of retaining a pointer object representing the position of the object on the reference data; A third step of determining imaging conditions of a LiDAR (Light Detection And Ranging) for imaging the object based on the reference data and the instruction object; and a fourth step of outputting the photographing conditions.
[0011] A photographing condition determination system according to one aspect includes: a reference data storage unit that stores reference data representing a position of an object; a designated object storage unit that stores a designated object that represents a position of an object on the reference data; an imaging condition determination unit that determines imaging conditions of a LiDAR (Light Detection And Ranging) that images the object based on the reference data and the instruction object; and an imaging condition output unit that outputs the imaging conditions.
[0012] An apparatus for determining photographing conditions according to one aspect of the present invention comprises: a reference data storage unit that stores reference data representing a position of an object; a designated object storage unit that stores a designated object that represents a position of an object on the reference data; an imaging condition determination unit that determines imaging conditions of a LiDAR (Light Detection And Ranging) that images the object based on the reference data and the instruction object; and an imaging condition output unit that outputs the imaging conditions.
[0013] According to one aspect, a computer readable medium includes: On the computer, a first step of maintaining reference data representative of the position of an object; a second step of retaining a pointer object representing a position of the object on the reference data; A third step of determining an imaging condition of a LiDAR (Light Detection And Ranging) for imaging the object based on the reference data and the instruction object; A fourth step of outputting the imaging conditions; The program for executing the above is stored. Effect of the Invention
[0014] According to the above aspects, it is possible to provide an image capturing condition determination method, an image capturing condition determination system, an image capturing condition determination device, and a computer-readable medium that can determine appropriate image capturing conditions for LiDAR. [Brief description of the drawings]
[0015] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a shooting condition determination system according to a first embodiment. [Diagram 2] FIG. 4 is a diagram showing an example of a method A1 for determining an imaging condition by an imaging condition determination unit according to the first embodiment. [Diagram 3] FIG. 11 is a diagram showing an example of a method A2 for determining an imaging condition by an imaging condition determination unit according to the first embodiment. [Figure 4] 4 is a flowchart showing an example of the overall operation flow of the shooting condition determination system according to the first embodiment. FIG. [Diagram 5] FIG. 11 is a diagram illustrating an example of the configuration of a shooting condition determination system according to a second embodiment. [Figure 6] FIG. 11 is a diagram showing an example of a method B1 for determining an imaging condition by an imaging condition determination unit according to the second embodiment. [Figure 7] FIG. 13 is a diagram showing an example of a method B2 for determining an imaging condition by an imaging condition determination unit according to the second embodiment. [Figure 8]FIG. 13 is a diagram showing an example of a method B3 for determining an imaging condition by an imaging condition determination unit according to the second embodiment. [Figure 9] FIG. 9 is a diagram showing an example of the image data in FIG. 8. [Figure 10] FIG. 9 is a diagram showing an example of the point cloud data of FIG. 8. [Figure 11] FIG. 11 is a flowchart showing an example of the overall operation flow of a shooting condition determining system according to the second embodiment. [Figure 12] FIG. 13 is a diagram illustrating an example of the configuration of a shooting condition determination device according to another embodiment. [Figure 13] FIG. 13 is a block diagram showing an example of the hardware configuration of a computer that realizes a shooting condition determination device according to another embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0016] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. Note that the following description and drawings are omitted and simplified as appropriate for clarity of explanation. In addition, in each of the following drawings, the same elements are given the same reference numerals, and duplicate explanations are omitted as necessary.
[0017] <Embodiment 1> First, with reference to FIG. 1, a configuration example of a shooting condition determining system 100 according to the first embodiment will be described.
[0018] As shown in FIG. 1, the image capture condition determination system 100 according to the first embodiment includes a reference data holding unit 101, an instruction object holding unit 102, an image capture condition determination unit 103, and an image capture condition output unit 104, and is a system for determining appropriate image capture conditions for a LiDAR (not shown).
[0019] The reference data storage unit 101 stores reference data. The reference data is data that represents the position of an object in a shooting site. For example, the reference data is point cloud data acquired by the LiDAR, image data acquired by a camera (not shown), or a design drawing.
[0020] The designated object storage unit 102 stores a designated object. The designated object is information that represents the position of an object photographed by the LiDAR on the reference data. For example, the designated object is a point included in the object on the reference data, an area that has a common area with the object on the reference data, etc.
[0021] The designated object can be specified by a user. However, if the target object shows a unique property in the reference data, the designated object can be determined by an automatic process, not by a user specification. For example, the designated object holding unit 102 may hold in advance a setting condition that a part whose color or shape feature (curvature) is within a predetermined range is set as the designated object. The designated object holding unit 102 may then search for a part defined in the setting condition from among the parts in the reference data, and determine and hold the found part as the designated object. Alternatively, the designated object holding unit 102 may hold in advance a setting condition that a certain object is set as the designated object. The designated object holding unit 102 may then use an object search technique, such as pattern matching, to search for an object defined in the setting condition from among the objects in the reference data, and determine and hold the found object as the designated object.
[0022] The imaging condition determination unit 103 determines imaging conditions for the LiDAR for imaging an object represented by the instruction object, based on the reference data and the instruction object. The shooting conditions are conditions under which the LiDAR captures an image of an object, such as the shooting position, shooting attitude, shooting viewing angle, shooting resolution, etc. A specific example of a method for determining the shooting conditions by the shooting condition determination unit 103 will be described later.
[0023] The photographing condition output unit 104 outputs the photographing conditions determined by the photographing condition determination unit 103 to a user or an external means. There are no particular limitations on the method of outputting the shooting conditions, but any method that assists the user or external means in efficient LiDAR shooting is suitable.
[0024] For example, the photographing condition output unit 104 may highlight a part of the reference data based on the photographing condition. For example, if the photographing condition is a photographing position, the photographing condition output unit 104 may highlight a position on the reference data that corresponds to the photographing position by marking or the like. Alternatively, the imaging condition output unit 104 may display an image diagram at the time of imaging based on the imaging conditions on the reference data. Alternatively, the photographing condition output unit 104 may display on a screen the photographing result estimated from the photographing conditions.
[0025] Here, a description will be given of a specific example of a method for determining the shooting conditions by the shooting condition determination unit 103 according to the present embodiment 1. The example described below is an example in which a shooting position and a shooting posture are determined as the shooting conditions.
[0026] (A1)Determination method A1 First, a method A1 for determining the shooting conditions by the shooting condition determination unit 103 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 shows a plan view of the shooting site seen from above (the same applies to Fig. 3 described later).
[0027] As shown in Fig. 2, in the determination method A1, first, the shooting condition determination unit 103 calculates a shooting area in which an object represented by a pointing object can be shot. The shooting area in which an object can be shot is an area in which the object is not blocked by an object and is physically shootable, etc. For example, when the LiDAR is installed on an object and cannot shoot, the area excluding the object is the physically shootable area.
[0028] Next, the photographing condition determination unit 103 determines a photographing position from within the photographing area calculated above. Thereafter, the photographing condition determination unit 103 determines the photographing attitude based on the direction vector from the photographing position determined above to the designating object.
[0029] (A2)Determination method A2 Next, a method A2 of determining the shooting conditions by the shooting condition determining unit 103 according to the first embodiment will be described with reference to FIG.
[0030] As shown in FIG. 3, in the determination method A2, first, the shooting condition determination unit 103 calculates an appropriate shooting area based on the distance to the pointing object or the incident angle. After that, the photographing condition determination unit 103 determines the photographing position and the photographing posture in the same manner as in the above-mentioned determination method A1. That is, the photographing condition determination unit 103 determines the photographing position from within the photographing area calculated above, and determines the photographing attitude based on a direction vector from the determined photographing position to the designating object.
[0031] Next, an example of the flow of the entire operation of the shooting condition determining system 100 according to the first embodiment will be described with reference to FIG.
[0032] 4, first, the reference data storage unit 101 stores reference data, and the designated object storage unit 102 stores a designated object (step S101). At this time, the reference data storage unit 101 stores reference data designated by a user. On the other hand, the designated object storage unit 102 stores a designated object designated by a user, or a designated object determined by automatic processing.
[0033] Next, the imaging condition determination unit 103 determines imaging conditions of the LiDAR for imaging the target object represented by the instruction object, based on the reference data and the instruction object (step S102). After that, the photographing condition output unit 104 outputs the photographing conditions determined by the photographing condition determination unit 103 to the user or an external means (step S103).
[0034] As described above, according to the first embodiment, the reference data storage unit 101 stores reference data representing the position of an object, and the instruction object storage unit 102 stores an instruction object representing the position of the target object on the reference data. In addition, the imaging condition determination unit 103 determines imaging conditions of the LiDAR for imaging the target object represented by the instruction object based on the reference data and the instruction object, and the imaging condition output unit 104 outputs the determined imaging conditions. This makes it possible to determine appropriate imaging conditions for the LiDAR.
[0035] <Embodiment 2> Next, with reference to FIG. 5, an example of the configuration of a shooting condition determining system 100A according to the second embodiment will be described. As shown in FIG. 5, a shooting condition determination system 100A according to the second embodiment is different from the configuration of the first embodiment in that a shooting control unit 105 is added.
[0036] The photography control unit 105 is arranged at the photography site together with a photography device (not shown), and acquires reference data at the photography site using the photography device. The photography device is a device including at least LiDAR among LiDAR and a camera, or an autonomous mobile robot equipped with the device. Therefore, in the second embodiment, the reference data is the data acquired by the photography device, and as a result, blueprints and the like are excluded.
[0037] The imaging condition determination unit 103 determines the imaging conditions of the LiDAR in the same manner as in the above-mentioned embodiment 1. Here, determining the imaging conditions of the LiDAR means determining the imaging conditions of the imaging device. Therefore, in the following, the imaging condition determination unit 103 will be described as determining the imaging conditions of the imaging device.
[0038] The photographing condition output unit 104 outputs the photographing conditions to the photographing control unit 105 through communication with the photographing control unit 105. In this case, the photographing conditions may be a route from the current position to the photographing position to be applied to the photographing device. Alternatively, the photographing conditions may be a displacement (elevation angle and azimuth angle) from the current attitude to the photographing attitude to be applied to the photographing device.
[0039] The photographing control unit 105 changes the state of the photographing device, that is, the state of the LiDAR, based on the photographing conditions output from the photographing condition output unit 104. For example, if the photographing device further includes a camera, changing the state of the photographing device also changes the state of the camera.
[0040] Here, a specific example of a method for determining the shooting conditions by the shooting condition determination unit 103 according to the second embodiment will be described.
[0041] (B1)Determination method B1 First, a method B1 for determining an imaging condition by the imaging condition determination unit 103 according to the second embodiment will be described with reference to Fig. 6. The method B1 is an example in which a displacement from a current posture to an imaging posture is determined as an imaging condition. Note that the method B1 is based on the premise that the imaging position is fixed.
[0042] As shown in FIG. 6, in determination method B1, the shooting condition determination unit 103 determines a displacement of the shooting attitude so that the designation object on the reference data is changed to a specific position (for example, the center) by changing the shooting attitude.
[0043] In the example of Figure 6, the shooting condition determination unit 103 calculates a directional vector from the center of the reference data to the center of the instruction object, and determines the displacement of the shooting attitude (elevation angle and azimuth angle) to be applied to the shooting device based on the calculated directional vector.
[0044] (B2)Determination method B2 Next, a method B2 for determining the image capture conditions by the image capture condition determination unit 103 according to the second embodiment will be described with reference to Fig. 7. The method B2 is an example in which a route from the current position to the image capture position is determined as the image capture condition. Fig. 7 shows a plan view of the image capture site seen from above.
[0045] As shown in FIG. 7, in the determination method B1, first, the shooting condition determination unit 103 calculates an appropriate shooting region in the same manner as in the determination method A2 (FIG. 3) in the above-mentioned first embodiment. Next, the photographing condition determination unit 103 specifies the current position of the photographing device on the reference data.
[0046] Next, the photographing condition determination unit 103 、 From the imaging area calculated above, an imaging position is determined based on the positional relationship with the current position of the imaging device (for example, the path length to reach). After that, the photographing condition determination unit 103 determines a route from the current position to the determined photographing position. The photographing condition determination unit 103 may determine the photographing posture in the same manner as the determination method A2 (FIG. 3) in the above-mentioned first embodiment.
[0047] In Fig. 7, the shooting condition determination unit 103 uses a method similar to the determination method A2 (Fig. 3) in the above-mentioned embodiment 1 when calculating the shooting area, but is not limited to this. The shooting condition determination unit 103 may calculate the shooting area using a method similar to the determination method A1 (Fig. 2) in the above-mentioned embodiment 1.
[0048] (B3) Decision method B3 Next, a method B3 of determining the shooting conditions by the shooting condition determining unit 103 according to the second embodiment will be described with reference to FIGS.
[0049] As shown in Fig. 8, in the determination method B3, it is assumed that the reference data is data in which image data acquired by a camera (see Fig. 9) and point cloud data acquired by a LiDAR (see Fig. 10) are superimposed. Therefore, in the determination method B3, it is assumed that the photographing device is also a device including both a LiDAR and a camera, or an autonomous mobile robot equipped with such a device.
[0050] In the example of Fig. 8, the instruction object is not on the point cloud data but on the image data. In this case, the photographing condition determination unit 103 determines the photographing posture using, for example, a method similar to the above-mentioned determination method B1 (Fig. 6).
[0051] On the other hand, although not shown, it is assumed that the designating object is located on one of the points of the point cloud data. In this case, the photographing condition determination unit 103 may determine the route from the current position to the photographing position and the photographing posture, for example, by using a method similar to the above-mentioned determination method B2 (FIG. 7).
[0052] However, even if the designated object is not on the point cloud data but on the image data, the photographing condition determination unit 103 can determine the route from the current position to the photographing position and the photographing attitude by using the following method. That is, the photographing condition determination unit 103 identifies an object including the designated object on the image data by clustering, and acquires a point that represents the identified object on the point cloud data. Then, the photographing condition determination unit 103 regards the acquired point as the designated object and determines the route and the photographing attitude.
[0053] Also, even if the designated object is not on the point cloud data but on the image data, it is possible to obtain a point that can be regarded as the designated object, so it is not necessary to display the point cloud data. Therefore, even if the reference data is data in which the image data and the point cloud data are superimposed, the shooting condition output unit 104 may display only the image data. Then, the shooting condition determination unit 103 may determine that the position touched on the image data is the designated object and perform the above operation.
[0054] Next, an example of the flow of the entire operation of the shooting condition determining system 100A according to the second embodiment will be described with reference to FIG.
[0055] 11, first, the photography control unit 105 acquires reference data using a photography device, and the reference data storage unit 101 stores the reference data acquired by the photography control unit 105 (step S201). Furthermore, the instruction object storage unit 102 stores an instruction object (step S202). At this time, the instruction object storage unit 102 stores an instruction object designated by a user, or stores an instruction object determined by automatic processing.
[0056] Next, the photographing condition determination unit 103 determines the photographing conditions of the photographing device for photographing the target represented by the instruction object, based on the reference data and the instruction object (step S203).
[0057] Next, the photographing condition output unit 104 outputs the photographing conditions determined by the photographing condition determination unit 103 to the photographing control unit 105 (step S204). After that, the photographing control unit 105 changes the state of the photographing device based on the photographing conditions output from the photographing condition output unit 104 (step S205).
[0058] As described above, according to the second embodiment, the image capturing condition output unit 104 outputs image capturing conditions to the image capturing control unit 105 that acquires reference data using an image capturing device including at least a LiDAR. The image capturing control unit 105 changes the state of the image capturing device based on the image capturing conditions. This makes it possible to correct the state of the image capturing device even if the image capturing device is located in a remote location, for example. Other effects are the same as those of the first embodiment.
[0059] <Other embodiments> In the above first and second embodiments, the reference data holding unit 101, the instruction object holding unit 102, the shooting condition determination unit 103, and the shooting condition output unit 104 are illustrated as being provided separately from each other, but these components may be provided together within a single device (shooting condition determination device).
[0060] Next, the configuration of a shooting condition determination device 200 according to another embodiment will be described with reference to FIG. 12, a shooting condition determination device 200 according to another embodiment includes a reference data holding unit 101, a designation object holding unit 102, a shooting condition determination unit 103, and a shooting condition output unit 104. Note that the operations of these components are similar to those described in the first and second embodiments, and therefore will not be described here.
[0061] <Hardware configuration of a shooting condition determination device according to another embodiment> Next, with reference to FIG. 13, a hardware configuration of a computer 300 that realizes the shooting condition determination device 200 according to the other embodiment will be described.
[0062] 13, the computer 300 includes a processor 301, a memory 302, a storage 303, an input / output interface (input / output I / F) 304, and a communication interface (communication I / F) 305. The processor 301, the memory 302, the storage 303, the input / output interface 304, and the communication interface 305 are connected by a data transmission path for transmitting and receiving data to and from each other.
[0063] The processor 301 is, for example, a processing device such as a central processing unit (CPU) or a graphics processing unit (GPU). The memory 302 is, for example, a random access memory (RAM) or a read only memory (ROM). The storage 303 is, for example, a storage device such as a hard disk drive (HDD), a solid state drive (SSD), or a memory card. The storage 303 may also be a memory such as a RAM or a ROM.
[0064] A program is stored in the storage 303. This program includes a set of instructions (or software code) for causing the computer to perform one or more functions described in the above embodiment when the program is loaded into the computer. The photographing condition determination unit 103 and the photographing condition output unit 104 in the above photographing condition determination device 200 may be realized by the processor 301 reading and executing the program stored in the storage 303. Also, the reference data holding unit 101 and the instruction object holding unit 102 in the above photographing condition determination device 200 may be realized by the memory 302 or the storage 303.
[0065] The above programs may also be stored on non-transitory computer-readable media or tangible storage media. By way of example and not limitation, computer-readable media or tangible storage media include RAM, ROM, flash memory, SSD or other memory technology, CD (Compact Disc)-ROM, DVD (Digital Versatile Disc), Blu-ray (registered trademark) disk or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The programs may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.
[0066] The input / output interface 304 is connected to a display device 3041, an input device 3042, a sound output device 3043, and the like. The display device 3041 is a device that displays a screen corresponding to drawing data processed by the processor 301, such as an LCD (Liquid Crystal Display), a CRT (Cathode Ray Tube) display, or a monitor. The input device 3042 is a device that accepts an operation input by an operator, and is, for example, a keyboard, a mouse, or a touch sensor. The display device 3041 and the input device 3042 may be integrated and realized as a touch panel. The sound output device 3043 is a device that acoustically outputs a sound corresponding to the sound data processed by the processor 301, such as a speaker.
[0067] The communication interface 305 transmits and receives data to and from an external device. For example, the communication interface 305 communicates with the external device via a wired communication path or a wireless communication path.
[0068] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure.
[0069] Furthermore, some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes. (Appendix 1) A method for determining a photographing condition performed by a photographing condition determination device, comprising: A first step of storing reference data representative of the position of an object; a second step of retaining a pointer object representing the position of the object on the reference data; A third step of determining imaging conditions of a LiDAR (Light Detection And Ranging) for imaging the object based on the reference data and the instruction object; A fourth step of outputting the shooting conditions. Method for determining shooting conditions. (Appendix 2) In the third step, Calculating a photographing area in which the object is not obstructed by an object and which can be physically photographed; determining a photographing position as the photographing condition from within the photographing area; determining a shooting attitude as the shooting condition based on a direction vector from the shooting position to the pointing object; 2. A method for determining shooting conditions as described in appendix 1. (Appendix 3) In the third step, Calculating a shooting area based on a distance or an incident angle to the pointing object; determining a photographing position as the photographing condition from within the photographing area; determining a shooting attitude as the shooting condition based on a direction vector from the shooting position to the pointing object; 2. A method for determining shooting conditions as described in appendix 1. (Appendix 4) In the fourth step, the photographing conditions are output to a photographing control unit that acquires the reference data using a photographing device including at least the LiDAR among the LiDAR and the camera, The photographing control unit changes a state of the photographing device based on the photographing conditions. 2. A method for determining shooting conditions as described in appendix 1. (Appendix 5) In the third step, Calculating a direction vector from a specific position of the reference data to a center of the pointing object; determining, as the imaging condition, a displacement from a current attitude of the imaging device to an imaging attitude based on the direction vector; A method for determining shooting conditions as described in Appendix 4. (Appendix 6) In the third step, Calculating a shooting area that is an area where the target object is not blocked by an object and is an area where it can be physically photographed, or calculating the shooting area based on a distance to the pointing object or an incident angle; determining a photographing position from the photographing area based on a positional relationship with a current position of the photographing device; determining a route from a current position of the imaging device to the imaging position as the imaging condition; A method for determining shooting conditions as described in Appendix 4. (Appendix 7) In the third step, determining a shooting attitude as the shooting condition based on a direction vector from the shooting position to the pointing object; 7. A method for determining shooting conditions as described in appendix 6. (Appendix 8) The imaging device includes both the LiDAR and the camera, The reference data is data in which point cloud data acquired by the LiDAR and image data acquired by the camera are superimposed, In the third step, When the instruction object is not on the point cloud data but on the image data, a displacement from a current attitude of the image capturing device to an image capturing attitude is determined as the image capturing condition; When the instruction object is located on any one of the points of the point cloud data, a route from the current position of the image capturing device to an image capturing position and an image capturing attitude are determined as the image capturing conditions. A method for determining shooting conditions as described in Appendix 4. (Appendix 9) The imaging device includes both the LiDAR and the camera, The reference data is data in which point cloud data acquired by the LiDAR and image data acquired by the camera are superimposed, In the third step, If the pointing object is not on the point cloud data but on the image data, Identifying an object including the pointing object on the image data by clustering; Obtaining points representing the identified object on the point cloud data; The obtained point is regarded as the designated object; determining a route from a current position of the image capturing device to an image capturing position and an image capturing attitude as the image capturing conditions; A method for determining shooting conditions as described in Appendix 4. (Appendix 10) In the third step, When determining a displacement from a current attitude of the image capturing apparatus to an image capturing attitude as the image capturing condition, Calculating a direction vector from a specific position of the reference data to a center of the pointing object; determining a displacement from a current attitude of the image capture device to an image capture attitude based on the direction vector; 10. A method for determining shooting conditions according to claim 8 or 9. (Appendix 11) In the third step, When determining a route from a current position of the image capturing device to an image capturing position and an image capturing attitude as the image capturing conditions, Calculating a shooting area that is an area where the target object is not blocked by an object and is an area where it can be physically photographed, or calculating the shooting area based on a distance to the pointing object or an incident angle; determining a photographing position from the photographing area based on a positional relationship with a current position of the photographing device; determining a route from the current position of the imaging device to the imaging position; determining a shooting attitude based on a direction vector from the shooting position to the pointing object; 10. A method for determining shooting conditions according to claim 8 or 9. (Appendix 12) a reference data storage unit that stores reference data representing a position of an object; a designated object storage unit that stores a designated object that represents a position of an object on the reference data; an imaging condition determination unit that determines imaging conditions of a LiDAR (Light Detection And Ranging) that images the object based on the reference data and the instruction object; and an imaging condition output unit that outputs the imaging conditions. Shooting condition determination system. (Appendix 13) A photographing control unit that acquires the reference data using a photographing device including at least the LiDAR among the LiDAR and the camera, The photographing condition output unit outputs the photographing condition to the photographing control unit, The photographing control unit changes a state of the photographing device based on the photographing conditions. 13. A shooting condition determination system according to claim 12. (Appendix 14) a reference data storage unit that stores reference data representing a position of an object; a designated object storage unit that stores a designated object that represents a position of an object on the reference data; an imaging condition determination unit that determines imaging conditions of a LiDAR (Light Detection And Ranging) that images the object based on the reference data and the instruction object; and an imaging condition output unit that outputs the imaging conditions. Shooting condition determination device. (Appendix 15) The photographing condition output unit outputs the photographing conditions to a photographing control unit that acquires the reference data using a photographing device including at least the LiDAR among the LiDAR and the camera, The photographing control unit changes a state of the photographing device based on the photographing conditions. 15. A shooting condition determination device according to claim 14. (Appendix 16) On the computer, a first step of maintaining reference data representative of the position of an object; a second step of retaining a pointer object representing a position of the object on the reference data; A third step of determining an imaging condition of a LiDAR (Light Detection And Ranging) for imaging the object based on the reference data and the instruction object; A fourth step of outputting the imaging conditions; A non-transitory computer-readable medium having stored thereon a program for executing the program. [Explanation of symbols]
[0070] 100,100A Shooting Condition Determination System 101 Reference data storage unit 102 Pointing object holding unit 103 Shooting condition determination unit 104 Shooting condition output unit 105 Shooting control section 200 Shooting condition determination device 300 Computers 301 Processor 302 Memory 303 Storage 304 Input / Output Interface 3041 Display device 3042 Input Device 3043 Sound output device 305 Communication Interface
Claims
1. A method for determining a photographing condition performed by a photographing condition determination device, comprising: a first step of maintaining reference data representative of the position of an object; a second step of maintaining a pointer object representing a position of the object on the reference datum; A third step of determining imaging conditions of a LiDAR (Light Detection And Ranging) for imaging the object based on the reference data and the instruction object; A fourth step of outputting the photographing conditions, In the third step, Calculating a shooting area based on a distance or an incident angle to the pointing object; determining a photographing position as the photographing condition from within the photographing area; determining a shooting attitude as the shooting condition based on a direction vector from the shooting position to the pointing object; Method for determining shooting conditions.
2. In the fourth step, the photographing conditions are output to a photographing control unit that acquires the reference data using a photographing device including at least the LiDAR among the LiDAR and the camera, The photographing control unit changes a state of the photographing device based on the photographing conditions. The method for determining a photographing condition according to claim 1 .
3. In the third step, Calculating a direction vector from a specific position of the reference data to a center of the pointing object; determining, as the imaging condition, a displacement from a current attitude of the imaging device to an imaging attitude based on the direction vector; The method for determining photographing conditions according to claim 2 .
4. In the third step, Calculating a shooting area that is an area where the target object is not blocked by an object and is an area where it can be physically photographed, or calculating the shooting area based on a distance to the pointing object or an incident angle; determining a photographing position from the photographing area based on a positional relationship with a current position of the photographing device; determining a route from a current position of the imaging device to the imaging position as the imaging condition; The method for determining photographing conditions according to claim 2 .
5. a reference data storage unit that stores reference data representing a position of an object; a designated object storage unit that stores a designated object that represents a position of an object on the reference data; an imaging condition determination unit that determines imaging conditions of a LiDAR (Light Detection And Ranging) for imaging the object based on the reference data and the instruction object; an imaging condition output unit that outputs the imaging conditions; The photographing condition determination unit is Calculating a shooting area based on a distance or an incident angle to the pointing object; determining a photographing position as the photographing condition from within the photographing area; determining a shooting attitude as the shooting condition based on a direction vector from the shooting position to the pointing object; Shooting condition determination system.
6. a reference data storage unit that stores reference data representing a position of an object; a designated object storage unit that stores a designated object that represents a position of an object on the reference data; an imaging condition determination unit that determines imaging conditions of a LiDAR (Light Detection And Ranging) for imaging the object based on the reference data and the instruction object; an imaging condition output unit that outputs the imaging conditions; The photographing condition determination unit is Calculating a shooting area based on a distance or an incident angle to the pointing object; determining a photographing position as the photographing condition from within the photographing area; determining a shooting attitude as the shooting condition based on a direction vector from the shooting position to the pointing object; Shooting condition determination device.
7. On the computer, a first step of maintaining reference data representative of the position of an object; a second step of maintaining a pointer object representing a position of the object on the reference datum; A third step of determining imaging conditions for a Light Detection and Ranging (LiDAR) system for imaging the object based on the reference data and the instruction object; A fourth step of outputting the imaging conditions; A program for executing In the third step, Calculating a shooting area based on a distance or an incident angle to the pointing object; determining a photographing position as the photographing condition from within the photographing area; determining a shooting attitude as the shooting condition based on a direction vector from the shooting position to the pointing object; program.
Citation Information
Patent Citations
Position attitude measuring method and device
JP2006242943A
Measuring device, method for correcting position and posture value of laser in measuring device, and laser position / posture value correcting program
JP2010175423A
Local localization system and method
JP2010540933A
Method and device of diagnosing stereo camera
JP2011180022A
Three-dimensional evaluation device, three-dimensional data measurement system and three-dimensional measurement method
JP2016217941A
