Distance measuring apparatus and distance measuring method

Abstract

To provide a technique for accurately determining a distance to an object.SOLUTION: The projector includes a control part 52 for controlling a projection state of light B3 based on a detection result of an object, a light projection part 10 for projecting light controlled by the control part to the object, and a processing part 61 for determining a distance to the object based on a detection result of reflected light, wherein the light is accurately projected to the object and the distance to the object is determined by projecting the light to the object and determining the distance to the object based on the detection result of the reflected light.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a distance measurement device and a distance measurement method. [Background technology]

[0002] There is known a camera device that extracts the outline of a subject based on the output of an AF area sensor, performs distance measurement focusing on the area within the outline within a wide range of distance measurement areas, and focuses based on the distance measurement data, thereby capturing an image by focusing on the main subject without being affected by the background (see, for example, Patent Document 1). Patent Document 1: Japanese Patent Application Laid-Open No. 2001-304855 General Disclosure

[0003] (Item 1) It may be a distance measuring device that projects light to measure the distance to an object. The distance measurement device may include a control unit that controls the projection state of light based on the detection result of the object. The distance measurement device may include a light projecting unit that projects light controlled by the control unit onto the object. The distance measurement device may include a processing unit that determines the distance to the object based on the detection result of the reflected light. (Item 2) The distance measurement device may include an imaging unit that captures an image of the object. The control unit may detect the object based on the imaging result obtained by the imaging unit. (Item 3) The light projecting unit may project light onto the object via an optical system. (Item 4) The imaging section may capture an image of the object via the optical system or an imaging optical system different from the optical system. (Item 5) The light projecting unit may include a light source unit that emits light. The control unit may control either one of the light source unit and the optical system to control the projection state of light. (Item 6) The light projection state may include either one of the light irradiation direction and the light intensity. (Item 7) The imaging section may further detect reflected light from the object. (Item 8) The distance measurement device may include a detection unit that detects reflected light from an object. (Item 9) The distance measurement device may include an analysis unit that analyzes the imaging results obtained by the imaging unit. The analysis section may analyze an image of the object in the imaging result to identify the object. (Item 10) The analysis unit may analyze the image of the object based on a machine learning model. The machine learning model may be constructed in advance by machine learning using images of the object to be measured for distance as training data. (Item 11) The analysis unit may analyze the image of the object using an image processing method. The image processing methods may include at least edge detection methods. (Item 12) The control unit may control any one of the optical system, the imaging optical system different from the optical system, and the imaging unit so that the object analyzed by the analysis unit is imaged at the center of the imaging area of ​​the imaging unit. (Item 13) The analysis unit may identify the object at the center of the image. (Item 14) The imaging section may capture an image of the target object multiple times at different times. The analysis unit may identify the object from the image differences between the multiple images. (Item 15) The analysis unit may detect the resolution of the image. The control unit may control the optical system based on the detection result of the resolution to enlarge or reduce the image of the object. (Item 16) The analysis unit may analyze the image of the object to identify the center or center of gravity of the object. The control unit may control either one of the light projecting unit and the optical system to project the light onto the center of the specified object. (Item 17) The analysis unit may analyze an image of the object to identify the object. The control unit may control the light to scan the identified object with the light. The processing unit may determine the distance to the object based on the relationship between the position of the object scanned with the light and the detection result of the reflected light. (Item 18) The distance measurement device may further include a display unit that displays an image of the object obtained by the imaging unit on a display screen. (Item 19) The display unit may display an object indicating the location on the object onto which the light is projected, or the object from which the distance has been determined, superimposed on the image of the object. (Item 20) The display unit may display the image of the object obtained by the imaging unit so that the location on the object onto which the light is projected is positioned at the center of the screen. (Item 21) The display screen may include a touch detection sensor that detects a touch operation by a user. When at least one location included in the image is selected by a touch operation on the display screen, the control unit may control the light to project the light onto the at least one location. (Item 22) The distance measuring device may further include a calculation unit that calculates the distance to multiple locations, or the distance and / or area between multiple locations, when multiple locations included in the image are selected by a touch operation on the display screen. (Item 23) The optical system may include at least one corrective optical element selected from the group consisting of a lens element, a prism, and a mirror. The control unit may drive at least one corrective optical element. (Item 24) The light projecting section may project light onto the object after the imaging section captures an image of the object. (Item 25) The control unit may correct shake of the distance measuring device by controlling the optical system or the imaging optical system.

[0004] (Item 26) The distance measurement method may be a method of measuring the distance to an object by projecting light. The distance measurement method may control the state of projection of light based on the detection result of the object. The distance measurement method may include projecting controlled light onto the object in the controlling step. The distance measurement method may determine the distance to the object based on the detection result of the reflected light.

[0005] The above summary of the invention does not list all of the features of the present invention, and subcombinations of these features may also be inventions. [Brief explanation of the drawings]

[0006] [Figure 1] 1 shows the configuration of a distance measuring device according to the present embodiment. [Figure 2A] 1 shows the deflection of light by a mirror. [Figure 2B] Illustrates the deflection of light by a corrective lens. [Figure 3] 10 shows an example of an object that can be identified from a captured image. [Figure 4A] 1 shows an object identified from a captured image. [Figure 4B] 1 shows the deviation from the reference axis detected for the identified object. [Figure 4C] 3 shows blur correction for the identified object. [Figure 5A] 10 shows an example of a display on a display screen. [Figure 5B] 10 shows another example of a display on the display screen. [Figure 6A] 10 shows an example of a display operation when a touch operation on the display screen is detected. [Figure 6B] 10 shows an example of a display operation when a touch operation on the display screen is detected. [Figure 7A] 10 shows an example of a display operation when multiple touch operations on the display screen are detected. [Figure 7B] 10 shows another example of a display operation when multiple touch operations on the display screen are detected. [Figure 8] 2 shows a flow of a distance measurement method according to the present embodiment. [Figure 9] 1 shows the configuration of a distance measurement device according to a first modified example. [Figure 10] 10 shows the configuration of a distance measurement device according to a second modified example. [Figure 11] An example of control of the correction lens will be described. DETAILED DESCRIPTION OF THE INVENTION

[0007] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention according to the claims. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0008] FIG. 1 shows the configuration of a distance measurement device 100 according to this embodiment. The distance measurement device 100 projects light B3 to measure the distance to an object. Note that measuring distance is also referred to simply as distance measurement, and the operation of the distance measurement device 100 is also referred to as distance measurement operation. A light projecting unit 10 projects light B3 onto a reference axis L. 10 The direction in which the light B3 is emitted along the reference axis L (i.e., the left direction in the drawing) is the forward direction, and the opposite direction (i.e., the right direction in the drawing) is the backward direction. 10 The orientation (also referred to as direction) of the distance measurement device 100 is uniquely determined by the orientation of the body of the distance measurement device 100 (i.e., the housing that houses each of the components). The distance measurement device 100 includes a light projecting unit 10, a detecting unit 20, an imaging unit 30, an analyzing unit 51, a control unit 52, a processing unit 61, a display unit 70, and a calculating unit 62. The analyzing unit 51, the control unit 52, the processing unit 61, and the calculating unit 62 are functional units that are realized when a calculation processing device (not shown) executes dedicated programs.

[0009] The light projecting unit 10 is a unit that projects light B3 controlled by a control unit 52 (described later) onto an object via a light projecting observation optical system (an example of an optical system) 12. The light projecting unit 10 includes a light source 11 and the light projecting observation optical system 12.

[0010] The light source 11 generates pulsed light B1 at a constant cycle and inputs it into the light projection observation optical system 12. For example, a semiconductor laser that emits infrared light can be used as the light source 11. The light B1 is emitted a predetermined number of times, for example, 320 times, at a constant cycle, for example, 500 to 700 μsec, in one distance measurement operation. The light source 11 may have a driving device (not shown), and the control unit 52 may control the driving device to tilt the light source 11. In this case, the emission direction of the light B1 emitted from the light source 11 changes, and the light B1 can be deflected toward the target.

[0011] The projection observation optical system 12 is an optical system that is composed of a plurality of optical elements that shape and direct the light B1, and includes, for example, a mirror 13, a correction lens 14, and an objective lens 15. These optical elements are arranged along a reference axis L of the projection observation optical system 12. 10 are arranged along

[0012] The mirror 13 is a mirror device that reflects or transmits light depending on its wavelength, and has a dichroic reflecting surface 13a and a driving device 13b. The dichroic reflecting surface 13a is a mirror element that reflects light in the infrared band and transmits light in the visible light band. The dichroic reflecting surface 13a is aligned with the reference axis L 10 11 and reflects the light B1 emitted from the light source 11 to the reference axis L 10 2A, the visible light A1 passing through the objective lens 15 from the front of the distance measurement device 100 is transmitted through the driving device 13b, and is sent out toward the imaging unit 30 disposed at the rear. The driving device 13b has a driving element such as an actuator or an electric motor, and tilts the dichroic reflecting surface 13a by being controlled by the control unit 52 based on the detection result of the tilt of the dichroic reflecting surface 13a by a rotation sensor (not shown) or the like. As shown in FIG. 2A, the driving device 13b tilts the dichroic reflecting surface 13a along the reference axis L. 10 By tilting the camera relative to the reference axis L, the emission direction of the light B3 can be adjusted to match the object moving relative to the camera body or the reference axis L. 10 It can be deflected towards an object that is out of range.

[0013] The correcting lens 14 is a lens device that deflects the light B2, and includes a lens element 14a and a driving device 14b. The lens element 14a is, for example, an internal focusing lens, and is aligned with a reference axis L between the mirror 13 and the objective lens 15. 10 The driving device 14b has a driving element such as a voice coil motor or a piezoelectric motor, and is controlled by the control unit 52 based on the detection result of the displacement of the lens element 14a by a displacement sensor (not shown), etc., to move the lens element 14a along the reference axis L 10 In this embodiment, the reference axis L 10 As shown in FIG. 2B, the lens element 14a is displaced along the reference axis L by the driving device 14b. 10 The light B3 is deflected by displacing it relative to the reference axis L 10 The correcting lens 14 may be a variable angle prism that is controlled by the control unit 52 and deforms asymmetrically with respect to the central axis.

[0014] The objective lens 15 is an optical element that collimates the light B2 output from the light source 11 and entering through the mirror 13 and the correcting lens 14 to send it forward as light B3 to the front of the distance measurement device 100, and also collimates the visible light A1 entering from the front of the distance measurement device 100 to send it backward. The objective lens 15 may be composed of multiple optical elements including at least one lens element. The objective lens 15 or the optical elements that constitute it are aligned with the reference axis L 10 The focal position may be driven back and forth by displacing the lens along the axis.

[0015] The projection observation optical system 12 may include a prism (not shown) instead of or in combination with the mirror 13. The prism is an optical system that sends the light B1 emitted from the light source 11 forward and sends the visible light A1 that enters the distance measurement device 100 from the front via the objective lens 15 backward, and for example, a roof prism, a porro prism, or the like can be used. The prism has a drive device that drives its holding frame, which allows the prism to be aligned with the reference axis L. 10By displacing and / or rotating the light source B3 relative to the fuselage, the emission direction of the light B3 can be deflected towards an object that moves relative to the fuselage.

[0016] The mirror 13, the correcting lens 14, and the prism (not shown) are examples of corrective optical elements, and it is sufficient that the projection observation optical system 12 includes at least one of these.

[0017] The detection unit 20 is a unit that detects reflected light from an object when the light B3 is projected. The detection unit 20 includes a light receiving lens 21 and a detection element 22.

[0018] The light receiving lens 21 is an optical element that collects the reflected light C1 from the object. The reflected light C1 collected by the light receiving lens 21 is sent to the detection element 22 as reflected light C2. The light receiving lens 21 is aligned with a reference axis L different from that of the objective lens 15 (light projection observation optical system 12) of the light projecting unit 10. 20 It has.

[0019] The detection element 22 receives the reflected light C2 and outputs a detection signal corresponding to its intensity. The detection element 22 may be, for example, a photodiode or phototransistor that is sensitive to the band of light B3. The detection element 22 may include a bandpass filter on or in front of its detection surface that transmits light in a narrow band including the reflected light C2 and blocks or attenuates light in other bands. The detection signal is converted into a digital signal and supplied to the processing unit 61.

[0020] In the detection unit 20 configured as described above, reflected light C1 reflected (or scattered) from an object located in front of the distance measurement device 100 is incident on the light receiving lens 21. The reflected light C1 is collected by the light receiving lens 21 and detected by the detection element 22 as reflected light C2. A detection signal is output to the processing unit 61.

[0021] The imaging unit 30 is a unit that captures an image of an object via the projection observation optical system 12. The imaging unit 30 has, as an example, a CMOS image sensor, and detects visible light A3 entering from the front of the aircraft via the projection observation optical system 12. A filter element that transmits visible light and cuts light (infrared light) may be provided on the light receiving surface of the image sensor. The detection result, i.e., the captured image of the object, is sent to the analysis unit 51 and the display unit 70. The optical axis of the light B3 emitted forward of the aircraft and the optical axis of the visible light A1 entering from the front of the aircraft are aligned along a reference axis L. 10 Since the light beams coincide with each other above, it is possible to project the light beam B3 onto the object at the center of the image captured by the imaging unit 30.

[0022] The analysis unit 51 is a unit that analyzes the imaging results obtained by the imaging unit 30, i.e., the captured image of the object. The analysis unit 51 analyzes the captured image of the object based on, for example, a machine learning model, and identifies the object from the captured image. Here, the machine learning model may be, for example, a multilayer neural network (DNN) constructed by deep learning, and is constructed by machine learning in advance using the position or multiple images of the object to be measured for distance as training data. Here, the number of objects to be identified is not limited to one, and multiple objects may be identified. Multiple types of objects may be machine learned in advance, and the user may be able to select which type of object to identify during distance measurement.

[0023] FIG. 3 shows an example of an object that can be identified from the captured image 200 by the analysis unit 51. In this example, a user who is a golf player measures the distance to a pin flag 202 as an object using the distance measuring device 100 to know the distance to a cup 201 on a green 210 on a golf course. The analysis unit 51 uses a machine learning model to identify the pin flag 202 from the captured image 200 of the object obtained by the imaging unit 30, and calculates the distance from the center of the image (i.e., the reference axis L of the projection observation optical system 12). 10) is calculated. The object is not limited to the pin flag 202, but may be a combination of an object located near the target cup 201, such as the green 210 or a pin (supporting the flag of the pin flag 202). This improves the accuracy of identifying the object by the machine learning model. Furthermore, when an object located near the target cup 201 is used, color information specific to the object (for example, green for the green 210) may be used.

[0024] 4A shows an object identified from the captured image 200. The analysis unit 51 determines whether the reference axis L 10 The target object is identified on the display screen 71a. When the user points the aircraft in the direction of the target object and positions the pin flag 202, which is the target object, on the display screen 71a, the analysis unit 51 identifies the pin flag 202 based on a machine learning model. Here, since the shape of the pin flag 202 is usually fixed, the analysis unit 51 identifies the center or center of gravity of the pin flag 202 from the shape of the pin flag 202. Alternatively, the imaging unit 30 can capture images of the pin flag 202 multiple times at different times, and identify the center or center of gravity of the pin flag 202 from the image difference between the multiple images (the offset between the images at which the difference in pixel values ​​is smallest).

[0025] Furthermore, if the user moves the aircraft and positions the target object near the center of the display screen 71a, the accuracy of identifying the target object can be further improved. Also, an image of the target object may be registered in advance in the aircraft, and a machine learning model appropriate for the situation when the aircraft is operated may be automatically selected depending on the situation. For example, if the situation in which the aircraft is operated is a golf game, a flag may be automatically selected as the machine learning (completed) model when the user selects golf. Also, the user may capture an image of the target object and register it in the aircraft during the first distance measurement operation, etc., and the registered machine learning (completed) model may be automatically selected during subsequent operations.

[0026] FIG. 4B shows the reference axis L detected for the identified object. 10 In this example, the object is positioned at the image center (reference axis L10 As described above, once the object is identified from the captured image 200, the analysis unit 51 recognizes the object at an arbitrary position within the captured image 200 and determines whether the object is located on the reference axis L. 10 The displacement S of the object relative to the image center corresponding to the position of the object (the central coordinates of the object relative to the central coordinates of the image center on the display screen 71a) is detected. The detection result of the displacement S is transmitted to the control unit 52. The image center on the display screen 71a is also the intersection of the reference axis L10 of the detection element 22 and the detection element 22.

[0027] Instead of using a machine learning model, captured images of objects may be analyzed using image processing techniques, including edge detection, which detects the contours of objects in the captured images. This allows for the detection of various objects on the golf course in the captured image 200 shown in FIG. 3, such as bunkers 220, forests 230, and other hazards.

[0028] Note that, when the analysis unit 51 cannot detect the object, the analysis unit 51 may detect the resolution of the captured image of the object, and the control unit 52 may control the projection observation optical system 12 based on the result of the detection of the resolution to enlarge or reduce the image of the object. Image analysis by the analysis unit 51 will be described in more detail below.

[0029] The control unit 52 is a unit that controls the projection state of the light B3 based on the imaging result obtained by the imaging unit 30. The control unit 52 controls the light projection unit 10 and / or the light projection observation optical system 12 to move the mirror 13 along the reference axis L 10 The correction lens 14 is tilted relative to the reference axis L 10 The light B3 is deflected in a direction determined by the displacement S (and the distance to the object) by displacing the light source 11 from the reference axes B1 and B2, displacing and / or rotating the prism (not shown), and / or tilting the light source 11 with respect to the reference axes B1 and B2. As a result, as shown by the arrow in Fig. 4C, the light B3 continues to be irradiated onto the pin flag 202, which is the object identified by the analyzing unit 51, particularly onto its center or center of gravity.

[0030] Furthermore, since there is a correspondence between the deflection angle Θ when deflecting light B3 and the angle of view of the display screen 71a, which is determined by the magnification of the optical system, the deflection angle Θ of light B3 directed toward the object can be calculated by determining the deviation S, which represents the amount of deviation of the center or center of gravity coordinates (pixel) of the object from the central coordinates (pixel) of the image center of the display screen 71a.

[0031] The control unit 52 may control the light projector 10 and / or the light projecting observation optical system 12 to deflect the light B3 so as to scan the light B3. The control unit 52 may also control the projection state of the light B3 by changing not only the projection direction of the light B3 but also the intensity of the light B3. For example, if the reflectance of the object is low (or high) and the intensity of the reflected light C1 detected by the detection unit 20 is weak (strong), the intensity of the light B3 may be increased (decreased). When scanning the object with the light B3, the light B3 may be scanned across the object, i.e., including the object and its surrounding area, or may be scanned only within the area of ​​the object.

[0032] Furthermore, the control unit 52 controls the light projecting unit 10 and / or the light projecting observation optical system 12 as described above, so that the object analyzed by the analysis unit 51 is imaged at the center of the imaging area of ​​the imaging unit 30. By imaging the object at the center of the imaging area in this way, detection accuracy is improved.

[0033] The processing unit 61 is a unit that determines the distance to the object based on the detection result of the reflected light C1 by the detection unit 20. The distance D to the object is calculated by determining the detection time T from the irradiation of the light B3 by the light projector 10 to the detection of the reflected light C1 by the detection unit 20, and using the speed of light c, the distance D is calculated as D = T × c / 2. Here, the detection time T is the time required for the light to travel a distance equivalent to a round trip from the measurement position where the measurement light is emitted to the object, so half of the detection time T is multiplied by the speed of light. Note that the detection time T may also be determined by averaging the results obtained for multiple irradiations of the measurement light.

[0034] The processing unit 61 may also determine the distance to the object by scanning the object with light B3. In this case, the analysis unit 51 analyzes the captured image of the object to identify the object, the control unit 52 controls the light projector 10 and / or the light projecting observation optical system 12 to scan the identified object with light B3, and simultaneously detects reflected light C1 with the detection unit 20. The processing unit 61 determines the distance to the object based on the relationship between the scan position of the object with light B3 and the detection result of reflected light C1. Here, based on the relationship between the scan position of the object and the detection result of reflected light, the distance can be determined for the scan position of the object where the detected intensity of reflected light C1 is maximum, or the distance can be determined for all scan positions within the object, and the average or minimum distance can be determined as the distance to the object.

[0035] The processing unit 61 may determine the distance to the object by scanning the entire deflection range or the entire angle of view of the captured image with light B3. In this case, the control unit 52 controls the light projection observation optical system 12 to scan the deflection range or the angle of view of the captured image with light B3, while simultaneously detecting the reflected light C1 with the detection unit 20. The processing unit 61 detects the object based on the relationship between the scan position of light B3 and the detection result of reflected light C1 and determines the distance to the object. Here, the processing unit 61 may identify the object at the scan position where the detection intensity of reflected light C1 is maximized based on the relationship between the scan position and the detection result of reflected light C1, and determine the distance to the object. Alternatively, the processing unit 61 may identify the object at the position where the detection time T is minimized based on the relationship between the scan position and the detection result of detection time T, and determine the distance to the object.

[0036] The processing unit 61 supplies the determined distance to the object to the display unit 70. The processing unit 61 may store the determined distance to the object in a storage device (not shown).

[0037] The display unit 70 is a unit that displays the captured image of the object obtained by the imaging unit 30 and the distance to the object determined by the processing unit 61, and includes a display device 71 and a touch detection sensor 72. The display device 71 may be an electronic viewfinder or a liquid crystal display having a display screen exposed on the aircraft body. In this embodiment, the touch detection sensor 72 is used in combination with the display device 71, and therefore a liquid crystal display is used as the display device 71. The touch detection sensor 72 is, for example, a capacitance sensor, and is disposed on the display screen 71a of the display device 71 to detect a touch operation by the user and the location on the display screen 71a that has been touched.

[0038] The calculation unit 62 is a unit that calculates the distance between one or more locations included in the captured image when the location or locations are selected by a touch operation on the display screen 71a, and the distance and / or area between the locations. These calculations will be described later.

[0039] FIG. 5A shows an example of a display displayed on the display screen 71a by the display unit 70. The display unit 70 displays, on the display screen 71a, a captured image 200 and, superimposed thereon, a mark 240 indicating the location on the object where light B3 is projected (or where the distance is displayed). Here, the display unit 70 displays the captured image 200 of the object obtained by the imaging unit 30, the location on the pin flag 202 where light B3 is projected, i.e., the mark 240. The determined distance to the object, "385 y (yards)," is also displayed. Note that the mark 240 may be displayed so as to be positioned at the center of the screen. Alternatively, instead of displaying the mark 240 indicating the location on the object where light B3 is projected, the object where the distance is displayed may be highlighted, or an object (e.g., a mark or arrow) may be superimposed on the object where the distance is displayed.

[0040] 5B shows an example of a display operation when the display unit 70 detects a touch operation on the display screen 71a by the touch detection sensor 72. In FIG. 5B, a pin flag 202 is displayed as an object on the display screen 71a of the display unit. Assume that the user touches the display screen 71a with a finger or the like to select the pin flag 202 included in the captured image 200. As a result, a mark 246 indicating the touch position is displayed superimposed on the pin flag 202. The touch detection sensor 72 detects the location (coordinates) on the display screen 71a where the user performed the touch operation. The analysis unit 51 calculates the deviation S of the location (coordinates) of the touch operation on the display screen 71a from the central coordinates of the image center of the display screen 71a, and calculates the deflection angle Θ of the light B3 to be directed toward the object. The control unit 52 controls the light projector 10 and / or the light projection observation optical system 12 to direct and project the light B3 toward the pin flag 202 at the calculated deflection angle Θ, and calculates the distance to the pin flag 202.

[0041] 6A and 6B show an example of a display operation when the display unit 70 detects a touch operation by the user on the display screen 71a with the touch detection sensor 72. In the state shown in Fig. 6A, the distance measurement device 100 identifies a pin flag 202, which is an object, in the captured image 200, locks onto it, projects light B3, and continues to measure the distance to the pin flag 202. In this state, it is assumed that the user selects a banker 220 included in the captured image 200 by touching the display screen 71a with a finger or the like. In this case, the display unit 70 detects the location on the display screen 71a touched by the user using the touch detection sensor 72 and displays a mark 242 on the bunker 220, which is the selected location, superimposed on the captured image 200. The analysis unit 51 detects the deviation S from the pin flag 202, which is the previously identified or selected object, to the bunker 220, which is the selected location. Based on the detection result of the deviation S, the control unit 52 controls the light projector 10 and / or the light projection observation optical system 12 to direct and project light B3 toward the selected bunker 220. As a result, as shown in FIG. 6B , the display unit 70 displays the captured image 200 and the mark 242, which indicates the location on the bunker 220 onto which light B3 is projected, on the display screen 71a so that the mark is positioned at the center of the screen. The distance to the determined bunker 220, "373 y (yards)," is also displayed.

[0042] 7A shows an example of a display operation when the display unit 70 detects multiple touch operations by the user on the display screen 71a using the touch detection sensor 72. In this example, the user captures an image of a cup 201 on a green 210 as an object using the distance measurement device 100, and the captured image 200 is displayed on the display screen 71a. In this state, assume that the user touches the display screen 71a with a finger or the like to select the locations of the cup 201 on the green 210 and the forest 230 behind the green 210 that are included in the captured image 200. In this case, the display unit 70 detects the locations on the display screen 71a where the user performed the touch operation using the touch detection sensor 72 and displays marks 246 at the two selected locations superimposed on the captured image 200. The control unit 52 controls the projection observation optical system 12 to project light B3 to each location. The processing unit 61 determines the distance to each location. The calculation unit 62 calculates the distance between the two locations based on the determined distances to the two locations and the angle of view between the two locations. As a result, the determined distance to the cup 201, "150y", and the distance to the forest 230, "170y", are displayed on the display screen 71a, and the calculated distance between the cup 201 and the forest 230, "30y", is displayed on the display screen 71a, allowing the user to evaluate the risk of the shot going out of bounds if it goes over the green 210 based on the distance from the cup 201 to the forest 230.

[0043] 7B shows another example of a display operation when the display unit 70 detects multiple touch operations by the user on the display screen 71a using the touch detection sensor 72. In this example, the user captures an image of the green 210 using the distance measurement device 100, and the captured image 200 is displayed on the display screen 71a. In this state, assume that the user touches the display screen 71a with a finger or the like to select multiple locations (four in this example) along the outline of the green 210 included in the captured image 200. In this case, the display unit 70 detects the locations on the display screen 71a where the user performed the touch operation using the touch detection sensor 72 and displays marks 242 at the four selected locations superimposed on the captured image 200. The calculation unit 62 calculates the area of ​​an area 244 enclosed by the four locations. The calculation result of the area of ​​the area 244 is displayed on the display screen 71a, allowing the user to know the approximate size of the green 210.

[0044] 8 shows a flow of the distance measurement method according to this embodiment. The distance measurement operation is started when the user presses an operation button (not shown) provided on the body of the distance measurement device 100. In this example, it is assumed that a user who is a golf player measures the distance to a pin flag 202 as an object using the distance measurement device 100 in order to know the distance to a cup 201 on a green 210 on a golf course as shown in FIG.

[0045] In step S102, the imaging unit 30 images the object via the projection observation optical system 12. As shown in Fig. 3, the image of the object, i.e., the pin flag 202 and the surrounding green 210, is captured. The captured image is displayed on the display screen 71a of the display device 71 by the display unit 70.

[0046] Next, the projection state of the light B3 is controlled based on the image pickup result obtained in step S102. Specifically, the following steps S104 to S110 are executed.

[0047] In step S104, the analysis unit 51 analyzes the captured image of the object obtained in step S102. Note that, during the first distance measurement operation, as shown in FIG. 4A, the user may shake the device up and down and left and right to move the pin flag 202, which is the object, along the reference axis L. 10 When the pin flag 202 is positioned at the top (i.e., the center of the image displayed on the display screen 71a), the analysis unit 51 identifies the pin flag 202. After this, the analysis unit 51 can identify the pin flag 202 at any position within the captured image.

[0048] In step S106, the analysis unit 51 determines whether or not an object has been detected. If the pin flag 202 is not present in the captured image, the analysis unit 51 cannot detect the pin flag 202, determines that an object has not been detected, and returns to step S102. The user then moves the aircraft to position the pin flag 202 within the captured image. In this way, the analysis unit 51 detects the pin flag 202 in the captured image, determines that an object has been detected, and proceeds to step S108.

[0049] In step S108, the analysis unit 51 identifies the center of the pin flag 202, which is the target object. As described above, the analysis unit 51 identifies the center of the pin flag 202 from the shape center of the target object or the image difference between multiple images, and then, as shown in FIG. 4B, 10 A deviation S of the object from the image center corresponding to the position (the center coordinates of the object relative to the center coordinates at the image center on the display screen 71a) is detected.

[0050] In step S110, the control unit 52 controls at least one corrective optical element included in the light projection observation optical system 12 based on the analysis result of the image of the object obtained in step S108. The control of the corrective optical element is as described above. As a result, light B3 can be irradiated onto the center of the pin flag 202, as shown by the arrow in FIG. 4C.

[0051] In step S112, the distance to the target object is measured. The light projection unit 10 projects light B3 onto the center of the pin flag 202 via the light projection observation optical system 12. Next, the detection unit 20 detects reflected light C1 from the pin flag 202, which is generated by the projection of light B3. Finally, the processing unit 61 determines the distance D to the pin flag 202 based on the detection result of the reflected light C1. The details of the projection of light B3, the detection of reflected light C1, and the determination of the distance D are as described above.

[0052] Note that the timing of imaging in step S102 and the projection of light B3 in step S112 is shifted so that after the image of the object is captured by the image capturing unit 30 in step S102, light B3 is projected onto the object by the light projecting unit 10 in step S112. This makes it possible to prevent reflected light C1 generated by projecting light B3 onto the object from being detected by the image capturing unit 30 when capturing an image of the object in step S102.

[0053] In step S114, the display unit 70 displays the pin flag 202 and its surrounding captured image 200 obtained in step S102, along with the distance to the object determined in step S112, "385y (yards)," on the display screen 71a, as shown in FIG. 5A.

[0054] In step S116, it is determined whether or not to end the distance measurement operation. If the operation button (not shown) is pressed again by the user, it is determined that the distance measurement operation should be continued and the flow returns to step S102, but if the operation button is not pressed, it is determined that the distance measurement operation should be ended and the flow ends.

[0055] The distance measurement device 100 according to this embodiment includes a light projection unit 10 that projects light B3 onto an object via a light projection observation optical system 12, an imaging unit 30 that captures an image of the object via the light projection observation optical system 12, an analysis unit 51 that analyzes the image of the object obtained by the imaging unit 30, and a control unit 52 that controls the light projection observation optical system 12 based on the analysis results of the analysis unit 51. This configuration enables the object to be captured via the light projection observation optical system 12 through which the light to be projected onto the object passes, the captured image of the object obtained by analyzing the image, and the control unit 52 to control the light projection observation optical system 12 based on the analysis results, thereby accurately projecting light onto the object and determining the distance to the object. Furthermore, since the user does not need to collimate an area including the object to visually recognize the object, it is easier to recognize the object.

[0056] In the distance measuring device 100 according to this embodiment, a configuration is adopted in which an image of an object is captured by the imaging unit 30 and the detection unit 20 detects the reflected light C1 from the object generated by projecting light B3. Alternatively, a configuration may be adopted in which the imaging unit 30 captures an image of the object and also detects the reflected light C1 from the object generated by projecting light B3.

[0057] 9 shows the configuration of a distance measurement device 110 according to a first modified example. The distance measurement device 110 includes a light projecting unit 10, an image capturing unit 30d, an analyzing unit 51, a control unit 52, a processing unit 61, a display unit 70, and a calculating unit 62. The units other than the image capturing unit 30d are configured in the same manner as those in the distance measurement device 100 described above.

[0058] The imaging unit 30d is a unit that captures an image of the object via the light projection observation optical system 12d and detects reflected light (infrared light) C1 from the object generated by projecting light B3 from the light projector 10. The imaging unit 30 can employ an image sensor that has sensitivity in the visible light band and the infrared band, such as a CMOS image sensor. The captured image of the object obtained by receiving visible light A1 is supplied to the analysis unit 51 and the display unit 70. A detection signal of reflected light (infrared light) C3 from the object, which is derived from light B3, is converted into a digital signal and supplied to the processing unit 61.

[0059] The processing unit 61 determines the distance to the target object based on the detection result of the reflected light (infrared light) C3 by the imaging unit 30d, as described above in detail.

[0060] According to the distance measuring device 110 having the above-described configuration, the imaging unit 30 captures an image of the object and also detects the reflected light C1 from the object generated by projecting light B3, and since the imaging and detection functions can be shared, it is possible to reduce costs.

[0061] In the above-described distance measurement device 100, the light projecting unit 10 and the imaging unit 30 share a single optical system (light projecting observation optical system 12), but instead, a configuration may be adopted in which the imaging unit 30 and the light projecting unit 10 each have an independent optical system.

[0062] 10 shows the configuration of a distance measurement device 120 according to the second modification. The distance measurement device 120 includes a light projecting unit 10d, a detecting unit 20d, an imaging unit 30, an analyzing unit 51, a control unit 52, a processing unit 61, a display unit 70, and a calculating unit 62. The units other than the light projecting unit 10d and the detecting unit 20d are configured in the same manner as those in the distance measurement device 100 described above.

[0063] The light projecting unit 10d is a unit that projects light B3 onto an object via a light projecting optical system (an example of a first optical system) 12dd. The light projecting unit 10d includes a light source 11 and the light projecting optical system 12dd.

[0064] As described above, the light source 11 generates pulsed light B1 at a constant cycle and inputs it into the light projection optical system 12dd.

[0065] The projection optical system 12dd is an optical system that is composed of a plurality of optical elements that shape and direct the light B1, and includes, for example, a correction lens 14 and an objective lens 15. These optical elements are aligned along the reference axis L of the projection optical system 12dd. 10 are arranged along

[0066] The correcting lens 14 is a lens device that deflects the light B1, and includes a lens element 14a and a driving device 14b, the configuration of which is as described above.

[0067] The objective lens 15 is an optical element that collimates the light B1 that is output from the light source 11 and enters via the correcting lens 14, and sends it as light B3 to the front of the distance measurement device 100. The configuration of the objective lens 15 is as described above.

[0068] The detector 20d is a unit that detects reflected light C1 from an object, which is generated by projecting light B3, via a detection observation optical system 22d (an example of a second optical system). The detector 20 includes a light receiving lens 21, a correction lens 23, a mirror 24, and a detection element 22.

[0069] The light receiving lens 21 is an optical element that collects the reflected light C1 from the object. The reflected light C1 collected by the light receiving lens 21 is sent to the correction lens 23.

[0070] The correction lens 23 is a lens device that changes the angle at which the reflected light C2 is received, and includes a lens element 23a and a drive device 23b. The lens element 23a is, for example, an internally focusing lens, and is aligned with a reference axis L between the light receiving lens 21 and the mirror 24. 20 The driving device 23b has a driving element such as a voice coil motor or a piezoelectric motor, and is controlled by the control unit 52 based on the detection result of the displacement of the lens element 23a by a displacement sensor (not shown) or the like, to move the lens element 23a along the reference axis L 20 In this embodiment, the reference axis L 20 The displacement is in two mutually perpendicular axes in a plane perpendicular to the axis.

[0071] The mirror 24 is a mirror device that reflects or transmits light depending on its wavelength, and has a dichroic reflecting surface 24a. The dichroic reflecting surface 24a is a mirror element that reflects light in the infrared band and transmits light in the visible light band. The dichroic reflecting surface 24a is aligned with the reference axis L 20It is placed on top and reflects the reflected light (infrared light) C2 to send it to the detection element 22, and transmits visible light A2 that enters from the front of the distance measuring device 100 through the light receiving lens 21 and the correction lens 14 together with the reflected light C1, and sends it towards the imaging unit 30 placed behind.

[0072] The detecting element 22 is an element that receives the reflected light C3 and outputs a detection signal corresponding to the intensity of the reflected light C3. The detecting element 22 is configured as described above. The detection signal is converted into a digital signal and supplied to the processing unit 61.

[0073] In the distance measurement device 120 configured as described above, the imaging unit 30 captures an image of the object by receiving visible light A3 via the detection observation optical system 22d. The analysis unit 51 analyzes the image of the object obtained by the imaging unit 30 and identifies the object from the captured image. Details of the analysis of the captured image are as described above. The control unit 52 controls the correcting lens 14 included in the light projection optical system 12dd and the correcting lens 23 included in the detection observation optical system 22d based on the analysis results by the analysis unit 51.

[0074] FIG. 11 shows an example of control of the correction lenses 14 and 23. The analysis unit 51 calculates the center of the image (reference axis L 10 When a deviation S of the object relative to the reference axis L (the center coordinates of the object relative to the center coordinates of the image center in the display screen 71a) is detected, the control unit 52 controls the driving device 14b to move the lens element 14a relative to the reference axis L 10 This causes the light B3 to be deflected (reference axis L 10 At the same time, the control unit 52 controls the driving device 23b to move the lens element 23a along the reference axis L 20 As a result, the angle of reception of reflected light C1 (and visible light A1) is shifted relative to the reference axis L 20The deflection angle of light B3 and the change in the acceptance angle of reflected light C1 (and visible light A1) are controlled equally. Therefore, light B3 is irradiated onto the object, and the reflected light C1 generated by the object can be received. Furthermore, this embodiment allows the deflection angle of light B3 and the acceptance angle of reflected light C1 (and visible light A1) to be controlled simultaneously, thereby shortening the processing time.

[0075] Furthermore, the control unit 52 controls the detection observation optical system 22d as described above so that the object analyzed by the analysis unit 51 is imaged at the center of the imaging area of ​​the imaging unit 30. By imaging the object at the center of the imaging area in this way, the detection accuracy is improved.

[0076] The correcting lenses 14 and 23 may be variable angle prisms that are controlled by the control unit 52 and deform asymmetrically about the central axis.

[0077] In addition, in the distance measuring device 120 of the second modified example, a configuration is adopted in which an image of an object is captured by the imaging unit 30 and reflected light C1 from the object generated by projecting light B3 by the detection unit 22 is detected, but instead of this, a configuration may be adopted in which the imaging unit 30 captures an image of the object and also detects reflected light C1 from the object generated by projecting light B3. The correction lenses 14 and 23 may also be used to control camera shake correction of the aircraft. In addition, the imaging unit 30 is driven by a driving device (not shown) so as to move along the reference axis L 10 The object may be controlled to be positioned at the center of the image by shifting it in a plane perpendicular to the center of the image.

[0078] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the claims that such modifications and improvements can also be included within the technical scope of the present invention.

[0079] It should be noted that the execution order of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before," "prior to," etc., and that the processes can be performed in any order unless the output of a previous process is used in a subsequent process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, this does not mean that the processes must be performed in this order. [Explanation of symbols]

[0080] 10...light projecting unit, 10d...light projecting unit, 11...light source, 12, 12d...light projecting observation optical system, 12dd...light projecting optical system, 13...mirror, 13a...dichroic reflecting surface, 13b...driving device, 14...correcting lens, 14a...lens element, 14b...driving device, 15...objective lens, 20, 20d...detecting unit, 21...light receiving lens, 22...detecting element, 22d...detection observation optical system, 23...correcting lens, 23a...lens element, 23b...driving device, 24...mirror, 24a...dichroic reflecting surface, 3 0,30d...imaging unit, 51...analysis unit, 52...control unit, 61...processing unit, 62...calculation unit, 70...display unit, 71...display device, 71a...display screen, 72...touch detection sensor, 100, 110, 120...distance measurement device, 200...captured image, 201...cup, 202...pin flag, 210...green, 220...banka, 230...forest, 240, 242, 246...mark, 244...area, A1, A2, A3...visible light, B1, B2, B3...light, C1, C2, C3...reflected light, L 10 ,L 20 ...Reference axis.

Claims

1. A distance measurement device that projects light to measure the distance to an object, an imaging unit that images the object via an imaging optical system; an analysis unit that detects a deviation of the object with respect to a reference axis of a first optical system used for projecting the light based on an imaging result obtained by the imaging unit; a control unit that tilts a mirror element included in the first optical system so as to deflect the light in a direction determined based on a detection result of the displacement of the object; a light projection unit that projects the light onto the object via the first optical system; a processing unit that determines a distance to the object based on a detection result of reflected light generated by projecting the light onto the object by the light projecting unit via a second optical system; and wherein the imaging optical system is common to at least a part of the first optical system or the second optical system.

2. The distance measurement device according to claim 1 , wherein the imaging optical system is at least partly common to the first optical system.

3. the imaging optical system is common to at least a part of the second optical system, the control unit further displaces a lens element included in the second optical system with respect to a reference axis of the second optical system to tilt a light-receiving angle of the reflected light.

2. A distance measuring device according to claim 1.

4. 4. The distance measuring device according to claim 3, wherein the deflection angle of the light and the change in the acceptance angle of the reflected light are controlled equally.

5. The distance measurement device according to claim 1 , wherein a part of the first optical system or the second optical system is used to control image stabilization of a body of the distance measurement device.

6. The distance measuring device according to claim 1 , wherein the imaging unit further detects reflected light from the object.

7. The distance measuring device according to claim 1 , further comprising a detector that detects reflected light from the object.

8. The distance measurement device according to claim 1 , wherein the analysis unit analyzes an image of the object in the imaging result to identify the object.

9. the analysis unit analyzes the image of the object based on a machine learning model; The distance measurement device according to claim 8 , wherein the machine learning model is constructed in advance by machine learning using an image of an object from which distance is to be measured as training data.

10. The analysis unit analyzes the image of the object using an image processing method, the image processing method includes at least an edge detection method; 9. A distance measuring device according to claim 8.

11. The distance measuring device according to claim 8 , wherein the analysis unit identifies the object at the center of the image.

12. the imaging unit images the object multiple times at different times, the analysis unit identifies the object based on an image difference between the plurality of images. A distance measuring device according to any one of claims 8 to 11.

13. the analysis unit analyzes the image of the object to identify the object; the control unit controls the light to scan the identified object using the light; The distance measurement device according to claim 8 , wherein the processing unit determines the distance to the object based on a relationship between a scanning position of the object with the light and a detection result of the reflected light.

14. a display unit that displays an image of the object obtained by the imaging unit on a display screen, the display screen includes a touch detection sensor that detects a touch operation by a user; 14. The distance measuring device according to claim 1, wherein the control unit controls the light to project the light onto at least one location included in the image when the at least one location is selected by a touch operation on the display screen.

15. The distance measuring device according to claim 14, further comprising a calculation unit that calculates, when a plurality of locations included in the image are selected by a touch operation on the display screen, distances to the plurality of locations, or distances and / or areas between the plurality of locations.

16. 16. A distance measuring device according to claim 1, wherein at least one of the first optical system and the second optical system further includes at least one of a prism that can be displaced and / or rotated relative to a reference axis of the one optical system and a mirror that tilts relative to the reference axis.

17. The distance measurement device according to claim 1 , wherein the light projecting unit projects the light onto the object after the imaging unit captures an image of the object.

18. 18. The distance measurement device according to claim 1, wherein the light projecting unit projects the light onto the object after the object is imaged by the imaging unit, thereby shifting the timing of imaging the object and projecting the light.

19. Further comprising a drive device that tilts the mirror element, The distance measuring device according to claim 1 , wherein the control unit controls the drive device to tilt the mirror element.

20. A distance measurement method for measuring a distance to an object by projecting light, comprising: imaging the object via an imaging optical system; detecting a deviation of the object from a reference axis of a first optical system used to project the light based on an imaging result obtained by the imaging step; tilting a mirror element included in the first optical system so as to deflect the light in a direction determined by a result of detecting the displacement of the object; projecting the light onto the object through the first optical system; and determining a distance to the object based on a detection result, via a second optical system, of reflected light generated by projecting the light onto the object in the projecting step, the imaging optical system is common to at least a part of the first optical system or the second optical system; Distance measurement method.

Images