Distance measuring device and system
The system improves distance measurement efficiency by coordinating multiple devices to adjust light irradiation ranges based on received data, addressing inefficiencies in detecting moving objects across overlapping measurement ranges.
Patent Information
- Application Number
- JP2022532463
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-06-19
- Filing Date
- 2021-05-28
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2041-05-28
AI Technical Summary
Existing distance measurement systems in self-propelled vehicles face inefficiencies in accurately measuring distances to moving objects across overlapping measurement ranges, leading to potential delays and inaccuracies due to high calculation loads and communication challenges between multiple distance measuring devices.
A system comprising two or more distance measuring devices that communicate and adjust their light irradiation ranges based on received setting data to efficiently measure distances to moving objects, using a processing circuit to determine object positions and control light emission, allowing for adaptive and coordinated distance measurement.
Enhances the efficiency of distance measurement by allowing for more accurate and timely detection of moving objects across overlapping measurement ranges, reducing calculation loads and communication delays.
Smart Images

Figure 0007591713000001 
Figure 0007591713000002 
Figure 0007591713000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a ranging device and a ranging system. [Background technology]
[0002] In self-propelled systems such as self-driving cars and self-propelled robots, it is important to avoid collisions with other vehicles, people, etc. To this end, systems that sense the external environment using cameras or distance measuring devices are used.
[0003] Regarding distance measurement, various devices have been proposed that measure the distance to one or more objects existing in space. For example, Patent Documents 1 to 3 disclose systems that measure the distance to an object using ToF (Time of Flight) technology.
[0004] Patent Document 1 discloses a system that measures the distance to an object by scanning a space with a light beam and detecting the reflected light from the object. This system changes the direction of the light beam during each of a number of frame periods and causes one or more light receiving elements in an image sensor to sequentially detect the reflected light. This operation successfully shortens the time required to obtain distance information for the entire target scene.
[0005] Patent Document 2 discloses a method for detecting a crossing object moving in a direction different from the direction of the vehicle by measuring distances in all directions multiple times. It discloses a method for reducing the noise to signal ratio by increasing the intensity or number of times the light pulse is emitted from the light source.
[0006] Patent Document 3 discloses providing a second distance measuring device that emits a light beam to a distant object in addition to a first distance measuring device in order to obtain detailed distance information about the distant object. [Prior art documents] [Patent documents]
[0007] [Patent Document 1] JP 2018-124271 A [Patent Document 2] JP 2009-217680 A [Patent Document 3] JP 2018-049014 A Summary of the Invention [Problem to be solved by the invention]
[0008] The present disclosure provides techniques for making distance measurement of a movable object more efficient using multiple distance measurement devices. [Means for solving the problem]
[0009] A distance measuring device according to an embodiment of the present disclosure is used in a system including two or more distance measuring devices whose distance measuring ranges are adjacent or partially overlapping. The distance measuring device includes a light emitting device capable of changing the irradiation range of light, a light receiving device that detects reflected light generated by the light emitted from the light emitting device being reflected by an object and outputs a detection signal, and a processing circuit having a function of communicating with other distance measuring devices in the system, calculating a distance to the object based on the detection signal, and determining the position of the object. The processing circuit generates first setting data that specifies the irradiation range of light to be emitted by the other distance measuring device based on the determined position of the object, transmits the first setting data to the other distance measuring device, and when it receives second setting data that specifies the irradiation range of light to be emitted by the light emitting device from the other distance measuring device, controls the light emission of the light emitting device according to the second setting data.
[0010] A comprehensive or specific aspect of the present disclosure may be realized in a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable recording disk, or may be realized in any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. A computer-readable recording medium may include a non-volatile recording medium such as a CD-ROM (Compact Disc-Read Only Memory). An apparatus may be composed of one or more devices. When an apparatus is composed of two or more devices, the two or more devices may be arranged in one device, or may be arranged separately in two or more separate devices. In this specification and the claims, "apparatus" may mean not only one device, but also a system consisting of multiple devices. Effect of the Invention
[0011] According to one aspect of the present disclosure, distance information of a movable object can be obtained more efficiently using multiple distance measuring devices. [Brief description of the drawings]
[0012] [Figure 1] FIG. 1 is a block diagram illustrating a schematic configuration of a distance measuring system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of an arrangement of a plurality of distance measuring devices. [Diagram 3] FIG. 2 is a block diagram showing an example of the configuration of a distance measuring device. [Figure 4A] 1A and 1B are diagrams illustrating examples of irradiation ranges of a light beam and a flash of light. [Figure 4B] 1A and 1B are diagrams illustrating examples of irradiation ranges of a light beam and a flash of light. [Figure 5A] FIG. 1 is a diagram showing an example of distance measurement by an indirect ToF method. [Figure 5B] FIG. 13 is a diagram showing another example of distance measurement by the indirect ToF method. [Figure 6A] FIG. 2 is a diagram illustrating an example of data stored in a storage medium. [Figure 6B]11A and 11B are diagrams illustrating an example of data recorded in a storage medium during processing. [Figure 6C] 10A and 10B are diagrams illustrating examples of formats of data transmitted and received between adjacent distance measuring devices. [Figure 7] FIG. 4 illustrates an example of information stored in a storage device. [Figure 8] 10 is a flowchart showing an example of an operation of the processing device. [Figure 9] 6 is a flowchart showing an example of the operation of each distance measuring device. [Figure 10A] FIG. 1 is a diagram showing an example of a situation in which a tracked object moves within the field of view of one distance measuring device. [Figure 10B] FIG. 11 is a diagram showing another example of a situation in which a tracked object moves within the field of view of one distance measuring device. [Figure 10C] FIG. 11 is a diagram showing an example of a situation in which tracking information is passed between two adjacent distance measuring devices. [Figure 10D] FIG. 13 is a diagram showing another example of a situation in which tracking information is exchanged between two adjacent distance measuring devices. [Figure 11] 10 is a flowchart showing another example of the operation of each distance measuring device. [Figure 12] FIG. 11 is a block diagram showing the configuration of a distance measuring system in a second embodiment. [Figure 13] 11 is a flowchart showing an example of the operation of the processing device according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] In the present disclosure, all or part of a circuit, unit, device, member or part, or all or part of a functional block in a block diagram may be implemented by one or more electronic circuits including, for example, a semiconductor device, a semiconductor integrated circuit (IC), or an LSI (large scale integration). The LSI or IC may be integrated into one chip, or may be configured by combining multiple chips. For example, functional blocks other than memory elements may be integrated into one chip. Here, although it is called an LSI or an IC, the name may change depending on the degree of integration, and it may be called a system LSI, a VLSI (very large scale integration), or an ULSI (ultra large scale integration). A Field Programmable Gate Array (FPGA), which is programmed after the manufacture of the LSI, or a reconfigurable logic device, which can reconfigure the junction relationship inside the LSI or set up the circuit partition inside the LSI, can also be used for the same purpose.
[0014] Furthermore, all or part of the functions or operations of a circuit, unit, device, member, or section can be executed by software processing. In this case, the software is recorded in one or more non-transitory recording media, such as a ROM, an optical disk, or a hard disk drive, and when the software is executed by a processor, the functions specified in the software are executed by the processor and peripheral devices. The system or device may include one or more non-transitory recording media on which the software is recorded, a processor, and necessary hardware devices, such as an interface.
[0015] Before describing the embodiments of the present disclosure, the findings on which the present disclosure is based will be described.
[0016] In conventional distance measuring devices, in order to measure the distance to multiple objects scattered over a wide area in a scene, a method is used in which a light beam is irradiated all over the scene, for example, by raster scanning. In such a method, the light beam is irradiated even in areas where no object exists, and the order of emitting the light beam is predetermined. Therefore, even if, for example, a dangerous or important object exists in the scene, the light beam cannot be irradiated preferentially to the object. In order to irradiate the light beam preferentially in a specific direction regardless of the order of emitting the light in the scan, there is a method of adding a distance measuring device that measures the distance in the preferential direction, as disclosed in Patent Document 3, for example.
[0017] In the method disclosed in Patent Document 3, in addition to a first LIDAR (Light Detection and Ranging) that measures distances all around the vehicle, a second LIDAR that can measure distances at a greater distance with higher resolution is used. Distant objects that cannot be adequately identified by the first LIDAR are identified with high resolution by the second LIDAR. In this configuration, the vehicle controller detects an object based on data output from the first LIDAR and adjusts the direction of the light beam from the second LIDAR so that the object is irradiated with light. In a configuration in which the controller determines and controls the emission direction of light from multiple ranging devices, as in the system of Patent Document 3, the calculation load of the controller is large, and a delay may occur in communication between the controller and each ranging device. For this reason, for example, it may not be possible to measure the distance with high accuracy to an object moving at high speed across the ranging ranges of multiple ranging devices.
[0018] In order to solve the above problem, in an embodiment of the present disclosure, setting data defining the irradiation range of light is transmitted and received between multiple distance measuring devices, and each distance measuring device adaptively emits light based on the received setting data. With this configuration, it is possible to more efficiently measure the distance to an object using multiple distance measuring devices.
[0019] An outline of an embodiment of the present disclosure will be described below.
[0020] A distance measuring device according to an embodiment of the present disclosure is used in a system including two or more distance measuring devices whose distance measuring ranges are adjacent or partially overlapping. The distance measuring device includes a light emitting device capable of changing the irradiation range of light, a light receiving device that detects reflected light generated by the light emitted from the light emitting device being reflected by an object and outputs a detection signal, and a processing circuit having a function of communicating with other distance measuring devices in the system, and calculating a distance to the object based on the detection signal and determining the position of the object. The processing circuit generates first setting data that specifies the irradiation range of light to be emitted by the other distance measuring device based on the determined position of the object, transmits it to the other distance measuring device, and when it receives second setting data that specifies the irradiation range of light to be emitted by the light emitting device from the other distance measuring device, controls the light emission of the light emitting device according to the second setting data.
[0021] Here, the "distance measurement range" of the distance measurement device means a range in space where the distance measurement device can measure distance. The distance measurement range is a range in three-dimensional space where the light emitted from the light emitting device reaches and where the reflected light from the object can be detected by the light receiving device if an object exists. In the following description, the distance measurement range may also be referred to as the "field of view range". "Adjacent distance measurement ranges" means that the distance measurement ranges are spatially continuous or are close to each other with a gap that is small compared to the size of each distance measurement range. The "irradiation range" of light means an area in space that is irradiated by the light. The light emitting device may be capable of changing the emission direction of the light beam. In that case, the irradiation range changes according to the change in the emission direction of the light beam. The light emitting device may also be capable of changing the degree of spread of the emitted light. In that case, the irradiation range changes according to the change in the degree of spread of the emitted light. Each of the first setting data and the second setting data may include, for example, information that defines at least one selected from the group consisting of the emission direction of the light emitted from the light emitting device, the degree of spread, and the position or range of the object to be illuminated. Such information may define the illumination range of the light.
[0022] According to the above configuration, setting data defining a light irradiation range is transmitted and received between two or more distance measuring devices whose distance measuring ranges are adjacent or partially overlapping. The light irradiation range defined by the setting data may be, for example, a range in which an important object to be measured exists. Each distance measuring device irradiates the defined irradiation range with light according to the received setting data. This makes it possible to efficiently obtain distance data for an object moving across the distance measuring ranges of multiple distance measuring devices.
[0023] The light emitting device may be capable of changing the spread angle of the emitted light. For example, the light emitting device may be configured to emit a light beam with a relatively small spread angle and diffused light with a relatively large spread angle. Alternatively, the light emitting device may be configured to emit a plurality of types of light beams with different spread angles. In this case, the second setting data may specify the spread angle of the light to be emitted by the light emitting device. Similarly, the first setting data may specify the spread angle of the light to be emitted by the light emitting device.
[0024] The first setting data may include information indicating a position of the object whose distance is calculated by the processing circuit. Similarly, the second setting data may include information indicating a position of an object to be measured. In that case, the processing circuit controls light emission of the light emitting device so that light is irradiated onto the object to be measured.
[0025] The light emitting device may be capable of switching between emitting a light beam and emitting diffused light, and changing the direction of the light beam. In this case, the second setting data may include information indicating whether the light to be emitted by the light emitting device is the light beam or the diffused light, and information specifying the direction of the light beam when the light to be emitted by the light emitting device is the light beam. The processing circuit may be configured to cause the light emitting device to emit the diffused light or emit the light beam in the specified direction according to the second setting data. Similarly, the first setting data may include information indicating whether the light to be emitted by the other distance measuring device is a light beam or diffused light, and information specifying the direction of the light beam when the light to be emitted by the other distance measuring device is the light beam.
[0026] The processing circuit may be configured to generate and transmit the first setting data to the other ranging device when it is determined that the object will enter the ranging range of the other ranging device based on data defining the ranging range of the other ranging device and a change over time in the determined position of the object. By such an operation, the first setting data can be transmitted to the other ranging device at an appropriate timing when it is predicted that the object will enter the ranging range of the other ranging device, thereby improving the efficiency of the operation.
[0027] The distance measurement range of each distance measuring device may include a first range measured by a light beam and a second range measured by a diffused light. The first range may be a range in space that can be scanned by a light beam. The processing circuit may be configured to determine whether the object falls within the first range or the second range based on data defining the first range and the second range and a change over time in the determined position of the object, generate the first setting data including information indicating that the light to be emitted by the other distance measuring device is a light beam and information defining the direction of the light beam when it is determined that the object falls within the first range, and transmit the first setting data to the other distance measuring device when it is determined that the object falls within the second range, and generate the first setting data including information indicating that the light to be emitted by the other distance measuring device is diffused light and transmit the first setting data to the other distance measuring device.
[0028] The processing circuit may be configured to periodically perform the operation of causing the light-emitting device to emit light and the light-receiving device to output the detection signal, and when it predicts that the position of the object determined based on the detection signal will fall within the ranging range of the other ranging device in the next period, generate the first setting data and transmit it to the other ranging device.
[0029] The processing circuit may be configured to transmit the first setting data to the other distance measuring device via a processing device included in the system, and to receive the second setting data from the other distance measuring device via the processing device. The processing device may be, for example, a server computer that controls or manages the overall operation of the system. The processing device may simply relay the first setting data and the second setting data. Alternatively, the processing device may relay the first setting data and the second setting data after performing necessary processing, such as coordinate conversion, on the first setting data and the second setting data. In this way, communication between multiple distance measuring devices may be performed via other devices.
[0030] A system according to another embodiment of the present disclosure includes two or more distance measuring devices whose distance measuring ranges are adjacent or partially overlapping. Each of the two or more distance measuring devices includes a light emitting device capable of changing the irradiation range of light, a light receiving device that detects reflected light generated by the light emitted from the light emitting device being reflected by an object and outputs a detection signal, and a processing circuit having a function of communicating with other distance measuring devices in the system, calculating a distance to the object based on the detection signal, and determining a position of the object. The processing circuit generates first setting data that specifies the irradiation range of light to be emitted by the other distance measuring device based on the determined position of the object, transmits the first setting data to the other distance measuring device, and when it receives second setting data that specifies the irradiation range of light to be emitted by the light emitting device from the other distance measuring device, controls the light emission of the light emitting device according to the second setting data.
[0031] A method according to still another embodiment of the present disclosure is executed by a computer of a distance measuring device in a system including two or more distance measuring devices whose distance measuring ranges are adjacent or partially overlapping, the method including: emitting light from a light emitting device capable of changing the irradiation range of the light; detecting reflected light generated by the light emitted from the light emitting device being reflected by an object and outputting a detection signal from a light receiving device; calculating a distance to the object based on the detection signal and determining a position of the object; generating first setting data defining an irradiation range of light to be emitted by another distance measuring device in the system based on the determined position of the object, and transmitting the first setting data to the other distance measuring device; and, when second setting data defining an irradiation range of light to be emitted by the light emitting device is received from the other distance measuring device, controlling light emission of the light emitting device according to the second setting data.
[0032] According to yet another embodiment of the present disclosure, a computer program is executed by a computer of a distance measuring device in a system including two or more distance measuring devices whose distance measuring ranges are adjacent or partially overlapping. The computer program causes the computer to execute the following: cause a light emitting device capable of changing the irradiation range of light to emit the light, cause a light receiving device to detect reflected light generated by the light emitted from the light emitting device being reflected by an object and output a detection signal, calculate a distance to the object based on the detection signal and determine a position of the object, generate first setting data that specifies an irradiation range of light to be emitted by another distance measuring device in the system based on the determined position of the object, and transmit the first setting data to the other distance measuring device, and when second setting data that specifies an irradiation range of light to be emitted by the light emitting device is received from the other distance measuring device, control light emission of the light emitting device according to the second setting data.
[0033] Hereinafter, exemplary embodiments of the present disclosure will be described. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, components, arrangement and connection forms of components, steps, order of steps, etc. shown in the following embodiments are merely examples and are not intended to limit the present disclosure. In addition, among the components in the following embodiments, components that are not described in an independent claim showing the highest concept are described as optional components. In addition, each figure is a schematic diagram and is not necessarily illustrated strictly. Furthermore, in each figure, substantially the same components are given the same reference numerals, and duplicated descriptions may be omitted or simplified.
[0034] (Embodiment 1) A distance measuring system according to a first exemplary embodiment of the present disclosure will be described.
[0035] [1-1 Configuration of the distance measurement system] Fig. 1 is a block diagram showing a schematic configuration of a ranging system 10 according to the present embodiment. The ranging system 10 includes a plurality of ranging devices 100, a storage device 200, and a processing device 300. Fig. 1 also shows a control device included in a moving object on which the ranging system 10 is mounted. In the present embodiment, the control device is an external element of the ranging system 10, but the control device may be included in the ranging system 10.
[0036] Each ranging device 100 can communicate with other adjacent ranging devices 100. Each ranging device 100 can also communicate with a processing device 300. The communication may be wireless or wired, and is not limited to a specific communication method.
[0037] FIG. 2 is a diagram showing an example of the arrangement of multiple ranging devices 100. As shown in FIG. 2, multiple ranging devices 100 may be mounted on a moving body 50 such as an automobile. The multiple ranging devices 100 may be attached to other types of moving bodies such as a moving robot other than an automobile. Each ranging device 100 may be attached to the outside of the moving body 50 and used for sensing the environment around the moving body 50. The storage device 200 and the processing device 300 may be arranged inside or outside the moving body 50.
[0038] The multiple ranging devices 100 each have a different range in which they can measure distances (referred to as a "ranging range" in this specification). The ranging ranges of any two adjacent ranging devices 100 among the multiple ranging devices 100 are adjacent to each other or overlap. In the example shown in Fig. 2, five ranging devices 100 can measure distances to the entire 360° range around the moving object 50.
[0039] 3 is a block diagram showing an example of the configuration of the distance measuring device 100. The distance measuring device 100 includes a light emitting device 110, a light receiving device 120, a storage medium 140, and a processing circuit 180. The processing circuit 180 includes a processor 130, a control circuit 150, and a communication circuit 160. The communication circuit 160 includes a receiving circuit 162 and a transmitting circuit 164.
[0040] The light emitting device 110 in this embodiment can emit a light beam with a small spread angle and a narrow irradiation range, and a flash light which is diffused light with a large spread angle and a wide irradiation range. The light emitting device 110 may have a light source that emits a light beam and a light source that emits a flash light, separately. Alternatively, the light emitting device 110 may have one light source that can emit both the light beam and the flash light. The light emitting device 110 may be configured to emit a plurality of types of light beams with different spread angles and flash light by changing the spread angle of the emitted light.
[0041] 4A and 4B are diagrams showing examples of the irradiation ranges of the light beam and the flash light, respectively. In FIG. 4A and FIG. 4B, an example of light irradiated from the light emitting device 110 of the distance measuring device 100 attached to the center of the front of the moving body 50, which is an automobile, is shown. The light emitting device 110 can switch between emitting the flash light L1 and the light beam L2. The flash light L1 is a diffused light that irradiates a wide area in front of the distance measuring device 100, and therefore has a relatively short reach. In contrast, the light beam has a narrowed light beam, and therefore reaches a relatively long distance.
[0042] In FIG. 4A and FIG. 4B, the positions of the light sources of the flash light L1 and the light beam L2 are shown as the same point, but the positions of these light sources may be different. That is, the light emitting device 110 may emit the flash light L1 and the light beam L2 from two light sources separated from each other. However, the flash light L1 and the light beam L2 are emitted at an angle at which the light receiving device 120 can receive the reflected light from the object caused by the irradiation of these lights. As shown in FIG. 4A and FIG. 4B, the irradiation range of the flash light L1 and the irradiation range of the light beam L2 overlap each other. The light emitting device 110 can emit the light beam L2 in any direction within the range at which the light receiving device 120 can receive the reflected light. By scanning that sequentially changes the emission direction, it is possible to measure the distance in a range equivalent to the range of the field of view of the flash light L1 shown in the dashed frame in FIG. 4A.
[0043] The light emitting device 110 may include a light source that emits a flash light, a light source that emits a light beam, such as a laser, and at least one movable mirror, such as a MEMS mirror. The emitted light beam is reflected by the movable mirror and directed toward a predetermined area in the scene. The control circuit 150 can change the direction of the light beam emitted from the second light source by driving the movable mirror. This allows scanning with the light beam.
[0044] A light source capable of changing the light emission direction by a structure different from that of a light emitting device having a movable mirror may be used. For example, a light emitting device using a reflective waveguide as disclosed in Patent Document 1 may be used. Alternatively, a light emitting device that changes the light direction of the entire array by adjusting the phase of light output from each antenna by an antenna array may be used.
[0045] The light receiving device 120 detects reflected light generated by the light emitted from the light emitting device 110 being reflected by an object, and outputs a detection signal. The light receiving device 120 may be, for example, an image sensor having a plurality of light receiving elements arranged two-dimensionally. The distance measuring device 100 can measure the distance to the object, for example, by using ToF technology. For example, for each light receiving element, the time of flight (ToF) of light, that is, the time from when the light is emitted to when it is received, can be measured, and the distance can be calculated from the time and the speed of light. ToF technology includes direct ToF and indirect ToF. The distance measuring device 100 may measure the distance by any method. The light receiving device 120 is not limited to an image sensor. For example, a light receiving device having a single light receiving element or an array of a small number of light receiving elements may be used. In addition, the method of distance measurement is not limited to direct ToF and indirect ToF, and may be, for example, a frequency-modulated continuous-wave (FMCW) method. In the following description, unless otherwise specified, the light receiving device 120 is an image sensor having a plurality of light receiving elements arranged two-dimensionally, and performs distance measurement by the indirect ToF method.
[0046] The image sensor may be, for example, a CCD (Charge-Coupled Device) sensor, a CMOS (Complementary Metal Oxide Semiconductor) sensor, or an infrared array sensor. Each light receiving element includes a photoelectric conversion element, for example, a photodiode, and one or more charge storage units. Charges generated by photoelectric conversion are accumulated in the charge storage unit during an exposure period. The charges accumulated in the charge storage unit are output after the exposure period ends. In this way, each light receiving element outputs an electric signal according to the amount of light received during the exposure period. This electric signal may be called a "detection signal." The image sensor may be a monochrome type imaging element or a color type imaging element. For example, a color type imaging element having an R / G / B, R / G / B / IR, or R / G / B / W filter may be used. The image sensor may have detection sensitivity not limited to the visible wavelength range, but may have detection sensitivity in wavelength ranges such as ultraviolet, near infrared, mid-infrared, and far infrared. The image sensor may be a sensor using a SPAD (Single Photon Avalanche Diode). The image sensor may be equipped with an electronic shutter mechanism that exposes all pixels at once, i.e., a global shutter mechanism. The electronic shutter mechanism may be a rolling shutter mechanism that exposes each row, or an area shutter mechanism that exposes only a partial area that matches the irradiation range of the light beam.
[0047] The image sensor receives reflected light during each of a plurality of exposure periods having different start and end timings based on the timing of light emission from light emitting device 110, and outputs a signal indicating the amount of received light for each exposure period.
[0048] The control circuit 150 determines the direction and timing of light emission by the light emitting device 110, and outputs a control signal to the light emitting device 110 to instruct the light emitting device 110 to emit light. Furthermore, the control circuit 150 determines the timing of exposure of the light receiving device 120, and outputs a control signal to the light receiving device 120 to instruct the exposure and output of a signal.
[0049] The processor 130 acquires signals indicating charges accumulated during different exposure periods output from the light receiving device 120, and calculates the distance to the object based on those signals. The processor 130 calculates the time from when the light beam is emitted from the light emitting device 110 to when the reflected light beam is received by the light receiving device 120 based on the ratio of the charges accumulated during the multiple exposure periods, and calculates the distance from that time. This type of distance measurement method is called an indirect ToF method.
[0050] FIG. 5A is a diagram showing an example of the timing of light projection, the timing of arrival of reflected light, and the timing of two exposures in the indirect ToF method. The horizontal axis shows time. The rectangular parts show the periods of light projection, arrival of reflected light, and two exposures. In this example, for simplicity, an example is described in which one light pulse is emitted, and the light receiving element that receives the reflected light generated by the light pulse is exposed twice in succession. (a) of FIG. 5A shows the timing of light emission from the light source. T0 is the pulse width. (b) of FIG. 5A shows the period in which the light pulse emitted from the light source and reflected by the object reaches the image sensor. Td is the flight time of the light pulse. In the example of FIG. 5A, the reflected light reaches the image sensor in a time Td shorter than the time width T0 of the light pulse. (c) of FIG. 5A shows the first exposure period of the image sensor. In this example, exposure starts at the same time as the start of light projection, and ends at the same time as the end of light projection. In the first exposure period, the light that returns early among the reflected light is photoelectrically converted, and the generated charge is accumulated. Q1 represents the energy of the light photoelectrically converted during the first exposure period. This energy Q1 is proportional to the amount of charge accumulated during the first exposure period. (d) of FIG. 5A shows the second exposure period of the image sensor. In this example, the second exposure period starts simultaneously with the end of the light projection and ends when the same time as the pulse width T0 of the light pulse, that is, the same time as the first exposure period, has elapsed. Q2 represents the energy of the light photoelectrically converted during the second exposure period. This energy Q2 is proportional to the amount of charge accumulated during the second exposure period. In the second exposure period, the light that arrives after the first exposure period is finished among the reflected light is received. Since the length of the first exposure period is equal to the pulse width T0 of the light pulse, the time width of the reflected light received in the second exposure period is equal to the flight time Td.
[0051] Here, the integral capacitance of the charge accumulated in the light receiving element during the first exposure period is Cfd1, the integral capacitance of the charge accumulated in the light receiving element during the second exposure period is Cfd2, the photocurrent is Iph, and the number of charge transfer clocks is N. The output voltage of the light receiving element during the first exposure period is expressed as Vout1 below. Vout1=Q1 / Cfd1=N×Iph×(T0-Td) / Cfd1
[0052] The output voltage of the light receiving element in the second exposure period is represented by Vout2 below. Vout2=Q2 / Cfd2=N×Iph×Td / Cfd2
[0053] 5A, since the time length of the first exposure period and the time length of the second exposure period are equal, Cfd1=Cfd2. Therefore, Td can be expressed by the following formula. Td = {Vout2 / (Vout1+Vout2)} × T0
[0054] The speed of light is C (≒ 3 × 10 8 m / s), the distance L between the device and the object is expressed by the following formula: L=1 / 2×C×Td=1 / 2×C×{Vout2 / (Vout1+Vout2)}×T0
[0055] Since the image sensor actually outputs the charge accumulated during the exposure period, there are cases where it is not possible to perform two exposures in succession in time. In such cases, for example, the method shown in FIG. 5B can be used.
[0056] FIG. 5B is a diagram showing the timing of light projection, exposure, and charge output when two exposure periods cannot be provided consecutively. In the example of FIG. 5B, first, the image sensor starts exposure at the same time as the light source starts light projection, and ends exposure at the same time as the light source ends light projection. This exposure period corresponds to exposure period 1 in FIG. 5A. The image sensor outputs the charge accumulated during this exposure period immediately after exposure. This charge amount corresponds to the energy Q1 of the received light. Next, the light source starts light projection again, and ends the light projection after the same time T0 as the first time has elapsed. The image sensor starts exposure at the same time as the light source ends light projection, and ends exposure after the same time length as the first exposure period has elapsed. This exposure period corresponds to exposure period 2 in FIG. 5A. The image sensor outputs the charge accumulated during this exposure period immediately after exposure. This charge amount corresponds to the energy Q2 of the received light.
[0057] Thus, in the example of Fig. 5B, in order to obtain a signal for the distance calculation, the light source projects light twice, and the image sensor is exposed at different timings for each projection. In this way, even if the two exposure periods cannot be provided consecutively in time, a voltage can be obtained for each exposure period. In this way, in an image sensor that outputs a charge for each exposure period, light under the same conditions is projected a number of times equal to the number of exposure periods set in advance in order to obtain information on the charge accumulated in each of a plurality of exposure periods set in advance.
[0058] In actual distance measurement, the image sensor may receive not only light emitted from a light source and reflected by an object, but also background light, i.e., external light such as sunlight or surrounding lighting. Therefore, an exposure period is generally provided for measuring the accumulated charge due to background light incident on the image sensor when no light pulse is emitted. The amount of charge measured during the background exposure period can be subtracted from the amount of charge measured when the reflected light of the light pulse is received to obtain the amount of charge when only the reflected light of the light pulse is received. In this embodiment, for simplicity, a description of the operation of the background light is omitted.
[0059] In this example, distance measurement is performed by the indirect ToF method, but distance measurement may also be performed by the direct ToF method. When distance measurement is performed by the direct ToF method, the light receiving device 120 is provided with a sensor in which light receiving elements with timer counters are arranged two-dimensionally along the light receiving surface. The timer counter starts timing when exposure starts, and ends timing when the light receiving element receives reflected light. In this way, the timer counter measures the time for each light receiving element, and directly measures the flight time of light. The processor 130 calculates the distance from the measured flight time of light.
[0060] The processor 130 acquires the detection signal for each pixel output from the light receiving device 120, and calculates the distance to the object for each pixel. The calculation result may be recorded as, for example, two-dimensional image data in which the pixel value is the distance value, that is, distance image data. Alternatively, the calculation result may be recorded as three-dimensional point cloud data. The point cloud data may be generated by converting the position and distance value of each pixel in the distance image into coordinates of a point on a three-dimensional coordinate system with the position of the light receiving device 120 as the origin, for example. The data of the pixel position and pixel value in the distance image, or the coordinate data in the point cloud data, are treated as data indicating the position of the object. The processor 130 records the generated distance image data or point cloud data in the storage device 200 and transmits it to the processing device 300.
[0061] The processor 130 further converts data indicating the position of a specific object acquired by the distance measuring device 100 into data expressed in a coordinate system set in the light receiving device of the distance measuring device adjacent to the distance measuring device 100. In the following description, the distance measuring device 100 of interest is sometimes referred to as the "self-measuring device 100", and the distance measuring device adjacent to the self-measuring device 100 is sometimes referred to as the "adjacent distance measuring device". The number of distance measuring devices adjacent to each distance measuring device 100 is two in this embodiment, but it may be one or three or more. The processor 130 judges whether the object whose distance is measured by the self-measuring device 100 and whose position is specified can be measured by each adjacent distance measuring device. Furthermore, if the object can be measured by each adjacent distance measuring device, it calculates whether the object is in a position where it can be measured by a flash light or a position where it can be measured by a light beam. The processor 130 also determines the type of lighting and the irradiation direction based on the lighting data received from the adjacent distance measuring device. This operation will be described in detail later.
[0062] The storage medium 140 includes memories such as ROM and RAM, and stores computer programs executed by the processor 130. The storage medium 140 also stores data indicating the relative positions of the self ranging device 100 and the adjacent ranging device. This data is used in a process of converting the position of an object in the coordinate system of the self ranging device 100 to the position of the object in the coordinate system of the adjacent ranging device.
[0063] FIG. 6A is a diagram showing an example of data stored in the storage medium 140. As shown in FIG. 6A, the storage medium 140 stores the position of the origin, the range measurable by the flash light, and the range measurable by the light beam for each of the distance measuring devices adjacent to the distance measuring device 100 as fixed values. The position of the origin of the adjacent distance measuring device may be set to, for example, the center position of the light receiving surface of the light receiving device in the distance measuring device. The position of the origin of the adjacent distance measuring device is expressed in the coordinate system of the self-measuring device 100. In the example of FIG. 6A, the distance measuring range by each of the flash light and the light beam of each of the adjacent distance measuring devices is recorded as a value expressed in a three-dimensional coordinate system set in the self-measuring device 100, which is the position corresponding to the maximum distance in two pixels at the upper left corner and the lower right corner of the light receiving device 120.
[0064] 6A, data in other formats for performing coordinate conversion between the coordinate system of the self ranging device 100 and the coordinate system of the adjacent ranging device may be recorded in the storage medium 140. For example, each parameter of affine transformation for converting the coordinate system of the self ranging device 100 to the coordinate system of each adjacent ranging device, and the ranging range of the flash light and the ranging range of the light beam expressed in the coordinate system of each adjacent ranging device may be recorded. The processor 130 performs conversion processing for making it possible to compare the position of the object expressed in the coordinate system of the self ranging device 100 and the ranging range of the flash light and the ranging range of the light beam expressed in the coordinate system of the adjacent ranging device according to the contents of the data stored in the storage medium 140.
[0065] In the storage medium 140, various data generated by the processor 130 in the process are also recorded. FIG. 6B is a diagram showing an example of data recorded in the storage medium 140 in the process. In this example, information on one or more objects detected in a scene is recorded in the storage medium 140. Here, the "object" represents a tracking object that is the subject of distance measurement across multiple frames. The processor 130 records information required for tracking of the object by the self-distance measuring device 100 and information to be handed over to an adjacent distance measuring device in the storage medium 140. In the example of FIG. 6B, the storage medium 140 stores an object ID for identifying the detected object, a code for identifying a template for detecting the object, a position in the previous frame, a position in the current frame, an estimated position in the next frame, an illumination type in the next frame, an irradiation direction in the next frame, and an illumination range of light in the next frame. The illumination type may be specified by a code indicating whether the light used is a light beam or a flash light. The illumination range represents the scanning range of the light beam and may be expressed, for example, in an angle. In addition, if the light source that emits the light beam is configured to be able to change the spread angle of the beam, the spread angle of the beam may be recorded. The processor 130 generates information on the object to be tracked based on the distance measurement data acquired by the distance measurement device 100 or the data transmitted from an adjacent distance measurement device. The information on the object is updated for each frame. When the distance measurement device 100 is no longer able to track the object, that is, when the object moves out of the field of view of the distance measurement device 100, that is, out of the distance measurement range, the information on the object may be erased.
[0066] The control circuit 150 determines the type of light emitted from the light emitting device 110 and determines the irradiation direction and irradiation timing of the light emitting device 110 according to the calculation result of the processor 130. The control circuit 150 also adjusts the exposure timing of the light receiving device 120 so as to be synchronized with the irradiation timing of the light emitting device 110. In this way, the control circuit 150 controls the distance measurement operation of the distance measuring device 100. Note that the functions of the processor 130 and the control circuit 150 may be integrated into one circuit.
[0067] The communication circuit 160 is a circuit for communicating with other ranging devices and the processing device 300. The communication circuit 160 transmits and receives signals in a manner conforming to any communication standard. The communication circuit 160 may perform communication in either a wireless or wired manner. The communication circuit 160 includes a receiving circuit 162 and a transmitting circuit 164.
[0068] The receiving circuit 162 receives the position information and illumination information of the object transmitted from a distance measuring device adjacent to the self distance measuring device 100 .
[0069] The transmission circuit 164 transmits the distance image data or point cloud data generated by the processor 130 to the processing device 300. The transmission circuit 164 also transmits, to the adjacent ranging device, position information of the object whose position has been determined by the processor 130 in the coordinate system of the adjacent ranging device, and information on the lighting type and lighting direction according to the position.
[0070] FIG. 6C is a diagram showing an example of the format of setting data transmitted between adjacent distance measuring devices 100. The setting data specifies the irradiation range of light to be emitted by the light emitting device 110 of the destination distance measuring device. In this embodiment, the setting data includes a destination ID for identifying the destination distance measuring device, information indicating the number of objects, and information for each object recorded in the storage medium 140. In the example of FIG. 6C, data on an ID for identifying the object, a code specifying a template for detecting the object, a position in the previous frame, a position in the current frame, a position in the next frame, a type of illumination, a direction of illumination of the beam, and a scanning range of the beam are transmitted for each object. Note that the direction of illumination of the beam and the position of the object in the next frame can be said to be equivalent data, so one of the data may be omitted. The transmission data on illumination can be adjusted according to the type of illumination that the adjacent distance measuring device can emit and adjustable items (e.g., the spread angle of the beam, etc.). Data on the position of the object in the previous frame, the current frame, and the next frame are recorded and transmitted as, for example, three-dimensional coordinate values. Alternatively, the object's position data may be recorded and transmitted as a combination of two-dimensional coordinate values and distance values. The data shown in FIG. 6C includes information about the object to be tracked (i.e., "tracking information"). In the following description, this data may be referred to as "tracking data."
[0071] The storage device 200 stores information on the installation positions and angles of the multiple distance measuring devices 100. FIG. 7 is a diagram showing an example of information stored in the storage device 200. In this example, the storage device 200 stores the installation position, installation angle, and correction value for each distance measuring device 100. The installation position can be expressed as a point in a three-dimensional coordinate system set in the distance measuring system 10. The origin of the three-dimensional coordinate system can be set to a specific point such as the center of gravity of a device or object such as a moving body on which the distance measuring system 10 is installed. The installation angle can be expressed as a vector that expresses, for example, the normal direction of the light receiving surface of the light receiving device 120 provided in the distance measuring device 100 in the above three-dimensional coordinate system. The correction value is a value for correcting the deviation of the distance measuring range caused by, for example, the difference in output of the light emitting device 110 for each distance measuring device 100. The correction value is used, for example, to correct the deviation of the coordinates caused by the deviation of the position or orientation of the sensor caused by the installation error during manufacturing. 7, as an example, correction values of coordinates in the x, y, and z directions are recorded. In addition to the coordinates, correction values of angles may also be recorded.
[0072] The processing device 300 is a computer that communicates with the multiple ranging devices 100 via wired or wireless communication and processes data output from each ranging device 100. The processing device 300 converts the distance image data or point cloud data sequentially output from each ranging device 100 into position data in a three-dimensional coordinate system that is unified throughout the ranging system 10. The processing device 300 converts the received data based on information stored in the storage device 200 that indicates the characteristics of each ranging device 100, such as the installation position and installation angle of each ranging device 100.
[0073] In this embodiment, the processing device 300 executes a process of converting data expressed in a coordinate system set in each ranging device 100 into data expressed in a three-dimensional coordinate system unified throughout the ranging system 10. However, the present disclosure is not limited to such a configuration. For example, the processor 130 in each ranging device 100 may convert data from the coordinate system of the ranging device 100 to a coordinate system unified throughout the ranging system 10, and transmit the converted data to the processing device 300. In this case, the storage medium 140 in each ranging device 100 also stores data required for performing the coordinate conversion. For example, data indicating the position and orientation of the ranging device 100 in the coordinate system unified throughout the ranging system 10 may be recorded in the storage medium 140. The position of the ranging device 100 may be represented by, for example, the coordinates of the center position of the light receiving surface of the light receiving device 120. The orientation of the ranging device 100 may be represented by, for example, a vector in the normal direction of the light receiving surface of the light receiving device 120.
[0074] [1-2 Operation of the distance measurement system] [1-2-1 Processing device operation] Next, the operation of the processing device 300 will be described.
[0075] Fig. 8 is a flowchart showing the operation of the processing device 300. The processing device 300 executes the operations of steps S1100 to S1700 shown in Fig. 8. The operation of each step will be described below.
[0076] (Step S1100) The processing device 300 determines whether or not distance data has been input from one or more of the multiple distance measuring devices 100. Here, the distance data may be transmitted as distance image data or three-dimensional point cloud data, as described above. If there is an input from the distance measuring device 100, the process proceeds to step S1200. If there is no input from the distance measuring device 100, step S1100 is repeated.
[0077] (Step S1200) The processing device 300 identifies the distance measuring device 100 that transmitted the data based on information such as the ID or source address included in the data input in step S1100.
[0078] (Step S1300) Processing device 300 refers to storage device 200, acquires correction value data corresponding to distance measuring device 100 identified in step S1200, and corrects the distance data acquired in step S1100 using the acquired correction value.
[0079] (Step S1400) The processing device 300 refers to the storage device 200, acquires data on the installation position and installation angle corresponding to the distance measuring device 100 identified in step S1200, and converts the distance data acquired in step S1100 based on the acquired data. Specifically, the distance data in the three-dimensional coordinate system set in the distance measuring device 100 is converted into position data in a three-dimensional coordinate system common to the entire distance measuring system 10. In this way, the distance data acquired from the multiple distance measuring devices 100 is integrated into position data in a common three-dimensional coordinate system, i.e., point cloud data.
[0080] (Step S1500) The processing device 300 records the converted and integrated position data in the storage device 200 in step S1400.
[0081] (Step S1600) The processing device 300 judges whether a predetermined processing period or sampling period has elapsed since the previous output time point or the start time point of processing. The processing period is the time width during which the distance data sequentially input from the distance measuring device 100 is integrated and output. If the processing period has elapsed, proceed to step S1700. If the processing period has not elapsed, return to step S1100.
[0082] The processing device 300 repeats steps S1100 to S1600 until it is determined in step S1600 that a predetermined processing period has elapsed.0 The distance data acquired from each of the above is integrated into position data on three-dimensional coordinates that are common to the entire ranging system 10.
[0083] (Step S1700) The processing device 300 outputs position data converted from distance data acquired by the multiple distance measuring devices 100 during a processing cycle. The output destination may be, for example, a control device of a mobile object equipped with the distance measuring system 10. The control device executes necessary operations such as collision avoidance based on the output position data.
[0084] [1-2-2 Operation of distance measuring device] Next, the operation of each distance measuring device 100 will be described.
[0085] FIG. 9 is a flowchart showing an example of the operation of each distance measuring device 100. The distance measuring device 100 in this embodiment has a function of detecting and tracking objects such as pedestrians or vehicles present in a scene by repeatedly performing distance measurement using a light beam or a flash light. The distance measuring device 100 also has a function of adaptively selecting an irradiation method suitable for measuring the distance of each object by transmitting and receiving information on the position of the object and information on illumination between adjacent distance measuring devices 100. Hereinafter, the distance measuring operation by the distance measuring device 100 and the operation of data communication between adjacent distance measuring devices will be described with reference to FIG. 9.
[0086] (Step S2100) The processor 130 judges whether the receiving circuit 162 has received data from an adjacent ranging device 100. The data may include, for example, as shown in Fig. 6C, the position of the object expressed in the coordinate system of the local ranging device 100, and information such as the type of illumination suitable for irradiating the object at that position and the beam emission direction. If the receiving circuit 162 has not received data from the adjacent ranging device 100, the process proceeds to step S2200. If the receiving circuit 162 has received data from the adjacent ranging device 100, the process proceeds to step S2400.
[0087] (Step S2200) If data is not received from an adjacent distance measuring device 100, the processor 130 refers to the storage medium 140 and determines whether or not there is an object to be tracked that was set at the time of the previous distance measurement. If there is an object to be tracked, the process proceeds to step S2400. If there is no object to be tracked, the process proceeds to step S2300. In the initial state, there is no object to be tracked, so the process proceeds to step S2300.
[0088] (Step S2300) If it is determined in step S2200 that the object to be tracked is not specified, the control circuit 150 generates a control signal for instructing the light emitting device 110 and the light receiving device 120 to perform an operation of measuring the distance over the entire field of view set in advance and detecting the object. The control signal may be, for example, a signal instructing the light emitting device 110 and the light receiving device 120 to perform an operation combining a distance measurement by a scanning operation in which the light beam is changed in emission angle and sequentially irradiated, and a distance measurement by irradiating a flash light. By measuring the distance by the flash light, a wide range of distance measurement at a relatively short distance can be performed at once. In addition, by the scanning operation by the light beam, the entire field of view at a distant distance can be measured. This operation is performed to detect a specific object from a relatively wide field of view. Note that only the distance measurement by the scanning operation using the light beam may be performed, and the distance measurement by the flash light may be omitted. After the operation of step S2300, the process proceeds to step S2700.
[0089] (Step S2400) Processor 130 determines whether or not a light beam is specified as the illumination, i.e., whether or not to execute a beam scan. This determination is made by referring to the illumination information included in the data received in step S2100, or the illumination information associated with the object determined to be the tracking target in step S2200. If a light beam is specified as the illumination, the process proceeds to step S2500. If a light beam is not specified as the illumination, i.e., if a flashlight is specified, the process proceeds to step S2600.
[0090] (Step S2500) The processor 130 refers to the illumination information included in the data received in step S2100 or the illumination information associated with the object determined to be tracked in step S2200, and determines the range to be irradiated with the light beam. The range to be irradiated with the light beam is a range that covers a part or the whole of the object, and may differ depending on the size of the object. The control circuit 150 generates a control signal to instruct the light emitting device 110 and the light receiving device 120 to perform an operation of scanning the determined range with the light beam and measuring the distance. After the operation of step S2500, the process proceeds to step S2700.
[0091] (Step S2600) In step S2400, if a light beam is not specified as illumination, the object is included in the range of distance measurement by the flash light. In this case, distance measurement and detection of the object are performed by distance measurement operation by the flash light. Control circuit 150 generates a control signal that instructs light emitting device 110 and light receiving device 120 to perform distance measurement operation by the flash light. After the operation of step S2600, the process proceeds to step S2700.
[0092] (Step S2700) The control circuit 150 outputs a control signal to the light emitting device 110 and the light receiving device 120 to instruct distance measurement based on the illumination conditions set in steps S2300, S2500, and S2600. The light emitting device 110 and the light receiving device 120 perform light emission and exposure according to the input control signal. This allows distance data for the entire or part of the pre-set field of view range to be acquired. If the type of illumination used is flash light, distance data for the entire distance measurement range of the flash light can be acquired by one irradiation. On the other hand, if the type of illumination used is a light beam, distance data within a specified range can be acquired by performing the operation of emitting a light beam and detecting reflected light multiple times while changing the emission direction of the light beam.
[0093] (Step S2800) The processor 130 judges whether or not a tracking target object exists within the range measured in step S2700. The tracking target object is an object set as a tracking target at the time of the previous distance measurement, or an object indicated by the data received in step S2100. The processor 130 detects an object included within the distance measurement range by, for example, performing clustering based on the distance value for the distance data obtained by the distance measurement in step S2700. Alternatively, the processor 130 detects an object included within the distance measurement range by performing clustering based on the position of the point cloud for the three-dimensional point cloud data generated from the distance data obtained by the distance measurement in step S2700. It is possible to judge whether or not the object is a tracking target by performing matching between the detected object and a template of the object to be tracked. If it is judged that the tracking target object exists within the range measured as a result of the matching, the process proceeds to step S2900. If it is judged that the tracking target object does not exist within the range measured, the process proceeds to step S3100.
[0094] (Step S2900) The processor 130 estimates the position of the object matched as the tracking object in step S2800 at the time of the next distance measurement. The position estimation can be performed, for example, by obtaining a movement vector of the object. The processor 130 obtains a movement vector when the object detected by the self-distance measuring device 100 or the adjacent distance measuring device prior to the distance measurement in step S2700 moves to the position specified in step S2700. By doubling the magnitude of the obtained movement vector, the position of the object at the time of the next distance measurement can be estimated.
[0095] (Step S3000) The processor 130 determines whether or not the estimated position of the object at the time of the next distance measurement, estimated in step S2900, is within the distance measurement range of the self-measuring device 100. If the estimated position of the object at the time of the next distance measurement is within the distance measurement range of the self-measuring device 100, the process proceeds to step S3200. If the estimated position of the object at the time of the next distance measurement is not within the distance measurement range of the self-measuring device 100, the process proceeds to step S3300.
[0096] (Step S3100) In step S2800, if the target object to be tracked is not detected as a result of matching, the processor 130 judges whether or not a new target object exists within the range measured in step S2700. The processor 130 performs clustering based on the distance value of each pixel for the distance image data generated in step S2700, for example, and judges whether or not the shape of the cluster matches a predetermined aspect ratio and size. There may be a plurality of combinations of the predetermined aspect ratio and size. Alternatively, the processor 130 may perform clustering based on the position of the point cloud for the three-dimensional point cloud data generated from the distance data obtained by the distance measurement in step S2700. In that case, the processor 130 judges whether or not the shape of each cluster matches a predetermined three-dimensional outline shape. The predetermined outline shape may be, for example, a rectangular parallelepiped. A plurality of outline shapes may be defined. Note that a new target object may be detected by matching with a predetermined template, as in step S2800. If a new target object is detected in step S3100, the process proceeds to step S3200. If no new object is detected, flow proceeds to step S3600.
[0097] (Step S3200) In step S3000, the processor 130 sets as a tracking target an object whose estimated position at the next distance measurement is determined to be within the distance measurement range of the distance measuring device 100 itself, or an object detected as a new object in step S3100. The processor 130 records data such as the estimated position and lighting type of the object to be tracked in the storage medium 140. Here, the data may be recorded for each detected object, for example, as shown in FIG. 6B. After step S3200, the process returns to step S2100.
[0098] (Step S3300) If it is determined in step S3000 that the estimated position of the object at the time of the next distance measurement is not within the field of view of the self-distance measuring device 100, the self-distance measuring device 100 cannot continue tracking the object. Therefore, the processor 130 determines whether the estimated position of the object at the time of the next distance measurement is within the field of view of the adjacent distance measuring device 100, that is, whether tracking can be continued by the adjacent distance measuring device 100. This determination is made by referring to data in the storage medium 140, for example, as shown in FIG. 6A. If the estimated position of the object is included in the distance measuring range of the flash light or the distance measuring range of the light beam of the adjacent distance measuring device, the processor 130 determines that the estimated position of the object is within the field of view of the adjacent distance measuring device. The storage medium 140 may store a conversion parameter for converting the coordinate system of the self-distance measuring device 100 to the coordinate system of each adjacent distance measuring device, and the distance measuring range by the flash light and the distance measuring range by the light beam expressed in the coordinate system of each adjacent distance measuring device. In this case, the processor 130 transforms the estimated position of the object into a representation in the coordinate system of the adjacent ranging device, and then determines whether the estimated position is within the ranging range of the adjacent ranging device. The transformation may be performed, for example, by affine transformation using rotation and translation. If the estimated position of the object is within the viewing range of the adjacent ranging device 100, the process proceeds to step S3400. If the estimated position of the object is not within the viewing range of the adjacent ranging device 100, the process proceeds to step S3600.
[0099] (Step S3400) The processor 130 refers to the information on the light irradiation range of the adjacent distance measuring device recorded in the storage medium 140 and determines an illumination method suitable for the adjacent distance measuring device to measure the distance to the object. If the estimated position of the object is within the distance measuring range of the flash light, the flash light is selected, and if the estimated position of the object is within the distance measuring range of the light beam, the light beam is selected. If the light beam is selected, the emission direction of the light beam is also determined. The emission direction of the light beam is determined as the direction in which the light beam is irradiated to the estimated position of the object.
[0100] (Step S3500) The transmission circuit 164 generates transmission data including the estimated position of the object expressed in the coordinate system of the adjacent distance measuring device and information on the illumination method determined in step S3400, and transmits the data to the adjacent distance measuring device. The transmission data may be data in a format as shown in FIG. 6C, for example. In the example of FIG. 6C, information on a plurality of objects is transmitted collectively, but may be transmitted individually for each object. In that case, information on the number of objects is omitted from the transmission data. In addition, when a light source capable of changing the spread angle of the light beam is used, information on the spread angle of the light beam may be included. Furthermore, when the adjacent distance measuring device is configured to be capable of emitting only one of the light beam and the flash light, information on only one of the light beam and the flash light may be included in the transmission data. After step S3500, the process proceeds to step S3600.
[0101] (Step S3600) If no new object is detected in step S3100, or if it is determined in step S3300 that the estimated position of the object is not within the field of view of the adjacent distance measuring device, or if data transmission in step S3500 is completed, a process of canceling the tracking setting is performed. Processor 130 erases the information of the tracking object recorded in storage medium 140, and cancels tracking of the object. After step S3600, the process returns to step S2100.
[0102] Each ranging device 100 repeats the operations of steps S2100 to S3600, thereby transmitting and receiving information on the tracking target and information on the illumination used to measure the distance to the tracking target with adjacent ranging devices. This allows each ranging device 100 to adaptively irradiate the tracking target with light. Therefore, for example, the frequency of scanning a distant area with a light beam can be reduced, and the target can be tracked efficiently.
[0103] In the above example, only when a tracking target is not detected by the matching process in step S2800, an operation of detecting a new target is performed in step S3100. The operation is not limited to this, and even when a tracking target is detected by the matching process, an operation of detecting a new target may be performed.
[0104] [1-3 Example of operation] Next, with reference to FIGS. 10A to 10D, some specific examples of the switching operation between the flash light and the light beam by the distance measuring device 100 and the tracking takeover operation performed between two adjacent distance measuring devices 100 will be described.
[0105] FIG. 10A shows an example of a situation in which a tracking target object 60 moves within the field of view of one distance measuring device 100. The target object 60 in the figure is a two-wheeled vehicle. t1, t2, t3 represents the timing of three consecutive distance measurements. t1, t2, t3 10A shows a distance measurement range 111 of the flash light and a distance measurement range 112 of the light beam. In the example of FIG. 10A, distance measurement device 100 is placed at the center in front of moving body 50. Within the field of view of distance measurement device 100, object 60 moves from a distant location toward distance measurement device 100.
[0106] The distance measuring device 100 is t1, t2, t3 In the situation shown in FIG. 10A, the operation shown in FIG. 9 is performed at each of the timings. t1, t2, t3 In either case, the object 60 is located within the field of view, i.e., within the distance measurement range, of the distance measurement device 100. Therefore, the distance measurement device 100 does not transmit or receive information about the object 60 and the illumination to or from other adjacent distance measurement devices. The distance measurement device 100 switches between the light beam and the flash light according to the position of the object 60 moving within its own distance measurement range. Hereinafter, the operation shown in FIG. 10A will be described with reference to FIG. 9 again.
[0107] At time t1, in step S2100, the distance measuring device 100 has not received information on the object from the adjacent distance measuring device. Therefore, the process proceeds to step S2200. At the time of step S2200, the object has not yet been detected and tracking has not been performed, so the process proceeds to step S2300. In step S2300, a control signal is generated to instruct a wide-area scan, that is, an operation of measuring the distance by sequentially irradiating the entire field of view with a light beam. In the following step S2700, the light emitting device 110 and the light receiving device 120 perform distance measurement by irradiating the light beam according to the control signal. The processor 130 calculates the distance from the light receiving result of the reflected light acquired for the entire field of view. For example, the processor 130 generates a distance image based on the detection result of the reflected light at each pixel of the light receiving device 120. In the following step S2800, the processor 130 matches the distance image generated in step S2700 with a predetermined template of the tracking object. At time t1, a motorcycle is detected within the range of distance measuring device 100 for the first time, so the process proceeds to step S3100. In step S3100, the motorcycle is detected as a new object in the range image, and the process proceeds to step S3200. In step S3200, the motorcycle is set as a new object to be tracked, and information about the object is recorded in storage medium 140. For example, data such as that shown in FIG. 6B may be recorded. t1 In this case, since the object's previous position is unknown, t2 Since the position is not estimated, the next time t2 The lighting used in t1 The orientation of the object may be determined, for example, by image processing based on a distance image. In the example of FIG. 10A, t2 A light beam is used, and the periphery of the position of the object at time t1 is set as a scan range by the light beam. After step S3200, the process returns to step S2100, and the operation at time t2 is performed.
[0108] In the example of FIG. 10A, even at time t2, in step S2100, no data is received from the adjacent distance measuring device. Therefore, the process proceeds to step S2200. Since the tracking target is set in step S3200 in the process at time t1, the process proceeds to step S2400. In step S2400, it is determined that scanning with a light beam is performed based on the data recorded in step S3200 at time t1. In step S2500, the periphery of the position of the target at time t1 is determined as a scanning range. In step S2700, the determined range is scanned with a light beam, and distance measurement is performed in the range. In step S2800, matching is performed between the distance image of the scanning area obtained in step S2400 and a matching template or model of the tracking target stored in the storage medium 140. It is determined that the tracking target is included in the distance image, and the process proceeds to step S2900. In step S2900, the processor 130 estimates the position at time t3 based on the movement amount of the object between time t1 and time t2, and records the position information in the storage medium 140. In the following step S3000, it is determined whether the position of the tracking object estimated in step S2900 is within the field of view of the distance measuring device 100. In the example of FIG. 10A, the position of the object at time t3 is within the field of view of the distance measuring device 100, so the process proceeds to step S3200. In step S3200, the processor 130 sets tracking according to the estimated position of the tracking object at time t3 stored in the storage medium 140. In the example of FIG. 10A, the estimated position of the object at time t3 is within the range of the flash light of the distance measuring device 100, so the flash light is set as the illumination used at time t3. After step S3200, the process returns to step S2100, and the operation at time t3 is performed.
[0109] At time t3 in the example of FIG. 10A, in step S2100, no data is received from the adjacent distance measuring device. Therefore, the process proceeds to step S2200. Since the tracking target is set in step S3200 in the process at time t1, the process proceeds to step S2400. In step S2400, a determination is made to perform distance measurement using flash light instead of beam scanning from the estimated position of the target at time t3 estimated at time t2. In step S2600, the processor 130 generates a control signal for instructing distance measurement using flash light. In step S2700, the processor 130 causes the light emitting device 110 and the light receiving device 120 to perform distance measurement using flash light, and obtains a distance image of the short distance range of the entire field of view. In step S2800, matching is performed between the distance image obtained in step S2700 and a matching template or model of the tracking target stored in the storage medium 140. In this example, since it is determined by matching that the tracking target stored in the storage medium 140 is included in the distance image, the process proceeds to step S2900. In step S2900, the processor 130 estimates the position of the object at the next time t4 (not shown) based on the amount of movement of the object between time t2 and time t3, and records the information of the estimated position in the storage medium 140. In the following step S3000, it is determined whether the position of the tracking object estimated in step S2900 is within the field of view of the distance measuring device 100. Although the position at time t4 is not shown in FIG. 10A, at time t4, the object 60 passes through the field of view of the distance measuring device 100 and is outside the field of view. Therefore, the process proceeds to step S3300. In the example of FIG. 10A, the field of view of the adjacent distance measuring device (not shown) is away from the field of view of the own distance measuring device 100. Therefore, in step S3300, it is determined that the estimated position of the object at time t4 is not within the field of view of the adjacent distance measuring device, and the process proceeds to step S3600. In step S3600, the processor 130 cancels the setting of the tracking object stored in the storage medium 140, and the process returns to step S2100.
[0110] 10B shows another example of a situation in which a tracked object 60 moves within the field of view of one distance measuring device 100. In this example, the distance measuring device 100 is disposed on the side of a moving body 50. A two-wheeled vehicle, which is the object 60, travels from diagonally forward to diagonally backward of the moving body 50, approximately parallel to the traveling direction of the moving body 50. At time t1, the object 60 is within the distance measuring range 112 of the light beam. At time t2, the object 60 enters the distance measuring range 111 of the flash light. At time t3, the object 60 again enters the distance measuring range 112 of the light beam.
[0111] time t1 10A, the processes are performed in the order of steps S2100, S2200, S2300, S2700, S2800, S3100, and S3200. When the information of the tracking object is recorded in the storage medium 140 in step S3200, the process returns to step S2100, and the time t2 Processing is carried out in .
[0112] time t2 Then, the process proceeds from step S2100 to step S2200. t1 Since the tracking object has been set in the process in step S2400, the process proceeds to step S2400. t1 If we expand the position of object 60 at time t2In step S2400, it is estimated that the object 60 falls within the flashlight distance measurement range 111, not the light beam distance measurement range 112. Therefore, step S2400 determines "no," and the flashlight is determined as the illumination in step S2600. In the following step S2700, distance measurement is performed using flashlight irradiation, and the process proceeds to step S2800. Since the tracking object is detected by the matching process in step S2800, the process proceeds to step S2900. In step S2900, the position of the object 60 at the next time t3 is estimated. In the following step S3000, it is determined that the object 60 is within the field of view of the self-distance measuring device 100, and the process proceeds to step S3200. In step S3200, information about the tracking object is recorded, and the process returns to step S2100, where the time t3 Processing is carried out in .
[0113] time t3 10A, the processes are performed in the order of steps S2100, S2200, and S2400. In step S2400, it is determined that a beam scan is to be performed, and the process proceeds to step S2500. S Following step S2500, steps S2700, S2800, and S2900 are executed. In step S2900, t4 The position of the object 60 at time t4 Since the estimated position at time t is outside the field of view of the distance measuring device 100, the process proceeds to step S3300. t4 Since the position of the object 60 at is outside the viewing range of the adjacent distance measuring device, the process proceeds to step S3600. When the tracking setting is released in step S3600, the process returns to step S2100.
[0114] Next, with reference to FIGS. 10C and 10D, an example of an operation in which tracking information of an object is exchanged between two adjacent distance measuring devices 100a and 100b and tracking is continued will be described.
[0115] FIG. 10C shows an example of a situation in which tracking information is transferred between two adjacent distance measuring devices 100a and 100b. In the example of FIG. 10C, the first distance measuring device 100a is disposed at the right front part of the moving body 50, and the second distance measuring device 100b is disposed at the right part of the moving body 50. (1) in FIG. 10C shows an example including switching between distance measuring using a light beam and distance measuring using a flash light. (2) in FIG. 10C shows an example in which tracking by distance measuring using a light beam is continued between the distance measuring devices 100a and 100b. FIGS. 10C and 10D show an example of distance measuring ranges 111a and 112a by the flash light and light beam of the first distance measuring device 100a, and distance measuring ranges 111b and 112b by the flash light and light beam of the second distance measuring device 100b. Hereinafter, specific operations of the examples (1) and (2) in FIG. 10C will be described with reference to FIG.
[0116] In the example (1) in Fig. 10C, the operation of the distance measuring device 100a at times t1 and t2 is the same as the operation at times t1 and t2 in the example in Fig. 10A. At time t1, the object 60 enters the distance measuring range of the distance measuring device 100a for the first time, and the distance measuring device 10 0Since no data is received from b, the result of the determination in step S2100 is "no", and the process proceeds to step S2200. Since the tracking setting has not been done yet in step S2200, the process proceeds to step S2300. In step S2300, a control signal for performing distance measurement by wide-area scanning is generated, and the process proceeds to step S2700. In step S2700, the light emitting device 110 and the light receiving device 120 perform distance measurement of the entire visual field range according to the control signal. The processor 130 generates a distance image based on the detection signal output from the light receiving device 120. In the following step S2800, the processor 130 matches the object in the distance image with the object for which the tracking setting has been done. Since the object to be matched has not yet been set at this point, the process proceeds to step S3100. In step S3100, the object to be tracked is extracted from the distance image generated in step S2700. In this example, a motorcycle is detected as a new object, and the process proceeds to step S3200. In step S3200, an ID is assigned to the detected object, and the position information of the object at time t1 and the information of the illumination to be used for distance measurement at the next time t2 according to the position are recorded in the storage medium 140a. In this example, since the object 60 is within the distance measurement range 112a of the light beam at times t1 and t2, the light beam is selected as the illumination. Then, the process returns to step S2100 and the process at time t2 is performed.
[0117] On the other hand, at time t1, the distance measuring device 100b does not detect an object, and does not receive data from the adjacent distance measuring device 100a. Therefore, the distance measuring device 100b performs the processes in the order of steps S2100, S2200, S2300, S2700, S2800, S3100, and S3600. Specifically, since the distance measuring device 100b does not receive data from the adjacent distance measuring device 100a in step S2100, it proceeds to step S2200. Since tracking has not yet been set, it proceeds to step S2300, where wide-area scanning with a light beam is selected. In step S2700, the distance measuring device 100b scans the entire field of view with a light beam to measure distance and obtain a distance image. At time t1, information about the object for which tracking has been set has not yet been recorded in the storage medium 140b of the distance measuring device 100b. Therefore, in step S2800, no tracking object is detected, and the process proceeds to step S3100. In step S3100, matching with a template or model of the object is performed. At time t1, since there is no object within the field of view of the ranging device 100b, the process proceeds to step S3600 and returns to step S2100. Thus, at time t1, the ranging device 100b performs distance measurement for the entire field of view, since no data has been received from the adjacent ranging device 100a and no tracking object has yet been set. Since no object is detected, tracking is not set, and the process returns to step S2100. Then, processing at time t2 is performed.
[0118] At time t2 in FIG. 10C, the distance measuring device 100a does not receive data from the adjacent distance measuring device 100b in step S2100, so it proceeds to step S2200. At time t2, the information of the tracking object detected at the previous time t1 is recorded in the storage medium 140a, so it proceeds to step S2400. Since the light beam is stored as the type of illumination in the storage medium 140a, it proceeds to step S2500. In step S2500, the range to be irradiated with the light beam is determined. The position of the object at time t1 is stored in the storage medium 140a, but the position of the object before that is not stored. Therefore, the irradiation range of the light beam is set to a relatively narrow range that is an extension of the position at time t1. In step S2700, the distance measuring device 100a emits a light beam in the direction set in step S2500, scans the set range to measure the distance, and generates a distance image of a part of the field of view of the distance measuring device 100a. In the next step S2800, the tracking object is detected by matching from the distance image generated in step S2700, and the process proceeds to step S2900. In step S2900, the processor 130 estimates the moving direction and the moving amount of the object between frames from the position of the object in the frame at time t1 and the position of the object in the frame at time t2, and estimates the position of the object at the next time t3. In the next step S3000, the processor 130 judges whether the position of the object at time t3 estimated in step S2900 is within the field of view of the distance measuring device 100a. In the example of (1) in FIG. 10C, the estimated position of the object at time t3 is outside the field of view of the distance measuring device 100a and within the flash irradiation range of the adjacent distance measuring device 100b. Therefore, the process proceeds from step S3000 to S3300 and S3400. In step S3400, the flash light is set as the illumination. In step S3500, the distance measuring device 100a transmits data including information on the object and illumination to the distance measuring device 100b. Then, in step S3600, the tracking setting of the object stored in the storage medium 140a of the distance measuring device 100a is released, and the process returns to step S2100.
[0119] On the other hand, the operation of the distance measuring device 100b at time t2 is the same as the operation at time t1. At time t2, since no data is received from the adjacent distance measuring device 100a and there is no target object within the field of view of the distance measuring device 100b, the process returns to step S2100 via steps S2100, S2200, S2300, S2700, S2800, S3100, and S3600.
[0120] The operation of the distance measuring device 100a at time t3 is similar to the operation of the distance measuring device 100b at times t1 and t2, that is, the process goes through steps S2100, S2200, S2300, S2700, S2800, S3100, and S3600, and then returns to step S2100.
[0121] On the other hand, at time t3, the distance measuring device 100b receives the data transmitted by the distance measuring device 100a at time t2 in step S3500. Therefore, the result of the determination in step S2100 is yes, and the process proceeds to step S2400. Since the data received from the distance measuring device 100a includes information specifying a flash light, the process proceeds to step S2600, and the flash light is set as the illumination. In step S2700, the distance measuring device 100b performs distance measurement using a flash light and generates a distance image. In the following step S2800, the distance measuring device 100b performs a matching process with a template or model of the object indicated by the data received from the distance measuring device 100a for the distance image, and detects the object. In the following step S2900, the distance measuring device 100b estimates the position of the object at time t4 from the position information of the object received from the distance measuring device 100a at time t2 and the position information of the object detected by itself at time t3. The position of the object at time t4 estimated here is within the visual field of distance measuring device 100b. Therefore, the process proceeds to step S3200, where tracking information is set, and the process returns to step S2100.
[0122] The operation of the distance measuring device 100a at time t4 is the same as the operation at time t3, that is, the process goes through steps S2100, S2200, S2300, S2700, S2800, S3100, and S3600, and then returns to step S2100.
[0123] At time t4, the distance measuring device 100b has not received data from the adjacent distance measuring device 100a at the time t3, so the process proceeds from step S2100 to step S3000. At time t3, in step S3200, the tracking setting of the object is set, so the process proceeds to step S2400. In the example of (1) in FIG. 10C, the estimated position of the object at time t4 is within the distance measuring range 111b of the flash light, so the process proceeds to step S2600, the setting of the irradiation of the flash light is set, and the process proceeds to step S2700. At step S2700, the distance measuring device 100b performs distance measurement using the flash light and generates a distance image. At the following step S2800, the object is detected by matching from the distance image with reference to the template data stored in the storage medium 140b. At step S2900, the position of the object at time t5 (not shown) is estimated. The estimated position of the object at time t5 is outside the field of view of the distance measuring device 100b. Therefore, the process proceeds to step S3300. In the example of Fig. 10C, the object does not exist within the field of view of any of the distance measuring devices at time t5, so the process proceeds to step S3600. The processor 130 of the distance measuring device 100b cancels the tracking setting stored in the storage medium 140b, and returns to step S2100.
[0124] Next, the operation of each of the distance measuring devices 100a and 100b in the example of FIG. 10C(2) will be described.
[0125] The operation of the distance measuring device 100a at time t1 in the example of Fig. 10C(2) is the same as the operation of the distance measuring device 100a at time t1 in the example of Fig. 10C(1), that is, the process goes through steps S2100, S2200, S2300, S2700, S2800, S3100, and S3200, and returns to step S2100.
[0126] The operation of the distance measuring device 100a at time t2 is generally the same as the operation of the distance measuring device 100a at time t2 in the example of (1) in FIG. 10C. That is, the distance measuring device 100a executes the operations of steps S2100, S2200, S2400, S2500, S2500, S2700, S2800, S2900, S3000, S3300, S3400, S3500, and S3600. However, in this example, the estimated position of the object at time t3 is within the distance measuring range 112b by the scanning of the light beam of the adjacent distance measuring device 100b. Therefore, in step S3400, scanning by the light beam is selected. In step S3500, the distance measuring device 100a transmits transmission data including information specifying scanning by the light beam to the adjacent distance measuring device 100b. Thereafter, in step S3600, the tracking setting is released and the flow returns to step S2100.
[0127] The operations of the distance measuring device 100b at times t1 and t2 in the example of FIG. 10C(2) are the same as those of the distance measuring device 100b at times t1 and t2 in the example of FIG. 10C(1), and therefore will not be described.
[0128] The operations of the distance measuring device 100a at times t3 and t4 in the example of FIG. 10C(2) are the same as those of the distance measuring device 100a at times t3 and t4 in the example of FIG. 10C(1), and therefore will not be described.
[0129] The operation of the distance measuring device 100b at time t3 in the example of FIG. 10C (2) is generally the same as the operation of the distance measuring device 100b at time t3 in the example of FIG. 10C (1), but differs in that beam scanning is selected in step S2400. At time t3, the distance measuring device 100b has received data transmitted from the distance measuring device 100a in step S3500 at time t2, so the process proceeds from step S2100 to step S2400. In this example, the data received from the distance measuring device 100a includes information specifying scanning with a light beam, so the process proceeds to step S2500. In step S2500, the distance measuring device 100b sets a range including the estimated position of the object at time t3 received from the distance measuring device 100a as the scanning range. In the following step S2700, the distance measuring device 100b scans the surrounding area of the estimated position of the object at time t3 with a light beam to generate a distance image. In the next step S2800, the distance image generated in step S2700 is matched with a template or model of the object indicated by the data received from the distance measuring device 100a to detect the object. In the next step S2900, the distance measuring device 100b estimates the position of the object at time t4 based on the position information of the object at time t2 received from the adjacent distance measuring device 100a and the position information of the object detected by itself at time t3. Since the estimated position of the object at time t4 is within the field of view of the distance measuring device 100b, the process proceeds to step S3200, where tracking information is set and the process returns to step S2100.
[0130] The operation of the distance measuring device 100b at time t4 in the example of FIG. 10C (2) is generally the same as the operation of the distance measuring device 100b at time t4 in the example of FIG. 10C (1), but differs in that beam scanning is selected in step S2400. In step S2100, since no data is transmitted from the adjacent distance measuring device 100a at time t3, the process proceeds to step S2200. Since a tracking target is set in step S3200 at time t3, the process proceeds to step S2400. In the example of FIG. 10C (2), since the estimated position of the target at time t4 is within the field of view of the scan by the light beam, the process proceeds to step S2500. In step S2500, the distance measuring device 100b sets the periphery of the estimated position of the target at time t4 as the scan range of the light beam, and proceeds to step S2700. In step S2700, the distance measuring device 100b generates a distance image of the scan area by the light beam. In the next step S2800, the target object is detected by matching from the distance image with reference to the template data stored in storage medium 140b. In step S2900, the position of the target object at time t5 (not shown) is estimated. The estimated position of the target object at time t5 is outside the field of view of distance measuring device 100b. Therefore, the process proceeds to step S3300. In the example of FIG. 10C, the target object does not exist within the field of view of any of the distance measuring devices at time t5, so the process proceeds to step S3600. Processor 130 of distance measuring device 100b cancels the tracking setting stored in storage medium 140b and returns to step S2100.
[0131] Next, the operation in the example of FIG. 10D will be described.
[0132] Fig. 10D shows another example of a situation in which tracking information is exchanged between two adjacent distance measuring devices 100a and 100b. In the example of Fig. 10D, the first distance measuring device 100a is disposed in the front center of the moving body 50, and the second distance measuring device 100b is disposed on the front right side of the moving body 50. Fig. 10D shows an example of a situation in which a two-wheeled vehicle crosses in front of the moving body 50 from left to right, and a situation in which the two-wheeled vehicle turns left in front of the moving body 50.
[0133] The operation of the distance measuring device 100a at time t1 in the example of Fig. 10D is the same as the operation of the distance measuring device 100a at time t1 in each example of Fig. 10C. That is, at time t1, the object enters the distance measuring range of the distance measuring device 100a for the first time, and the distance measuring device 10 0 Since no data is received from b, the result of the determination in step S2100 is "no", and the process proceeds to step S2200. Since the tracking setting has not been done yet in step S2200, the process proceeds to step S2300. In step S2300, a control signal for performing distance measurement by wide-area scanning is generated, and the process proceeds to step S2700. In step S2700, the light emitting device 110 and the light receiving device 120 perform distance measurement of the entire visual field range according to the control signal. The processor 130 generates a distance image based on the detection signal output from the light receiving device 120. In the following step S2800, the processor 130 matches the object in the distance image with the object for which the tracking setting has been done. Since the object to be matched has not yet been set at this point, the process proceeds to step S3100. In step S3100, the object to be tracked is extracted from the distance image generated in step S2700. In this example, a motorcycle is detected as a new object, and the process proceeds to step S3200. In step S3200, an ID is assigned to the detected object, and the position information of the object at time t1 and the information of the illumination to be used for distance measurement at the next time t2 according to the position are recorded in the storage medium 140a. In the example of FIG. 10D, the object is within the distance measurement range 112a of the light beam at time t1, but it is estimated that the object will enter the distance measurement range 111a of the flash light if it moves in the traveling direction of the object from its position at time t1. Therefore, in step S3200, tracking setting is performed so that the illumination to be used in the next frame, i.e., at time t2, is the flash light. After that, the process returns to step S2100, and processing at time t2 is performed.
[0134] On the other hand, at time t1, the distance measuring device 100b does not detect an object, and does not receive data from the adjacent distance measuring device 100a. Therefore, similar to the operation at time t1 in the example of Fig. 10C, the distance measuring device 100b performs the processes in the order of steps S2100, S2200, S2300, S2700, S2800, S3100, and S3600.
[0135] At time t2, since the distance measuring device 100a does not receive data from the adjacent distance measuring device 100b in step S2100, the process proceeds to step S2200. At time t2, information on the tracking object detected at the previous time t1 is recorded in the storage medium 140a, so the process proceeds to step S2400. Since flash light is stored as the type of illumination in the storage medium 140a, the process proceeds to step S2600. In step S2600, flash light is set as the illumination. In step S2700, the distance measuring device 100a performs distance measurement using flash light and generates a distance image. In the following step S2800, the object set as the tracking object is detected from the distance image generated in step S2700 by matching with a template, and the process proceeds to step S2900. In step S2900, the processor 130 estimates the moving direction and the moving amount of the object between frames from the position of the object in the frame at time t1 and the position of the object in the frame at time t2, and estimates the position of the object at the next time t3. In the following step S3000, the processor 130 judges whether the position of the object at time t3 estimated in step S2900 is within the field of view of the distance measuring device 100a. In the example of FIG. 10D, the estimated position of the object at time t3 is outside the field of view of the distance measuring device 100a and is within the distance measuring range 112b of the light beam of the adjacent distance measuring device 100b. Therefore, the process proceeds from step S3000 to S3300 and S3400. In step S3400, the light beam is set as the illumination. In step S3500, the distance measuring device 100a transmits data including information on the object and illumination to the distance measuring device 100b. Thereafter, in step S3600, the target tracking setting stored in storage medium 140a of distance measuring device 100a is released, and the process returns to step S2100.
[0136] On the other hand, at time t2, the distance measuring device 100b does not receive data from the adjacent distance measuring device 100a in step S2100, so the process proceeds to step S2200. In step S2200, the tracking setting has not been set yet, so the process proceeds to step S2300. In step S2300, a control signal for performing distance measurement by wide-area scanning is generated, and the process proceeds to step S2700. In step S2700, the light emitting device 110 and the light receiving device 120 perform distance measurement of the entire field of view range according to the control signal. The processor 130 generates a distance image based on the detection signal output from the light receiving device 120. In the following step S2800, the processor 130 matches the object in the distance image with the object for which tracking setting has been set. At this point, the object to be matched has not yet been set, so the process proceeds to step S3100. In step S3100, a new object is detected from the distance image generated in step S2700 by matching with a predetermined object template or model. In the example of FIG. 10D, a motorcycle is detected as a new object, and the process proceeds to step S3200. In step S3200, an ID is assigned to the detected object, and the position information of the object at time t2 and the information of the illumination used for distance measurement at the next time t3 according to the position are recorded in the storage medium 140a. In the example of FIG. 10D, considering the traveling direction of the object from the position at time t1 to the position at time t2, it is estimated that the object will be within the distance measurement range 112b of the light beam at time t3. Therefore, in step S3200, tracking setting is performed so that the illumination used in the next frame, i.e., at time t3, is the light beam. After that, the process returns to step S2100, and processing at time t3 is performed.
[0137] The operation of the distance measuring device 100a at time t3 is the same as the operation at times t3 and t4 in each example of FIG. 10C. In step S2100, since no data is received from the adjacent distance measuring device 100b, the process proceeds to step S2200. Since the tracking setting is released at time t2, the process proceeds to step S2300. After that, the process proceeds from step S2700 to step S2800. Since there is no tracking object to be matched in step S2800, the process proceeds to step S3100. In the example of FIG. 10D, since there is no new object within the field of view of the distance measuring device 100a at time t3, the process proceeds to step S3600 and returns to step S2100.
[0138] On the other hand, at time t3, the distance measuring device 100b receives the data transmitted by the distance measuring device 100a at time t2 in step S3500. Therefore, the answer is determined as yes in step S2100, and the process proceeds to step S2400. Since the data received from the distance measuring device 100a includes information specifying scanning with a light beam, the process proceeds to step S2500, and the scanning range is set. In this example, apart from the data received from the adjacent distance measuring device 100a, the tracking data generated by the distance measuring device 100b in step S3200 at the previous time t2 also includes information on the illumination used at time t3. In such a case, the illumination information included in the data received from the adjacent distance measuring device 100a is given priority, and the illumination information generated by the distance measuring device 100b itself is discarded. In the following step S2700, the distance measuring device 100b performs distance measurement by beam scanning around the estimated position of the target object, and generates a distance image of the scan area. In the next step S2800, the distance measuring device 100b performs matching of the distance image with a template of the object indicated by the data received from the distance measuring device 100a, and detects the object. In the next step S2900, the distance measuring device 100b estimates the position of the object at time t4 (not shown) from the position of the object at time t2 in the tracking data and the position of the object at time t3 identified from the distance image. In step S3000, it is determined whether the position of the object estimated in step S2900 is within the field of view of the distance measuring device 100b. In the example of FIG. 10D, if the position is estimated linearly from the position at time t2 and the position at time t3, it is estimated that the position of the object at time t4 is outside the field of view of the distance measuring device 100b. Therefore, the process proceeds to step S3300. In the example of FIG. 10D, the position of the object at time t4 is not within the field of view of any of the adjacent distance measuring devices, so the process proceeds to step S3600. In step S3600, the tracking setting is released, and the process returns to step S2100.
[0139] In the example of FIG. 10D, two adjacent distance measuring devices 100a and 100b are close to each other, and most of the field of view of the flash light overlaps. At time t2, according to FIG. 9, both distance measuring device 100a and distance measuring device 100b measure the distance to the same object. In contrast, at time t3, according to FIG. 9, distance measuring device 100b measures the distance to the object according to the tracking information transmitted from distance measuring device 100a. Distance measuring device 100b detects the object from a distance image of a relatively narrow area obtained by a beam scan with a narrowed range. This operation improves the efficiency of processing.
[0140] When processing according to Fig. 9, the distance measuring device 100a and the distance measuring device 100b perform distance measuring operations at time t2 independently. For greater efficiency, when the overlap of the field of view is large as in the example of Fig. 10D, the tracking information of an object present within the field of view of the common flash light of the distance measuring device 100a and the distance measuring device 100b may be shared. An example of such an operation will be described below with reference to Fig. 11.
[0141] Fig. 11 is a flowchart showing the operation of each distance measuring device 100 when sharing tracking information of an object present within the field of view of a common flashlight. The operations from step S2100 to S2900 or S3100 in Fig. 11 are the same as the operations of the corresponding steps shown in Fig. 9. In the example of Fig. 11, after steps S2900 and S3100, the operation of step S2950 is executed.
[0142] First, the operation of the distance measuring device 100a at time t1 in the example of FIG. 10D will be described. The distance measuring device 100a executes the operations of steps S2100, S2200, S2300, S2700, S2800, and S3100, as in the example of FIG. 9. In step S3100, an object is detected, and the process proceeds to step S2950. In step S2950, the processor 130 determines whether the estimated position of the object at time t2 is within the range where the distance measuring range 111a of the flash light of the self distance measuring device 100a and the distance measuring range 111b of the flash light of the adjacent distance measuring device 100b overlap. At time t1, the distance measuring device 100a detects the object for the first time, so the position of the object at time t2 is set to a range that is an extension of the position at time t1. In the example of FIG. 10D, the range that is an extension of the position at time t1 is within the field of view of the flash of the distance measuring device 100a. Therefore, the result of the determination in step S2950 is yes, and the process proceeds to step S3400. In step S3400, the distance measuring device 100a sets the type of illumination to be used at time t2 to flash light. In the following step S3500, the distance measuring device 100a transmits tracking data including information on the object and illumination to the adjacent distance measuring device 100b. Furthermore, in step S3200, the distance measuring device 100a sets tracking information for its own tracking and stores it in the storage medium 140a. Through the operations of steps S3500 and S3200, the distance measuring device 100a and the distance measuring device 100b share the tracking information. After step S3200, the process returns to step S2100.
[0143] On the other hand, the operation of the distance measuring device 100b at time t1 is the same as the operation in Fig. 9. That is, the processes of steps S2100, S2200, S2300, S2700, S2800, S3100, and S3600 are performed in this order, and the process returns to step S2100.
[0144] The operation of the distance measuring device 100a at time t2 is the same as the example of FIG. 9. That is, the process is performed in the order of steps S2100, S2200, S2400, S2600, S2700, S2800, and S2900. In step S2900, the distance measuring device 100a estimates the position of the object at time t3. The distance measuring device 100a estimates the position of the object at time t3 based on the positions at times t1 and t2. Since the estimated position of the object at time t3 is outside the field of view of the flash light of the distance measuring device 100a, the result of step S2950 is no, and the process proceeds to step S3000. In step S3000, the estimated position of the object at time t3 is outside the entire field of view including the scan range of the distance measuring device 100a, so the process proceeds to step S3600. In step S3600, the distance measuring device 100a cancels the tracking setting. That is, the tracking information regarding the object recorded in storage medium 140a is deleted. After that, the process returns to step S2100.
[0145] On the other hand, at time t2, the ranging device 100b receives the shared tracking information from the adjacent ranging device 100a, so the result of the determination in step S2100 is yes, and the process proceeds to step S2400. The shared tracking information transmitted from the ranging device 100a indicates that the target is within the field of view of the flash light, so the process proceeds to step S2600. In step S2600, the flash light is set as the illumination. In step S2700, the ranging device 100b performs distance measurement by irradiating the flash light, and generates a distance image. In step S2800, the ranging device 100b matches the distance image with a template of the target indicated in the shared tracking information transmitted from the ranging device 100a, and detects the tracking target. In step S2900, the ranging device 100b estimates the position at time t3 from the position information at time t1 and the position information at time t2 included in the shared tracking information. In step S2950, it is determined that the position of the object at time t3 estimated in step S2900 is outside the field of view of the flash of the distance measuring device 100b, and the process proceeds to step S3000. In step S3000, it is determined that the position of the object at time t3 estimated in step S2900 is within the field of view of the scan of the distance measuring device 100b, and the process proceeds to step S3200. In step S3200, the distance measuring device 100b records information on the position of the object at time t3 and the lighting used in the storage medium 140 to update the tracking information. Then, the process returns to step S2100.
[0146] In this example, the estimated position of the object at time t3 is outside the field of view of the flashes of both the distance measuring devices 100a and 100b, so neither the distance measuring device 100a nor the distance measuring device 100b transmits data for sharing tracking information.
[0147] At time t3, the ranging device 100a performs the same operation as in the example of Fig. 9. In this case, no shared information is received from the adjacent ranging device 100b, and the tracking setting is released at time t2. Therefore, steps S2100, S2200, S2300, S2700, S2800, and S3100 are processed in this order. In step S3100, no new object is detected, so the process proceeds to step S3600 and returns to step S2100.
[0148] On the other hand, at time t3, since no shared information was transmitted from the adjacent ranging device 100a at the previous time t2 to the ranging device 100b, the process proceeds from step S2100 to step S2200. Tracking information indicating that the estimated position of the object at time t3 is within the scanning range is recorded in the storage medium 140 of the ranging device 100b. Therefore, the process proceeds to step S2400, where beam scanning is selected. In the following step S2500, the scanning range is set. In step S2700, ranging is performed by beam scanning, and a distance image of the scanning range is generated. In step S2800, the tracking object is detected in the distance image of the scanning range acquired in step S2700, and the process proceeds to step S2900. In step S2900, the position of the object at the next time t4 (not shown) is estimated from the position of the object at time t2 and the position of the object at time t3. The estimated position of the object at time t4 is outside the field of view of the flashes of both the distance measuring device 100b and the distance measuring device 100a. Therefore, the answer is determined as "no" in step S2950, and the process proceeds to step S3000. In step S3000, the estimated position of the object at time t4 is determined to be outside the entire field of view including the scan range of the distance measuring device 100b, and the process proceeds to step S3600. In step S3600, the tracking setting is released, and the process returns to step S2100.
[0149] Next, as another example, the operation when the distance measuring device 100a detects an object at a position indicated by t2' in FIG. 10D at time t2 will be described. In this case, in step S2900, the distance measuring device 100a estimates the position indicated by t3' in FIG. 10D as the position of the object at time t3 from the position and orientation of the object at times t1 and t2. Since this position is outside the field of view of the flash of the distance measuring devices 100a and 100b, the process proceeds to step S3000. In step S3000, the position of t3' is determined to be within the beam scan range of the distance measuring device 100a, and the process proceeds to step S3200. In this case, the operations of steps S3400 and S3500 are not performed, and therefore the tracking information is not transmitted to the adjacent distance measuring device 100b. In step S3200, the tracking information of the distance measuring device 100a is updated, and the process returns to step S2100. Thereafter, the distance measuring device 100a continues tracking the object.
[0150] On the other hand, at time t2, when the object is at position t2' shown in Fig. 10D, the operation of distance measuring device 100b is the same as the operation of distance measuring device 100b at time t1. That is, the processes are performed in the order of steps S2100, S2200, S2300, S2700, S2800, S3100, and S3600, and then the process returns to step S2100.
[0151] If an object is present at time t3 at position t3' in FIG. 10D, the distance measuring device 100a determines in step S2100 that there is no reception from the adjacent distance measuring device 100b, and proceeds to step S2200. In step S2200, since information on the tracking object is stored in the storage medium 140a, the process proceeds to step S2400. In step S2400, it is determined that a beam scan is to be performed, and the process proceeds to step S2500. In step S2500, the distance measuring device 100b determines the direction of the light beam scan. In step S2700, the distance measuring device 100b acquires a distance image of an area corresponding to the scan range. In step S2800, the tracking object is detected in the distance image acquired in step S2700, and the process proceeds to step S2900. Step S2 In step S2900, the distance measuring device 100b estimates the position of the object at time t4 (not shown) from the position and orientation of the object at time t2 and the position and orientation of the object at time t3. In the following step S2950, the distance measuring device 100a judges whether the estimated position of the object at time t4 estimated in step S2900 is within the common field of view of the flashes of the distance measuring devices 100a and 100b. In this example, since the estimated position of the object at time t4 is outside the common field of view of the flashes of the distance measuring devices 100a and 100b, the process proceeds to step S3000. Also, since the estimated position of the object at time t4 is outside the entire field of view including the field of view of the scan of the distance measuring device 100a, the process proceeds to step S3600. In step S3600, the distance measuring device 100a cancels the setting of the tracking target and returns to step S2100.
[0152] On the other hand, at time t3, when the object is at position t3' shown in Fig. 10D, the operation of distance measuring device 100b is the same as that of distance measuring device 100b at times t1 and t2. That is, the processes are performed in the order of steps S2100, S2200, S2300, S2700, S2800, S3100, and S3600, and then the process returns to step S2100.
[0153] As described above, in the example shown in FIG. 11, the distance measuring devices 10 0 a and 10 0 b share information about objects that exist in the overlapping areas of their fields of view. 0 a and 10 0 b can look back and retain past position information of an object it detects for the first time. Therefore, it can estimate the object's position with higher accuracy, and more efficient distance measurement is possible by narrowing the light irradiation range. Since it can appropriately select the type and direction of illumination according to the estimated object's position, it is possible to efficiently track objects across multiple distance measuring devices.
[0154] As described above, according to this embodiment, information required for tracking an object is transmitted and received between multiple distance measuring devices 100 whose distance measuring ranges are adjacent or partially overlapping. Therefore, the object can be tracked efficiently without resetting tracking information for the same object for each distance measuring device 100. In particular, when scanning a wide range with a light beam as in the conventional method, it takes time to detect the object. In contrast, in this embodiment, by transmitting and receiving tracking information between multiple distance measuring devices 100, the scanning range with the light beam can be narrowed according to the measured position or estimated position of the object. As a result, even an object that enters the field of view of the distance measuring device 100 for the first time can be quickly detected.
[0155] (Embodiment 2) Next, a second embodiment of the present disclosure will be described.
[0156] In the first embodiment, data on the object and illumination is transmitted and received between the multiple ranging devices 100 included in the ranging system 10. Each ranging device 100 transmits data indicating the ranging result to the processing device 300. In contrast, in the second embodiment, each ranging device 100 transmits data on the object and illumination to the processing device 300 in addition to the data indicating the ranging result. The processing device 300 integrates the transmitted ranging data into data expressed in a common coordinate system based on the information on the position and orientation of each ranging device 100. The processing device 300 further estimates the position of the object measured by each ranging device 100 at the next ranging time, and transmits data on illumination to other ranging devices 100 that can measure the distance to the object. This makes it possible to efficiently track an object moving across the ranging ranges of multiple ranging devices 100.
[0157] 12 is a block diagram showing the configuration of the distance measuring system 20 in the second embodiment. In this embodiment, each distance measuring device 100 does not directly communicate with other distance measuring devices 100, but transmits and receives data via the processing device 300. Each distance measuring device 100 is connected to the processing device 300 wirelessly or by wire, and can transmit and receive data between the processing device 300. In this embodiment, the storage device 200 stores data indicating the distance measuring ranges of the flash light and the light beam of each distance measuring device 100 in addition to the data shown in FIG. 7. The data indicating the distance measuring ranges is expressed in a common coordinate system set in the distance measuring system 20.
[0158] Fig. 13 is a flowchart showing the operation of the processing device 300 in the second embodiment. The same operations as those of the processing device 300 in the first embodiment (see Fig. 8) are denoted with the same reference numerals, and the description thereof will be omitted. The operations from step S1100 to step S1600 and step S1700 are the same as those shown in Fig. 8. In this embodiment, the operations from step S4100 to S4400 are added between step S1600 and step S1700. The operations from step S4100 to S4400 will be described below.
[0159] (Step S4100) The processing device 300 estimates the position of the object at the time of the next distance measurement based on the position data of the object recorded in step S1500 and the position data of the same object recorded at the time of the immediately preceding distance measurement. The position estimation can be performed, for example, by determining a movement vector of the object. The processing device 300 determines the movement vector from the difference in the object's position at the time of two consecutive distance measurements. By doubling the magnitude of the determined movement vector, the position of the object at the time of the next distance measurement can be estimated.
[0160] (Step S4200) The processing device 300 refers to the data on the distance measurement range of each distance measurement device 100 recorded in the storage device 200, and selects one or more distance measurement devices 100 capable of measuring the distance to the object located at the position estimated in step S4100.
[0161] (Step S4300) The processing device 300 converts the coordinate values of the estimated position of the object into coordinate values in the coordinate system of the distance measuring device 100 selected in step S4200, by referring to the coordinates and orientation of the distance measuring device 100 recorded in the storage device 200. Then, by referring to the data in the storage device 200, it determines the type and irradiation direction of the illumination of the distance measuring device 100 suitable for measuring the distance to the object.
[0162] (Step S4400) The processing device 300 transmits tracking data including information on the type of illumination and the irradiation direction determined in step S4300 and information such as a template showing the shape of the target object to the distance measuring device 100 selected in step S4200. The tracking data may be transmitted in a format similar to that of the data shown in Fig. 6C, for example.
[0163] By the above operation, an object moving across the visual field ranges of a plurality of distance measuring devices 100 can be efficiently tracked as a single object without being initialized every time the distance measuring device 100 that measures the distance is switched.
[0164] Instead of performing the operations of steps S4100 to S4400, the processing device 300 may be configured to simply relay the tracking data transmitted from each ranging device 100 to other ranging devices 100. In that case, either the source ranging device 100 or the destination ranging device 100 performs the necessary coordinate conversion and determines the type of lighting and the irradiation direction suitable for measuring the distance to the target object.
[0165] In the above embodiment, each distance measuring device 100 can switch between emitting a light beam and a flash light, but may not have a function of emitting a flash light. In that case, the operation of determining the type of illumination is omitted, and the recorded and transmitted data does not include information indicating the type of illumination. Also, each distance measuring device 100 may have a function of changing the spread angle of the light beam. In such a configuration, the spread angle of the light beam can be adaptively changed according to the size or distance of the object. [Industrial Applicability]
[0166] The technology disclosed herein can be widely used in systems including multiple distance measuring devices, and is useful, for example, in a distance measuring system mounted on a moving object that performs automatic driving. [Explanation of symbols]
[0167] 10, 20 Distance measurement system 50 Mobile 60 Objects 100 Rangefinder 110 Light emitting device 120 Photodetector 130 processors 140 Storage medium 150 Control circuit 160 Communication Circuit 162 Receiving signal circuit 164 sending signal circuit 200 Storage device 300 Processing Equipment
Claims
1. A ranging device in a system including two or more ranging devices having adjacent or partially overlapping ranging ranges, A light emitting device capable of changing a light irradiation range; a light receiving device that detects reflected light generated when the light emitted from the light emitting device is reflected by an object and outputs a detection signal; a processing circuit having a function of communicating with other distance measuring devices in the system, the processing circuit calculating a distance to the object based on the detection signal and determining a position of the object; Equipped with The processing circuitry includes: generating first setting data that defines an irradiation range of light to be emitted by the other distance measuring device based on the determined position of the object, and transmitting the first setting data to the other distance measuring device; when receiving second setting data defining an irradiation range of light to be emitted by the light emitting device from the other distance measuring device, controlling light emission by the light emitting device in accordance with the second setting data; Ranging device.
2. The light emitting device is capable of changing the spread angle of the emitted light, The second setting data defines a spread angle of light to be emitted by the light-emitting device.
2. A distance measuring device according to claim 1.
3. 3. The distance measuring device according to claim 1, wherein the first setting data defines a spread angle of light to be emitted by the other distance measuring device.
4. 4. The distance measuring device according to claim 1, wherein the first setting data includes information indicating a position of the object whose distance is calculated by the processing circuit.
5. the second setting data includes information indicating a position of an object to be distance-measured, the processing circuit controls light emission of the light emitting device so that light is irradiated onto the object to be measured.
5. A distance measuring device according to claim 1.
6. the light emitting device is capable of switching between emitting a light beam and emitting diffused light and changing the direction of the light beam; the second setting data includes information indicating whether the light to be emitted by the light-emitting device is the light beam or the diffused light, and information defining a direction of the light beam when the light to be emitted by the light-emitting device is the light beam; the processing circuit causes the light emitting device to emit the diffuse light or emit the light beam in the defined direction according to the second configuration data; 6. A distance measuring device according to claim 1.
7. A ranging device as described in any one of claims 1 to 6, wherein the first setting data includes information indicating whether the light to be emitted by the other ranging device is a light beam or diffused light, and information specifying the direction of the light beam when the light to be emitted by the other ranging device is the light beam.
8. A ranging device as described in any one of claims 1 to 7, wherein when the processing circuit determines that the object falls within the ranging range of the other ranging device based on data defining the ranging range of the other ranging device and changes in the determined position of the object over time, it generates the first setting data and transmits it to the other ranging device.
9. the distance measurement range of the other distance measurement device includes a first range measured by a light beam and a second range measured by a diffused light, The processing circuitry includes: determining whether the object falls within the first range or the second range based on data defining the first range and the second range and the determined change in the position of the object over time; when it is determined that the object falls within the first range, generating the first setting data including information indicating that the light to be emitted by the other distance measuring device is a light beam and information defining a direction of the light beam, and transmitting the first setting data to the other distance measuring device; when it is determined that the object falls within the second range, generating the first setting data including information indicating that the light to be emitted by the other distance measuring device is diffuse light, and transmitting the first setting data to the other distance measuring device; 9. A distance measuring device according to claim 1.
10. the processing circuit periodically executes an operation of causing the light-emitting device to emit light and causing the light-receiving device to output the detection signal; generating the first setting data and transmitting it to the other distance measuring device when it is predicted that the position of the object determined based on the detection signal will be within the distance measuring range of the other distance measuring device in the next period; 10. A distance measuring device according to claim 1.
11. The processing circuitry includes: transmitting the first setting data to the other distance measuring device via a processing device included in the system; receiving the second setting data from the other distance measuring device via the processing device; A distance measuring device according to any one of claims 1 to 10.
12. A system including two or more ranging devices with adjacent or overlapping ranging ranges, Each of the two or more distance measuring devices A light emitting device capable of changing a light irradiation range; a light receiving device that detects reflected light generated when the light emitted from the light emitting device is reflected by an object and outputs a detection signal; a processing circuit having a function of communicating with other distance measuring devices in the system, the processing circuit calculating a distance to the object based on the detection signal and determining a position of the object; Equipped with The processing circuitry includes: generating first setting data that defines an irradiation range of light to be emitted by the other distance measuring device based on the determined position of the object, and transmitting the first setting data to the other distance measuring device; when receiving second setting data defining an irradiation range of light to be emitted by the light emitting device from the other distance measuring device, controlling light emission by the light emitting device in accordance with the second setting data; system.
13. 1. A computer-implemented method of measuring distances in a system including two or more ranging devices with adjacent or overlapping ranging ranges, comprising: Emitting light from a light emitting device capable of changing an irradiation range of the light; causing a light receiving device to detect reflected light generated when the light emitted from the light emitting device is reflected by an object and outputting a detection signal; calculating a distance to the object based on the detection signal and determining a position of the object; generating first setting data that defines an irradiation range of light to be emitted by another distance measuring device in the system based on the determined position of the object, and transmitting the first setting data to the other distance measuring device; when receiving second setting data defining an irradiation range of light to be emitted by the light emitting device from the other distance measuring device, controlling light emission of the light emitting device in accordance with the second setting data; The method includes:
14. A computer program executed by a computer of a distance measuring device in a system including two or more distance measuring devices whose distance measuring ranges are adjacent or partially overlapping, comprising: The computer includes: Emitting light from a light emitting device capable of changing an irradiation range of the light; causing a light receiving device to detect reflected light generated when the light emitted from the light emitting device is reflected by an object and outputting a detection signal; calculating a distance to the object based on the detection signal and determining a position of the object; generating first setting data that defines an irradiation range of light to be emitted by another distance measuring device in the system based on the determined position of the object, and transmitting the first setting data to the other distance measuring device; when receiving second setting data defining an irradiation range of light to be emitted by the light emitting device from the other distance measuring device, controlling light emission of the light emitting device in accordance with the second setting data; A computer program that executes the following:
Citation Information
Patent Citations
Transverse object detection device and transverse object detecting method, and program
JP2009217680A
Drive assist system
JP2015225615A
Vehicle with multiple light detection and ranging devices (lidars)
JP2018049014A
Imaging system
JP2018124271A
LIDAR systems and methods
JP2019535014A
