Output control device, distance measuring device equipped with the same, output control method, and output control program

Abstract

To provide an output control device, a distance measuring device including the same, an output control method, and an output control program, which can reduce a data amount of information including distance information to be output.SOLUTION: A control section 10 is an output control device for controlling output of information included in a distance image including information on distance to an object 30, and comprises a distance calculation section 11 and an output information selection section 19. The distance calculation section 11 acquires the information on the distance to the object 30 according to the amount of reflection of light L1 emitted from a lighting device 21 to the object 30. The output information selection section 19 selects, as an output target, the distance information corresponding to pixels of the distance image including the detected object 30 on the basis of the distance information acquired by the distance calculation section 11.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an output control device for controlling the output of information contained in a distance image including distance information to an object, and a distance measuring device, an output control method, and an output control program including the output control device. [Background technology]

[0002] In recent years, distance measuring devices have been used that generate distance images containing distance information to the object to be measured for each pixel using, for example, a TOF (Time-of-Flight) sensor that receives reflected light from light irradiated toward the object to be measured from an LED (Light Emitting Diode) as a light source and measures the distance to the object to be measured. For example, Patent Document 1 discloses a coordinate calibration method for a human measurement system in which the coordinate system of a distance image obtained by a depth camera is configured into a laboratory coordinate system based on data of an indoor planar area included in the distance image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-122690 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the above-mentioned conventional human body measurement system has the following problems. In other words, although the above publication discloses a method for calibrating the coordinate system of a distance image obtained by a depth camera to a laboratory coordinate system, there is a risk that the amount of data output will become enormous, since information including distance information corresponding to all pixels of the distance image is output.

[0005] For this reason, the large amount of data output may result in, for example, an increase in communication time between the system and the host receiving the output. Also, when post-processing is performed on the data received by the host, such as detecting a specific object, the large amount of data to be processed may result in an increase in the post-processing load on the host. An object of the present invention is to provide an output control device capable of reducing the amount of data, including distance information, that is output, and a distance measuring device, an output control method, and an output control program including the output control device. [Means for solving the problem]

[0006] An output control device according to a first aspect of the present invention is an output control device that controls output of information included in a distance image including distance information to an object, the output control device comprising: a distance information acquisition unit; an output information selection unit; An angle information acquisition unit, a three-dimensional coordinate conversion unit, a plane detection unit, a height calculation unit, a coordinate rotation calculation unit, an object detection unit, and a threshold setting unit, The distance information acquisition unit acquires distance information to the object according to a reflection amount of an electromagnetic wave irradiated from the lighting device to the object. The output information selection unit selects, as an output target, distance information corresponding to a pixel of a distance image including the object detected based on the distance information acquired by the distance information acquisition unit. The angle information acquisition unit acquires angle information corresponding to each pixel included in the distance image. The three-dimensional coordinate conversion unit converts the distance information acquired by the distance information acquisition unit into three-dimensional coordinates based on the angle information acquired by the angle information acquisition unit. The plane detection unit detects the floor surface on which the target object is placed. The height calculation unit calculates the installation height of the distance measuring device based on the distance information on the floor surface detected by the plane detection unit and the three-dimensional coordinates converted by the three-dimensional coordinate conversion unit. In addition, the height calculation unit calculates the average value of the vertical coordinate values ​​among the coordinate values ​​acquired again by rotating the Cartesian coordinate system of the distance measuring device around an axis by an angle formed between the perpendicular line of the floor surface detected by the plane detection unit and the optical axis of the distance measuring device as the installation height. The coordinate rotation calculation unit calculates rotated coordinates by rotating the three-dimensional coordinates converted from the distance information and angle information in the three-dimensional coordinate conversion unit around an axis. The object detection unit compares the height coordinate of the rotated coordinates calculated by the coordinate rotation calculation unit with the installation height calculated by the height calculation unit, and detects an object having a dimension in the height direction as an object. The threshold setting unit sets first, second, and third thresholds as predetermined thresholds used when the object detection unit detects the object. The object detection unit then determines that an object is present on the floor if the dimension in the height direction from the floor is greater than the first threshold, determines that a hole is present on the floor if the dimension in the height direction from the floor is smaller than the second threshold, and determines that a slope is present on the floor if the amount of change in the dimension in the height direction from the floor of adjacent pixels is greater than the third threshold.

[0007] Here, for example, distance information corresponding to pixels of a distance image including an object detected using distance information to the object obtained from a TOF (Time-of-Flight) sensor that receives reflected light of light irradiated toward the object from an LED (Light Emitting Diode) as a light source and measures the distance to the object is selected as the output target. Here, the output control device may be provided, for example, within a distance measuring device such as a TOF sensor, or may be provided outside the distance measuring device.

[0008] The electromagnetic waves irradiated from the lighting device include, for example, light in the broad sense (ultraviolet light, visible light, infrared light), gamma (γ) rays and X-rays which have shorter wavelengths than light, microwaves and broadcasting radio waves (short wave, medium wave, long wave) which have longer wavelengths than light, ultrasound, elastic waves, quantum waves, etc. The distance information acquisition unit may be configured to detect reflection of electromagnetic waves and calculate distance information, or may be configured to acquire distance information from, for example, a distance sensor provided as an external device.

[0009] This makes it possible to selectively output distance information corresponding to pixels that contain an object placed on the floor surface, for example, and control the output so that no output is generated from pixels that contain only the floor surface and no object. As a result, the amount of data, including distance information, output from the distance measuring device can be significantly reduced. Furthermore, for example, in a configuration in which the distance measuring device includes, as a light receiving unit, a light receiving lens and an image sensor that detects the reflection of the electromagnetic waves received through the light receiving lens, the angle of reflection of the electromagnetic waves incident through the light receiving lens is determined for each pixel of the image sensor that generates the distance image, so that angle information corresponding to each pixel can be obtained. Furthermore, the distance information can be converted into three-dimensional coordinates (X, Y, Z) using the angle information corresponding to each pixel. In addition, by detecting the floor surface as a preliminary step to actually measuring the distance to the target object, the distance (height) of the ranging device from the floor surface can be used as a reference value when detecting the presence or absence of the target object. Furthermore, when calculating the installation height of the distance measuring device from the floor surface position and detecting the presence or absence of an object, the distance (height) of the distance measuring device from the floor surface can be used as a reference value. In addition, for the distance to the floor surface measured by the distance measuring device, the Cartesian coordinate system of the distance measuring device is rotated around an axis by the angle formed by the perpendicular line to the floor surface and the optical axis of the distance measuring device, so that the coordinate value in the optical axis direction of the reacquired coordinate value can be calculated as the installation height of the distance measuring device. That is, for example, by rotating around an axis by the angle formed by the perpendicular line to the floor surface and the optical axis of the distance measuring device so that the Z axis corresponding to the optical axis of the distance measuring device faces vertically, the installation height can be calculated so that the same distance information is obtained as when the distance measuring device irradiates light directly downward and receives the reflected light. Note that, by calculating the average value of the coordinate values ​​(distances) from the plane recognized as the floor surface and calculating this average value as the installation height, for example, the installation height of the distance measuring device from the floor surface can be accurately calculated even if the floor surface has minute irregularities. In addition, when actually measuring the distance information to the object, the three-dimensional coordinates converted from the distance information and angle information in the three-dimensional coordinate conversion unit are rotated around an axis to calculate rotated coordinates, thereby detecting the distance to the object. In other words, by using the calculated rotated coordinates, it is possible to measure the distance in the height direction, which is essentially measured when the object is viewed from directly above. In addition, by detecting an object having a height from a surface recognized as the floor as the target object, it is possible to easily identify the pixel containing the distance information to be output, and by comparing the installation height from the floor surface with the target object's height (coordinate in the height direction), it is possible to easily detect whether or not the object is the target object depending on whether or not the target object has a dimension in the height direction. In addition, when detecting an object, when comparing the installation height from the floor surface with the height of the object (coordinate in the height direction), if the difference in height is greater or smaller than a predetermined threshold, the object is detected as an object, thereby preventing erroneous detection of the object. Furthermore, by performing the judgment process using different threshold values ​​S1, S2, and S3, the condition of the floor surface FL can be detected. For example, even if the distance measuring device 20 is mounted on a conveying device capable of running on the floor surface FL, the presence or absence of unevenness such as holes 130a on the floor surface FL, the presence or absence of obstacles, etc. can be accurately determined, and the conveying operation can be carried out smoothly.

[0021] No. 2 The output control device according to the present invention is 1 In the output control device according to the present invention, the output information selection section selects and outputs distance information for each pixel including an object detected by the object detection section. This makes it possible to selectively output distance information corresponding to only those pixels that include the target object out of all the pixels of the image sensor, thereby significantly reducing the amount of data to be output and easing the output load.

[0022] No. 3 The distance measuring device according to the present invention is 1 or No. 2 The issue Clearly The output control device and an illuminator for irradiating an object with electromagnetic waves Akira and a light receiving section that detects the amount of reflected electromagnetic waves emitted from the lighting device. As a result, by providing the above-mentioned output control device inside a distance measuring device equipped with an illumination device and a light receiving unit, it is possible to obtain a distance measuring device that can output distance information corresponding only to pixels that include the target object, rather than all pixels of the imaging element of the light receiving unit, thereby significantly reducing the amount of data output.

[0023] No. 4 The distance measuring device according to the present invention is 3 The distance measuring device of the present invention further includes a memory unit for storing at least one of distance information, angle information corresponding to each pixel included in the distance image, a Cartesian coordinate system of the distance measuring device, an installation height, rotated coordinates obtained by rotating three-dimensional coordinates converted from the distance information and angle information around an axis, a threshold value used when detecting an object, and coordinate values ​​of the pixel to be output. This allows distance information, angle information, Cartesian coordinate system, installation height, rotation coordinates, thresholds, coordinate values ​​of pixels to be output, etc. to be stored within the ranging device, and processing can be performed using the various stored data to significantly reduce the amount of data output.

[0024] No. 5 The distance measuring device according to the present invention is 3 Or 4 The distance measuring device according to the present invention further comprises an output section which outputs distance information corresponding to the pixel selected by the output information selection section to an external device. This allows only the distance information corresponding to the selected pixels that are determined to contain the target object to be output from the output unit to an external device, significantly reducing the amount of data including distance information output from the ranging device.

[0025] No. 6 The output control method according to the present invention is an output control method for controlling output of information included in a distance image including distance information to an object, the output control method comprising: a distance information acquisition step; and an output information selection step. An angle information acquisition step, a three-dimensional coordinate conversion step, a plane detection step, a height calculation step, a coordinate rotation calculation step, an object detection step, and a threshold setting step.The distance information acquiring step acquires distance information to the object according to a reflection amount of an electromagnetic wave irradiated from the lighting device to the object. The output information selecting step selects, as an output target, distance information corresponding to a pixel of a distance image including the object detected based on the distance information acquired in the distance information acquiring step. The angle information acquisition step acquires angle information corresponding to each pixel included in the distance image. The three-dimensional coordinate conversion step converts the distance information acquired in the distance information acquisition step into three-dimensional coordinates based on the angle information acquired in the angle information acquisition step. The plane detection step detects a floor surface on which an object is placed. The height calculation step calculates an installation height of the distance measuring device based on the distance information on the floor surface detected in the plane detection step, and the three-dimensional coordinates converted in the three-dimensional coordinate conversion step. The height calculation step also calculates, as the installation height, an average value of vertical coordinate values ​​among the coordinate values ​​acquired again by rotating the Cartesian coordinate system of the distance measuring device around an axis by an angle formed between the perpendicular line of the floor surface detected in the plane detection step and the optical axis of the distance measuring device. The coordinate rotation calculation step calculates rotated coordinates by rotating the three-dimensional coordinates converted from the distance information and angle information in the three-dimensional coordinate conversion step around an axis. The object detection step compares the height coordinate of the rotated coordinates calculated in the coordinate rotation calculation step with the installation height calculated in the height calculation step, and detects the object as an object when an object having a dimension in the height direction is detected. The threshold setting step sets first, second, and third thresholds as predetermined thresholds used when detecting the object in the object detection step. The object detection step then determines that an object is present on the floor if the dimension in the height direction from the floor is greater than the first threshold, determines that a hole is present on the floor if the dimension in the height direction from the floor is smaller than the second threshold, and determines that a slope is present on the floor if the amount of change in the dimension in the height direction from the floor of adjacent pixels is greater than the third threshold.

[0026] Here, for example, distance information corresponding to pixels of a distance image including an object detected using distance information to the object obtained from a TOF (Time-of-Flight) sensor that receives reflected light of light irradiated toward the object from an LED (Light Emitting Diode) as a light source and measures the distance to the object is selected as the output target. Here, the output control method may be implemented within a distance measuring device such as a TOF sensor, or may be implemented outside the distance measuring device.

[0027] The electromagnetic waves irradiated from the lighting device include, for example, light in the broad sense (ultraviolet light, visible light, infrared light), gamma (γ) rays and X-rays which have shorter wavelengths than light, microwaves and broadcasting radio waves (short wave, medium wave, long wave) which have longer wavelengths than light, ultrasound, elastic waves, quantum waves, etc. In addition, the distance information acquisition step may be configured to detect reflection of electromagnetic waves and calculate distance information, or may be configured to acquire distance information from, for example, a distance sensor provided as an external device.

[0028] This makes it possible to selectively output distance information corresponding to pixels that contain an object placed on the floor surface, for example, and control the output so that no output is generated from pixels that contain only the floor surface and no object. As a result, the amount of data, including distance information, output from the distance measuring device can be significantly reduced. Furthermore, for example, in a configuration in which the distance measuring device includes, as a light receiving unit, a light receiving lens and an image sensor that detects the reflection of the electromagnetic waves received through the light receiving lens, the angle of reflection of the electromagnetic waves incident through the light receiving lens is determined for each pixel of the image sensor that generates the distance image, so that angle information corresponding to each pixel can be obtained. Furthermore, the distance information can be converted into three-dimensional coordinates (X, Y, Z) using the angle information corresponding to each pixel. In addition, by detecting the floor surface as a preliminary step to actually measuring the distance to the target object, the distance (height) of the ranging device from the floor surface can be used as a reference value when detecting the presence or absence of the target object. Furthermore, when calculating the installation height of the distance measuring device from the floor surface position and detecting the presence or absence of an object, the distance (height) of the distance measuring device from the floor surface can be used as a reference value. In addition, for the distance to the floor surface measured by the distance measuring device, the Cartesian coordinate system of the distance measuring device is rotated around an axis by the angle formed by the perpendicular line to the floor surface and the optical axis of the distance measuring device, so that the coordinate value in the optical axis direction of the reacquired coordinate value can be calculated as the installation height of the distance measuring device. That is, for example, by rotating around an axis by the angle formed by the perpendicular line to the floor surface and the optical axis of the distance measuring device so that the Z axis corresponding to the optical axis of the distance measuring device faces vertically, the installation height can be calculated so that the same distance information is obtained as when the distance measuring device irradiates light directly downward and receives the reflected light. Note that, by calculating the average value of the coordinate values ​​(distances) from the plane recognized as the floor surface and calculating this average value as the installation height, for example, the installation height of the distance measuring device from the floor surface can be accurately calculated even if the floor surface has minute irregularities. In addition, when actually measuring the distance information to the object, the three-dimensional coordinates converted from the distance information and angle information in the three-dimensional coordinate conversion unit are rotated around an axis to calculate rotated coordinates, thereby detecting the distance to the object. In other words, by using the calculated rotated coordinates, it is possible to measure the distance in the height direction, which is essentially measured when the object is viewed from directly above. In addition, by detecting an object having a height from a surface recognized as the floor as the target object, it is possible to easily identify the pixel containing the distance information to be output, and by comparing the installation height from the floor surface with the target object's height (coordinate in the height direction), it is possible to easily detect whether or not the object is the target object depending on whether or not the target object has a dimension in the height direction. In addition, when detecting an object, when comparing the installation height from the floor surface with the height of the object (coordinate in the height direction), if the difference in height is greater or smaller than a predetermined threshold, the object is detected as an object, thereby preventing erroneous detection of the object. Furthermore, by performing the judgment process using different threshold values ​​S1, S2, and S3, the condition of the floor surface FL can be detected. For example, even if the distance measuring device 20 is mounted on a conveying device capable of running on the floor surface FL, the presence or absence of unevenness such as holes 130a on the floor surface FL, the presence or absence of obstacles, etc. can be accurately determined, and the conveying operation can be carried out smoothly.

[0029] No. 7 The output control program according to the present invention is an output control program for controlling output of information included in a distance image including distance information to an object, Each step of the output control method according to the sixth aspect of the present invention to be executed by the computer.

[0030] Here, for example, distance information corresponding to pixels of a distance image including an object detected using distance information to the object obtained from a TOF (Time-of-Flight) sensor that receives reflected light of light irradiated toward the object from an LED (Light Emitting Diode) as a light source and measures the distance to the object is selected as the output target. Here, the output control program may be loaded and executed by a CPU in a distance measuring device such as a TOF sensor, or may be loaded and executed by a CPU in an external device of the distance measuring device.

[0031] The electromagnetic waves irradiated from the lighting device include, for example, light in the broad sense (ultraviolet light, visible light, infrared light), gamma (γ) rays and X-rays which have shorter wavelengths than light, microwaves and broadcasting radio waves (short wave, medium wave, long wave) which have longer wavelengths than light, ultrasound, elastic waves, quantum waves, etc. In addition, the distance information acquisition step may be configured to detect reflection of electromagnetic waves and calculate distance information, or may be configured to acquire distance information from, for example, a distance sensor provided as an external device.

[0032] This means: Effects similar to those achieved by the output control method according to the sixth aspect of the present invention described above, For example, the output can be controlled so that only distance information corresponding to pixels containing an object placed on the floor is selectively output, and output is not performed from pixels that are only on the floor and have no object. 、 The amount of data, including distance information, output from a distance measuring device can be significantly reduced. It can have the following effects: . Effect of the Invention

[0033] According to the distance measuring device of the present invention, the amount of data including the distance information to be output can be reduced. [Brief description of the drawings]

[0034] [Figure 1] 1 is a perspective view showing the external configuration of a distance measuring device according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a control block diagram of the distance measuring device in FIG. 1. [Diagram 3] FIG. 3 is a control block diagram formed in a control unit of the distance measuring device of FIG. 2. [Figure 4] 3 is a diagram for explaining the principle of calculating the distance to an object using a TOF method included in the distance measuring device of FIG. 2. [Diagram 5] FIG. 2 is a diagram showing the positional relationship between the distance measuring device in FIG. 1 and an object placed on the floor. [Figure 6] 6 is a diagram showing a rotated Cartesian coordinate format in which the Cartesian coordinate format (three-dimensional coordinates) of the distance measuring device in FIG. 5 is rotated by an angle θ around the X-axis. [Figure 7] FIG. 7 is a diagram for explaining conversion of FIG. 6 into an orthogonal coordinate format. [Figure 8] 7 is a diagram for explaining the conversion of FIG. 6 into an orthogonal coordinate rotation format. [Figure 9] 2 is a diagram showing the positional relationship between the distance measuring device in FIG. 1 and an object placed on the floor surface in a Cartesian coordinate rotation format. [Figure 10] FIG. 2 is a diagram showing the positional relationship between the distance measuring device in FIG. 1 and a hole in the floor surface in a Cartesian coordinate rotation format. [Figure 11] 2 is a diagram showing the positional relationship between the distance measuring device in FIG. 1 and a slope on the floor surface in a Cartesian coordinate rotation format. [Figure 12] 4 is a flowchart showing the flow of a calibration process performed before actual measurement, among the processes of an output control method performed by the distance measuring device of FIG. 1; [Figure 13] 4 is a flowchart showing a flow of processing during actual distance measurement, among the processing of an output control method performed by the distance measuring device of FIG. [Figure 14] 14 is a flowchart for explaining in detail the flow of detection of an object (body) placed on the floor surface in the process of step S25 in FIG. [Figure 15] 14 is a flowchart for detecting holes in the floor surface of FIG. 10 in the process of step S25 of FIG. 13. [Figure 16] 14 is a flowchart for detecting the slope of FIG. 11 in the process of step S25 of FIG. 13. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0035] (Embodiment 1) A distance measuring device 20 including a control unit (output control device) 10 according to one embodiment of the present invention will be described below with reference to FIGS. 1 to 16. (1) Configuration of distance measuring device 20 As shown in FIG. 1, the distance measuring device 20 of this embodiment receives reflected light of light L1 (an example of electromagnetic waves) irradiated toward an object 30 from an illumination device 21 provided on the surface of a main body 20a at an image sensor 23 via a light receiving lens 22, and acquires distance information calculated according to the time of flight of light from when the light L1 is irradiated to when it is received.

[0036] As shown in FIG. 2, the distance measuring device 20 includes an illumination device 21, a light receiving lens 22, an imaging element 23, a control unit (output control device) 10, a storage unit 25, and an output unit . The lighting device 21 has, for example, an LED, and irradiates light having a desired wavelength onto the object 30. The lighting device 21 is provided with a projection lens (not shown) that collects the light irradiated from the LED and directs it toward the object 30.

[0037] The light receiving lens 22 is provided to receive light that is irradiated from the illumination device 21 to the object 30 and reflected by the object 30 , and to guide the light to the imaging element 23 . The imaging element 23 has a plurality of pixels, and receives the reflected light received by the light receiving lens 22 at each of the plurality of pixels, and transmits a photoelectrically converted electrical signal to the control unit 10. In addition, the electrical signal corresponding to the amount of reflected light detected by the imaging element 23 is used by the control unit 10 to calculate distance information for each pixel.

[0038] 2, the control unit 10 is connected to the illumination device 21, the image sensor 23, and the storage unit 25. The control unit 10 reads an illumination control program stored in the storage unit 25 and controls the illumination device 21 to irradiate light onto the object 30. More specifically, the control unit 10 controls the illumination device 21 to irradiate the optimum light depending on the distance to the object 30 to be irradiated, the shape, the color, and other properties of the object. The control unit 10 also calculates distance information to the object 30 for each pixel based on an electrical signal corresponding to each pixel received from the image sensor 23. The principle of how the distance measuring device 20 measures the distance to the object 30 will be described in detail later.

[0039] 2, the storage unit 25 is connected to the control unit 10 and stores data such as a control program for controlling the illumination device 21 and the image sensor 23, the amount of reflected light detected by the image sensor 23, the timing of light reception, and distance information calculated based on the amount of reflected light. Furthermore, the storage unit 25 stores information such as distance information, angle information, an orthogonal coordinate system, installation height, rotation coordinates, a threshold value, and coordinate values ​​of pixels to be output, which will be described later. The output unit 26 outputs distance information corresponding to pixels selected by an output information selection unit 19 (see FIG. 3), which will be described later, to an external device. The distance information corresponding to each pixel output from the output unit 26 is not for all pixels, but is limited to information corresponding to a selected portion of pixels. This makes it possible to reduce the output load and also reduce the load of post-processing in the external device that is the output destination.

[0040] (2) Configuration of control unit 10 As shown in FIG. 3, the control unit 10 includes a distance calculation unit (distance information acquisition unit) 11, an angle information acquisition unit 12, a three-dimensional coordinate conversion unit 13, a plane detection unit 14, a height calculation unit 15, a coordinate rotation calculation unit 16, a threshold setting unit 17, an object detection unit 18, and an output information selection unit 19.

[0041] Distance calculation unit 11 calculates distance information to object 30 corresponding to each pixel of the grayscale image captured by imaging element 23, based on the distance measurement principle of the TOF (Time of Flight) method described later. The angle information acquisition unit 12 acquires angle information corresponding to each of the multiple pixels that make up the distance image generated by the image sensor 23, which receives reflected light through the light receiving lens 22, because the angle of incidence of the reflected light with respect to the subject is determined.

[0042] The three-dimensional coordinate conversion unit 13 converts the distance information acquired by the distance calculation unit 11 into three-dimensional coordinates (X, Y, Z) in the Cartesian coordinate format based on the angle information acquired by the angle information acquisition unit 12 (see FIG. 7). The plane detection unit 14 detects the floor surface FL on which the object 30 is placed by specifying a range of pixels for detecting the floor surface FL as a reference for measuring the distance to the object 30 (calibration process).

[0043] The height calculation unit 15 calculates an installation height h of the distance measuring device 20 from the floor surface FL based on the three-dimensional coordinates (X, Y, Z) converted by the three-dimensional coordinate conversion unit 13 from the distance information (height) on the floor surface FL detected by the plane detection unit 14. More specifically, the height calculation unit 15 calculates, as the installation height h, the coordinate value Zr in the optical axis direction among the coordinate values ​​(X, Yr, Zr) obtained again by rotating the Cartesian coordinate system (X, Y, Z) of the distance measuring device 20 around the axis by the angle θ formed between the perpendicular to the floor surface FL and the optical axis of the distance measuring device 20 (see FIG. 6).

[0044] In this embodiment, the height calculation unit 15 calculates the installation height h as the average value of the coordinate values ​​in the Z direction of multiple coordinate values ​​(Xr, Yr, Zr) acquired again by rotating the Cartesian coordinate system (X, Y, Z) of the distance measuring device 20 around an axis. The coordinate rotation calculation unit 16 calculates rotated coordinates (rotated Cartesian coordinate format) by rotating the three-dimensional coordinates (cartesian coordinate format) converted from the distance information and angle information in the three-dimensional coordinate conversion unit 13 around an axis (see FIG. 6).

[0045] The threshold setting unit 17 sets a predetermined threshold used when the object detection unit 18 detects the object 30. The threshold set by the threshold setting unit 17 may be set to a different value as appropriate depending on the form, shape, size, etc. of the object 30 to be detected. The object detection unit 18 compares the height coordinate z of the rotated coordinates calculated in the coordinate rotation calculation unit 16 with the installation height h calculated in the height calculation unit 15, and when it detects an object having a dimension in the height direction, it detects this object as an object 30 placed on the floor surface FL.

[0046] The output information selection unit 19 selects and outputs only the distance information corresponding to the pixels including the object 30 from among the multiple pixels that constitute the distance image including the object 30 detected based on the distance information calculated in the distance calculation unit 11.

[0047] <Principle of distance measurement by distance measuring device 20> The principle of measuring the distance to an object by the distance measuring device 20 of this embodiment will be described below with reference to FIG. That is, in this embodiment, the control unit 10 (distance calculation unit 11) of the distance measuring device 20 calculates the distance to the target object 30 based on the phase difference Φ (see Figure 4) between the projected wave of light irradiated from the lighting device 21 and the received wave of light received by the imaging element 23. Here, the phase difference Φ is expressed by the following relational expression (1). Φ = atan(y / x) (1) (x=a2-a0, y=a3-a1, a0~a3 are the amplitudes at four sampling points of the received light wave at 90 degree intervals)

[0048] The conversion equation from the phase difference Φ to the distance D is given by the following relational expression (2). D = (c / (2 × f LED ))×(Φ / 2π)+D OFFSET ...(2) (c is the speed of light (≒3×10 8 m / s), f LED is the frequency of the LED light, D OFFSET is the distance offset.) As a result, by receiving the reflected light of the light irradiated from the lighting device 21 and comparing the phase difference, the distance calculation unit 11 can easily calculate the distance to the object 30 using the speed of light c.

[0049] <Process to select output target> The method of selecting an output target by the control unit 10 of the distance measuring device 20 of this embodiment will be described below with reference to the drawings. That is, in this embodiment, the distance measuring device 20 is attached at a diagonally downward mounting angle to the upper end of a pillar P1 of height h installed on a floor surface FL, as shown in Figure 5, and an object 30 is placed on the floor surface FL.

[0050] In this case, the distance measuring device 20 calculates the distance to the object (target object 30, floor surface FL, etc.) reflected in every pixel of the image sensor 23, and stores three-dimensional coordinates (X, Y, Z) with the distance measuring device 20 as the origin as distance information corresponding to each pixel. The distance measuring device 20 of this embodiment performs the following output control process to selectively output only the distance information of the pixel corresponding to the position of the target object 30 from the distance information corresponding to each of these pixels.

[0051] First, as a preliminary preparation, the distance measuring device 20 performs a calibration to calculate the installation height h from the floor surface FL. Specifically, as shown in FIG. 5, the distance measuring device 20 measures distances on the floor surface FL in a Cartesian coordinate system (X, Y, Z) and obtains the measurement result (X, Y, Z) coordinate values ​​for each pixel.

[0052] Next, the distance measuring device 20 performs plane detection within the specified pixel range on the obtained results, and obtains the coefficients a, b, c, and d of the equation aX+bY+cZ+d=0 of the plane α. Plane detection and derivation of a, b, c, and d can be performed using existing technology. For example, they can be obtained using the sample code for plane detection (Plane model segmentation) presented in the Point Cloud Library (see http: / / pointclouds.org / documentation / tutorials / planar_segmentation.html, etc.).

[0053] Next, the distance measuring device 20 obtains an angle θ between a perpendicular line to the floor surface FL and the Z axis of the distance measuring device 20's Cartesian coordinate system. Here, the angle θ between the plane α shown in FIG. 6 and the Z axis (z+t=0) of the Cartesian coordinate system of the distance measuring device 20 is calculated by the following relational expression (1). θ=cos-1(|a×0+b×0+c×1|÷((a 2 +b 2 +c 2 )1 / 2×(0 2 +0 2 +1 2 ))) ····(1) By measuring the distance again using a rotated orthogonal coordinate system obtained by rotating the orthogonal coordinate system by θ degrees around the X axis, the coordinate values ​​of the measurement results (Xr, Yr, Zr) in the rotated orthogonal coordinate system for each pixel can be obtained.

[0054] Next, the distance measuring device 20 calculates the average value of Zr within the planar range in which the plane α is detected, and calculates this average value as the height h from the floor surface FL. The process of converting the distance measurement value for each pixel of the imaging element 23 into three-dimensional coordinates based on the angle information will be described below with reference to FIG. That is, the distance measuring device 20 converts the measured distance r corresponding to each pixel into three-dimensional coordinates X, Y, and Z using the angles θ and φ, as shown in FIG.

[0055] Note that r, θ, φ, and X, Y, and Z shown in FIG. 7 are defined as follows. X=r×sinθcosφ Y=r×sinθsinφ Z=r×cosθ (The measurement value r is the magnitude of the distance vector r, the angle θ is the angle between the direction of the distance vector r and the Z axis, and the angle information φ is the angle between the projection vector of the distance vector r onto the XY plane and the X axis.) Next, the process of converting the three-dimensional coordinates (X, Y, Z) obtained by converting the measured distance values ​​corresponding to each pixel into an effective coordinate rotation system by rotating them around the X-axis, Y-axis, and Z-axis will be described with reference to FIG. 8.

[0056] Here, the distance measuring device 20 specifies the rotation angles around the X-axis, Y-axis, and Z-axis, and calculates the rotated coordinate values ​​Xr, Yr, and Zr for the X, Y, and Z coordinates of all pixels using the following relational expression (2).

[0057]

number

[0058] Next, after the installation height h of the distance measuring device 20 is obtained by the above-described calibration process, the distance to the target object 30 is actually measured as shown in FIG. That is, the distance is measured in a Cartesian coordinate rotation format rotated θ degrees around the X axis, and the distance measurement results (Xr, Yr, Zr) at each pixel of the image sensor 23 are obtained. At this time, in the distance measuring device 20, the threshold setting unit 17 sets a predetermined threshold S1 for detecting the object 30.

[0059] Then, the distance measuring device 20 compares the value of Zr in the coordinates (Xr, Yr, Zr) obtained as the measurement result with the value of the installation height h calculated in the calibration process, and if the magnitude of the difference exceeds a predetermined threshold value S1, it determines that the pixel contains an object 30, and the coordinates (Xr, Yr, Zr) of the measurement result corresponding to that pixel are selected as the output target.

[0060] In the distance measuring device 20 of this embodiment, for example, as shown in FIG. 9, an object 30 placed on a floor surface FL is detected, and information on the distance to the object 30 is selected and output. At this time, a threshold value S1 is set as a threshold value for detecting the object 30 placed on the floor surface FL. Then, focusing on Zr of the distance measurement result (Xr, Yr, Zr) obtained in the Cartesian coordinate rotation format, the difference (h-Zr) is calculated for each pixel of the image sensor 23.

[0061] If the difference (h-Zr)>S1, it is determined that the object 30 is present at that pixel position, and the distance information corresponding to that pixel is selected and output. As described above, the distance measuring device 20 of this embodiment converts the measured distance information into an orthogonal coordinate rotation format using the distance information and angle information to the object 30 acquired by the TOF method. Then, by comparing the installation height h with the Zr value, the distance measuring device 20 can distinguish between a position where there is an object whose height difference with the floor surface FL is equal to or greater than a predetermined threshold value S1 and a position where there is only the floor surface without an object, and detect the position where there is an object as a pixel where the object 30 exists.

[0062] This allows only the distance information corresponding to the pixel where the object 30 is detected to be selected and output, thereby avoiding the output of unnecessary information such as distance information to the position on the floor where the object 30 is not present, and significantly reducing the amount of data output. Next, a process for the case where the object detected using the distance information as described above is a hole 130a formed in the floor surface FL will be described with reference to FIG.

[0063] Here, as shown in FIG. 10, a hole 130a formed in a floor surface FL is detected, and only the distance measurement result therefor is selected and output. Specifically, after the installation height h of the distance measuring device 20 is obtained by the above-mentioned calibration process, the distance to the target object (hole 130a) is actually measured as shown in FIG.

[0064] That is, the distance is measured in a Cartesian coordinate rotation format rotated θ degrees around the X axis, and the distance measurement results (Xr, Yr, Zr) at each pixel of the image sensor 23 are obtained. At this time, in the distance measuring device 20, the threshold setting unit 17 sets a predetermined threshold S2 for detecting the hole 130a. Then, the distance measuring device 20 compares the Zr value among the coordinates (Xr, Yr, Zr) of all pixels obtained as the measurement result with the installation height h value calculated in the calibration process, and if the difference (h-Zr) is less than a predetermined threshold value S2, it determines that the pixel contains a hole 130a, and the coordinates (Xr, Yr, Zr) of the measurement result corresponding to that pixel are selected as the output target.

[0065] This makes it possible to easily detect the position of the hole 130a as the state of the floor surface FL, and by selecting and outputting only the distance information corresponding to the pixel where the hole 130a is detected, it is possible to avoid outputting unnecessary information such as distance information to a position on the floor surface FL where there is no hole 130a, thereby significantly reducing the amount of data output. Next, a process will be described with reference to FIG. 11 when the object detected using the distance information as described above is the slope 130b formed on the floor surface FL and whose height varies.

[0066] Here, as shown in FIG. 11, a slope 130b whose height changes on the floor surface FL is detected, and only the distance measurement result is selected and output. Specifically, after the installation height h of the distance measuring device 20 is obtained by the above-mentioned calibration process, the distance to the target object (slope 130b) is actually measured as shown in FIG.

[0067] That is, the distance is measured in a Cartesian coordinate rotation format rotated θ degrees around the X axis, and the distance measurement results (Xr, Yr, Zr) at each pixel of the image sensor 23 are obtained. At this time, in the distance measuring device 20, the threshold setting unit 17 sets a predetermined threshold S3 for detecting the slope 130b. Then, the distance measuring device 20 focuses on the value of Zr among the coordinates (Xr, Yr, Zr) of all pixels acquired as measurement results, and calculates the amount of change (ΔZr / ΔXr)+(ΔZr / ΔYr) between adjacent pixels above, below, left, and right.

[0068] If (ΔZr / ΔXr)+(ΔZr / ΔYr) is greater than a predetermined threshold value S3, S is selected and output as the distance measurement result corresponding to the pixel where the slope 130b is detected. This allows only the distance information corresponding to the pixel where slope 130b is detected to be selected and output as the state of the floor surface FL, thereby avoiding the output of unnecessary information such as distance information to a position on the floor surface FL where slope 130b is not present, thereby significantly reducing the amount of data output.

[0069] <Output control method processing flow> The distance measuring device 20 of this embodiment, configured as described above, executes an output control method in accordance with the flowcharts shown in FIGS. That is, in FIG. 12, as described above, a calibration process is performed as a stage prior to measuring the distance to the actual target object 30.

[0070] In step S11, the distance calculation unit 11 of the distance measuring device 20 calculates distance information from the phase difference information for all pixels of the image sensor . Next, in step S12, based on the distance information for each pixel calculated in step S11 and the angle information corresponding to each pixel acquired by the angle information acquisition unit 12, the three-dimensional coordinate conversion unit 13 converts the distance information into three-dimensional coordinates (X, Y, Z) in Cartesian coordinate format.

[0071] Next, in step S13, the plane detection unit 14 performs a plane detection process on a predetermined plane range on the floor surface FL on which the distance measuring device 20 is installed. Next, in step S14, the height calculation unit 15 calculates the angle θ (see FIG. 6) between the Z axis of the three-dimensional coordinate system of the distance measuring device 20 and the perpendicular line to the floor surface FL. Next, in step S15, the coordinate rotation calculation unit 16 calculates coordinates (Xr, Yr, Zr) in an orthogonal coordinate rotation format by rotating the three-dimensional coordinates by a specified angle θ around three axes for all pixels.

[0072] Next, in step S16, the height calculation unit 15 obtains the average value of Zr in a predetermined planar range of the floor surface FL, and sets this as the installation height h. In the distance measuring device 20 of this embodiment, a calibration process is performed as a preliminary step to measuring the distance to the actual target object 30 by the above-mentioned processing, and the installation height h of the distance measuring device 20 is set as a reference used to detect the position of the target object 30.

[0073] 13, after the calibration process shown in FIG. 12 is performed, a process of measuring the distance to the actual target object 30 is performed. That is, in step S21, the distance calculation unit 11 uses the phase difference information acquired for all pixels of the image sensor 23 to calculate distance information to the object corresponding to each of the multiple pixels.

[0074] Next, in step S22, the three-dimensional coordinate conversion unit 13 converts the distance information calculated for all the pixels of the imaging element 23 into three-dimensional coordinates (X, Y, Z) in orthogonal coordinate form based on the angle information for each pixel acquired by the angle information acquisition unit 12. Next, in step S23, the coordinate rotation calculation unit 16 rotates the three-dimensional coordinates corresponding to all the pixels by a predetermined angle θ around the three axes of X, Y, and Z to calculate the rotated coordinates (Xr, Yr, Zr).

[0075] Next, in step S24, in order to check one by one whether each pixel of the imaging element 23 is a pixel having distance information to be output, for example, in order to start from the lower left end among all the pixels of the imaging element 23, i = 0 and j = 0 are set. Next, in step S25, the Z-axis coordinate value Zr after rotation of the pixel (i, j) is compared with the installation height h, and the coordinates (Xr, Yr, Zr) are stored as selection targets for the pixels determined to have a difference greater than or equal to predetermined threshold values S1, S2, and S3 set according to the object 30 to be detected.

[0076] Note that the processing content of step S25 varies depending on the type of the object 30, and thus the details of the processing will be described in detail in the subsequent stage. Next, in step S26, i is incremented by 1, and for adjacent pixels, it is checked whether they are pixels having distance information to be output. Next, in step S27, it is determined whether the condition i < Max_i is satisfied. That is, in step S27, it is checked whether the pixels of the imaging element 23 have been verified from end to end in the horizontal direction.

[0077] Here, if it is determined that the verification has not yet reached the end (MAX) in the horizontal direction, the process returns to step S25, and it is verified whether the pixel has distance information to be output. On the other hand, if it is determined that the verification has reached the end (MAX) in the horizontal direction, the process moves to step S28. Next, in step S28, since it is determined in step S27 that verification has been performed up to the pixel at the maximum position (end) in the horizontal direction, in order to move to the pixels in the row above, set i = 0 and j = j + 1.

[0078] Next, in step S29, it is determined whether the condition j < Max_j is satisfied. That is, in step S29, it is confirmed whether the pixels of the image sensor 23 have been verified from end to end in the vertical direction. Here, if it is determined that verification has not yet been performed up to the end (MAX) in the vertical direction, the process returns to step S25, and verification is performed to determine whether the pixel has distance information to be output. On the other hand, if it is determined that verification has been performed up to the end (MAX) in the vertical direction, the process moves to step S30.

[0079] Next, in step S30, since verification of all the pixels of the image sensor 23 has been completed, based on the result of the verification in step S25, the coordinates (Xr, Yr, Zr) corresponding to the selected pixel are output. Thereby, by selecting and outputting only the distance information corresponding to the pixels where the object 30 is detected, it is possible to avoid outputting the distance information for all the pixels corresponding to the position of the floor surface FL without the object 30, and significantly reduce the amount of data to be output.

[0080] <When the detection target is the object 30> Here, the process of verifying whether each pixel of the image sensor 23 in step S25 of FIG. 13 described above has distance information to be output, particularly the process when the object 30 is an object placed on the floor surface FL, will be described in detail with reference to FIG. 14. That is, in step S31, the coordinate Zr value corresponding to the vertical direction in the orthogonal coordinate rotation system of the target pixel (i, j) is subtracted from the height h from the floor surface FL obtained by the calibration process shown in FIG. 12 to calculate (h - Zr).

[0081] Next, in step S32, it is determined whether the result (h-Zr) of the subtraction process in step S31 is greater than a predetermined threshold value S1 set by the threshold value setting unit 17 in order to determine the presence or absence of an object 30 placed on the floor surface FL. If it is determined that the result of the subtraction process (h-Zr) is greater than the threshold value S1, the object 30 contained in the target pixel is recognized as an object whose height dimension from the floor surface FL is equal to or greater than the threshold value, and the process proceeds to step S33.

[0082] On the other hand, if it is determined that the result of the subtraction process (h-Zr) is smaller than the threshold value S1, the object 30 contained in the target pixel is recognized as an object with almost no height dimension from the floor surface FL or as the floor surface FL, and the process proceeds to step S35. Next, in step S33, since in step S32 the object 30 contained in the target pixel was recognized as an object whose height dimension from the floor surface FL is equal to or greater than a threshold value, the object detection unit 18 determines that the object 30 is on the floor surface FL.

[0083] Next, in step S34, the output information selection unit 19 selects the coordinates (Xr, Yr, Zr) of the target pixel (i, j) determined to contain the target object 30 and its target object ID (01) as output targets. Next, in step S35, since in step S32 the object 30 contained in the target pixel was recognized as an object having almost no height dimension from the floor surface FL or as the floor surface FL, it is determined that there is no object at the position on the floor surface FL corresponding to that pixel, and the process proceeds to step S26. This makes it easy to determine whether or not the target pixel contains an object 30 placed on the floor surface FL by using a threshold value S1 that is set to determine the presence or absence of an object (target object 30) placed on the floor surface FL.

[0084] <When the detection target is the hole 130a> Here, the process of verifying whether each pixel of the image sensor 23 in step S25 of FIG. 13 described above has distance information to be output, particularly the process when the object 30 is a hole 130a (see FIG. 10) formed in the floor surface FL, will be described in detail with reference to FIG. 15.

[0085] That is, in step S41, the coordinate Zr value corresponding to the vertical direction of the target pixel (i, j) in the Cartesian coordinate rotation system is subtracted from the height h from the floor surface FL obtained by the calibration processing shown in FIG. 12 to calculate (h-Zr). Next, in step S42, it is determined whether the result (h-Zr) of the subtraction process in step S41 is smaller than a predetermined threshold value S2 set by the threshold value setting unit 17 in order to determine the presence or absence of a hole 130a formed in the floor surface FL.

[0086] That is, when the target object is the hole 130a, the distance information of the corresponding pixel acquired by the distance measuring device 20 is greater than the installation height h to the floor surface FL. Therefore, in this case, the value of (h-Zr) is determined to be smaller than the threshold value S2 set for determination, taking into consideration that the value of (h-Zr) is a negative value for the pixel corresponding to the hole 130a. If it is determined that the result of the subtraction process (h-Zr) is smaller than the threshold value S2, the object 30 included in the target pixel is recognized as a hole 130a located below the floor surface FL, and the process proceeds to step S43.

[0087] On the other hand, if it is determined that the result of the subtraction process (h-Zr) is greater than the threshold value S2, the object 30 contained in the target pixel is recognized as an object with almost no depth dimension from the floor surface FL or as the floor surface FL, and the process proceeds to step S45. Next, in step S43, since it was determined in step S42 that the height dimension from the floor surface FL of the object 30 included in the target pixel is smaller than the threshold value S2, the object detection unit 18 determines that there is a hole 130a in the floor surface FL.

[0088] Next, in step S44, the output information selection unit 19 selects the coordinates (Xr, Yr, Zr) of the target pixel (i, j) determined to have the hole 130a and its target ID (02) as the output target. Next, in step S45, since the object contained in the target pixel was recognized in step S42 to be an object with almost no depth dimension from the floor surface FL or the floor surface FL, it is determined that there is no hole 130a at the position on the floor surface FL corresponding to that pixel, and the process proceeds to step S26. This makes it possible to easily determine whether or not the target pixel includes a hole 130a formed on the floor surface FL by using the threshold value S2 that is set for determining whether or not there is a hole 130a formed on the floor surface FL.

[0089] <When the detection target is slope 130b> Here, the process of verifying whether each pixel of the image sensor 23 in step S25 of FIG. 13 described above has distance information to be output, particularly the process when the object 30 is a slope 130b on the floor surface FL (see FIG. 11), will be described in detail with reference to FIG. 16.

[0090] That is, in step S51, in order to determine the presence or absence of a slope 130b in which the dimension in the height direction changes, the amount of change in Zr, ΔZr / ΔXr, between a pixel position (i,j) and its adjacent pixel position (i-1,j) on the negative horizontal side is calculated. Furthermore, the amount of change in Zr, ΔZr / ΔYr, between a pixel position (i,j) and its adjacent pixel position (i,j-1) on the negative vertical side is calculated.

[0091] Next, in step S52, in order to determine the presence or absence of a slope 130b on the floor surface FL, it is determined whether the sum of ΔZr / ΔXr and ΔZr / ΔYr calculated in step S51 is greater than a predetermined threshold S3 set by the threshold setting unit 17, that is, whether the conditional equation {(ΔZr / ΔXr)+(ΔZr / ΔYr)}>threshold S3 is satisfied. In other words, when the object is slope 130b, the amount of change in the height direction between adjacent pixels in the horizontal and vertical directions is greater than a predetermined value, and it is determined whether the sum of the vertical and horizontal amounts of change is greater than a threshold value S3 set for the determination.

[0092] If it is determined that the result of the determination is greater than the threshold value S3, it is recognized that there is a possibility that the object 30 included in the target pixel is the slope 130b, and the process proceeds to step S53. On the other hand, if it is determined that the result is smaller than the threshold value S3, it is recognized that the target pixel does not include the slope 130b, and the process proceeds to step S57. Next, in step S53, the amount of change ΔZr / ΔXr in Zr between a pixel position (i,j) and its adjacent pixel position (i+1,j) on the positive horizontal side is calculated. Furthermore, the amount of change ΔZr / ΔYr in Zr between a pixel position (i,j) and its adjacent pixel position (i,j+1) on the positive vertical side is calculated.

[0093] Next, in step S54, it is determined whether the sum of ΔZr / ΔXr and ΔZr / ΔYr calculated in step S53 is greater than a threshold value S3, that is, whether the condition {(ΔZr / ΔXr)+(ΔZr / ΔYr)}>S3 is satisfied. If it is determined that the result of the determination is greater than the threshold value S3, the object 30 included in the target pixel is recognized as the slope 130b, and the process proceeds to step S55.

[0094] On the other hand, if it is determined that the result is smaller than the threshold value S3, it is recognized that the target pixel does not include the slope 130b, and the process proceeds to step S57. Next, in step S55, since it is determined in step S54 that the sum of ΔZr / ΔXr and ΔZr / ΔYr is greater than the threshold value S3, the object detection unit 18 determines that the slope 130b is present on the floor surface FL.

[0095] Next, in step S56, the output information selection unit 19 selects the coordinates (Xr, Yr, Zr) of the target pixel (i, j) determined to have the slope 130b and its target ID (03) as the output target. Next, in step S57, since it was determined in step S54 that the sum of ΔZr / ΔXr and ΔZr / ΔYr is smaller than threshold value S3, it is recognized that there is almost no change in the dimension of the object in the height direction between adjacent pixels, so it is determined that there is no slope on the floor surface and the process proceeds to step S26. This makes it possible to easily determine whether or not the target pixel includes the slope 130b placed on the floor surface FL, using the threshold value S3 that is set for determining the presence or absence of the slope 130b on the floor surface FL.

[0096] <Detection process of floor surface FL condition> As described above, the distance measuring device 20 of this embodiment can select and output only the distance information held by target pixels that contain the target object by using distance information to determine whether or not each pixel contained in the image sensor 23 contains an object (such as an object, hole, slope, etc.).

[0097] Furthermore, the distance measuring device 20 of this embodiment can also detect the state of the floor surface FL by successively executing the flowcharts of FIG. 14 to FIG. Specifically, by successively executing the flowcharts shown in Figures 14 to 16 for the processing of step S25 in Figure 13, the state of the floor surface FL, such as the presence or absence of an object, the presence or absence of a hole, the presence or absence of a slope, etc., can be detected using three threshold values ​​S1, S2, and S3.

[0098] For this reason, first, a judgment process is performed using a threshold value S1 according to the flowchart shown in FIG. 14, and if an object having a height dimension is detected on the floor surface FL, it is determined that there is an object 30 placed on the floor surface FL, and if no object is detected, a judgment process is performed according to the flowchart shown in FIG. 15. Then, a judgment process is performed using the threshold value S2 according to the flowchart shown in FIG. 15, and if a hole 130a having a depth dimension is detected on the floor surface FL, it is determined that there is a hole 130a formed on the floor surface FL, and if the hole 130a is not detected, a judgment process is performed according to the flowchart shown in FIG. 16.

[0099] Finally, a judgment process is performed using the threshold value S3 according to the flowchart shown in FIG. 16, and if the slope 130b is detected on the floor surface FL, it is judged that the slope 130b is present on the floor surface FL, and if the slope 130b is not detected, the state detection process of the floor surface FL is terminated and the process proceeds to step S26. As a result, by performing the judgment process using different threshold values ​​S1, S2, and S3, even if the distance measuring device 20 is mounted on a conveying device capable of running on the floor surface FL, the presence or absence of unevenness such as holes 130a on the floor surface FL, the presence or absence of obstacles, etc. can be accurately determined, and the conveying operation can be carried out smoothly.

[0100] [Other embodiments] Although one embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and various modifications are possible without departing from the gist of the invention. (A) In the above embodiment, the present invention has been described as an example of an output control device and an output control method, but the present invention is not limited to this.

[0101] For example, the present invention may be realized as an output control program that causes a computer to execute the output control method of the output control device described above. This program is stored in a memory (storage unit) mounted on the output control device, and the CPU reads the output control program stored in the memory and causes the hardware to execute each step. More specifically, the CPU reads the output control program and executes the distance information acquisition step and the output information selection step described above, thereby achieving the same effects as those described above. Furthermore, the present invention may be realized as a recording medium storing an output control program for the output control device.

[0102] (B) In the above embodiment, the distance information acquisition unit has been described by taking the distance calculation unit 11 that calculates distance information corresponding to each pixel of a distance image using a TOF method as an example. However, the present invention is not limited to this.

[0103] For example, distance information corresponding to each pixel of a distance image obtained by the TOF method may be obtained from an external distance measuring device. In other words, the output control device of the present invention may be provided separately from the distance measuring device, acquire distance information from the distance measuring device, and select and output distance information corresponding to the pixel to be output.

[0104] (C) In the above embodiment, an example has been described in which the mounting angle θ of the distance measuring device 20 is calculated by calculation, but the present invention is not limited to this. For example, if the mounting angle of the distance measuring device is known in advance, the mounting angle θ may be used to determine the installation height, etc.

[0105] (D) In the above embodiment, an example has been described in which the distance to an object is measured by detecting reflected light of light irradiated onto the object from the lighting device 21. However, the present invention is not limited to this. For example, the lighting device may be configured to irradiate an object with electromagnetic waves such as light in the broad sense (ultraviolet light, visible light, infrared light), gamma rays, X-rays, which have shorter wavelengths than light, microwaves, and broadcasting radio waves (short wave, medium wave, long wave), which have longer wavelengths than light, and measure the distance to the object by detecting the reflection. In other words, the light irradiated to the target object may be other electromagnetic waves whose reflection amount attenuates inversely proportional to the square of the distance.

[0106] (E) In the above embodiment, the object placed on the floor surface FL, the hole 130a, and the slope 130b are described as examples of objects to be detected using distance information. However, the present invention is not limited to this.

[0107] For example, the detectable object may be an object other than those mentioned above. In this case, the presence or absence of each object can be detected by using a threshold value that is set according to the form, size, shape, etc. of each object. [Industrial Applicability]

[0108] INDUSTRIAL APPLICABILITY The distance measuring device of the present invention has an effect of reducing the amount of data of information including distance information to be output, and is therefore widely applicable to distance measuring devices such as TOF sensors. [Explanation of symbols]

[0109] 10 Control unit (output control device) 11 Distance calculation section (distance information acquisition section) 12 Angle information acquisition section 13 3D coordinate conversion section 14 Plane detection section 15 Height calculation section 16 Coordinate rotation calculation section 17 Threshold setting section 18 Object detection unit 19 Output information selection section 20 Ranging device 20a Main body 21 Lighting Equipment 22 Receiving lens 23 Image sensor 25 Memory section 26 Output section 30 Objects 130a hole 130b Slope D Distance FL floor surface L1 light P1 post

Claims

1. An output control device that controls output of information included in a distance image including distance information to an object, a distance information acquisition unit that acquires distance information to the object according to an amount of reflection of an electromagnetic wave irradiated from a lighting device to the object; an output information selection unit that selects, as an output target, distance information corresponding to a pixel of the distance image including the object detected based on the distance information acquired by the distance information acquisition unit; an angle information acquisition unit that acquires angle information corresponding to each pixel included in the distance image; a three-dimensional coordinate conversion unit that converts the distance information acquired by the distance information acquisition unit into three-dimensional coordinates based on the angle information acquired by the angle information acquisition unit; a plane detection unit that detects a floor surface on which the object is placed; a height calculation unit that calculates an installation height of the distance measuring device based on the distance information on the floor surface detected by the plane detection unit and three-dimensional coordinates converted by the three-dimensional coordinate conversion unit; a coordinate rotation calculation unit that calculates rotated coordinates by rotating the three-dimensional coordinates converted from the distance information and the angle information in the three-dimensional coordinate conversion unit around an axis; an object detection unit that compares a coordinate in a height direction of the rotated coordinates calculated by the coordinate rotation calculation unit with the installation height calculated by the height calculation unit, and detects an object having a dimension in a height direction as the object; a threshold setting unit that sets first, second and third thresholds as predetermined thresholds used when the object detection unit detects the object; Equipped with the height calculation unit calculates, as the installation height, an average value of vertical coordinate values ​​among coordinate values ​​reacquired by rotating an orthogonal coordinate system of the distance measuring device around an axis by an angle formed between a perpendicular line to the floor surface detected by the plane detection unit and an optical axis of the distance measuring device; The object detection unit determines that the object is present on the floor surface when the dimension in the height direction from the floor surface is greater than the first threshold value, determines that a hole is present on the floor surface when the dimension in the height direction from the floor surface is smaller than the second threshold value, and determines that a slope is present on the floor surface when an amount of change in dimension in the height direction from the floor surface between adjacent pixels is greater than the third threshold value. Output control device.

2. The output information selection unit selects and outputs distance information of each pixel including the object detected by the object detection unit. The output control device according to claim 1 .

3. An output control device according to claim 1 or 2; A lighting device that irradiates the object with electromagnetic waves; a light receiving unit that detects the amount of reflection of the electromagnetic wave irradiated from the lighting device; A distance measuring device comprising:

4. a storage unit for storing at least one of the distance information, angle information corresponding to each pixel included in the distance image, an orthogonal coordinate system of the distance measuring device, an installation height, rotated coordinates obtained by rotating three-dimensional coordinates converted from the distance information and the angle information around an axis, a threshold value used when detecting the object, and coordinate values ​​of pixels to be output; 4. A distance measuring device according to claim 3.

5. an output unit that outputs the distance information corresponding to the pixel selected by the output information selection unit to an external device; 5. A distance measuring device according to claim 3 or 4.

6. An output control method for controlling output of information included in a distance image including distance information to an object, comprising: a distance information acquisition step of acquiring distance information to the object according to a reflection amount of an electromagnetic wave irradiated from a lighting device to the object; an output information selection step of selecting, as an output target, distance information corresponding to a pixel of the distance image including the object detected based on the distance information acquired in the distance information acquisition step; an angle information acquiring step of acquiring angle information corresponding to each pixel included in the distance image; a three-dimensional coordinate conversion step of converting the distance information acquired in the distance information acquisition step into three-dimensional coordinates based on the angle information acquired in the angle information acquisition step; a plane detection step of detecting a floor surface on which the object is placed; a height calculation step of calculating an installation height of a distance measuring device based on the distance information on the floor surface detected in the plane detection step, and the three-dimensional coordinates converted in the three-dimensional coordinate conversion step; a coordinate rotation calculation step of calculating rotated coordinates by rotating the three-dimensional coordinates converted from the distance information and the angle information in the three-dimensional coordinate conversion step around an axis; an object detection step of detecting an object having a dimension in a height direction as the object by comparing a coordinate in the height direction of the rotated coordinates calculated in the coordinate rotation calculation step with the installation height calculated in the height calculation step; a threshold setting step of setting first, second and third thresholds as predetermined thresholds used when detecting the object in the object detection step; Equipped with the height calculation step includes calculating, as the installation height, an average value of vertical coordinate values ​​among coordinate values ​​reacquired by rotating an orthogonal coordinate system of the distance measuring device about an axis by an angle formed between a perpendicular line to the floor surface detected in the plane detection step and an optical axis of the distance measuring device; The object detection step determines that the object is present on the floor surface when the dimension in the height direction from the floor surface is greater than the first threshold value, determines that a hole is present on the floor surface when the dimension in the height direction from the floor surface is smaller than the second threshold value, and determines that a slope is present on the floor surface when an amount of change in dimension in the height direction from the floor surface between adjacent pixels is greater than the third threshold value. Output control method.

7. An output control program for controlling output of information included in a distance image including distance information to an object, An output control program for causing a computer to execute each step of the output control method according to claim 6.

Images