Sensor detection direction adjustment supporting system and method

Abstract

To provide a sensor detection direction adjustment supporting system and method capable of enabling adjustment of a detection direction of a sensor of an imaging apparatus and the like with a simple configuration.SOLUTION: A sensor detection direction adjustment supporting system comprises: a difference calculation unit for calculating a difference between information with respect to a position and inclination of a predetermined object included in information detected by a predetermined sensor and a predetermined reference value with respect to the position and inclination; and an adjustment supporting information output unit for outputting information indicating a direction into which a detection direction of the sensor should be adjusted on the basis of the difference.SELECTED DRAWING: Figure 17

Description

[Technical field]

[0001] The present disclosure relates to a sensor sensing orientation adjustment assistance system and method. [Background technology]

[0002] Patent Document 1 describes a focus position adjustment device for adjusting the focus position of a camera whose imaging direction is directed toward a predetermined shooting target position. In the focus position adjustment device described in Patent Document 1, an operator adjusts the field of view by visually checking the monitor, and then the focus position is automatically adjusted. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-55013 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, depending on the shooting mode, there may be cases where the tasks of visual inspection on the monitor and adjustment of the field of view must be shared among a plurality of workers. In such cases, there is a problem in that it may require a lot of manpower.

[0005] The present disclosure has been made to solve the above-mentioned problems, and aims to provide a sensor detection direction adjustment support system and method that can adjust the detection direction of a sensor such as an imaging device with a simple configuration. [Means for solving the problem]

[0006] In order to solve the above problems, the sensor detection direction adjustment support system of the present disclosure includes a difference calculation unit that calculates the difference between information related to the position and inclination of a specified object contained in information detected by a specified sensor and specified reference values ​​related to the position and inclination, and an adjustment support information output unit that outputs information indicating the direction in which the detection direction of the sensor should be adjusted based on the difference.

[0007] The sensor detection direction adjustment support method of the present disclosure includes a step of calculating the difference between information related to the position and inclination of a specified object contained in information detected by a specified sensor and a specified reference value related to the position and inclination, and a step of outputting information indicating the direction in which the detection direction of the sensor should be adjusted based on the difference. Effect of the Invention

[0008] According to the sensor detection direction adjustment support system and method disclosed herein, it is possible to adjust the detection direction of a sensor such as an imaging device with a simple configuration. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing an example configuration of an image processing system according to a first embodiment of the present disclosure. [Diagram 2] 1 is a perspective view showing an installation example of an imaging device according to a first embodiment of the present disclosure. [Diagram 3] 1 is a perspective view showing a configuration example of an imaging device according to a first embodiment of the present disclosure. [Figure 4] 2 is a schematic diagram showing a configuration example of an indicator according to the first embodiment of the present disclosure. FIG. [Diagram 5] 3 is a schematic diagram showing an example of an adjustment range of the shooting direction (pan angle) of the imaging device according to the first embodiment of the present disclosure. FIG. [Figure 6] 4 is a schematic diagram showing an example of an adjustment range of the imaging direction (tilt angle) of the imaging device according to the first embodiment of the present disclosure. FIG. [Figure 7] 4 is a schematic diagram showing an example of an adjustment range of the imaging direction (roll angle) of the imaging device according to the first embodiment of the present disclosure. FIG. [Figure 8] 2A to 2C are schematic diagrams illustrating examples of captured images according to the first embodiment of the present disclosure. [Figure 9] 4A to 4C are schematic diagrams for explaining an example of image processing of a captured image according to the first embodiment of the present disclosure. [Figure 10] 4A to 4C are schematic diagrams for explaining examples of reference values ​​of a captured image according to the first embodiment of the present disclosure. [Figure 11] 5A to 5C are schematic diagrams for explaining an example of calculation of a difference between a captured image and a reference value according to the first embodiment of the present disclosure. [Figure 12] 4A to 4C are schematic diagrams for explaining a display operation (pan angle) of an indicator according to the first embodiment of the present disclosure. [Figure 13] 4A to 4C are schematic diagrams for explaining a display operation (tilt angle) of an indicator according to the first embodiment of the present disclosure. [Figure 14] 4A to 4C are schematic diagrams for explaining a display operation (roll angle) of an indicator according to the first embodiment of the present disclosure. [Figure 15] FIG. 2 is a system flow diagram showing an example of the operation of the image processing system according to the first embodiment of the present disclosure. [Figure 16] FIG. 11 is a block diagram showing an example configuration of an image processing system according to a second embodiment of the present disclosure. [Figure 17] FIG. 13 is a block diagram showing an example configuration of a sensor detection direction adjustment support system according to a third embodiment of the present disclosure. [Figure 18] FIG. 1 is a schematic block diagram illustrating a configuration of a computer according to at least one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, a sensor detection direction adjustment support system and method according to an embodiment of the present disclosure will be described with reference to the drawings. Note that in each drawing, the same or corresponding components are designated by the same reference numerals and descriptions thereof will be omitted as appropriate.

[0011] First Embodiment (Image Processing System Configuration) Fig. 1 is a block diagram showing a configuration example of an image processing system according to a first embodiment of the present disclosure. The image processing system 1 shown in Fig. 1 is one configuration example of a sensor detection direction adjustment support system of the present disclosure.

[0012] The image processing system 1 shown in Fig. 1 includes an imaging device 2 and an image processing device 3. The imaging device 2 includes an indicator 4. The image processing system 1 is a system that inputs an image captured by the imaging device 2 to the image processing device 3, processes the captured image by the image processing device 3, and outputs the result. Fig. 2 is a perspective view showing an installation example of the imaging device 2 according to the first embodiment of the present disclosure.

[0013] In the example shown in FIG. 2, a plurality of imaging devices 2-1, 2-2, 2-3, and 2-4 and a plurality of image processing devices 3-1, 3-2, 3-3, and 3-4 are installed on a gantry G1 installed on a road R1. The imaging devices 2-1 to 4 and the image processing devices 3-1 to 4 constitute image processing systems 1-1 to 4, and correspond to the imaging device 2 and the image processing device 3 shown in FIG. 1. The image processing systems 1-1 to 4 correspond to the image processing system 1 shown in FIG. 1. In the example shown in FIG. 2, the image processing system 1 is a system that recognizes the license plate (automobile registration plate; also written as "NP") 5-1 of a vehicle C-1, the license plate 5-1 of a vehicle C-2, and the like. In the example shown in FIG. 2, the imaging device 2-1 is for capturing images of the vehicle traveling on the lane L1 (for capturing images from the front), and the imaging device 2-2 is for capturing images of the vehicle traveling on the lane L1 (for capturing images from the rear). The imaging device 2-3 is used to capture a front image of a vehicle traveling on the lane L2, and the imaging device 2-4 is used to capture a rear image of a vehicle traveling on the lane L2.

[0014] Fig. 3 is a perspective view showing a configuration example of the imaging device 3 according to the first embodiment of the present disclosure. The imaging device 2 shown in Fig. 3 has an indicator 4 and a hood 21 for the indicator 4 installed on the rear surface. The imaging device 2 also includes an attachment mechanism 22 that can adjust pan, tilt, and roll. The attachment mechanism 22 can be adjusted manually by an operator, for example.

[0015] FIG. 4 is a schematic diagram showing a configuration example of the indicator 4 according to the first embodiment of the present disclosure. The indicator 4 has six LEDs (light emitting diodes) 41-46, and indicates the directions to be adjusted for the pan, tilt, and roll of the imaging direction of the imaging device 2. In the example shown in FIG. 4, when LED 41 is lit, it indicates that the pan should be adjusted in the positive direction. When LED 42 is lit, it indicates that the pan should be adjusted in the negative direction. When LED 43 is lit, it indicates that the tilt should be adjusted in the positive direction. When LED 44 is lit, it indicates that the tilt should be adjusted in the negative direction. When LED 45 is lit, it indicates that the roll should be adjusted in the positive direction. When LED 45 is lit, it indicates that the roll should be adjusted in the negative direction. When both the positive and negative directions are off, it indicates that the adjustment for that direction (angle) has been completed.

[0016] Fig. 5 is a schematic diagram (plan view) showing an example of an adjustment range of the shooting direction (pan angle) of the imaging device according to the first embodiment of the present disclosure. Fig. 6 is a schematic diagram (side view) showing an example of an adjustment range of the shooting direction (tilt angle) of the imaging device according to the first embodiment of the present disclosure. Fig. 7 is a schematic diagram (front view) showing an example of an adjustment range of the shooting direction (roll angle) of the imaging device according to the first embodiment of the present disclosure. Note that in this embodiment, the shooting direction means the direction when the angles of pan, tilt, and roll are not adjusted.

[0017] (Example of image processing system operation) An operation example of the image processing system 1 shown in Fig. 1 will be described below with reference to Figs. 8 to 15. Fig. 8 is a schematic diagram showing an example of a captured image 11 according to the first embodiment of the present disclosure. The captured image 11 shown in Fig. 8 is an image captured by placing, for example, an adjustment board with an NP attached on a road R1 or an actual vehicle at a predetermined detection position (designed detection position). The captured image 11 includes an NP image 5.

[0018] Fig. 9 is a schematic diagram for explaining an example of image processing of a captured image by the image processing device 3 according to the first embodiment of the present disclosure. The example shown in Fig. 11 is an example in which pixel positions P1 to P4 at the four corners of an NP image 5, a central position P5 calculated from the pixel positions P1 to P4, and a tilt angle θ1 from the horizontal direction (horizontal 0°) are recognized.

[0019] Fig. 10 is a schematic diagram for explaining an example of a reference value of a captured image according to the first embodiment of the present disclosure. In the example shown in Fig. 10, upper and lower limit coordinates BP1 to BP4 in the X and Y directions of a pixel position where a center position P5 should be captured, and a range θB of an inclination angle from the horizontal direction (horizontal 0°) are shown.

[0020] Fig. 11 is a schematic diagram for explaining an example of calculation of the difference from the reference value of the captured image according to the first embodiment of the present disclosure. In the example shown in Fig. 11, the center position P5 (coordinates (x5, y5)) is within the reference value in the Y direction but outside the reference value in the X direction. In addition, the inclination θ1 is also outside the reference range θB.

[0021] 12 is a schematic diagram for explaining the display operation (pan angle) of the indicator 4 according to the first embodiment of the present disclosure. For example, when the X coordinate: x5 of the center position P5 is smaller than the X coordinate: xb1 of the coordinate BP1, the LED 42 on the negative pan side is lit. When the X coordinate: x5 of the center position P5 is larger than the X coordinate: xb2 of the coordinate BP2, the LED 41 on the positive pan side is lit. Also, when the coordinate x5 is equal to or larger than the coordinate xb1 and equal to or smaller than the coordinate xb2, the LED 41 and the LED 42 are turned off.

[0022] 13 is a schematic diagram for explaining the display operation (tilt angle) of the indicator 4 according to the first embodiment of the present disclosure. For example, when the Y coordinate: y5 of the central position P5 is smaller than the Y coordinate: yb1 of the coordinate BP1, the LED 44 on the negative tilt side is turned on. When the Y coordinate: y5 of the central position P5 is larger than the Y coordinate: xy4 of the coordinate BP4, the LED 43 on the positive tilt side is turned on. Also, when the coordinate y5 is equal to or larger than the coordinate yb1 and equal to or smaller than the coordinate yb4, the LED 43 and the LED 44 are turned off.

[0023] 14 is a schematic diagram for explaining the display operation (roll angle) of the indicator 4 according to the first embodiment of the present disclosure. For example, when the tilt θ1 is smaller than the negative reference value of the roll angle −θB / 2, the LED 46 on the negative roll side is turned on. When the tilt θ1 is larger than the positive reference value of the roll angle +θB / 2, the LED 45 on the positive roll side is turned on. When the tilt θ1 is equal to or larger than the negative reference value of the roll angle −θB / 2 and equal to or smaller than the positive reference value +θB / 2, the LED 45 and the LED 46 are turned off.

[0024] 15 is a system flow diagram showing an operation example when adjusting the imaging direction of the imaging device 2 in the image processing system 1 according to the first embodiment of the present disclosure. When the operator H1 operates the imaging device 2 to instruct the start of imaging (step S10), the imaging device 2 captures an image of the sample NP (step S20). Thereafter, the imaging device 2 repeatedly captures images at a predetermined cycle until an instruction to end imaging is received.

[0025] When the imaging device 2 captures an image of the sample NP, the image processing device 3 then receives the sample NP image (step S21). Next, the image processing device 3 extracts the NP from the captured image and calculates the deviation (difference) from the design reference value (step S23). Next, the image processing device 3 calculates in which direction the NP should be moved in the pan / tilt / roll direction and transmits the calculation result (step S24).

[0026] Next, the imaging device 2 receives the calculation result (step S25) and turns on or off the indicator 4 (indicating which way to move in the pan / tilt / roll direction) (step S26). After that, the imaging device 2 and the image processing device 3 repeatedly execute the process from capturing a sample NP image (S20) to turning on / off the indicator (S26) (step S27).

[0027] Meanwhile, the worker H1 looks at the indicator 4 and adjusts the angle (step S11), confirms that the indicator 4 is turned off (step S12), and after fixing the angle, operates the imaging device 2 to instruct the end of imaging (step S13).

[0028] Here, the imaging device 2 ends imaging (step S28), and the image processing device 3 ends the processing.

[0029] (Action and effect) As described above, according to this embodiment, the imaging direction (detection direction) of the imaging device 2 can be adjusted with a simple configuration.

[0030] (Modification) The indicator 4 is not limited to indicating the direction of movement by turning on or off an LED, and may be, for example, a 7-segment LED or the like that quantitatively indicates the degree of adjustment that should be made. Alternatively, the period of blinking of the LED may be changed to indicate the degree of adjustment that should be made.

[0031] <Second embodiment> Fig. 16 is a block diagram showing a configuration example of an image processing system 1a according to a second embodiment of the present disclosure. The image processing system 1a shown in Fig. 16 includes an imaging device 2 and an image processing device 3 having an indicator 4 installed therein. In the second embodiment, the indicator 4 is installed in the image processing device 3, and for example, the imaging direction can be adjusted in a state where the image processing device 3 is connected to the imaging device 2. According to the second embodiment, the imaging direction (detection direction) of the imaging device 2 can be adjusted with a simple configuration.

[0032] <Third embodiment> FIG. 17 is a block diagram showing a configuration example of a sensor detection direction adjustment support system according to a third embodiment of the present disclosure. The sensor detection direction adjustment support system 11 of the present disclosure is not limited to the imaging device 2, and may be applied to other sensors such as a 3D scanner. The sensor detection direction adjustment support system 11 shown in FIG. 17 includes a sensor 12, a difference calculation unit 13, and an adjustment support information output unit 14. The difference calculation unit 13 calculates a difference between information related to the position and tilt of a predetermined object contained in information detected by a predetermined sensor 12 and a predetermined reference value related to the position and tilt. The adjustment support information output unit 14 outputs information indicating a direction in which the detection direction of the sensor 12 should be adjusted based on the difference. According to the third embodiment, the simple configuration in which the adjustment support information output unit 14 outputs information indicating a direction in which the detection direction of the sensor 12 should be adjusted based on the difference allows the detection direction of the sensor 12 to be adjusted with a simple configuration. The sensor 12 corresponds to, for example, the imaging device 2. The difference calculation unit 13 corresponds to, for example, the image processing device 3. The adjustment support information output unit 14 corresponds to, for example, the indicator 4.

[0033] (Other embodiments) Although the embodiments of the present disclosure have been described in detail above with reference to the drawings, the specific configuration is not limited to this embodiment, and design changes and the like that do not depart from the gist of the present disclosure are also included.

[0034] Computer Configuration FIG. 18 is a schematic block diagram illustrating a configuration of a computer according to at least one embodiment. The computer 90 comprises a processor 91, a main memory 92, a storage 93, and an interface 94. The image processing device 3, the difference calculation unit 13, and the like described above are implemented in a computer 90. The operations of the above-mentioned processing units are stored in the form of a program in a storage 93. The processor 91 reads the program from the storage 93, loads it in the main memory 92, and executes the above-mentioned processing in accordance with the program. The processor 91 also secures storage areas in the main memory 92 corresponding to the above-mentioned storage units in accordance with the program.

[0035] The program may be for realizing a part of the functions to be performed by the computer 90. For example, the program may be for realizing the functions by combining with other programs already stored in the storage or by combining with other programs implemented in other devices. In another embodiment, the computer may include a custom LSI (Large Scale Integrated Circuit) such as a PLD (Programmable Logic Device) in addition to or instead of the above configuration. Examples of PLDs include PAL (Programmable Array Logic), GAL (Generic Array Logic), CPLD (Complex Programmable Logic Device), and FPGA (Field Programmable Gate Array). In this case, some or all of the functions to be realized by the processor may be realized by the integrated circuit.

[0036] Examples of the storage 93 include a hard disk drive (HDD), a solid state drive (SSD), a magnetic disk, a magneto-optical disk, a compact disc read only memory (CD-ROM), a digital versatile disc read only memory (DVD-ROM), and a semiconductor memory. The storage 93 may be an internal medium directly connected to the bus of the computer 90, or an external medium connected to the computer 90 via an interface 94 or a communication line. In addition, when the program is distributed to the computer 90 via a communication line, the computer 90 that receives the program may load the program into the main memory 92 and execute the above-mentioned process. In at least one embodiment, the storage 93 is a non-transitory tangible storage medium.

[0037] <Additional Notes> The sensor detection direction adjustment support system 11 described in each embodiment can be understood, for example, as follows.

[0038] (1) A sensor detection direction adjustment support system 11 according to a first aspect includes a difference calculation unit 13 that calculates the difference between information relating to the position and inclination of a predetermined object contained in information detected by a predetermined sensor 12 and predetermined reference values ​​relating to the position and inclination, and an adjustment support information output unit 14 that outputs information indicating the direction in which the detection direction of the sensor should be adjusted based on the difference. According to this aspect and each of the following aspects, it is possible to adjust the detection direction of a sensor such as an imaging device with a simple configuration.

[0039] (2) A sensor detection direction adjustment support system 11 according to a second aspect is the sensor detection direction adjustment support system 11 of (1), wherein the information indicating the direction in which the detection direction of the sensor should be adjusted includes information indicating the direction in which the pan, tilt, and roll of the detection direction of the sensor should be adjusted.

[0040] (3) The sensor detection direction adjustment support system 11 according to a third aspect is the sensor detection direction adjustment support system 11 of (1) or (2), in which the adjustment support information output unit 14 is provided on the sensor 12. According to this aspect, even when it is not easy to monitor the detection information of the sensor, it becomes possible to adjust the detection direction.

[0041] (4) The sensor detection direction adjustment support system 11 according to a fourth aspect is the sensor detection direction adjustment support system 11 of (1) to (3), in which the sensor is an imaging device and the target object is an automobile registration plate. [Explanation of symbols]

[0042] 1, 1a…Image processing system 2. Imaging device 3...Image processing device 4…Indicator 11…Sensor detection direction adjustment support system 12…Sensor 13...Difference calculation section 14...Adjustment support information output section

Claims

1. a difference calculation unit that calculates a difference between information related to a position and inclination of a predetermined object included in information detected by a predetermined sensor and a predetermined reference value related to the position and inclination; an adjustment support information output unit that outputs information indicating a direction in which the detection direction of the sensor should be adjusted based on the difference; A sensor detection direction adjustment support system comprising:

2. The information indicating the direction in which the detection direction of the sensor should be adjusted includes information indicating the direction in which the detection direction of the sensor should be adjusted with respect to pan, tilt, and roll. The sensor detection direction adjustment assistance system according to claim 1 .

3. The adjustment support information output unit is provided on the sensor. The sensor detection direction adjustment assistance system according to claim 2 .

4. the sensor is an imaging device; The object is a vehicle registration plate The sensor detection direction adjustment assistance system according to claim 3 .

5. A step of calculating a difference between information related to a position and inclination of a predetermined object included in information detected by a predetermined sensor and a predetermined reference value related to the position and inclination; outputting information indicating a direction in which the detection direction of the sensor should be adjusted based on the difference; A method for assisting in adjustment of a sensor detection direction, comprising:

Images