Vehicle recognition system and vehicle recognition method

The vehicle recognition system addresses overexposure issues by using shutter and illuminance sensors to adjust camera settings and image brightness, maintaining accurate vehicle recognition in varying lighting conditions.

JP2024158966AActive Publication Date: 2024-11-08TOYOTA JIDOSHA KK
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2023074642
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-28
Publication Date
2024-11-08
Estimated Expiration
2043-04-28

AI Technical Summary

Technical Problem

Cameras installed in closed spaces, such as garages or factories, may become overexposed when shutters open, leading to blown-out highlights and reduced accuracy in vehicle recognition due to varying outdoor illumination.

Method used

A vehicle recognition system that uses shutter opening/closing information and illuminance sensors to determine if outdoor illuminance exceeds indoor illuminance, and performs brightness correction by adjusting camera settings or image brightness to prevent overexposure.

Benefits of technology

Prevents a decrease in vehicle recognition accuracy by correcting camera images for overexposure when shutters open, ensuring clear vehicle identification.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024158966000001_ABST
    Figure 2024158966000001_ABST
Patent Text Reader

Abstract

To provide a technology that, in the case of recognizing a vehicle going out from a closed space on the basis of a camera image including the vehicle, can inhibit accuracy of recognizing the vehicle from being reduced when a shutter opens.SOLUTION: In a recognition processing of a vehicle included in a camera image acquired by a camera installed in a closed space, a vehicle recognition system determines whether or not a shutter provided at an entrance / exit for a vehicle in the closed space is open based on opening / closing information on the shutter. The vehicle recognition system also determines, based on information on an outside illuminance of the closed space and information on an inside illuminance inside the closed space and in an imaging space of the camera, whether or not the outside illuminance is higher than the inside illuminance. The vehicle recognition system further performs brightness correction processing for correcting brightness of the camera image when it is determined that the shutter is open and that the outside illuminance is higher than the inside illuminance.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a technology for recognizing vehicles. [Background technology]

[0002] Patent Document 1 discloses an imaging device that improves the visibility of a subject that a user wants to focus on. In this conventional technology, the face of a person who is a subject of interest is detected based on an image that combines low-illuminance and high-illuminance images captured by a camera, and the luminance distribution of the face area is calculated. Then, based on the luminance distribution of the face area of ​​the person in the low-illuminance or high-illuminance area, the exposure amount of the face area is controlled so as to approach the appropriate exposure range. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2011-254340 A Summary of the Invention [Problem to be solved by the invention]

[0004] Now, consider a scene in which a vehicle leaving a closed space having a certain extent, such as a garage, a parking lot, a factory, etc., is recognized by a camera installed in the closed space. In this case, when a shutter installed at the vehicle entrance to the closed space is opened, the amount of light received by the light receiving sensor installed in the camera may become saturated and whiteout may occur in the camera image depending on the weather and time of day around the closed space. If a vehicle is included in the whiteout part of the camera image, the camera may not be able to recognize the vehicle.

[0005] One objective of the present disclosure is to provide a technology that can suppress a decrease in accuracy of vehicle recognition when a shutter opens, when recognizing a vehicle based on a camera image that includes the vehicle leaving a closed space. [Means for solving the problem]

[0006] A first aspect of the present disclosure relates to a vehicle recognition system that recognizes a vehicle present in a closed space. The vehicle recognition system includes a storage device that stores a camera image acquired by a camera installed in the closed space, information on whether a shutter installed at an entrance / exit of the vehicle in the closed space is open or closed, information on inside illuminance indicating the illuminance inside the closed space and in the space photographed by the camera, and information on outside illuminance indicating the illuminance outside the closed space, and a processor that performs recognition processing of the vehicle included in the camera image. In the recognition processing, the processor determines whether the shutter is open or closed based on the information on the opening and closing of the shutter. In addition, in the recognition processing, the processor determines whether the outside illuminance is higher than the inside illuminance based on the information on the outside illuminance and the information on the inside illuminance. Furthermore, when it is determined in the recognition processing that the shutter is open and the outside illuminance is higher than the inside illuminance, the processor performs a brightness correction processing to correct the brightness of the camera image.

[0007] A second aspect of the present disclosure has the following features in addition to the first aspect: When the outer illuminance is higher than the inner illuminance by a threshold or more in the brightness correction process, the processor determines that the outer illuminance is higher than the inner illuminance, and corrects the brightness of the camera image.

[0008] A third aspect of the present disclosure has the following features in addition to the first aspect: The storage device further stores camera setting information including a shutter speed of the camera. The brightness correction process includes at least one of a process of correcting brightness calculated from a camera image and a process of adjusting the shutter speed.

[0009] A fourth aspect of the present disclosure has the following features in addition to the third aspect. The shutter opening / closing information includes information on the degree of opening / closing of the shutter. When the information on the degree of opening / closing of the shutter is included in the shutter opening / closing information, the processor sets a degree of correction of the brightness calculated from the camera image according to the degree of opening / closing of the shutter. Also, the processor sets a degree of adjustment of the shutter speed according to the degree of opening / closing of the shutter in the process of adjusting the shutter speed.

[0010] A fifth aspect of the present disclosure relates to a vehicle recognition method for recognizing a vehicle present in a closed space. The vehicle recognition method includes: determining whether a shutter provided at an entrance / exit of the vehicle in the closed space is open based on opening / closing information of the shutter in a recognition process of a vehicle included in a camera image acquired by a camera installed in the closed space; determining whether the outside illuminance is higher than the inside illuminance in the recognition process based on information on outside illuminance indicating the illuminance outside the closed space and information on inside illuminance indicating the illuminance inside the closed space and in the shooting space of the camera; and performing a brightness correction process to correct the brightness of the camera image when it is determined in the recognition process that the shutter is open and the outside illuminance is higher than the inside illuminance. Effect of the Invention

[0011] According to the present disclosure, when the shutter is open and the external illuminance is higher than the internal illuminance, that is, when a situation occurs in which whiteout of the camera image may occur, the brightness of the camera image is corrected, thereby making it possible to suppress a decrease in the accuracy of recognition of a vehicle leaving a closed space based on a camera image that includes the vehicle when the shutter is opened. [Brief description of the drawings]

[0012] [Figure 1] 1 is a diagram for explaining an overview of a vehicle recognition system according to an embodiment; [Diagram 2]FIG. 2 is a diagram for explaining a specific example of a vehicle recognition system according to an embodiment. [Diagram 3] FIG. 2 is a diagram for explaining a specific example of a vehicle recognition system according to an embodiment. [Figure 4] 1 is a block diagram showing an example of the configuration of a vehicle recognition system according to an embodiment; [Diagram 5] 4 is a flowchart illustrating an example of processing of the vehicle recognition system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] A vehicle recognition system and a vehicle recognition method according to an embodiment of the present disclosure will be described with reference to the accompanying drawings. In addition, common elements in the drawings will be denoted by the same reference numerals and duplicated explanations will be omitted.

[0014] 1. Overview FIG. 1 is a diagram for explaining an overview of a vehicle recognition system 1 according to an embodiment. The vehicle recognition system 1 is a system that recognizes a vehicle 4 in a closed space 2 by using a camera 5 installed in the closed space 2. As shown in FIG. 1(A), the vehicle recognition system 1 includes the camera 5, a first illuminance sensor 6, a second illuminance sensor 7, and an information processing device 10. The camera 5, the first illuminance sensor 6, and the information processing device 10 are all provided inside the closed space 2. The second illuminance sensor 7 is provided outside the closed space 2. The information processing device 10 may be provided outside the closed space 2.

[0015] The closed space 2 is a space with a certain amount of expanse in which vehicle movement is expected, such as a garage, parking lot, factory, etc. As shown in Fig. 1(A), the closed space 2 is provided with at least one shutter 3 connecting the inside of the closed space 2 to the outside of the closed space 2 for the entrance and exit of a vehicle 4. The shutter 3 has a structure that allows it to be opened and closed in the vertical direction.

[0016] The camera 5 captures an image of the shooting space within the closed space 2. The shooting space means the angle of view 8 of the camera 5 that is set so that the camera image captured by the camera 5 includes the vehicle 4 that exists within a predetermined distance from the shutter 3. The camera 5 may also have a zoom function so that the vicinity of the vehicle 4 can be magnified and captured.

[0017] The first illuminance sensor 6 is a sensor that acquires an inner illuminance indicating the illuminance in the shooting space of the camera 5. The first illuminance sensor 6 may be fixedly attached somewhere in the shooting space of the camera 5, or may be attached to a vehicle 4 present in the shooting space of the camera 5. In the example shown in FIG. 1(A), the first illuminance sensor 6 is fixedly attached on a wall surface on the inner side of the closed space 2 in the shooting space of the camera 5.

[0018] The second illuminance sensor 7 is a sensor that acquires external illuminance indicating the illuminance outside the closed space 2. The second illuminance sensor 7 may be fixedly attached outside the closed space 2 and near the shutter 3, or may be attached to a vehicle that is outside the closed space 2. In the example shown in FIG. 1(A), the second illuminance sensor 7 is fixedly attached on the wall surface outside the closed space 2 and above the shutter 3.

[0019] The information processing device 10 is a device that performs recognition processing of the vehicle 4 included in the camera image captured by the camera 5. The information processing device 10 is connected to each of the devices, namely, the shutter 3, the camera 5, the first illuminance sensor 6, and the second illuminance sensor 7. The information processing device 10 is connected to each of the devices by, for example, a cable. Note that, when each device is provided with a communication device, the information processing device 10 may acquire various information via each of the communication devices provided in each device.

[0020] Here, as shown in Fig. 1(B), consider a case where the shutter 3 is opened to move the vehicle 4 from inside the closed space 2 to outside the closed space 2. In this case, light 9 is incident toward the inside of the closed space 2 from an entrance connecting the inside of the closed space 2 to the outside of the closed space 2. If the reflected light of the light 9 incident inside the closed space 2 is captured by the camera 5 in a predetermined amount or more, there is a possibility that the camera image captured by the camera 5 may be overexposed.

[0021] According to the vehicle recognition system 1 of the embodiment, the information processing device 10 performs the following process when the shutter 3 is open. Specifically, the information processing device 10 determines whether or not the shutter 3 is open. The determination of whether or not the shutter 3 is open is performed, for example, based on the opening / closing information of the shutter 3. The opening / closing information of the shutter 3 includes, for example, information on the opening / closing button (open button or close button) of the shutter 3.

[0022] Then, the information processing device 10 determines whether or not the outer illuminance is higher than the inner illuminance based on the information on the inner illuminance acquired by the first illuminance sensor 6 and the information on the outer illuminance acquired by the second illuminance sensor 7. Details of the illuminance determination process for determining whether or not the outer illuminance is higher than the inner illuminance will be described later.

[0023] Furthermore, when it is determined that the shutter 3 is open and that the outer illuminance is higher than the inner illuminance, the information processing device 10 performs a brightness correction process to correct the brightness of the camera image. The details of the brightness correction process will be described later.

[0024] 2. Specific examples 2-1. Example of illuminance judgment processing Fig. 2 is an explanatory diagram showing a specific example of the vehicle recognition system 1 according to the embodiment. Specifically, Fig. 2 shows an example of illuminance determination processing for determining whether the outer illuminance is higher than the inner illuminance when the shutter 3 is open. In the example shown in Fig. 2(A), it is shown that the outer illuminance is higher than the inner illuminance, and the difference between the outer illuminance and the inner illuminance is equal to or greater than a threshold. In this case, since the difference between the outer illuminance and the inner illuminance is large, it can be said that the situation is such that blown-out highlights may occur in the camera image.

[0025] On the other hand, in the example shown in Figure 2(B), although the outer illuminance is higher than the inner illuminance, the difference between the outer illuminance and the inner illuminance is less than the threshold value. In this case, since the difference between the outer illuminance and the inner illuminance is small, it can be said that the situation is not such that whiteout in the camera image may occur.

[0026] Therefore, when the shutter 3 is open and the outer illuminance is higher than the inner illuminance by a threshold or more, the information processing device 10 corrects the brightness of the camera image.

[0027] 2-2. Example of brightness correction processing Fig. 3 is an explanatory diagram showing a specific example of the vehicle recognition system 1 according to the embodiment. Specifically, Fig. 3 shows an example of a brightness correction process for correcting the brightness of a camera image executed by the information processing device 10. In the example shown in Fig. 3(A), the brightness correction process includes two processes: parameter adjustment of the camera 5 and correction of the camera image. The contents of each process will be described below.

[0028] The parameter adjustment of the camera 5 is performed based on the setting information of the camera 5. The setting information of the camera 5 includes information on the shutter speed of the camera 5. In other words, the parameter adjustment of the camera 5 means adjusting the shutter speed of the camera 5. For example, in a situation where whiteout may occur in a camera image, the setting value of the shutter speed of the camera 5 is adjusted so as to increase the shutter speed of the camera 5. This makes it possible to suppress the amount of reflected light of the light 9 captured by the camera 5. Therefore, the situation where whiteout may occur in a camera image is improved.

[0029] Next, the correction of the camera image will be described. The correction of the camera image is performed based on the brightness calculated from the camera image. In other words, when the brightness calculated from the camera image is equal to or greater than a reference value, it can be said that the camera image is in a situation where blown-out highlights may occur. Therefore, by correcting the brightness of the camera image so that the brightness is less than the reference value, the situation where blown-out highlights may occur in the camera image is improved.

[0030] As shown in FIG. 3A, the brightness correction process may include at least one of a process of adjusting the shutter speed of the camera 5 and a process of correcting the brightness calculated from the camera image. In the example shown in case 1 of FIG. 3A, the brightness correction process includes only a process of adjusting the shutter speed of the camera 5. In the example shown in case 2 of FIG. 3A, the brightness correction process includes only a process of correcting the brightness calculated from the camera image. In the example shown in case 3 of FIG. 3A, the brightness correction process includes a process of adjusting the shutter speed of the camera 5 and a process of correcting the brightness calculated from the camera image.

[0031] Furthermore, the information processing device 10 may determine the execution content of the brightness correction process according to the opening and closing degree of the shutter 3, as shown in Fig. 3(B). The opening and closing degree of the shutter 3 (opening degree or closing degree) is expressed as a percentage using the position of the lowest part (e.g., drain) of the shutter 3, for example. For example, the lowest part position when the entrance is completely closed by the shutter 3 is set to 0%, and the lowest part position when the entrance is completely opened by the shutter 3 is set to 100%. In this way, the opening degree is expressed as a percentage. This concept of the opening degree can also be applied to the closing degree (closing degree = 100 - opening degree).

[0032] The degree of opening of the shutter 3 is calculated, for example, based on information on the speed at which the shutter 3 opens and information on the open button of the shutter 3 included in the opening / closing information of the shutter 3. Specifically, it is assumed that the speed at which the shutter 3 opens is constant and known information. In this case, the degree of opening of the shutter 3 is calculated based on the speed and the time period from when the open button of the shutter 3 is enabled to when it is disabled. In this way, the degree of opening of the shutter 3 is obtained. This idea of ​​calculating the degree of opening can also be applied to calculating the degree of closing of the shutter 3.

[0033] The opening degree of the shutter 3 is classified into three types, a first opening degree, a second opening degree, and a third opening degree, as shown in Fig. 3(B), for example. The first opening degree means that the opening degree of the shutter 3 is less than a predetermined degree. The second opening degree means that the opening degree of the shutter 3 is equal to or greater than a predetermined degree. The third opening degree means that the opening degree of the shutter 3 is equal to or greater than a predetermined degree and is greater than the second opening degree.

[0034] 3B, the opening degree of the shutter 3 is the first opening degree. In this case, the situation is not such that whiteout in the camera image may occur, so the information processing device 10 does not execute the brightness correction process.

[0035] In the examples shown in Case 2 of FIG. 3B and Case 3 of FIG. 3B, the opening degree of the shutter 3 is the second opening degree. In this case, the situation is such that whiteout of the camera image may occur, so the information processing device 10 executes the brightness correction process. However, when the opening degree of the shutter 3 is the second opening degree, the situation in which whiteout of the camera image may occur is improved by executing either one of the processes of adjusting the shutter speed of the camera 5 and the process of correcting the brightness calculated from the camera image, which are included in the brightness correction process. Therefore, in the example of Case 2 of FIG. 3B, the information processing device 10 executes the process of adjusting the shutter speed of the camera 5. On the other hand, in the example of Case 3 of FIG. 3B, the information processing device 10 executes the process of correcting the brightness calculated from the camera image.

[0036] In the example shown in case 4 of FIG. 3B, the opening degree of the shutter 3 is the third opening degree. In this case, since the situation is such that whiteout may occur in the camera image, the information processing device 10 executes a brightness correction process. However, when the opening degree of the shutter 3 is the third opening degree, it is expected that whiteout in the camera image will not be eliminated even if either the process of adjusting the shutter speed of the camera 5 or the process of correcting the brightness calculated from the camera image is executed. Therefore, when the opening degree of the shutter 3 is the third opening degree, the information processing device 10 may execute both of the above-mentioned processes.

[0037] The concept of the brightness correction process according to the opening degree of the shutter 3 described with reference to FIG. 3B can also be applied to the brightness correction process according to the closing degree of the shutter 3.

[0038] 3.Effects In this way, in the vehicle recognition system 1 according to the embodiment, when the shutter 3 is open and the external illuminance is higher than the internal illuminance, that is, when a situation is present in which whiteout of the camera image may occur, a brightness correction process is executed to correct the brightness of the camera image. In the brightness correction process, at least one of a process of adjusting the shutter speed of the camera 5 and a process of correcting the brightness calculated from the camera image is executed. This makes it possible to prevent the accuracy of recognition of the vehicle 4 that is based on the camera image including the vehicle 4 leaving the closed space 2 from decreasing when the shutter 3 is opened.

[0039] 4. Configuration Example 4 is a block diagram showing an example of a configuration of the information processing device 10 in the vehicle recognition system 1 according to the embodiment. The information processing device 10 includes a processor 20 and a storage device 30. The processor 20 executes various processes. The storage device 30 stores various information required for the processes by the processor 20.

[0040] The various information stored in the storage device 30 includes camera image information, opening / closing information of the shutter 3, information on inner illuminance, information on outer illuminance, and setting information of the camera 5. The opening / closing information of the shutter 3 includes information on the opening / closing button of the shutter 3 and information on the opening / closing degree of the shutter 3. Furthermore, the setting information of the camera 5 includes information on the shutter speed of the camera 5.

[0041] The storage device 30 further includes a vehicle recognition program (not shown). The vehicle recognition program is a computer program executed by the processor 20. When the processor 20 executes the vehicle recognition program, the functions of the vehicle recognition system 1 are realized.

[0042] The connection between the various sensors including the camera 5, the first illuminance sensor 6, and the second illuminance sensor 7 and the information processing device 10 may be a cable (first connection) or communication via a communication device provided in the various sensors (second connection). When the connection between the various sensors and the information processing device 10 is the second connection, the information processing device 10 further includes a communication device capable of communicating with each sensor.

[0043] 5. Processing example FIG. 5 is a flowchart showing an example of processing by the information processing device 10 in the vehicle recognition system 1 according to the embodiment.

[0044] In step S100, the information processing device 10 acquires various information. After that, the process proceeds to step S110. The various information includes camera image information, shutter 3 open / close information, inner illuminance information, outer illuminance information, and camera 5 setting information.

[0045] In step S110, the information processing device 10 determines whether the shutter 3 is open or not based on the opening / closing information of the shutter 3. If it is determined that the shutter 3 is open (step S110; Yes), the process proceeds to step S120. Otherwise (step S110; No), the process ends.

[0046] In step S120, the information processing device 10 determines whether the outer illuminance is higher than the inner illuminance based on the information on the outer illuminance and the information on the inner illuminance. If it is determined that the outer illuminance is higher than the inner illuminance (step S120; Yes), the process proceeds to step S130. Otherwise (step S120; No), the process ends.

[0047] In step S130, when it is determined that the shutter 3 is open and the outer illuminance is higher than the inner illuminance, the information processing device 10 executes a brightness correction process for the camera image. The brightness correction process includes at least one of a process for adjusting the shutter speed of the camera 5 and a process for correcting the brightness calculated from the camera image. [Explanation of symbols]

[0048] REFERENCE SIGNS LIST 1...vehicle recognition system, 2...closed space, 3...shutter, 4...vehicle, 5...camera, 6...first illuminance sensor, 7...second illuminance sensor, 8...angle of view, 9...light, 10...information processing device, 20...processor, 30...storage device

Claims

1. A vehicle recognition system for recognizing a vehicle present in a closed space, a storage device that stores camera images acquired by a camera installed in the closed space, information on opening and closing of a shutter installed at a vehicle entrance and exit of the closed space, information on inside illuminance indicating the illuminance inside the closed space and in the space photographed by the camera, and information on outside illuminance indicating the illuminance outside the closed space; A processor that performs a process of recognizing vehicles included in the camera images; Equipped with The processor, in the recognition process, determining whether the shutter is open or closed based on the shutter opening / closing information; determining whether the outer illuminance is higher than the inner illuminance based on the information on the outer illuminance and the information on the inner illuminance; When it is determined that the shutter is open and the outer illuminance is higher than the inner illuminance, a brightness correction process is performed to correct the brightness of the camera image. Vehicle recognition system.

2. 2. The vehicle recognition system according to claim 1, The processor, in the brightness correction process, When the outer illuminance is higher than the inner illuminance by a threshold value or more, the outer illuminance is determined to be higher than the inner illuminance, and the brightness of the camera image is corrected. Vehicle recognition system.

3. 2. The vehicle recognition system according to claim 1, The storage device further stores setting information of the camera, including a shutter speed of the camera; The brightness correction process includes at least one of a process of correcting the brightness calculated from the camera image and a process of adjusting the shutter speed. Vehicle recognition system.

4. 4. The vehicle recognition system according to claim 3, the shutter opening / closing information includes information on the degree of opening / closing of the shutter, The processor, When the information on the degree of opening / closing is included in the opening / closing information, in a process of correcting the brightness calculated from the camera image, a degree of correction of the brightness is set according to the degree of opening / closing; In the process of adjusting the shutter speed, a degree of adjustment of the shutter speed is set according to the degree of opening or closing. Vehicle recognition system.

5. A vehicle recognition method for recognizing a vehicle present in an enclosed space, comprising: In a recognition process of a vehicle included in a camera image acquired by a camera installed in the closed space, determining whether or not a shutter provided at an entrance / exit of a vehicle in the closed space is open based on opening / closing information of the shutter; In the recognition process, based on information on an external illuminance indicating an illuminance outside the closed space and information on an internal illuminance indicating an illuminance inside the closed space and in a shooting space of the camera, it is determined whether the external illuminance is higher than the internal illuminance; performing a brightness correction process for correcting brightness of the camera image when it is determined in the recognition process that the shutter is open and the outer illuminance is higher than the inner illuminance; Includes Vehicle recognition method.

Citation Information

Patent Citations

  • Object Monitoring System and Methods

    US20220019810A1

  • Monitor camera system and monitor camera

    WO2018193580A1

  • Imaging apparatus

    JP2011254340A