Organism detection system and mechanical parking facility

Abstract

To provide an organism detection system capable of preventing erroneous detection of an organism in a vehicle in a getting-on / off room.SOLUTION: This organism detection system for detecting an organism in a getting-on / off room by a detection wave-type detector after a user exits the getting-on / off room comprises: a photographing device that captures images of a vehicle and its surroundings in the getting-on / off room; and a control device. The control device includes: a presence region detection unit that detects a presence region of a motion part in an image captured by the photographing device; a difference detection unit that detects a fluctuation pixel in which a difference between a latest image and a background image generated from a plurality of past images is equal to or larger than a threshold value; and a motion determination unit that determines that the motion part is moving when a ratio of the number of fluctuation pixels included in the presence region to the total number of pixels in the presence region is equal to or higher than a threshold value. The control device delays, after the exiting of the user from the getting-on / off room, validating detection of the organism by the detection wave-type detector until the motion end of the motion part upon determination of the motion determination unit that the motion part is moving.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present application relates to a biometric detection system capable of preventing false detection of biometric detection in a boarding and alighting room of a mechanical parking facility.

Background Art

[0002] Conventionally, mechanical parking facilities have monitored the abandonment of passengers or the like in boarding and alighting rooms where vehicles enter and exit. For example, at the time of storage, after the vehicle is stored in the boarding and alighting room and the user exits the boarding and alighting room, the entry / exit door is closed after the user confirms that there is no one in the boarding and alighting room. At the same time, the mechanical parking facility side also monitors the abandonment in the boarding and alighting room.

[0003] As a prior art document regarding the confirmation of no one in this type of boarding and alighting room, there is an object detection device that outputs a transmission wave in a garage in a mechanical parking facility, receives a reflected wave from a reflector, and determines the presence or absence of a person based on the transmission wave and the reflected wave (see, for example, Patent Document 1).

[0004] Also, as another prior art document, there is an object detection device that outputs a transmission wave into a vehicle in the boarding and alighting room, receives a reflected wave from a reflector, and determines whether or not a person is present in the vehicle based on the transmission wave and the reflected wave (see, for example, Patent Document 2).

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] By the way, in the above-mentioned prior arts 1 and 2, after the user gets out of the boarding and alighting compartment, the presence or absence of a person left unattended is determined by performing biometric detection inside the boarding and alighting compartment or inside the vehicle based on the standing wave synthesized from the transmitted wave and the received wave. However, in recent years, there are vehicles in which components such as door mirrors and sliding doors operate after the user exits the boarding and alighting compartment. For this reason, when biometric detection inside the boarding and alighting compartment is performed after the user exits the compartment, the operating parts of the vehicle may be erroneously detected as a person being left unattended.

[0007] For example, as shown in the time chart of FIG. 8, even when there is no one left unattended inside the vehicle, if the door mirror operates during the signal stabilization waiting period in biometric detection by a standing wave radar after detecting that the user has exited the boarding and alighting compartment, the door mirror continues to operate during the determination time of biometric detection (biometric detection is performed for a predetermined time after the signal stabilization waiting period), and there may be a false detection where the movement of the door mirror is determined as a person being left unattended and the determination result becomes "ON". When such a false detection occurs, a message for alerting about being left unattended is erroneously notified by display or voice, and the reliability of biometric detection is impaired. In addition, since the user needs to enter the boarding and alighting compartment again for reconfirmation to cancel the false detection, smooth storage work cannot be performed.

[0008] An object of the present application is to provide a biometric detection system capable of preventing false detection of biometric detection in a boarding and alighting compartment and a mechanical parking facility equipped with the biometric detection system.

Means for Solving the Problem

[0009] A biometric detection system according to one aspect of the present application is a biometric detection system that detects a living body in the boarding and alighting compartment with a detection wave type detector after the user exits from the boarding and alighting compartment. The biometric detection system includes a photographing device that photographs the vehicle and its surroundings in the boarding and alighting compartment, and a control device. The detection wave type detector analyzes a transmission wave transmitted from the detection wave type detector and a reflection wave reflected by the living body to determine whether the living body is detected. The control device includes an existence area detection unit that detects an existence area in the image of an operation unit that operates after the vehicle stops in the boarding and alighting compartment, a difference detection unit that detects a changing pixel in which the difference between the latest image and a background image generated from a plurality of past images is equal to or greater than a threshold value, and an operation determination unit that determines that the operation unit is operating when the ratio of the number of the changing pixels detected by the difference detection unit that are included in the existence area to the number of pixels in the entire existence area is equal to or greater than a threshold value. After the user exits from the boarding and alighting compartment, the control device delays enabling the detection of the living body by the detection wave type detector until after the operation of the operation unit ends, based on the determination by the operation determination unit that the operation unit is operating.

[0010] With this configuration, even if the operation unit operates during biometric detection by the detection wave type detector after the user exits from the boarding and alighting compartment, the operation of the operation unit is detected, and enabling the detection of the living body by the detection wave type detector is delayed until after the operation of the operation unit ends. Therefore, false detection during biometric detection by the detection wave type detector can be prevented.

[0011] Further, the detection wave type detector may be a standing wave radar.

[0012] With such a configuration, general control techniques for biometric detection such as abandonment can be used.

[0013] Further, the operating part is a side mirror of the vehicle, and the control device may identify the end of the operation of the side mirror from the image captured by the imaging device, and enable the detection of the living body by the detection wave type detector after the operation of the side mirror ends. The side mirror includes mirrors provided on the side part of the vehicle such as "door mirror" and "fender mirror".

[0014] With such a configuration, even if the side mirror performs a storage operation or the like after the user exits the boarding and alighting compartment, since the detection of the living body is enabled after the operation of the side mirror ends, it is possible to appropriately detect the living body such as abandonment.

[0015] Further, the operating part is a sliding door of the vehicle, and the control device may identify the end of the operation of the sliding door from the image captured by the imaging device, and enable the detection of the living body by the detection wave type detector after the operation of the sliding door ends.

[0016] With such a configuration, even if the sliding door is closed after the user exits the boarding and alighting compartment, since the detection of the living body is enabled after the operation of the sliding door ends, it is possible to appropriately detect the living body such as abandonment.

[0017] Further, the control device may set a predetermined time for delaying the detection of the living body by the detection wave type detector according to the operating part, and delay the detection of the living body by the detection wave type detector by the predetermined time based on the determination by the operation determination part that the operating part is operating.

[0018] With such a configuration, the control device sets a predetermined time for delaying the detection of the living body from the operating time corresponding to the operating part, and can appropriately detect the living body after the lapse of the set predetermined time after the user exits the boarding and alighting compartment.

[0019] The living body detection system of the above aspect is preferably provided in a mechanical parking facility.

Effects of the Invention

[0020] According to the biological detection system and the mechanical parking facility of the present application, it is possible to appropriately prevent false detection of biological detection such as abandonment in the boarding and alighting room.

Brief Description of the Drawings

[0021]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Modes for Carrying Out the Invention

[0022] Hereinafter, an embodiment of the present application will be described with reference to the drawings. In the following embodiments, an elevator-type parking facility will be described as an example of the mechanical parking facility 10. In the following, the biometric detection system 1 will be described by taking the biometric detection inside the vehicle V as an example. Abandonment is caused, for example, by a person sleeping in the rear seat. In addition, the concepts of front-back, left-right directions in this specification and the patent claim documents shall be consistent with the concepts of front-back, left-right directions in the state of facing the loading / unloading port 12 from the outside as shown in FIG. 1.

[0023] <Configuration of Mechanical Parking Facility> FIG. 1 is an overall perspective view showing an example of a mechanical parking facility 10 to which the biometric detection system 1 is applied. FIG. 2 is a plan view showing the boarding and alighting chamber 15 of the mechanical parking facility 10 shown in FIG. 1. FIG. 2 schematically shows the inside of the boarding and alighting chamber 15.

[0024] As shown in FIG. 1, the mechanical parking facility 10 of this embodiment includes a loading / unloading port 12 on the first floor above the ground of the parking tower 11. An opening / closing entrance door 13 is provided at the loading / unloading port 12. The vehicle V enters or exits the boarding and alighting chamber 15 inside the parking tower 11 from the loading / unloading port 12. An operation panel 14 is provided to the right of the loading / unloading port 12. In addition, a sensor 17 for detecting the exit of the user is provided in the vicinity of the loading / unloading port 12. The sensor 17 takes a photoelectric sensor as an example, but other sensors may also be used.

[0025] As shown in FIG. 2, inside the boarding and alighting chamber 15, a pallet 16 on which the vehicle V is mounted is arranged at the central portion. The vehicle V is guided to park at the central portion of the pallet 16 and stops. The boarding and alighting chamber 15 is provided with a plurality of cameras 20 which are imaging devices for imaging the vehicle V and its surroundings. The plurality of cameras 20 are one of the elements constituting the biometric detection system 1. In the present embodiment, a first camera 21 is provided in front of the vehicle V, and images the vehicle V within a predetermined range 21a from the front. Also, a second camera 22 and a third camera 23 are provided in the left - right direction at the front of the vehicle V, and image the vehicle V within predetermined ranges 22a and 23a from the left - right direction at the front. Further, a fourth camera 24 and a fifth camera 25 are provided in the left - right direction at the rear of the vehicle V, and image the vehicle V within predetermined ranges 24a and 25a from the left - right direction at the rear. In this example, the vehicle V and its surroundings are imaged by five cameras 21 to 25.

[0026] Also, in front of the vehicle V, a standing - wave radar 30 which is a detection - wave - type detector is provided. The standing - wave radar 30 is provided with two units, a first standing - wave radar 31 and a second standing - wave radar 32, at the left - right positions in front of the vehicle V. The first standing - wave radar 31 and the second standing - wave radar 32 are provided so as to transmit radio waves 31a and 32a from the front of the vehicle V including the inside of the vehicle V. The detection - wave - type detector includes those using radio waves such as microwaves and millimeter waves or ultrasonic waves as detection waves. The boarding and alighting chamber 15 is provided with a control device 40.

[0027] <Control device> FIG. 3 is a block diagram including a control device 40 of a mechanical parking facility 10 to which the biometric detection system 1 is applied and main components. The control device 40 of the mechanical parking facility 10 includes an edge AI computer 41 as an image analysis unit having a processor, a volatile memory, a non-volatile memory, an I / O interface, etc., and a mechanism control unit 46. The edge AI computer 41 is one of the elements constituting the biometric detection system 1. The edge AI computer 41 is realized by the processor performing arithmetic processing using the volatile memory based on a program stored in the non-volatile memory. The edge AI computer 41 has software including a function of image processing the image captured by the camera 20. The image processing by the edge AI computer 41 includes a technique of estimating the existence area of a specific operation unit 50 using AI and a technique of detecting the operation of the operation unit 50 by determining whether there is a change in the image in the existence area of the operation unit 50 from the difference from a past image.

[0028] The edge AI computer 41 has an existence area detection unit 42, a difference detection unit 43, and an operation determination unit 44. The existence area detection unit 42 uses a technique of detecting an object shown in the image from the image by AI. The existence area detection unit 42 has a function of analyzing the image captured by the camera 20 and detecting the existence area in the image of the operation unit 50 that operates after the vehicle V stops in the boarding and alighting room 15.

[0029] The difference detection unit 43 has a function of taking a difference for each pixel between the entire image of the latest one frame and the entire background image generated from a plurality of past frames using a plurality of images with a time difference captured by the camera 20, and detecting variable pixels whose difference is equal to or greater than a threshold value. Further, the operation determination unit 44 determines that the operation unit 50 is operating when the ratio of the number of variable pixels detected by the difference detection unit 43 that are included in the existence area of the operation unit 50 in the image detected by the existence area detection unit 42 to the number of all pixels included in the existence area is equal to or greater than a threshold value. In the present embodiment, the control device 40 including the edge AI computer 41 is provided in the boarding and alighting room 15, but the edge AI computer 41 may be provided outside the boarding and alighting room 15.

[0030] The mechanism control unit 46 consists of, for example, a PLC (Programmable Logic Controller). The mechanism control unit 46 performs drive control of each mechanism such as a pallet lifter (not shown) provided in the mechanical parking facility 10 and the entrance / exit door 13. The mechanism control unit 46 is in cooperation with the stationary wave radar 30 and the edge AI computer 41, and performs drive control of each mechanism based on the results output from the stationary wave radar 30 and the edge AI computer 41.

[0031] <Detection of the presence area of the operating part> FIG. 4 is a drawing of a captured image of the first camera 21 showing an example of detecting the presence area of the operating part 50 of the vehicle V in the boarding and alighting compartment 15 shown in FIG. 2. In this example, the operating part 50 is an example of the door mirrors 51 and 52 which are side mirrors of the vehicle V. The side mirrors include the door mirrors 51 and 52 and the fender mirrors. The door mirrors 51 and 52 may be retracted after the vehicle V is parked (stopped) on the pallet 16 of the vehicle V, and are the operating part 50.

[0032] The biometric detection system 1 operates at the timing when the user stores the vehicle V. As an example of the specific timing, it is conceivable that after the user performs an entry call operation on the operation panel 14, a mobile terminal, etc., a carrier with an empty pallet 16 arrives at the boarding and alighting compartment 15 and the entrance / exit door 13 opens. Further, as another example of the specific timing, it is conceivable that the entrance / exit door 13 opens and the vehicle V enters the boarding and alighting compartment 15, and the sensor 17 of the entrance / exit door 13 and a vehicle detection sensor (not shown) in the boarding and alighting compartment 15 detect in this order. The above two examples of specific timings are useful for reducing the load on the edge AI computer 41. However, timings other than the above two specific timings may also be used. The edge AI computer 41 starts detecting the presence area of the operating part 50 from the image captured by the camera 20 at the above timing.

[0033] A method for detecting the existence area of the operating part 50 from the image captured by the camera 20 will be described in more detail. The edge AI computer 41 has a storage unit 45. In the storage unit 45, a learning model created by previously learning the features of the operating part 50 using a large number of learning images is stored. The learning model of this embodiment is created by learning the characteristic shape of the side mirror of a general vehicle. In this embodiment, a plurality of cameras 20 are provided, but the positions of the respective cameras 20 in the passenger compartment 15 are different. As a result, even for the same vehicle V, the appearance of the vehicle V in the images captured by each camera 20 is different. That is, even for the same vehicle V, the appearances of the door mirrors 51, 52 in the images captured by each camera 20 are different. Therefore, it is preferable that the learning model is created for each camera 20 so as to easily detect the door mirrors 51, 52. If configured in this way, it is considered that the detection accuracy will be improved. However, in consideration of the calculation cost of image processing, etc., the learning model may be configured as one common to all of the plurality of cameras 20. In this embodiment, the learning model stored in the storage unit 45 is assumed to be one created in advance using the captured images of the first camera 21 to the fifth camera 25.

[0034] In this embodiment, five cameras 21 to 25 are provided as the cameras 20, and the existence areas of the door mirrors 51, 52 are detected from the captured images of the five cameras 21 to 25 respectively. In the following description, as a representative, the detection of the existence area of the door mirrors 51, 52 by the existence area detection unit 42 using the image of the first camera 21 located in front of the vehicle V will be described. The image of the first camera 21 is an image of the vehicle V seen from the front side.

[0035] The presence area detection unit 42 detects, using a learning model, a portion having the characteristics of the side mirror within the image of one frame captured by the first camera 21. In the present embodiment, the door mirrors 51 and 52 are detected as the portions having the characteristics of the side mirror. The presence area detection unit 42 sets, as the presence area of the operation unit 50, the box-shaped first area 53 and second area 54 in which the door mirrors 51 and 52 are detected within the image of one frame captured by the first camera 21. Note that the presence area detection unit 42 always detects the door mirrors 51 and 52 within the image based on the latest one-frame captured image, and sets the box-shaped first area 53 and second area 54. Therefore, the positions and sizes of the first area 53 and second area 54 set at the current time may be different from the positions and sizes of the first area 53 and second area 54 set at a slightly past time point.

[0036] <Operation determination of the operation unit> The control device 40 monitors changes in the first area 53 and the second area 54 from a plurality of frames of images captured by the first camera 21, and determines whether the door mirrors 51 and 52 have been operated. Specifically, the difference detection unit 43 takes the difference for each pixel between the entire image of the latest one frame captured by the first camera 21 and the entire background image generated from a plurality of past frames. Then, it extracts the changing pixels whose difference exceeds a predetermined threshold value.

[0037] Next, the operation determination unit 44 counts the number of changing pixels extracted by the difference detection unit 43 among the pixels included in the first area 53 and the second area 54 in the image. When the ratio of the counted number of changing pixels to the number of all pixels included in the first area 53 and the second area 54 exceeds a predetermined determination setting value, the operation determination unit 44 determines that the door mirrors 51 and 52 are operating. When the ratio of the changing pixels falls below the predetermined determination setting value after the state where the ratio of the changing pixels exceeds the predetermined determination setting value has continued, the operation determination unit 44 determines the end of the operation of the door mirrors 51 and 52. After the operation of the door mirrors 51 and 52 ends, the control device 40 enables the vital sign detection by the stationary wave radar 30.

[0038] In this example, the door mirrors 51 and 52 are used as the operating unit 50 for illustration purposes. However, the operating unit 50 can be freely set by selecting the teacher data of the object to be the learning target for creating the learning model. The operating unit 50 is preferably a part of the vehicle V that may move electrically after the user exits the boarding and alighting compartment 15. For example, an electric sliding door or an electric rear gate can be considered. Additionally, as long as it is learnable, it can also be an in-vehicle key holder, hanger, seat belt, etc.

[0039] <Biological Detection Flow by the Biological Detection System> FIG. 5 is a flowchart of biological detection by the biological detection system 1 after the vehicle V is stored in the boarding and alighting compartment 15 shown in FIG. 2. The following flowchart also uses the door mirrors 51 and 52 as the operating unit 50 for illustration purposes and explains the case of detecting being left behind. Detecting being left behind is defined as a series of processes performed by the control device 40 in combination with waiting for signal stability and biological detection by the stationary wave radar 30 enabled after waiting for signal stability. Also, in the following flowchart, after the user performs the first user authentication operation and the inbound call operation, when the carrier carrying the empty pallet 16 arrives at the boarding and alighting compartment 15 and the entrance / exit door 13 opens, the biological detection system 1 operates. The explanation starts from the state where the transmission of radio waves by the stationary wave radar 30 and the imaging by the cameras 21 to 25 are started along with the operation of the biological detection system 1.

[0040] When the biometric detection process starts, it is determined whether the user has exited the boarding and alighting compartment 15 (S1). The determination of whether the user has exited is made based on whether the sensor 17 has detected that the user has left the boarding and alighting compartment 15. If the user has exited, the abandonment detection is started (S2). The stationary wave radar 30 analyzes the detection wave and outputs a determination signal indicating "high" when the detection wave analysis result signal exceeds a predetermined threshold value and "low" when it is below the threshold value. The abandonment detection is determined by the mechanism control unit 46 based on the elapse of a predetermined signal stabilization waiting time and the determination signal output by the stationary wave radar 30 enabled after the signal stabilization waiting time. The signal stabilization waiting time is determined as the time until the time-series data for signal processing when the stationary wave radar 30 detects a living body is accumulated, for example, 3 seconds. After the signal stabilization waiting time has elapsed, the mechanism control unit 46 determines, for example, whether there is a person remaining in the vehicle V from the determination signal of the stationary wave radar 30 within a determination time of about 2 seconds. If the determination signal of the stationary wave radar 30 indicates "high" during the determination time after the signal stabilization waiting time has elapsed, the mechanism control unit 46 determines that there is abandonment. Even if the determination signal of the stationary wave radar 30 indicates "high" before the signal stabilization waiting time has elapsed, the mechanism control unit 46 invalidates it.

[0041] After starting the abandonment detection, it is determined whether the door mirrors 51 and 52 have operated (S3). The determination of whether the door mirrors 51 and 52 have operated is made regardless of whether the current is in the signal stability waiting state or whether the determination of whether there is a person remaining in the vehicle V is being made. The edge AI computer 41 sets a first region 53 and a second region 54 in the image from the latest one frame of the image captured by the first camera 21. Then, the edge AI computer 41 takes the pixel-by-pixel difference between the latest one frame of the image and the background image generated from a plurality of past frames captured by the first camera 21, and extracts the variable pixels whose difference exceeds the threshold value. The edge AI computer 41 counts the number of variable pixels included in the first region 53 and the second region 54, and determines whether the door mirrors 51 and 52 are performing a storage operation or the like based on whether the ratio of the counted number of variable pixels to the total number of pixels included in the first region 53 and the second region 54 exceeds the determination setting value.

[0042] Before the total time (e.g., 5 seconds) elapses, which is the sum of the elapsed time of the signal stabilization waiting time (e.g., 3 seconds) and the elapsed time of the determination time (e.g., 2 seconds) for determining whether there is a person remaining in the vehicle V by the stationary wave radar 30, if it is determined that the door mirrors 51, 52 are operating, the abandonment detection is aborted (S4), and it is determined whether the operation of the door mirrors 51, 52 has ended (S5). The edge AI computer 41 determines that the operation of the door mirrors 51, 52 has ended when the ratio of the counted number of changing pixels to the total number of pixels included in the first region 53 and the second region 54 has fallen below the predetermined determination setting value after continuing to exceed the predetermined determination setting value. When it is determined that the operation of the door mirrors 51, 52 has ended, the abandonment detection is restarted from the signal stabilization waiting state (S2). In this way, when the operation of the door mirrors 51, 52, which are the operating parts, is detected after the abandonment detection is started, the abandonment detection is reset once and restarted from the signal stabilization waiting state after the operation of the door mirrors 51, 52 ends. That is, the determination of the presence or absence of abandonment by the mechanism control unit 46 based on the determination signal of the stationary wave radar 30 is delayed. Note that the subsequent abandonment detection after the operation of the door mirrors 51, 52 ends may start from the determination time instead of from the signal stabilization waiting state. Also, it may be determined after the elapse of a signal stabilization waiting time shorter than the normal signal stabilization waiting time.

[0043] Thereafter, during the determination time, based on a determination signal as to whether a person has been detected remaining in the vehicle V by the stationary wave radar 30, the mechanism control unit 46 determines the presence or absence of abandonment (S6). In the case of a determination of no abandonment in this determination, the user checks the safety inside the passenger compartment 15 (S7), and by performing a second user authentication operation, the access door 13 is closed (S8), and the process ends.

[0044] On the other hand, in the determination of whether there is someone left behind (S6), if it is determined that there is someone left behind, the control device 40 notifies the user by displaying a message, making a sound, etc. (S9). The control device 40 displays a warning message such as "Please confirm that there is no one in the vehicle" on the operation panel 14 or notifies the user by voice. The user checks the interior of the vehicle V based on this notification, makes the person remaining in the vehicle exit from the boarding and alighting compartment 15, and confirms that there is no one in the boarding and alighting compartment 15 (S10). After that, the user checks the safety inside the boarding and alighting compartment 15 (S7), closes the entrance and exit door 13 (S8), and then ends.

[0045] In this way, the biometric detection system 1 sets, using image processing technology from the camera images inside the boarding and alighting compartment 15 separately from the stationary wave radar 30, the area where the operating parts 50 such as the door mirrors 51 and 52 inside the boarding and alighting compartment 15 operate, and detects the operation of the operating part 50 from the difference from the past images within that area. And while the operation of the operating part 50 is being detected, delaying the enabling of biometric detection by the stationary wave radar 30 prevents false detection due to the operation of the door mirrors 51 and 52 etc.

[0046] In this embodiment, after it is determined that the door mirrors 51 and 52, which are the operating parts 50, have operated, and after it is determined that the operation of the door mirrors 51 and 52 has ended, it is reset so that the detection of someone left behind starts again from waiting for signal stability. The reset of the detection of someone left behind may be, for example, after it is determined that the operating part 50 is operating, according to the type of the operating part 50, after a predetermined time has elapsed, the detection of someone left behind is started again. The predetermined time can be set in advance considering the operation time according to the type of the operating part 50. The operation time can be determined from the generally operating time, although it may vary somewhat depending on the vehicle V in the case of the door mirrors 51 and 52, for example. The detection of someone left behind may wait for the elapse of a predetermined time according to the operating part 50 after detecting the operation of the operating part 50, and after this predetermined time has elapsed, start again from waiting for signal stability.

[0047] <Example of Biometric Detection by Biometric Detection System> FIG. 6 is a time chart when a living body is not detected in the flowchart shown in FIG. 5. FIG. 7 is a time chart when a living body is detected in the flowchart shown in FIG. 5. These figures also take the detection of abandonment inside the vehicle V as an example.

[0048] The example shown in FIG. 6 is a graph of an example in which the door mirrors 51 and 52 operate after the user exits the boarding and alighting compartment 15 in a state without abandonment. Before the user exits the boarding and alighting compartment 15, since the movement of the user is also detected by the stationary wave radar 30, the detection wave analysis result signal of the stationary wave radar 30 is higher than the threshold value, and the determination signal of the stationary wave radar 30 is in the "high" state. When the user exits the boarding and alighting compartment 15, the sensor 17 detects the exit and the sensor output becomes "ON". When it is detected that the user has exited from inside the boarding and alighting compartment 15, the abandonment detection by the control device 40 is started. The abandonment detection by the control device 40 starts from waiting for signal stability. In this state of waiting for signal stability (before the elapse of a predetermined signal stability waiting time), the door mirrors 51 and 52 operate, and the edge AI computer 41 detects the operation of the door mirrors 51 and 52. When the operation of the door mirrors 51 and 52 is detected by the edge AI computer 41, the control device 40 stops the abandonment detection. In this state, when the door mirrors 51 and 52 operate, the detection wave analysis result signal of the stationary wave radar 30 exceeds the threshold value and is high.

[0049] When the operations of the door mirrors 51 and 52 are completed, the detection wave analysis result signal of the stationary wave radar 30 becomes low and falls below the threshold value. When the edge AI computer 41 detects the completion of the operations of the door mirrors 51 and 52, the control device 40 restarts the leaving detection from waiting for signal stabilization. In this way, when the operations of the door mirrors 51 and 52 are detected, the leaving detection is reset. Then, the determination of the presence or absence of leaving by the mechanism control unit 46 based on the determination signal of the stationary wave radar 30 is delayed. The reset leaving detection starts from waiting for signal stabilization, and after a predetermined time of waiting for signal stabilization, based on the determination signal of the stationary wave radar 30, the mechanism control unit 46 determines whether a person has been detected or not for the presence or absence of leaving. Since this figure shows an example without leaving, the signal output of the stationary wave radar 30 remains low, and the determination result of the leaving detection is "OFF".

[0050] The example shown in FIG. 7 is a graph of an example in which the door mirrors 51 and 52 operate after the user exits the boarding and alighting room 15 with a person remaining in the rear seat. Before the user exits the boarding and alighting room 15, since the movement of the user is also detected by the stationary wave radar 30, the detection wave analysis result signal of the stationary wave radar 30 is higher than the threshold value, and the determination signal of the stationary wave radar 30 is in the "high" state. When the user exits the boarding and alighting room 15, the sensor 17 detects the exit and the sensor output becomes "ON". When it is detected that the user has exited from within the boarding and alighting room 15, the leaving detection by the control device 40 is started. The leaving detection by the control device 40 starts from waiting for signal stabilization. In this state of waiting for signal stabilization (before a predetermined signal stabilization waiting time has elapsed), the door mirrors 51 and 52 operate, and the edge AI computer 41 detects the operations of the door mirrors 51 and 52.

[0051] When the control device 40 detects the operations of the door mirrors 51 and 52 by the edge AI computer 41, it stops the abandonment detection. In this example, since there is human abandonment, regardless of the operations of the door mirrors 51 and 52, the detection wave analysis result signal of the standing wave radar 30 is in a high state exceeding the threshold value. When the edge AI computer 41 detects the end of the operations of the door mirrors 51 and 52, the control device 40 resumes the abandonment detection from waiting for signal stabilization. In this way, when the operations of the door mirrors 51 and 52 are detected, the abandonment detection by the control device 40 is reset. Then, the determination of the presence or absence of abandonment by the mechanism control unit 46 based on the determination signal of the standing wave radar 30 is delayed. The reset abandonment detection starts from waiting for signal stabilization, and after the elapse of a predetermined time of waiting for signal stabilization, based on the determination signal of the standing wave radar 30, the mechanism control unit 46 determines whether a person has been detected, that is, the presence or absence of abandonment. Since there is abandonment in this figure, the detection wave analysis result signal of the standing wave radar 30 remains in a high state exceeding the threshold value, and the determination result of the abandonment detection becomes "ON".

[0052] Note that FIGS. 6 and 7 above are an example in which the sensor 17 detects that the user has exited the boarding and alighting room 15, and then the operations of the door mirrors 51 and 52 are detected after the abandonment detection by the control device 40 is started. However, the door mirrors 51 and 52 may operate when the user exits. In this case, after the sensor 17 detects that the user has exited the boarding and alighting room 15, the abandonment detection by the control device 40 is not started while the door mirrors 51 and 52 are operating. The abandonment detection starts from waiting for signal stabilization after detecting the end of the operations of the door mirrors 51 and 52.

[0053] Thus, according to the biosensing system 1, even if the operating parts 50 such as the door mirrors 51 and 52 and the sliding door that move within the boarding and alighting chamber 15 operate after the user exits the boarding and alighting chamber 15, the operation is detected and the presence detection is aborted, and after the operation of the operating part 50 ends, the presence detection is started again from waiting for signal stability. Therefore, even if there is something that operates within the boarding and alighting chamber 15 after the user exits the boarding and alighting chamber 15, after the operation ends, the biosensing of the standing wave radar 30 can be enabled, and it becomes possible to appropriately perform biosensing such as detecting the presence of a person.

[0054] <Other Modification Examples> The mechanical parking facility is not limited to the elevator type in the above-described embodiment. For example, a horizontal circulation type, a plane reciprocating type, a vertical and horizontal movement puzzle type, etc. may be used, and any configuration having the boarding and alighting chamber 15 can be applied, and the mechanical parking facility is not limited.

[0055] Also, in the above-described embodiment, as an example, the presence of a vehicle V inside is determined by the biosensing of the standing wave radar 30, but it is also possible to determine the presence inside the boarding and alighting chamber 15 by the biosensing of the standing wave radar.

[0056] Furthermore, the above-described embodiment shows an example, and the operating part 50 can also have a plurality of operating parts such as a side mirror and a sliding door, and various configurations may be changed without impairing the gist of the present application, and the present application is not limited to the above-described embodiment.

[0057] <Summary> As described above, according to the biosensing system 1 described above, after the user exits the boarding and alighting chamber 15, false detection due to operations other than a person can be avoided. As a result, in the mechanical parking facility, false detection of biosensing such as detecting the presence of a person can be reduced, and it becomes possible to improve convenience.

Explanation of Reference Numerals

[0058] 1 Biosensing System 10 Mechanical Parking Facility 15 Entrance and exit room 17 Sensor 20 Camera 21 First camera 21a Predetermined range 22 Second camera 22a Predetermined range 23 Third camera 23a Predetermined range 24 Fourth camera 24a Predetermined range 25 Fifth camera 25a Predetermined range 30 Standing wave radar (detection wave type detector) 31 First standing wave radar (detection wave type detector) 31a Radio wave (detection wave) 32 Second standing wave radar (detection wave type detector) 32a Radio wave (detection wave) 40 Control device 41 Edge AI computer (image analysis unit) 42 Presence area detection unit 43 Difference detection unit 44 Operation determination unit 50 Operation unit 51 Door mirror 52 Door mirror 53 First area 54 Second area 60 Front window

Claims

1. A biometric detection system that detects a living body in a boarding and alighting compartment with a detection wave type detector after a user exits the boarding and alighting compartment, comprising: An imaging device that captures images of the vehicle and its surroundings in the boarding and alighting compartment; A control device; The detection wave type detector analyzes a transmission wave transmitted from the detection wave type detector and a reflected wave that returns after being reflected by the living body to determine whether the living body has been detected. The control device includes: An existence area detection unit that analyzes the image captured by the imaging device to detect the existence area of the operation unit that operates after the vehicle stops in the boarding and alighting compartment; A difference detection unit that detects fluctuating pixels whose difference between the latest image and a background image generated from a plurality of past images is equal to or greater than a threshold value; An operation determination unit that determines that the operation unit is operating when the ratio of the number of the fluctuating pixels detected by the difference detection unit that are included in the existence area to the total number of pixels in the existence area is equal to or greater than a threshold value. After the user exits the boarding and alighting compartment, the control device delays enabling the detection of the living body by the detection wave type detector until after the operation of the operation unit ends, based on the determination by the operation determination unit that the operation unit is operating. A biometric detection system.

2. The biometric detection system according to claim 1, wherein the detection wave type detector is a stationary wave radar.

3. The operation unit is a side mirror of the vehicle, and the control device identifies the end of the operation of the side mirror from the image captured by the imaging device and enables the detection of the living body by the detection wave type detector after the end of the operation of the side mirror. The biometric detection system according to claim 1.

4. The operation unit is a sliding door of the vehicle, and the control device identifies the end of the operation of the sliding door from the image captured by the imaging device and enables the detection of the living body by the detection wave type detector after the end of the operation of the sliding door. The biometric detection system according to claim 1.

5. The control device sets a predetermined time for delaying the detection of the living body by the detection wave type detector according to the operation unit, and delays the detection of the living body by the detection wave type detector by the predetermined time based on the determination by the operation determination unit that the operation unit is operating. The biometric detection system according to any one of claims 1 to 4.

6. The biometric detection system according to claim 1, wherein the control device sets a predetermined time for delaying the detection of the living body by the detection wave type detector according to the operation unit, and delays the detection of the living body by the detection wave type detector by the predetermined time based on the determination by the operation determination unit that the operation unit is operating. The biometric detection system according to any one of claims 1 to 4.

6. ​ A mechanical parking facility comprising the biological detection system according to any one of claims 1 to 4.

Images