Vehicle occupant monitoring device
Patent Information
- Application Number
- CN201811487040.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-02-01
- Filing Date
- 2018-12-06
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2038-12-06
AI Technical Summary
[0010]然而,在乘员监视装置停止的情况下,即使启动乘员监视装置,如果并非在识别出乘坐的乘员之后,乘员监视装置也无法开始对乘员进行监视
[0023]在本发明中,使得识别部和监视部分别启动停止,该识别部对乘坐于车辆的乘员进行识别,该监视部根据识别部对乘员的识别结果而对乘坐于车辆的乘员进行监视。例如能够通过针对识别部和监视部分别设定启动或停止,从而使得识别部和监视部分别启动停止。
Smart Images

Figure CN110103978B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a device for monitoring passengers of a vehicle such as a car. Background Art
[0002] In vehicles such as automobiles, it is sometimes desirable to monitor passengers such as a driver riding in the vehicle (Patent Documents 1 to 3).
[0003] The occupant monitoring device, for example, identifies occupants in a vehicle, monitors whether the occupants are looking aside or falling asleep, and issues an alarm to occupants who are looking aside or falling asleep.
[0004] This allows the occupants to focus their attention on the running of the vehicle, thereby improving safety.
[0005] Patent Document 1: Japanese Patent Application Publication No. 2013-103530
[0006] Patent Document 2: Japanese Patent Application Publication No. 2013-109447
[0007] Patent Document 3: Japanese Patent Application Publication No. 2004-330979
[0008] However, depending on the occupant, the warning of the occupant monitoring device may not be necessary, or the occupant monitoring device may annoy the occupant.
[0009] Therefore, it is preferable that the occupant monitoring device can be set to start or stop by the occupant's operation.
[0010] However, when the occupant monitoring device is stopped, even if the occupant monitoring device is activated, the occupant monitoring device cannot start monitoring the occupant unless the occupant is identified.
[0011] When a passenger such as a driver is replaced during the movement of the vehicle, the passenger must wait until the passenger monitoring device has completely identified the passenger.
[0012] If the occupant starts moving again before the occupant monitoring device has finished recognizing the occupant, the occupant monitoring device may monitor the occupant's sideways gaze or drowsiness while recognizing an occupant different from the actual occupant. It is not preferable to allow use in such a state.
[0013] In such a vehicle, it is desirable to be able to appropriately activate and deactivate the occupant monitoring device. Summary of the invention
[0014] The vehicle occupant monitoring device involved in the present invention is an occupant monitoring device that is installed in the vehicle and monitors the occupants riding in the vehicle, and comprises: an identification unit that identifies the occupants riding in the vehicle; a monitoring unit that monitors the occupants riding in the vehicle based on the identification result of the occupants by the identification unit; and a start control unit that starts and stops the identification unit and the monitoring unit respectively, and the start control unit starts the identification unit when the monitoring unit is in a stopped state.
[0015] Preferably, the monitoring unit monitors the identified occupant when the identification unit identifies a specific occupant, and monitors the occupant in the vehicle without determining the occupant when the identification unit does not identify the specific occupant.
[0016] Preferably, the activation control unit activates the recognition unit while the monitoring unit is in a stopped state when the activation control unit detects that an occupant has boarded the vehicle.
[0017] Preferably, the activation control unit activates the recognition unit while the monitoring unit is in a stopped state when the vehicle is activated.
[0018] Preferably, the activation control unit activates or stops the recognition unit and the monitoring unit, respectively, based on activation or deactivation settings set for the recognition unit and the monitoring unit, respectively.
[0019] Preferably, the activation control unit activates the monitoring unit while the vehicle is traveling, and activates the recognition unit while the vehicle is parked.
[0020] Preferably, it comprises: a buffer which records setting data corresponding to the occupant identified by the identification unit for use by the monitoring unit; and a setting update unit which updates the buffer according to the identification result of the occupant by the identification unit, wherein the setting update unit updates the buffer based on the latest identification result of the occupant by the identification unit when the monitoring unit is started, and does not update the buffer when the monitoring unit is stopped.
[0021] Preferably, a communication unit is provided that transmits the setting data for identifying an occupant set in the buffer to another device provided in the vehicle.
[0022] Effects of the Invention
[0023] In the present invention, the recognition unit and the monitoring unit are started and stopped respectively. The recognition unit recognizes the occupant in the vehicle, and the monitoring unit monitors the occupant in the vehicle according to the recognition result of the occupant. For example, the recognition unit and the monitoring unit can be started and stopped respectively by setting start or stop for each.
[0024] Furthermore, in the present invention, the identification unit can be activated while the monitoring unit is stopped. Therefore, the occupant riding in the vehicle can be identified while the monitoring unit is stopped. In addition, when the monitoring unit is activated thereafter, the monitoring unit can appropriately start monitoring the occupant riding in the stopped vehicle without waiting for the identification by the identification unit. Thus, in the present invention, the occupant monitoring device can be appropriately activated and deactivated. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] Figure 1 It is an explanatory diagram of a car to which the occupant monitoring device of the present invention is applied.
[0026] Figure 2 yes Figure 1 An explanatory diagram of an example of an in-vehicle network system of an automobile.
[0027] Figure 3 It is an explanatory diagram of an occupant monitoring device according to an embodiment of the present invention.
[0028] Figure 4 yes Figure 3 An explanatory diagram of the correspondence between the set value of the monitoring start setting data and the set value of the identification start setting data, and the start / stop state of the occupant monitoring device.
[0029] Figure 5 yes Figure 3 An illustration of the data structure of a personal database.
[0030] Figure 6 Yes means Figure 2 Flowchart of the process of occupant recognition processing of an occupant monitoring device.
[0031] Figure 7 Yes means Figure 2 Flowchart of the process of monitoring startup processing of an occupant monitoring device.
[0032] Figure 8 yes Figure 2 An illustration of the jump of the setting status in the occupant monitoring device.
[0033] Description of the label
[0034] 1 automobile (vehicle), 2 vehicle body, 3 door, 4 seat, 5 instrument panel, 6 steering wheel, 10 vehicle-mounted network system, 11 in-vehicle network, 12 occupant monitoring device, 13 door opening and closing sensor, 14 vehicle speed sensor, 15 parking sensor, 16 gear setting device, 17 driving assistance device, 18 vehicle external communication device, 21 monitor, 22 touch panel, 23 in-vehicle camera, 24 monitoring unit, 25 processing unit, 26 occupant monitoring unit (monitoring unit), 27 speaker, 28 seat vibration component, 29 in-vehicle communication unit, 30 personal setting data buffer, 31 setting update unit, 32 start control unit, 33 personal identification unit (identification unit), 34 recording unit, 35 main body, 36 personal database, 37 identification of occupant data, 38 monitoring start setting data, 39 identification of start setting data, 51 first setting state, 52 second setting state, 53 third setting state, 54 fourth setting state. DETAILED DESCRIPTION
[0035] Hereinafter, embodiments of the present invention will be described based on the drawings.
[0036] Figure 1 It is an explanatory diagram of a car 1 to which the occupant monitoring device of the present invention is applied.
[0037] The automobile 1 is an example of a vehicle. The automobile 1 may use an internal combustion engine as a power source for traveling, may use the stored power of a battery as a power source for traveling, or may use a combination of the internal combustion engine and the stored power of a battery.
[0038] Figure 1 The automobile 1 includes a vehicle body 2 forming a passenger compartment, and a door 3 provided on a side of the vehicle body 2 .
[0039] The driver or other passenger opens the door 3 and enters the passenger compartment and sits on the seat 4. On the front side of the driver's seat 4, there are arranged operating components such as a steering wheel 6 protruding rearward from a dashboard 5, an ignition switch, an accelerator pedal, a brake pedal, a shift lever, and a parking lever.
[0040] The driver operates the operating member while sitting on the seat 4. The automobile 1 travels according to the driver's operation, and changes direction and stops.
[0041] Furthermore, after the driver or other passenger operates the ignition switch to stop the automobile 1 , the passenger opens the vehicle door 3 and leaves the passenger compartment.
[0042] Figure 2 yes Figure 1 FIG. 1 is an explanatory diagram of an example of an in-vehicle network system 10 of a car 1 .
[0043] In the in-vehicle network system 10 , a plurality of electronic devices capable of communicating with each other are connected via an in-vehicle network 11 so as to be able to perform data communication with each other.
[0044] exist Figure 2 In the figure, as a plurality of electronic devices, an occupant monitoring device 12, a door opening and closing sensor 13, a vehicle speed sensor 14, a parking sensor 15, a shift setting device 16, a driving assistance device 17, and an external vehicle communication device 18 are illustrated.
[0045] The in-vehicle network 11 may be a wired communication network based on, for example, CAN (Controller Area Network) or LIN (Local Interconnect Network). The in-vehicle network 11 may also be a wireless communication network.
[0046] In addition, the in-vehicle network 11 may be in a dormant state in which communication is restricted after the passenger gets off the vehicle. In this case, the in-vehicle network 11 changes to an activated state in which communication is possible when the passenger gets on the vehicle. The in-vehicle network 11 changes from the dormant state to the activated state based on, for example, the detection of a keyless entry device held by the passenger. The in-vehicle network 11 may have a network control unit that autonomously switches the in-vehicle network 11 between an on state and an off state.
[0047] The occupant monitoring device 12, for example, identifies an occupant who has entered the passenger compartment and sat in the driver's seat 4, and monitors the identified occupant for side-eyeing or drowsiness. Furthermore, when it is detected that the occupant is side-eyeing or drowsing, the occupant monitoring device 12 issues an alarm to the occupant through voice or the like. This allows the occupant to focus on the driving of the automobile 1, and it is expected that safety will be improved.
[0048] The door opening and closing sensor 13 detects when the door 3 of the automobile 1 is opened from a closed state, and when the door 3 in an open state is closed.
[0049] The vehicle speed sensor 14 detects whether the vehicle 1 is stopped or running. The vehicle speed sensor 14 can detect the running speed of the vehicle 1 .
[0050] The parking sensor 15 detects the parking state in which the automobile 1 is maintained. For example, the parking state can be detected by operating a shift lever to a parking position or pulling a parking lever.
[0051] The gear setting device 16 adjusts, for example, the front-back, top-back, and bottom-back positions of the seat 4 and the angle of the backrest, the front-back, top-back, and bottom-back positions and angles of the steering wheel 6, and the front-back, top-back, and bottom-back positions and angles of various pedals. In addition, the setting data corresponding to the occupant sitting on the seat 4 is recorded, and the position and angle adjustment of the seat 4, the steering wheel 6, and the pedals is performed based on the data. In addition, the gear setting device 16 can record the setting data of the gear in the automatic driving separately from the setting data of the gear in the manual driving, and change the gear according to the driving condition of the automobile 1.
[0052] The driving assistance device 17 controls the running, stopping, and steering of the automobile 1 to assist the occupant in the running operation of the automobile 1. In addition, the driving assistance device 17 can control the running, stopping, and steering of the automobile 1 in a fully automatic manner.
[0053] The vehicle external communication device 18 performs two-way data communication with communication equipment installed on the ground and vehicle external communication devices 18 of other vehicles 1, for example, using a public wireless communication network or a commercial wireless communication network. Thus, the vehicle 1 can obtain traffic information, the driving status of vehicles 1 driving around, and information related to the traffic conditions around the vehicle. In addition, the vehicle external communication device 18 can transmit information on the driving status of the vehicle, such as automatic driving.
[0054] Furthermore, the electronic devices transmit and receive data to each other via the in-vehicle network 11. Thus, for example, the occupant monitoring device 12 can obtain information required for the control and can provide the shift setting device 16 and the driving support device 17 with information required.
[0055] However, it is conceivable that, depending on the occupant, the warning of the occupant monitoring device 12 may not be necessary or the occupant monitoring device 12 may be annoying.
[0056] Therefore, it is preferable that the occupant monitoring device 12 can be set to be activated or deactivated by the occupant's operation.
[0057] However, when the occupant monitoring device 12 is stopped, even if the occupant monitoring device 12 is activated, the occupant monitoring device 12 cannot start monitoring the occupant unless the occupant riding in the vehicle is identified.
[0058] When a passenger such as a driver is replaced during the movement of the automobile 1 , the passenger must wait until the passenger monitoring device 12 has completely recognized the passenger.
[0059] If the occupant starts moving again before the occupant monitoring device 12 has finished recognizing the occupant, the occupant monitoring device 12 may monitor the occupant's sideways gaze or drowsiness while recognizing an occupant different from the actual occupant. It is not preferable to allow the occupant in such an unfavorable state to be monitored.
[0060] In this way, in the automobile 1 , it is preferable that the occupant monitoring device 12 can be activated and stopped appropriately.
[0061] Figure 3 It is an explanatory diagram of the occupant monitoring device 12 according to the embodiment of the present invention.
[0062] Figure 3 1 and 2 show a door opening and closing sensor 13, a vehicle speed sensor 14, and a parking sensor 15 that can transmit and receive data with the occupant monitoring device 12 through the in-vehicle network 11. The door opening and closing sensor 13 transmits information on the opening and closing state of the door 3 to the occupant monitoring device 12. The vehicle speed sensor 14 transmits information on the speed of the vehicle 1 to the occupant monitoring device 12. The parking sensor 15 transmits information on whether the vehicle is in a parking state to the occupant monitoring device 12. The above sensors are included to form an occupant monitoring system. The above sensors can be provided as part of the occupant monitoring device 12.
[0063] Figure 3 The occupant monitoring device 12 has a monitor 21, a touch panel 22, an in-vehicle camera 23, an occupant monitoring unit 26 having a monitoring unit 24 and a processing unit 25, a speaker 27, a seat vibration component 28, an in-vehicle communication unit 29, a personal setting data buffer 30, a setting update unit 31, a start control unit 32, a personal identification unit 33, and a recording unit 34.
[0064] The speaker 27 and the seat vibration member 28 may be provided in the automobile 1 separately from the occupant monitoring device 12 , and can transmit and receive data with the occupant monitoring device 12 via the in-vehicle network 11 .
[0065] The occupant monitoring unit 26, the setting update unit 31, the activation control unit 32, and the personal identification unit 33 can be realized in the occupant monitoring device 12 by causing a microcomputer device called an ECU (Electric Control Unit) of the occupant monitoring device 12 to execute a program. In addition, the personal setting data buffer 30, the recording unit 34, and the in-vehicle communication unit 29 can be provided in the occupant monitoring device 12 in a state of being assembled in the microcomputer device. The program can be recorded in the recording unit 34.
[0066] The monitor 21 is a display unit called a liquid crystal device and displays, for example, an operation screen, a monitoring screen, and an alarm screen to provide information to the user.
[0067] The touch panel 22 is a member operated by the user. The touch panel 22 may be provided so as to overlap with the monitor 21. The monitor 21 and the touch panel 22 form a user interface of the occupant monitoring device 12.
[0068] The in-car camera 23 is a component for photographing the interior of the passenger compartment. The in-car camera 23 can photograph the driver's head or the entire passenger compartment in 360-degree directions.
[0069] Moreover, if Figure 1 As shown, the main body 35 of the occupant monitoring device 12 is arranged in the center of the instrument panel 5, thereby enabling the driver and the passenger in the front passenger seat to view the display screen of the monitor 21 and operate the touch panel 22. In addition, the in-vehicle camera 23 can capture the driver's head from the front.
[0070] The speaker 27 is a component for outputting voice into the passenger compartment. The speaker 27 can be connected to the main body 35 of the passenger monitoring device 12 by a voice cable and is installed in the vehicle door 3.
[0071] The seat vibration member 28 is a vibrating member. The seat vibration member 28 is connected to the main body 35 of the occupant monitoring device 12 by a signal cable and is provided in the driver's seat 4. In place of the seat vibration member 28, a vibration member built into the steering wheel 6 may be provided.
[0072] The in-vehicle communication unit 29 is connected to the in-vehicle network 11. The in-vehicle communication unit 29 receives information required by the occupant monitoring device 12 as needed or periodically. In addition, the in-vehicle communication unit 29 transmits information from the occupant monitoring device 12 as needed or periodically. The in-vehicle communication unit 29 receives, for example, information on the opening and closing state of the door 3, information on the speed of the car 1, and information on whether the car is in a parked state.
[0073] The recording unit 34 is a component that stores recorded data even when power is not supplied. The recording unit 34 may be, for example, a nonvolatile memory. The recording unit 34 stores, for example, a personal database 36, identification occupant data 37, monitoring start setting data 38, and identification start setting data 39.
[0074] Figure 4 yes Figure 3 The diagram is an explanatory diagram of the correspondence between the setting value of the monitoring start setting data 38 and the setting value of the identification start setting data 39, and the start / stop state of each function of the occupant monitoring device 12.
[0075] like Figure 4As shown, when the monitoring start setting data 38 (occupant monitoring) is set to ON, the side-gaze detection function and the drowsiness detection function are enabled. The start control unit 32 starts the occupant monitoring unit 26. The occupant monitoring unit 26 is in a state where it can start monitoring.
[0076] On the other hand, when the monitoring start setting data 38 (occupant monitoring) is set to OFF, the side-gaze detection function and the dozing detection function are invalid. The start control unit 32 stops the occupant monitoring unit 26. The occupant monitoring unit 26 ends monitoring.
[0077] When the identification start setting data 39 (personal identification) is set to ON, the personal identification function is enabled. The start control unit 32 starts the personal identification unit 33. The personal identification unit 33 is in a state where it can start authentication.
[0078] On the other hand, when the setting value (personal identification) of the identification start setting data 39 is OFF, the personal identification function is invalid. The start control unit 32 stops the personal identification unit 33. The personal identification unit 33 ends the authentication.
[0079] The activation control unit 32 controls activation and deactivation of the occupant monitoring unit 26 and the individual identification unit 33 according to the on / off state of the in-vehicle network 11 .
[0080] When the in-vehicle network 11 is turned on, the activation control unit 32 activates the occupant monitoring unit 26 and the individual identification unit 33 according to the setting value of the monitoring activation setting data 38 and the setting value of the identification activation setting data 39 at that time.
[0081] If the in-vehicle network 11 is in the disconnected state, the activation control unit 32 stops both the occupant monitoring unit 26 and the individual identification unit 33 .
[0082] Furthermore, the activation control unit 32 can control activation and deactivation of the occupant monitoring unit 26 and the personal identification unit 33 , respectively, according to the on / off state of the ignition switch for activating the functions of the automobile 1 .
[0083] In this way, the activation control unit 32 can activate the individual identification unit 33 based on the setting to activate the individual identification unit 33 in the setting state in which the occupant monitoring unit 26 is stopped.
[0084] Furthermore, the occupant monitoring unit 26 that can start monitoring basically performs monitoring processing while the automobile 1 is traveling in order to ensure safety during traveling.
[0085] Furthermore, the individual identification unit 33 performs individual identification processing as necessary during parking of the automobile 1 where the need for occupant monitoring is low.
[0086] Figure 5 yes Figure 3 An explanatory diagram of the data structure of the personal database 36.
[0087] exist Figure 5 In FIG. 1 , each record of the personal database 36 appearing in each row corresponds to each passenger riding in the car 1. The record includes, for example, a personal ID, facial data, a setting value for monitoring activation, a setting value for identification activation, and personal setting data.
[0088] The personal ID is an identification number issued to each registered passenger so as to avoid duplication.
[0089] The face data is data obtained by photographing the face of the registered occupant.
[0090] The personal setting data is setting data of the car 1 registered for the registered occupant and includes, for example, setting values of on / off of the speaker 27, setting values of on / off of the vibration member, and setting values of the occupant position of the seat 4, the steering wheel 6, and the like.
[0091] The personal setting data buffer 30 stores the personal ID and setting data for the identified occupant. The setting data is used by the occupant monitoring unit 26. The personal ID or part of the setting data is transmitted to other electronic devices by the in-vehicle communication unit 29.
[0092] Other electronic devices perform various personal setting controls based on the received personal ID or setting data. For example, the shift setting device 16 adjusts the front and rear up and down positions of the seat 4 and the backrest angle based on the received setting data or the setting data recorded in the device corresponding to the received personal ID.
[0093] When the setting value of the identification start setting data 39 is the ON setting that enables authentication to be started, the individual identification unit 33 executes an individual identification process for identifying an occupant riding in the car 1 .
[0094] The personal identification process will be described in detail later. The personal identification unit 33 compares the image of the passenger's face captured by the in-vehicle camera 23 with a plurality of facial data registered in the personal database 36 .
[0095] When facial data that can obtain a predetermined matching value is obtained, the individual recognition unit 33 updates the recognized occupant data 37 using the individual ID registered in the individual database 36 in association with the facial data with the highest matching value.
[0096] Thereby, the personal ID corresponding to the occupant riding in the automobile 1 is registered in the identified occupant data 37 .
[0097] The setting update unit 31 updates the monitoring start setting data 38 and the identification start setting data 39 based on the operation of the touch panel 22 .
[0098] The setting update unit 31 adds, deletes, or updates records in the personal database 36 based on the operation of the touch panel 22 .
[0099] The setting update unit 31 updates the setting value of the personal setting data buffer 30 based on the operation of the touch panel 22 .
[0100] When the occupant monitoring unit 26 is in a state capable of starting monitoring, and also when updating the occupant identification data 37 during monitoring, the setting update unit 31 reads the records corresponding to the personal ID of the occupant identification data 37 in the personal database 36, and sets these records in the monitoring start setting data 38, the identification start setting data 39, and the personal setting data buffer 30.
[0101] Thus, in the setting state in which the occupant monitoring unit 26 is activated, the setting update unit 31 updates the setting data in the personal setting data buffer 30 based on the result of the occupant authentication by the personal identification unit 33, and does not update the setting data in the setting state in which the occupant monitoring unit 26 is stopped. In addition, the setting data corresponding to the occupant identified by the personal identification unit 33 is recorded in the personal setting data buffer 30.
[0102] When the occupant monitoring unit 26 has finished monitoring, the setting update unit 31 updates the personal database 36 based on the monitoring start setting data 38 , the identification start setting data 39 , and the setting values of the personal setting data buffer 30 .
[0103] When the ignition switch of the automobile 1 is turned off, the occupant monitoring unit 26 updates the personal database 36 based on the data at that time. The buffer storage process is performed.
[0104] Furthermore, the occupant monitoring unit 26 can update the personal database 36 appropriately based on the monitoring start setting data 38, the identification start setting data 39, and the setting values of the personal setting data buffer 30 as needed. This update can update all the setting values of the personal database 36, or can update a part of the setting values. For example, when registering the personal ID to the personal database 36, the occupant monitoring unit 26 can simultaneously register the setting values used in the occupant monitoring device 12 itself, and when the ignition is stopped later, the setting values of other devices such as the temperature of the air conditioner other than the illustration of the automobile 1 can be registered in the personal database 36.
[0105] The occupant monitoring unit 26 includes a monitoring unit 24 and a processing unit 25 .
[0106] When the setting value of the monitoring start setting data 38 is the ON setting that enables authentication to be started, the monitoring unit 24 executes a monitoring process for monitoring the occupant riding in the automobile 1 based on the result of the occupant identification by the individual identification unit 33 .
[0107] During the monitoring process, the monitoring unit 24 determines whether the image of the passenger's face captured by the in-vehicle camera 23 is in a state corresponding to a specified monitoring target state based on the facial data registered in the personal database 36 corresponding to the personal ID registered in the identification passenger data 37.
[0108] For example, when sidelong glance is the monitoring target, it is determined whether the face in the captured image is in a state where the direction deviates from the front in the traveling direction for a period of time greater than or equal to a predetermined time.
[0109] Furthermore, when dozing off is a monitoring target, it is determined whether a state has occurred in which the eyes in the captured image are closed a predetermined number of times or more or for a predetermined period of time or more.
[0110] In addition, when the personal ID is not registered in the identified passenger data 37, the monitoring unit 24 can use the generalized standard facial data as a reference to determine whether the image of the passenger's face captured by the in-vehicle camera 23 is in a state corresponding to the specified monitoring object state.
[0111] When the monitoring unit 24 determines that an alarm state has occurred, the processing unit 25 performs an alarm process.
[0112] In the alarm processing, the processing unit 25 checks the setting value of the personal setting data buffer 30. If the setting value is such that the speaker 27 is turned on, the processing unit 25 outputs the alarm sound from the speaker 27 for a constant period of time. If the setting value is such that the vibration member is turned on, the processing unit 25 vibrates the seat vibration member 28 for a constant period of time. In addition, the processing unit 25 checks the setting value of the personal setting data buffer 30, and if the setting value is such that the display is turned on, the alarm is displayed on the monitor 21.
[0113] In this way, the occupant monitoring unit 26 of the occupant monitoring device 12 can monitor the occupant riding in the automobile 1 based on the result of occupant recognition by the personal recognition unit 33 and issue an alarm through display, voice, etc. as needed.
[0114] In the setting state where the occupant monitoring unit 26 is activated or stopped, the in-vehicle communication unit 29 transmits the setting data for identifying the occupant set in the personal setting data buffer 30 to other electronic devices installed in the automobile 1 .
[0115] The in-vehicle communication unit 29 may periodically and repeatedly transmit the setting data to other electronic devices.
[0116] Figure 6 Yes means Figure 2 Flowchart of the process of occupant recognition processing of the occupant monitoring device 12.
[0117] The activation control unit 32 of the occupant monitoring device 12 periodically and repeatedly executes Figure 6 processing.
[0118] exist Figure 6 In the occupant identification process, the start control unit 32 first determines whether the car 1 is being started (step ST1). The start control unit 32 can determine whether the car 1 is being started based on whether the ignition switch of the car 1 is within a predetermined period after being turned on. When the car 1 is being started, the personal authentication unit performs the personal authentication process of step ST5 regardless of whether the occupant monitoring unit 26 is started or stopped.
[0119] When a prescribed period of time has passed since the car 1 was started, the start control unit 32 determines that it is not in the start state and determines whether the door 3 has been closed (step ST2). The personal authentication unit can determine whether the door 3 has been closed based on the detection value of the door opening and closing sensor 13 received by the in-vehicle communication unit 29, for example. When an occupant is riding in the car 1, the occupant opens the door 3 to get in the car, and closes the door 3 while sitting in the seat 4. The occupant's boarding can be detected using the detection value of the door opening and closing sensor 13. In addition, the start control unit 32 can determine whether the door 3 has been opened or closed. Furthermore, when the door 3 has not been closed, the start control unit 32 ends. Figure 6 processing.
[0120] When the door 3 is closed, the start control unit 32 determines whether the automobile 1 is parked (step ST3). The start control unit 32 may determine that the automobile 1 is parked based on, for example, the detected speed of the vehicle speed sensor 14 received by the in-vehicle communication unit 29 being 0 kilometers per hour. If the automobile 1 is not parked, the start control unit 32 ends the process. Figure 6 processing.
[0121] When the vehicle is parked, the start control unit 32 determines whether the personal identification is set to on based on the identification start setting data 39 (step ST4). If the personal identification is not set to on, the start control unit 32 ends. Figure 6 processing.
[0122] When the personal identification setting is turned on, or when it is determined in step ST1 that the personal identification is being activated, the activation control unit 32 instructs the personal identification unit 33 to perform personal identification processing (step ST5). The personal identification unit 33 compares the facial image of the passenger captured by the in-vehicle camera 23 with a plurality of facial data registered in the personal database 36, and performs processing to identify and confirm the individual on the vehicle.
[0123] Then, the individual recognition unit 33 determines whether a matching individual can be recognized (step ST6). If no matching result is obtained, the individual recognition unit 33 ends the individual recognition process. In this case, the recognized occupant data 37 is not updated.
[0124] When a matching result is obtained, the individual identification unit 33 determines whether the occupant monitoring is set to ON based on the monitoring start setting data 38 (step ST7 ).
[0125] When the passenger monitoring setting is turned on, the individual recognition unit 33 updates the identified passenger data 37 using the individual ID registered corresponding to the facial data determined to be a match (step ST8). Then, the setting update unit 31 reads the setting data corresponding to the individual ID registered in the identified passenger data 37 from the individual database 36, and updates the individual setting data buffer 30 (step ST9). Thus, the setting data for the identified passenger is registered in the individual setting data buffer 30. In addition, the setting update unit 31 instructs the passenger monitoring unit 26 to perform passenger monitoring (step ST10). The passenger monitoring unit 26 can start passenger monitoring based on the setting data in the updated individual setting data buffer 30.
[0126] When the passenger monitoring setting is turned off, the individual identification unit 33 updates the identified passenger data 37 using the individual ID registered corresponding to the facial data determined to be a match (step ST11). In this case, the setting update unit 31 does not update the personal setting data buffer 30. Therefore, the passenger monitoring unit 26 starts or continues passenger monitoring based on the setting data previously registered in the personal setting data buffer 30.
[0127] Figure 7 Is based on Figure 2 Flow chart of the monitoring startup processing flow performed by the occupant monitoring device 12.
[0128] The occupant monitoring unit 26 of the occupant monitoring device 12 periodically and repeatedly executes Figure 7 processing.
[0129] exist Figure 7In step ST21 , the occupant monitoring unit 26 determines whether the occupant monitoring is set to ON based on the monitoring start setting data 38 (step ST21 ).
[0130] When the occupant monitoring setting is turned on, the setting update unit 31 reads the setting data corresponding to the personal ID registered in the identification occupant data 37 from the personal database 36 based on the instruction of the occupant monitoring unit 26, and updates the personal setting data buffer 30 (step ST22). Thus, the setting data for the last identified occupant is registered in the personal setting data buffer 30. Then, the occupant monitoring unit 26 reads the setting data for the control used for monitoring from the personal setting data buffer 30, and performs monitoring according to the setting (step ST23).
[0131] When the occupant monitoring setting is turned off, the occupant monitoring unit 26 executes a process to end the monitoring (step ST24). The setting update unit 31 reads the setting data of the personal setting data buffer 30 based on the instruction of the occupant monitoring unit 26, and updates the corresponding setting data in the personal database 36. In this way, the latest setting data of the occupant is always recorded in the personal database 36.
[0132] Figure 8 yes Figure 2 An illustration of the jump of the setting state of the occupant monitoring device 12. Figure 8 This is based on the premise that personal authentication is set to ON.
[0133] like Figure 8 As shown, when the car 1 is started, the personal identification process can be executed. The occupant in the car is identified by the personal identification process.
[0134] Then, when the identified occupant is registered in the personal database 36 , the setting state of the occupant monitoring device 12 is changed to the first setting state 51 or the second setting state 52 .
[0135] The first setting state 51 is a state in which the passenger monitoring setting is turned on. In this case, the registered user A is authenticated, and the setting value of the user A is set in the personal setting data buffer 30 for passenger monitoring. In this case, the passenger monitoring device 12 identifies the passenger on the vehicle and monitors the passenger.
[0136] The second setting state 52 is a state when the passenger monitoring is set to OFF. In this case, the user A is authenticated, but the setting value of the user A is not set in the personal setting data buffer 30. Then, the passenger monitoring is set to ON by an operation to change to the first setting state 51, thereby setting the setting value of the user A. However, when the passenger monitoring is set to OFF by an operation thereafter to jump from the first setting state 51, the setting value of the user A is set in the personal setting data buffer 30.
[0137] If the occupancy is detected, the occupant in the new occupancy state is authenticated again through personal identification processing.
[0138] For example, when the user B registered in the personal database 36 is identified, the setting state of the occupant monitoring device 12 is changed to the first setting state 5 or the second setting state 52 for the user B.
[0139] On the other hand, when the user C who is not registered in the personal database 36 is identified, the setting state of the occupant monitoring device 12 is changed to the third setting state 53 or the fourth setting state 54 .
[0140] The third setting state 53 is a state in which the passenger monitoring setting is turned on. In this case, the user C is not registered, so the user is not set, and the personal setting data buffer 30 is not updated. The setting data not associated with the user C is registered in the personal setting data buffer 30. In this case, the passenger monitoring device 12 monitors the passenger in the vehicle without confirming the passenger in the vehicle. Then, the passenger monitoring setting is turned off by an operation, and the fourth setting state 54 is entered.
[0141] The fourth setting state 54 is a state when the passenger monitoring is set to OFF. In this case, the user is not set, and the personal setting data buffer 30 is not updated. Then, the passenger monitoring is set to ON by operation, and the third setting state 53 is changed.
[0142] In this way, the occupant monitoring device 12 of the present embodiment switches to a different setting state according to the on / off setting of the occupant monitoring and the result of the individual identification.
[0143] As described above, in the present embodiment, the personal identification unit 33 for identifying the occupant riding in the automobile 1 and the occupant monitoring unit 26 for monitoring the occupant riding in the automobile 1 based on the setting of the occupant identified by the personal identification unit 33 can be activated or stopped respectively. That is, by setting activation or deactivation for the personal identification unit 33 and the occupant monitoring unit 26 respectively, the personal identification unit 33 and the occupant monitoring unit 26 can be activated or stopped respectively.
[0144] Furthermore, in the present embodiment, in the setting state of stopping the occupant monitoring unit 26, the individual identification unit 33 can be activated based on the setting of activating the individual identification unit 33. Therefore, in the setting state of stopping the occupant monitoring unit 26, the occupant riding in the automobile 1 can be identified. Moreover, when the occupant monitoring unit 26 is activated thereafter, the occupant monitoring unit 26 can immediately and appropriately start monitoring the occupant who is identified riding in the stopped vehicle without waiting for the identification by the individual identification unit 33. The occupant monitoring device 12 can be appropriately activated and deactivated.
[0145] Moreover, the passenger monitoring unit 26 can monitor the identified passenger when the identified passenger is identified by the personal identification unit 33, and monitor the passenger in the vehicle without identifying the identified passenger when the identified passenger is not identified by the personal identification unit 33.
[0146] In contrast, assuming that the entire occupant monitoring device 12 is controlled to start and stop based on one setting, even if the occupant monitoring device 12 is started, the occupant monitoring device 12 cannot start monitoring the occupant unless the occupant is identified. The problem unique to the automobile 1 in which the occupants are allowed to get on and off the vehicle repeatedly cannot be solved. In the case where the driver and other passengers are replaced during the movement of the automobile 1, the replaced passengers must wait until the occupant monitoring device 12 finishes identifying themselves. Furthermore, assuming that the occupant monitoring device 12 restarts moving before identifying the occupant, the occupant monitoring device 12 monitors the occupant's squint and drowsiness in a state where a different occupant is identified than the actual occupant. It is not preferable to allow monitoring in this state.
[0147] In this embodiment, when the passenger's boarding is detected, the individual identification unit 33 is activated even in the setting state of stopping the passenger monitoring unit 26. Therefore, when the passenger is boarding the automobile 1, the passenger can be identified regardless of whether the passenger monitoring unit 26 is started or stopped.
[0148] In this embodiment, when the car 1 is started, the individual identification unit 33 can be activated in a setting state where the occupant monitoring unit 26 is stopped. Therefore, when the car 1 is started, the occupant can be identified regardless of whether the occupant monitoring unit 26 is started or stopped.
[0149] In the present embodiment, the occupant monitoring unit 26 is activated based on the setting while the automobile 1 is traveling, and the individual recognition unit 33 is activated based on the setting while the automobile 1 is parked and the necessity for monitoring by the occupant monitoring unit 26 is low. Therefore, the occupant can be recognized by the individual recognition unit 33 without hindering the occupant monitoring unit 26 from monitoring during traveling.
[0150] In the present embodiment, the personal setting data buffer 30 for recording the setting data used by the occupant monitoring unit 26 is updated based on the latest identification result of the occupant by the personal identification unit 33 when the occupant monitoring unit 26 is started, and is not updated when the occupant monitoring unit 26 is stopped.
[0151] Therefore, in the setting state where the occupant monitoring unit 26 is activated, the monitoring unit 24 can update the personal setting data buffer 30 based on the recognition of the change of the occupant and monitor with the updated occupant settings. The setting data can be monitored in accordance with the actual occupant.
[0152] Furthermore, in the setting state where the occupant monitoring unit 26 is stopped, the personal setting data buffer 30 can be updated without being accidentally performed.
[0153] In particular, when the in-vehicle communication unit 29 transmits the setting data for identifying the occupant set in the personal setting data buffer 30 to other electronic devices provided in the automobile 1 in the setting state in which the occupant monitoring unit 26 is activated, if the buffer is updated in the setting state in which the occupant monitoring unit 26 is stopped, there is a possibility that inappropriate setting data may be transmitted to other electronic devices other than the occupant monitoring device 12. In the present embodiment, the transmission of such inappropriate setting data can be prevented.
[0154] The above-mentioned embodiments are examples of preferred embodiments of the present invention, but the present invention is not limited thereto, and various modifications and changes can be made without departing from the gist of the invention.
[0155] For example, in the above-mentioned embodiment, the passenger's entry into the automobile 1 is detected by the closing operation of the door 3. In addition, for example, the passenger's entry into the automobile 1 may be detected by the opening operation of the door 3. In addition, the passenger's entry into the automobile 1 may be detected by the seat sensor of the seat 4 detecting the passenger.
[0156] In the present embodiment, the start of the automobile 1 is detected by turning on the ignition switch of the automobile 1. Alternatively, the start of the automobile 1 may be detected by, for example, operating the accelerator pedal while the automobile is stopped.
Claims
1. An occupant monitoring device, which is installed in a vehicle and monitors an occupant riding in the vehicle, wherein: The occupant monitoring device comprises: an identification unit that identifies a passenger riding in the vehicle and performs a personal identification process to identify the individual of the passenger riding in the vehicle; a buffer for recording setting data and a personal ID of the vehicle corresponding to the occupant identified by the identification unit; a recording unit including identified occupant data for registering the personal ID of the occupant identified by the identification unit; a monitoring unit that performs monitoring processing for determining whether the occupant riding in the vehicle is in a state corresponding to a prescribed monitoring target state based on the setting data of the buffer, thereby monitoring the occupant riding in the vehicle; and a start control unit that starts and stops the recognition unit and the monitoring unit, respectively, based on the start or stop settings set for the recognition unit and the monitoring unit, so that the recognition unit can be started when the monitoring unit is stopped. When the recognition unit is activated in the activation state of the monitoring unit, the personal ID corresponding to the occupant identified by the recognition unit is registered in the identified occupant data of the recording unit, and the setting data of the buffer corresponding to the occupant identified by the recognition unit is updated, When the monitoring unit is activated in a stopped state, the personal ID corresponding to the occupant identified by the identification unit is registered in the identified occupant data of the recording unit, and the updating of the setting data of the buffer is not performed. When the monitoring unit is activated, regardless of the activation / deactivation state of the identification unit, the buffer is updated based on the setting data in the identified passenger data registered in the recording unit, and then the passengers riding in the vehicle are monitored based on the setting data in the buffer.
2. The occupant monitoring device according to claim 1, wherein: When a specific occupant is identified by the identification unit, the monitoring unit monitors the identified occupant based on the updated setting data of the buffer, When the recognition unit fails to recognize a specific passenger, the passenger on the vehicle is monitored without specifying the passenger on the vehicle based on the setting data of the buffer that has not been updated.
3. The occupant monitoring device according to claim 1 or 2, wherein: The activation control unit activates the recognition unit while the monitoring unit is in a stopped state when the boarding of an occupant in the vehicle is detected.
4. The occupant monitoring device according to claim 1 or 2, wherein: The activation control unit activates the recognition unit while the monitoring unit is in a stopped state when the vehicle is activated.
5. The occupant monitoring device according to claim 1 or 2, wherein: The activation control unit activates or stops the recognition unit and the monitoring unit, respectively, based on activation or stop settings set for the recognition unit and the monitoring unit, respectively.
6. The occupant monitoring device according to claim 1 or 2, wherein: The activation control unit activates the monitoring unit while the vehicle is traveling. The recognition unit is activated while the vehicle is parked.
7. The occupant monitoring device according to claim 1 or 2, wherein: The occupant monitoring device includes a communication unit that transmits the setting data set in the buffer to another device provided in the vehicle.
