Opening and closing body control device
The opening/closing body control device addresses erroneous vehicle door operations by using a camera and lighting system to ensure valid user gestures are detected within a defined area, enhancing user convenience and reducing malfunctions.
Patent Information
- Application Number
- JP2021023488
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-02-17
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2041-02-17
Smart Images

Figure 0007585852000001 
Figure 0007585852000002 
Figure 0007585852000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an opening / closing member control device. [Background technology]
[0002] Patent Document 1 describes, as an example of an opening / closing body control device, a vehicle window sensor that includes a sensor electrode provided on the window glass of a vehicle and a capacitance detection circuit that detects the capacitance between the sensor electrode and the vehicle body. When a user places their hand on the window glass, in other words, when the vehicle window sensor detects a user operation, it unlocks or opens the door. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2006-213206 A Summary of the Invention [Problem to be solved by the invention]
[0004] The vehicle window sensor as described above has room for improvement in terms of preventing false door operation. [Means for solving the problem]
[0005] The means for solving the above problems and their effects will be described below. The opening / closing body control device that solves the above problem is an opening / closing body control device applied to a vehicle that includes a vehicle body having an opening, an opening / closing body that opens and closes the opening, a drive unit that operates the opening / closing body, and a detection device that detects a user's gesture operation, and includes a position acquisition unit that acquires the position of a portable device held by the user via wireless communication, an operation determination unit that determines whether or not the gesture operation has been performed when the portable device is present in the detection area of the detection device, and an opening / closing body control unit that operates the opening / closing body based on the content of the gesture operation when it is determined that the user has performed the gesture operation.
[0006] The opening / closing body control device configured as described above operates the opening / closing body when both the portable device is present in the detection area and the user is performing a gesture operation. In other words, if the portable device is not present in the detection area, the opening / closing body control device will not operate the opening / closing body even if the user is performing a gesture operation. Therefore, the opening / closing body control device can suppress erroneous operation of the opening / closing body.
[0007] In the above-mentioned opening / closing body control device, it is preferable that the detection device is a camera, the detection area is a shooting area of the camera, and the device is equipped with an area setting unit that sets a recognition area narrower than the shooting area based on the position of the portable device, and the operation determination unit determines whether or not the gesture operation has been performed when the portable device is present in the recognition area.
[0008] The opening / closing body control device having the above configuration sets the recognition area in relation to the current position of the user carrying the portable device. In other words, the opening / closing body control device does not set the recognition area in relation to the vehicle, such as the position in front of the opening / closing body. Therefore, the user can operate the opening / closing body by performing a gesture operation at any position. Therefore, the opening / closing body control device can improve the convenience for the user.
[0009] In the above-mentioned opening / closing body control device, it is preferable that the detection device is a camera, the detection area is a shooting area of the camera, and the operation determination unit determines whether or not the gesture operation is performed while the portable device approaches the vehicle.
[0010] The opening / closing body control device configured as described above operates the opening / closing body when a user carrying the portable device approaches a vehicle while performing a gesture operation. Therefore, even if the opening / closing body control device erroneously determines that the user has performed a gesture operation, the opening / closing body control device will not operate the opening / closing body unless the user is approaching the vehicle. Therefore, the opening / closing body control device can suppress erroneous operation of the opening / closing body.
[0011] In the above-mentioned opening / closing body control device, it is preferable that the opening has a first opening and a second opening which open at different positions on the vehicle body, the opening / closing body has a first opening / closing body which opens and closes the first opening, and a second opening / closing body which opens and closes the second opening, and that the opening / closing body control unit operates the first opening / closing body based on the content of the gesture operation when the portable device is closer to the first opening / closing body than the second opening / closing body, and operates the second opening / closing body based on the content of the gesture operation when the portable device is closer to the second opening / closing body than the first opening / closing body.
[0012] The opening / closing body control device having the above configuration can switch the opening / closing body to be operated depending on the opening / closing body that the user is approaching. In other words, the user does not need to use different gesture operations depending on the opening / closing body to be operated. Therefore, the opening / closing body control device can improve user convenience.
[0013] In the above-mentioned opening / closing body control device, it is preferable that the camera is configured to be able to adjust its orientation, and is equipped with a camera control unit that adjusts the orientation of the camera so that the portable unit is present in the shooting area when the portable unit is not present in the shooting area.
[0014] The opening / closing object control device having the above configuration can set the recognition area from a wider shooting area. In other words, the opening / closing object control device can widen the area in which the user's gesture operation can be detected, compared to when the camera orientation is fixed.
[0015] In the above opening / closing body control device, it is preferable that the vehicle is equipped with a lighting device that illuminates the surroundings of the vehicle, and is further equipped with a lighting control unit that controls the lighting device in accordance with the brightness of the surroundings of the vehicle.
[0016] When the surroundings of the vehicle are dark, the quality of the image captured by the camera is likely to deteriorate. In this regard, the opening / closing body control device having the above-mentioned configuration can illuminate the surroundings of the vehicle using the lighting device, so that the quality of the image captured by the camera is unlikely to deteriorate even when the surroundings of the vehicle are dark. As a result, the opening / closing body control device can suppress erroneous detection of the user's gesture operation. Effect of the Invention
[0017] The opening / closing body control device having the above configuration can suppress malfunction of the opening / closing body. [Brief description of the drawings]
[0018] [Figure 1] 1 is a schematic diagram of a vehicle equipped with a door control device according to a first embodiment. [Diagram 2] FIG. 2 is a block diagram showing a control configuration of the door control device according to the first embodiment. [Diagram 3] 4 is a flowchart illustrating a flow of processing executed by the door control device of the first embodiment. [Figure 4] FIG. 11 is a schematic diagram of a vehicle equipped with a door control device according to a second embodiment. [Diagram 5] FIG. 11 is a block diagram showing a control configuration of a door control device according to a second embodiment. [Figure 6] 10 is a flowchart illustrating a flow of processing executed by a door control device according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0019] (First embodiment) A vehicle equipped with an opening / closing member control device (hereinafter, also referred to as a "door control device") according to a first embodiment will be described with reference to the drawings.
[0020] As shown in Figures 1 and 2, a vehicle 10 includes a vehicle body 20, a door 30, a door drive unit 40, a door lock device 50, a door lock drive unit 60, a camera 70, a lighting device 80, an in-vehicle communication device 90, and a door control device 100.
[0021] As shown in Fig. 1, the vehicle body 20 has a first opening 21 and a second opening 22 that open to the sides, and a third opening 23 that opens to the rear. The first opening 21 is located forward of the second opening 22. The first opening 21 and the second opening 22 are areas through which a user passes when getting on and off the vehicle 10. The third opening 23 is an area through which a user puts and takes out luggage from the luggage compartment. The first opening 21, the second opening 22, and the third opening 23 correspond to examples of "openings".
[0022] The door 30 includes a front door 31 that opens and closes the first opening 21, a rear door 32 that opens and closes the second opening 22, and a back door 33 that opens and closes the third opening 23. The front door 31 is a swing door whose front end is connected to the vehicle body 20 via a hinge (not shown). The front door 31 is displaced between a fully closed position in which the first opening 21 is fully closed and a fully open position in which the first opening 21 is fully opened. The rear door 32 is a slide door supported by a rail (not shown) extending in the front-rear direction. The rear door 32 is displaced between a fully closed position in which the second opening 22 is fully closed and a fully open position in which the second opening 22 is fully opened. The back door 33 is a flip-up door whose upper end is connected to the vehicle body 20 via a hinge (not shown). The back door 33 is displaced between a fully closed position in which the third opening 23 is fully closed and a fully open position in which the third opening 23 is fully opened. The door 30 corresponds to an example of an "opening and closing body."
[0023] As shown in FIG. 2, the door drive unit 40 has a first door drive unit 41 that drives the front door 31, a second door drive unit 42 that drives the rear door 32, and a third door drive unit 43 that drives the back door 33. The first door drive unit 41, the second door drive unit 42, and the third door drive unit 43 are each configured to include, for example, a motor and a transmission mechanism that transmits the power of the motor to the door 30. In the following description, operating the door 30 from the fully closed position toward the fully open position is also referred to as an "opening operation," and operating the door 30 from the fully open position toward the fully closed position is also referred to as a "closing operation." The door drive unit 40 corresponds to an example of a "drive unit."
[0024] As shown in FIG. 1, the door lock device 50 includes a first door lock device 51 that locks the front door 31 to the vehicle body 20, a second door lock device 52 that locks the rear door 32 to the vehicle body 20, and a third door lock device 53 that locks the back door 33 to the vehicle body 20. The first door lock device 51 switches between a locked state in which the front door 31 located in the fully closed position is locked to the vehicle body 20 and an unlocked state in which the front door 31 located in the fully closed position is not locked to the vehicle body 20. The second door lock device 52 switches between a locked state in which the rear door 32 located in the fully closed position is locked to the vehicle body 20 and an unlocked state in which the rear door 32 located in the fully closed position is not locked to the vehicle body 20. The third door lock device 53 switches between a locked state in which the back door 33 located in the fully closed position is locked to the vehicle body 20 and an unlocked state in which the back door 33 located in the fully closed position is not locked to the vehicle body 20.
[0025] 2, the door lock drive unit 60 has a first door lock drive unit 61 that switches the state of the first door lock device 51, a second door lock drive unit 62 that switches the state of the second door lock device 52, and a third door lock drive unit 63 that switches the state of the third door lock device 53. The door lock drive unit 60 includes a motor and a transmission mechanism that transmits the power of the motor to the door lock device 50. In the following description, shifting the door lock device 50 from a locked state to an unlocked state is also referred to as an unlock operation, and shifting the door lock device 50 from an unlocked state to a locked state is also referred to as a lock operation. The door lock drive unit 60 corresponds to an example of a "drive unit."
[0026] The camera 70 has a side camera 71 that captures the area on the side of the vehicle 10, and a back camera 72 that captures the area behind the vehicle 10. The camera 70 is configured to be adjustable in orientation. In other words, the camera 70 can adjust the capture area by changing the orientation. In the following description, as shown in FIG. 1, the area that the camera 70 can capture at present is also referred to as a "first capture area A1," and the area that the camera 70 can capture by adjusting the orientation of the camera 70 is also referred to as a "second capture area A2." In other words, the first capture area A1 is smaller than the second capture area A2. The camera 70 corresponds to an example of a "detection device," and the first capture area A1 corresponds to an example of a "detection area."
[0027] In this embodiment, the side camera 71 is installed in the side mirror, but in other embodiments, the side camera 71 can be installed in the front door 31 and the rear door 32, or installed above the first opening 21 and the second opening 22 in the vehicle body 20. In this embodiment, the rear camera 72 is installed in the back door 33, but in other embodiments, the rear camera 72 can be installed below the third opening 23 in the vehicle body 20. The camera 70 may be a dedicated camera provided for detecting a gesture operation by a user, which will be described later, or may be a camera provided for detecting the surroundings of the vehicle 10. The camera 70 outputs the captured image to the door control device 100.
[0028] The lighting device 80 is a light that illuminates the surroundings of the vehicle 10. It is preferable that the lighting device 80 can illuminate at least the shooting area of the side camera 71 and the shooting area of the rear camera 72. In this regard, it is preferable that the lighting device 80 is installed near the side camera 71 or the rear camera 72.
[0029] The in-vehicle communication device 90 has a first antenna 91 and a first communication control unit 92. The portable device 200 that communicates with the in-vehicle communication device 90 has a second antenna 201 and a second communication control unit 202. The in-vehicle communication device 90 is a communication device mounted on a vehicle, and the portable device 200 is a communication device carried by a user. In other words, the portable device 200 is an electronic key for the vehicle 10, a smartphone, or the like. The portable device 200 may be a wearable device such as a smart watch.
[0030] The first antenna 91 includes an antenna for transmitting signals in the LF (Low Frequency) band, an antenna for receiving signals in the UHF (Ultra High Frequency) band, and an antenna for transmitting and receiving signals in the UWB (Ultra Wide Band) band. It is preferable that two or more first antennas 91 are installed at different locations on the vehicle body 20. The second antenna 201 includes an antenna for receiving signals in the LF band, an antenna for transmitting signals in the UHF band, and an antenna for transmitting and receiving signals in the UWB band.
[0031] The first communication control unit 92 and the second communication control unit 202 mutually authenticate each other by transmitting and receiving signals to each other. The authentication method will be briefly described below. The first communication control unit 92 transmits an LF band signal including information for identifying the in-vehicle communication device 90 from the first antenna 91 at a predetermined control cycle. When the second communication control unit 202 receives the LF band signal transmitted from the first antenna 91, it analyzes the signal. Then, if the received signal includes information indicating that the in-vehicle communication device 90 is mounted on the vehicle 10 linked to the portable device 200, the second communication control unit 202 authenticates the in-vehicle communication device 90. After authenticating the in-vehicle communication device 90, the second communication control unit 202 transmits a UHF band signal including information for identifying the portable device 200 from the second antenna 201. When the first communication control unit 92 receives the UHF band signal transmitted from the second antenna 201, it analyzes the signal. Then, if the received signal contains information indicating that the portable device 200 is linked to the in-vehicle communication device 90, the first communication control unit 92 authenticates the portable device 200. In this manner, the in-vehicle communication device 90 and the portable device 200 perform mutual authentication. In the following description, the area in which the in-vehicle communication device 90 and the portable device 200 perform mutual authentication is also referred to as a "mutual authentication area." In this embodiment, the mutual authentication area is an area larger than the second imaging area A2.
[0032] Moreover, the first communication control unit 92 estimates the position of the portable device 200 by transmitting and receiving signals to and from the second communication control unit 202. The position estimation method will be briefly described below. The first communication control unit 92 transmits a UWB band signal from the first antenna 91. Next, when the second communication control unit 202 receives the UWB band signal from the first antenna 91, it transmits the UWB band signal from the second antenna 201. After that, the first communication control unit 92 receives the UWB band signal from the second antenna 201. The first communication control unit 92 transmits and receives the above-mentioned signal in relation to the multiple first antennas 91 installed in the vehicle 10. Finally, the first communication control unit 92 estimates the position of the portable device 200 based on a signal arrival time, which is the time it takes to transmit and receive a signal, and a signal arrival direction, which is the direction in which the signal is received.
[0033] The door control device 100 will be described in detail below. 2, the door control device 100 includes a position acquisition unit 101, a camera control unit 102, a lighting control unit 103, an area setting unit 104, an operation determination unit 105, and a door control unit 106. In this embodiment, the door control unit 106 corresponds to an example of an "opening / closing body control unit."
[0034] The position acquisition unit 101 acquires the position of the portable device 200 by causing the in-vehicle communication device 90 and the portable device 200 to communicate with each other. In other words, the position acquisition unit 101 acquires the position of the user who carries the portable device 200 by wireless communication.
[0035] The camera control unit 102 adjusts the orientation of the camera 70. More specifically, when the portable device 200 is located outside the first photographing area A1 but within the second photographing area A2, the camera control unit 102 adjusts the orientation of the camera 70 so that the portable device 200 fits within the first photographing area A1. Even if the portable device 200 fits within the first photographing area A1, if the portable device 200 is located at the edge of the first photographing area A1, the camera control unit 102 may adjust the orientation of the camera 70 so that the portable device 200 is located at the center of the first photographing area A1.
[0036] The lighting control unit 103 controls the on / off of the lighting device 80 when the vehicle 10 is stopped and the camera 70 is activated. In detail, the lighting control unit 103 turns on the lighting device 80 when the surroundings of the vehicle 10 are dark enough to be unsuitable for the camera 70 to take an image, and turns off the lighting device 80 when the surroundings of the vehicle 10 are bright enough not to affect the image taking by the camera 70. The lighting control unit 103 may switch the lighting device 80 on and off according to the time period, for example, based on the times of sunrise and sunset. In addition, when the vehicle 10 is equipped with an illuminance sensor, the lighting control unit 103 may switch the lighting device 80 on and off based on the detection result of the illuminance sensor.
[0037] The area setting unit 104 sets a recognition area A3 narrower than the first photographing area A1 based on the position of the portable device 200. The recognition area A3 is preferably an area including the user who carries the portable device 200. For this reason, the recognition area A3 may be, for example, a circular area with a radius of about 50 cm centered on the position of the portable device 200. In other embodiments, the recognition area A3 may be an elliptical area or a rectangular area.
[0038] The operation determination unit 105 determines whether or not the user has performed a gesture operation set in advance within the recognition area A3, based on an image captured by the camera 70. The gesture operation is performed by the user moving a part of the body, such as the foot or hand. For example, a gesture operation using the user's foot is an action in which the user shakes the toe around the heel. Also, a gesture operation using the user's hand is an action in which the user raises or waves the hand.
[0039] In detail, the operation determination unit 105 performs a specification process for specifying a part of the user's body used in the gesture operation, and a determination process for determining whether or not the specified part of the user's body has made a movement corresponding to the gesture operation. In the specification process, the operation determination unit 105 may specify the part of the user's body using a trained model obtained by machine learning. Here, the trained model is a trained model obtained by machine learning using teacher data in which an image captured in advance is associated with a part of the user's body. In addition, in the determination process, the operation determination unit 105 may use optical flow to determine whether or not the movement of the specified part of the user's body matches the gesture operation.
[0040] When it is determined that the user has performed a gesture operation, the door control unit 106 operates the door 30. The operation of the door 30 includes locking the door 30, unlocking the door 30, closing the door 30, and opening the door 30. The door control unit 106 also operates the door 30 when a switch provided on the driver's seat and the door 30 is operated and when a switch provided on the portable device 200 is operated.
[0041] The door control unit 106 determines the door 30 to be operated according to the position of the user who performs the gesture operation. When the user performs the gesture operation in the first photographing area A1 on the right side of the vehicle 10, the door control unit 106 operates one of the right front door 31 and the right rear door 32. More specifically, the door control unit 106 operates the door that the user is closest to among the right front door 31 and the right rear door 32. Similarly, when the user performs the gesture operation in the first photographing area A1 on the left side of the vehicle 10, the door control unit 106 operates one of the left front door 31 and the left rear door 32. More specifically, the door control unit 106 operates the door that the user is closest to among the left front door 31 and the left rear door 32. When the user performs the gesture operation in the first photographing area A1 on the rear side of the vehicle 10, the door control unit 106 operates the back door 33. In this way, when the user performs a gesture operation, the door control unit 106 operates the door that the user is closest to among the five doors. In this embodiment, the front door 31 and the rear door 32 correspond to an example of the "first opening / closing body and the second opening / closing body", respectively.
[0042] When the user performs a gesture operation, the door control unit 106 may only unlock a specific door, or may unlock and open the specific door. In particular, the front door 31 and the back door 33 may be within the operation range of the door, where a user performing a gesture may be present. For this reason, it is preferable that the door control unit 106 restricts the operation of the front door 31 and the back door 33 when the portable device 200 is present within the operation range of the front door 31 and the back door 33. For example, it is preferable that the door control unit 106 unlocks the front door 31 and the back door 33 but does not open or close the front door 31 and the back door 33.
[0043] In another embodiment, the door control unit 106 may determine the door 30 to be operated depending on the contents of the gesture operation performed by the user. Furthermore, the door control unit 106 may limit the door 30 to be operated when the user performs a gesture operation to the front door 31 or the rear door 32. Furthermore, the door control unit 106 may be configured so that the user can appropriately set the correspondence between the gesture operation, the door 30 to be operated, and the operation contents.
[0044] Next, a flow of processing performed by the door control device 100 when a user attempts to operate a specific door of the stopped vehicle 10 will be described with reference to the flowchart shown in Fig. 3. This processing is performed after mutual authentication between the in-vehicle communication device 90 and the portable device 200 is completed.
[0045] 3, the door control device 100 acquires the position of the portable device 200 by transmitting and receiving a UWB band signal between the in-vehicle communication device 90 and the portable device 200 (S11). After that, the door control device 100 determines whether or not the portable device 200 is present in the second photographing area A2 (S12). If the portable device 200 is not present in the second photographing area A2 (S12: NO), in other words, if the user carrying the portable device 200 is not present near the vehicle 10, the door control device 100 temporarily ends this process.
[0046] On the other hand, when the portable device 200 is present in the second photographing area A2 (S12: YES), in other words, when the user carrying the portable device 200 is present near the vehicle 10, the door control device 100 activates the camera 70 (S13). At this time, if the surroundings of the vehicle 10 are too dark for photographing by the camera 70, it is preferable that the door control device 100 turns on the lighting device 80.
[0047] After that, the door control device 100 acquires the position of the portable device 200 (S14). Then, the door control device 100 judges whether or not the portable device 200 is present in the first photographing area A1 (S15). If the portable device 200 is present in the first photographing area A1 (S15: YES), the door control device 100 shifts the process to step S17. On the other hand, if the portable device 200 is not present in the first photographing area A1 (S15: NO), the door control device 100 adjusts the orientation of the camera 70 so that the portable device 200 fits in the first photographing area A1 (S16). After that, the door control device 100 shifts the process to step S17.
[0048] Next, the door control device 100 sets a recognition area A3 based on the position of the portable device 200 (S17). For the door control device 100, setting the recognition area A3 means that a user's gesture operation is detectable. Therefore, the door control device 100 may notify the user that the state has shifted to a state where the user's gesture operation is detectable. Examples of a notification method include vibrating the portable device 200 or outputting a sound from the portable device 200.
[0049] Then, the door control device 100 judges whether or not a user gesture operation has been detected in the recognition area A3 (S18). If a user gesture operation has been detected (S18: YES), the door control device 100 operates the door 30 to be operated (S19). After that, the door control device 100 stops the camera 70 (S20) and ends this process.
[0050] In step S18, if the gesture operation cannot be detected (S18: NO), the door control device 100 judges whether the portable device 200 is present in the second photographing area A2 (S21). If the portable device 200 is present in the second photographing area A2 (S21: YES), in other words, if the user carrying the portable device 200 has moved around the vehicle 10, the door control device 100 shifts the process to step S14. On the other hand, if the portable device 200 is not present in the second photographing area A2 (S21: NO), in other words, if the user carrying the portable device 200 has left the vehicle 10, the door control device 100 stops the camera 70 (S22) and ends this process.
[0051] The operation of this embodiment will be described. As shown in Fig. 1, a user who wishes to open the front door 31 approaches the front door 31 while holding the portable device 200. The user then performs a predetermined gesture operation. Then, the front door 31 is unlocked and then opened. At this time, the user only needs to perform the gesture operation within the shooting area of the side camera 71, and does not need to perform the gesture operation, for example, in front of the front door 31.
[0052] The effects of the first embodiment will be described. (1) The door control device 100 operates the door 30 when both the portable device 200 is present in the first photographing area A1 and the user is performing a gesture operation. In other words, if the portable device 200 is not present in the first photographing area A1, the door control device 100 does not operate the door 30 even if the user is performing a gesture operation. Therefore, the door control device 100 can suppress the operation of the door 30 based on the gesture operation of a user who does not carry the portable device 200. In addition, the door control device 100 can suppress the operation of the door 30 when the gesture operation is erroneously determined due to, for example, the movement of an object other than the user around the vehicle 10. Therefore, the door control device 100 can suppress the erroneous operation of the door 30.
[0053] (2) The door control device 100 sets the recognition area A3 in relation to the current position of the user carrying the portable device 200. In other words, the door control device 100 does not set the recognition area A3 in relation to the vehicle 10, such as a position in front of the door 30. Therefore, the user can operate the door 30 by performing a gesture operation at any position. Therefore, the door control device 100 can improve the user's convenience. In addition, the door control device 100 determines whether or not the user's gesture operation has been performed in the narrow recognition area A3, not in a wide shooting area. Therefore, the door control device 100 can reduce the risk of erroneously detecting the user's gesture operation.
[0054] (3) The door control device 100 can switch the door 30 to be operated depending on the door 30 the user is approaching. In other words, the user does not need to use different gesture operations depending on the door 30 to be operated. Therefore, the door control device 100 can improve user convenience.
[0055] (4) The door control device 100 adjusts the orientation of the camera 70. As a result, the door control device 100 can set the recognition area A3 from a wider shooting area. In other words, the door control device 100 can widen the area in which the user's gesture operation can be detected, compared to when the orientation of the camera 70 is fixed.
[0056] (5) When the surroundings of the vehicle 10 are dark, the quality of the image captured by the camera 70 is likely to deteriorate. In this regard, the door control device 100 can illuminate the surroundings of the vehicle 10 using the lighting device 80, so that even if the surroundings of the vehicle 10 are dark, the quality of the image captured by the camera 70 is unlikely to deteriorate. As a result, the door control device 100 can suppress erroneous detection of a gesture operation by the user.
[0057] Second embodiment Hereinafter, a door control device 100A according to the second embodiment will be described with reference to the drawings. In the second embodiment, the same reference numerals are used for the components common to the first embodiment, and the description thereof will be omitted. The door control device 100A according to the second embodiment differs from the first embodiment in that it does not include a camera control unit 102 and an area setting unit 104. In addition, the processing contents of the operation determination unit 105A are different.
[0058] As shown in FIGS. 4 and 5, the door control device 100A includes a position acquisition unit 101, a lighting control unit 103, an operation determination unit 105A, and a door control unit . In the second embodiment, the operation determination unit 105A determines whether the portable device 200 approaches the vehicle 10 over time based on the position of the portable device 200 acquired by the position acquisition unit 101. Then, the operation determination unit 105A determines whether the user has performed a gesture operation while the portable device 200 approaches the vehicle 10. The gesture operation performed by the user is a gesture operation that can be performed while walking. As an example, the gesture operation is an action of maintaining one hand in a raised state or maintaining a clenched hand. From the above, the operation determination unit 105A determines whether a part of the user's body that is the target of the gesture operation moves only in the moving direction of the portable device 200, thereby determining whether the user has performed a gesture operation while the portable device 200 approaches the vehicle 10.
[0059] The operation determination unit 105A may specify the position of the user's hand by using, for example, a trained model obtained by machine learning. Here, the trained model is a trained model obtained by machine learning using teacher data in which images captured in advance are associated with parts of the user's body.
[0060] In the second embodiment, the orientation of the camera 70 cannot be adjusted. For this reason, the fixed imaging area is referred to as the "first imaging area A1." Next, a flow of processing performed by the door control device 100A when a user attempts to operate the door 30 of the stopped vehicle 10 will be described with reference to the flowchart shown in Fig. 6. This processing is performed after mutual authentication between the in-vehicle communication device 90 and the portable device 200 is completed.
[0061] As shown in FIG. 2, the door control device 100A acquires the position of the portable device 200 by transmitting and receiving a UWB band signal between the in-vehicle communication device 90 and the portable device 200 (S11). After that, the door control device 100A judges whether the portable device 200 is present in the first photographing area A1 (S12). If the portable device 200 is not present in the first photographing area A1 (S12: NO), in other words, if the user carrying the portable device 200 is not present near the vehicle 10, the door control device 100A temporarily ends this process. On the other hand, if the portable device 200 is present in the first photographing area A1 (S12: YES), in other words, if the user carrying the portable device 200 is present near the vehicle 10, the door control device 100A activates the camera 70 (S13). At this time, if the surroundings of the vehicle 10 are dark enough not to be suitable for photographing by the camera 70, it is preferable that the door control device 100A turns on the lighting device 80.
[0062] The door control device 100A judges whether or not a gesture operation by the user has been detected (S14). If the gesture operation cannot be detected (S14: NO), the door control device 100A waits until the gesture operation can be detected. On the other hand, if the gesture operation can be detected (S14: YES), the door control device 100A acquires the position of the portable device 200 (S15). After that, the door control device 100A judges again whether or not a gesture operation by the user has been detected (S16).
[0063] When the gesture operation cannot be continuously detected (S16: NO), the door control device 100A shifts the process to step S14. On the other hand, when the gesture operation can be continuously detected (S16: YES), the door control device 100A acquires the position of the portable device 200 (S17). Then, the door control device 100A determines whether the movement amount MV of the portable device 200 after the step S14 is determined to be positive is equal to or larger than a movement amount determination value MVth (S18).
[0064] Here, the movement amount MV is an amount indicating how close the user carrying the portable device 200 is to the vehicle 10 when performing a gesture operation. In addition, the movement amount determination value MVth is preferably set in advance to, for example, between several tens of centimeters and several meters. When the movement amount determination value MVth is set small, the user only needs to approach the vehicle 10 when performing a gesture operation, which improves user convenience. On the other hand, when the movement amount determination value MVth is set large, the user only needs to approach the vehicle 10 when performing a gesture operation, which improves the accuracy of determination of the gesture operation. In addition, the movement amount MV takes a positive value when approaching the vehicle 10, and takes a negative value when moving away from the vehicle 10.
[0065] If the user's movement amount MV is less than the movement amount judgment value MVth, the door control device 100A proceeds to step S16. However, if the movement amount MV shows a decreasing tendency, that is, if the user leaves the vehicle 10, the door control device 100A preferably ends this process. On the other hand, if the user's movement amount MV is equal to or greater than the movement amount judgment value MVth, the door control device 100A operates the door 30 to be operated (S19). Thereafter, the door control device 100A stops the camera 70 (S20) and ends this process.
[0066] The operation of this embodiment will be described. 1, a user who intends to open the front door 31 approaches the front door 31 while holding the portable device 200 and performing a gesture operation. Then, the front door 31 is unlocked and then opened.
[0067] The following describes the effects of the second embodiment. In addition to the effects (1) and (3) of the first embodiment, the second embodiment can provide the following effects. (6) The door control device 100A operates the door 30 when the user carrying the portable device 200 approaches the vehicle 10 while performing a gesture operation. Therefore, even if the door control device 100A erroneously determines that the user has performed a gesture operation, the door control device 100A does not operate the door 30 unless the user is approaching the vehicle 10. Therefore, the door control device 100A can suppress erroneous operation of the door 30.
[0068] This embodiment can be modified as follows: This embodiment and the following modifications can be combined with each other to the extent that there is no technical contradiction. The door control device 100, 100A may start up the camera 70 after the mutual authentication between the in-vehicle communication device 90 and the portable device 200 is completed.
[0069] The door control device 100, 100A may determine whether the portable device 200 is approaching the vehicle 10 based on a change in the position of the portable device 200 over time. The door control device 100 may operate the door 30 when it is determined that the user has performed a gesture operation after the portable device 200 has approached the vehicle 10. The door control device 100 may also operate the door 30 when the portable device 200 approaches the vehicle 10 after it is determined that the user has performed a gesture operation. In other words, the determination of the approach of the portable device 200 to the vehicle 10 and the determination of the user's gesture may be made at different timings.
[0070] When the door control device 100A determines whether the user has performed a gesture operation after determining that the portable device 200 is approaching the vehicle 10, for example, an electrostatic sensor installed on the window glass of the door 30 can be used as a "detection device". In this case, the door control device 100A operates the door 30 when the portable device 200 approaches the vehicle 10 and the electrostatic capacitance value of the electrostatic sensor changes in a predetermined manner. In other words, even if the electrostatic capacitance value of the electrostatic sensor changes in a predetermined manner due to raindrops adhering to the window glass of the door 30, the door control device 100A does not operate the door 30 unless the portable device 200 approaches the vehicle 10. Therefore, the door control device 100A can reduce the risk of erroneously operating the door 30 compared to a case where the operation of the door 30 is determined using only the electrostatic sensor. In this case, the detection area of the electrostatic sensor refers to the position of the user when a part of the body such as a hand can be brought close to the electrostatic sensor.
[0071] In the second embodiment, the door control device 100A may determine the door 30 to be operated based on the approaching direction of the portable device 200 with respect to the vehicle 10. For example, when the front door 31 is present in the approaching direction of the portable device 200, the door control device 100A may determine the door 30 to be operated as the front door 31, and when the rear door 32 is present in the approaching direction of the portable device 200, the door control device 100A may determine the door 30 to be operated as the rear door 32. According to this, in a situation where the user is approaching the front door 31 and performs a gesture at a position closer to the back door 33 than the front door 31, the door control device 100A can operate the front door 31.
[0072] In the second embodiment, the door control device 100A may predict the user's path based on the approaching direction of the portable device 200 relative to the vehicle 10. In this case, the door control device 100A may limit the opening operation of the front door 31 when the predicted path of the user and the operation trajectory during the opening operation of the front door 31 intersect.
[0073] The first communication control unit 92 and the second communication control unit 202 may perform mutual authentication using Wi-Fi and Bluetooth (registered trademark). The first communication control unit 92 and the second communication control unit 202 may measure the distance between the in-vehicle communication device 90 and the portable device 200 using BLE (Bluetooth Low Energy).
[0074] The lighting device 80 may be a headlight, a backlight, a room light, or the like that is provided in the vehicle 10. The door 30 to be operated may be another opening / closing body of the vehicle 10. For example, the opening / closing body may be a window glass of the door 30, a sunroof panel, or a fuel lid.
[0075] The door control device 100, 100A and the communication control unit 92, 202 may be configured as a circuit including one or more processors operating according to a computer program (software), one or more dedicated hardware circuits such as dedicated hardware (application specific integrated circuit: ASIC) that executes at least some of the various processes, or a combination of these. The processor includes a CPU and memory such as RAM and ROM, and the memory stores program code or instructions configured to cause the CPU to execute processes. The memory, i.e., the storage medium, includes any available medium accessible by a general-purpose or dedicated computer. [Explanation of symbols]
[0076] 10. Vehicle 20…Body 21~23…Opening 30…Door 31...Front door (an example of an opening and closing body) 32...Rear door (an example of an opening and closing body) 33...Back door (an example of an opening and closing body) 40(41~43)…Door drive unit 50(51~53)…Door lock device 60(61~63)…Door lock drive unit 70(71,72)…Camera 80…Lighting equipment 90…In-vehicle communication device 100,100A...Door control device 101...Position acquisition unit 102...Camera control unit 103...Lighting control unit 104...Area setting section 105,105A...Operation judgment section 106...Door control unit 200…Portable device A1: First photography area A2: Second photography area A3…Recognition area
Claims
1. An opening / closing body control device that is applied to a vehicle including a vehicle body having an opening, an opening / closing body that opens and closes the opening, a drive unit that operates the opening / closing body, and a detection device that detects a gesture operation of a user, a location acquisition unit that acquires a location of a portable device carried by the user through wireless communication; an operation determination unit that determines whether or not the gesture operation has been performed in a situation where the portable device is present in a detection area of the detection device; an opening / closing body control unit that operates the opening / closing body based on the content of the gesture operation when it is determined that the user has performed the gesture operation, The detection device is a camera, and the detection area is a photographing area of the camera, The operation determination unit determines whether the gesture operation is performed while the portable device is approaching the vehicle. Opening and closing body control device.
2. An opening / closing body control device applied to a vehicle including a vehicle body having an opening, an opening / closing body that opens and closes the opening, a drive unit that operates the opening / closing body, and a detection device that detects a user's gesture operation, a location acquisition unit that acquires a location of a portable device carried by the user through wireless communication; an operation determination unit that determines whether or not the gesture operation has been performed in a situation where the portable device is present in a detection area of the detection device; an opening / closing body control unit that operates the opening / closing body based on the content of the gesture operation when it is determined that the user has performed the gesture operation, The detection device is a camera, and the detection area is a photographing area of the camera, an area setting unit that sets a recognition area narrower than the photographing area based on a position of the portable device; the operation determination unit determines whether or not the gesture operation has been performed in a situation where the portable device is present in the recognition area, The camera is configured to be adjustable in orientation, a camera control unit that adjusts the orientation of the camera when the portable device is not present in the photographing area so that the portable device is present in the photographing area; Opening and closing body control device.
3. The opening includes a first opening and a second opening that open at different positions in the vehicle body, The opening / closing body includes a first opening / closing body that opens and closes the first opening, and a second opening / closing body that opens and closes the second opening, The opening / closing body control unit operates the first opening / closing body based on the content of the gesture operation when the portable device is closer to the first opening / closing body than the second opening / closing body, and operates the second opening / closing body based on the content of the gesture operation when the portable device is closer to the second opening / closing body than the first opening / closing body. The opening / closing member control device according to claim 1 or 2.
4. The vehicle is equipped with a lighting device that illuminates a surrounding area of the vehicle, A lighting control unit that controls the lighting device in accordance with the brightness of the surroundings of the vehicle. The opening / closing member control device according to any one of claims 1 to 3.
Citation Information
Patent Citations
Window sensor for vehicle
JP2006213206A
Image display system
JP2012121384A
Smart entry system
JP2012172367A
Device and method for opening gate of vehicle by using camera
JP2016196798A
Automobile trunk opening device and method, and recording medium recording program for executing this method
JP2017512268A
