Vehicle device and method performed by vehicle device

The vehicle hands-free control system efficiently switches connections based on passenger identification and seat priority, enhancing convenience by automatically linking passenger devices and maintaining driver connections.

JP2024159929AActive Publication Date: 2024-11-08JVC KENWOOD CORP

Patent Information

Application Number
JP2024147358
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-29
Publication Date
2024-11-08
Estimated Expiration
2040-12-14

AI Technical Summary

Technical Problem

Existing hands-free vehicle systems fail to automatically switch connections between drivers and passengers efficiently, leading to inconvenience when a different driver takes over or when a passenger needs to use the system.

Method used

A vehicle hands-free control system that uses a camera to identify passengers and determine their boarding positions, enabling automatic connection to their mobile devices via short-range wireless communication, prioritizing connections based on seat positions and maintaining the driver's connection until explicitly disconnected.

Benefits of technology

Enhances passenger convenience by automatically connecting their mobile devices for hands-free functions, ensuring seamless transitions and maintaining driver connections, thus improving overall user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024159929000001_ABST
    Figure 2024159929000001_ABST
Patent Text Reader

Abstract

To improve convenience for a passenger carrying a portable terminal in a vehicle.SOLUTION: A passenger detection unit 113 identifies a passenger on board a vehicle from a video captured by a camera 20 that captures the inside of the cabin of the vehicle, and determines a boarding position of the passenger. A determination unit 114 determines whether or not a mobile terminal 2 of the passenger identified by the passenger detection unit 113 is in a state of connectable by near field communication. In the case where there are multiple mobile terminals 2 that the determination unit 114 determines to be in a state of being connectable by near field communication, a decision unit 115 decides the mobile terminal 2 to be connected by near field communication on the basis of the boarding positions of multiple passengers corresponding to the multiple mobile terminals 2. A communication control unit 116 connects the mobile terminal 2 decided by the decision unit 115 to the vehicle device by near field communication, and continues the connection with a driver's mobile terminal until a predetermined time elapses even in the case where the passenger detection unit 113 becomes unable to identify the driver of the vehicle.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a vehicle device to which an image captured by a camera is input, and a control method executed by the vehicle device. This relates to a method for [Background technology]

[0002] While driving a car, the driver uses a mobile device (mainly a smartphone or feature phone) Holding a mobile phone in your hand and using it for calling, etc. is prohibited by law and ordinance. The mobile terminal and the hands-free device in the vehicle are connected via short-range wireless communication, allowing hands-free communication. Stories and manipulation methods are used.

[0003] Usually, the hands-free device in the vehicle automatically connects to the most recently connected mobile device. Therefore, if a different driver than the previous driver is driving, However, the connection was not automatic, and it was necessary to select the mobile device of the new driver. When a driver is driving without realizing it, they are unable to use the hands-free function, which can be inconvenient. .

[0004] In response to this, a table that associates the user's face information with the identification information of the mobile device is referred to. The system recognizes the driver's face captured by the driver's seat camera and establishes a connection with the mobile device. A method for automatically establishing the driver's seat has been proposed (see, for example, Patent Document 1). In this case, it is not possible to capture the entire interior of the vehicle, including passengers other than the driver. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2008-042577 A Summary of the Invention [Problem to be solved by the invention]

[0006] For example, if the driver temporarily gets off the vehicle, the connection destination of the hands-free device on the vehicle will be It would be convenient to switch from the driver's mobile device to the passenger's mobile device in the passenger seat. .

[0007] The present embodiment has been made in view of the above circumstances, and its object is to provide a vehicle The present invention aims to provide a technology for improving convenience for passengers who carry portable terminals. [Means for solving the problem]

[0008] In order to solve the above problem, a vehicle hands-free control device of a certain aspect of this embodiment includes a passenger detection unit that identifies a passenger in the vehicle from an image captured by a camera that captures the interior of the vehicle cabin and specifies the passenger's seating position, a judgment unit that judges whether a mobile terminal of the passenger identified by the passenger detection unit is in a state where it can be connected via short-range wireless communication, and, when there are multiple mobile terminals that the judgment unit has determined to be in a state where it can be connected via short-range wireless communication, a decision unit that determines a mobile terminal to connect via short-range wireless communication based on the seating positions of multiple passengers specified by multiple pieces of biometric information corresponding to the multiple mobile terminals, and a communication control unit that connects the mobile terminal determined by the decision unit to this hands-free control vehicle device via short-range wireless communication, and continues the connection with the driver's mobile terminal until a predetermined time has elapsed even if the passenger detection unit can no longer identify the driver of the vehicle in a state where the mobile terminal is connected to the mobile terminal of the passenger in the driver's seat of the vehicle via short-range wireless communication.

[0009] Another aspect of the present embodiment is a method executed by a hands-free control device for a vehicle. In this method, the hands-free control device for a vehicle executes the following steps: identifying a passenger who is in the vehicle from an image captured by a camera that captures the interior of the vehicle and specifying the passenger's seating position; judging whether or not the mobile terminal of the identified passenger is in a state where it can be connected by short-range wireless communication; if there are multiple mobile terminals that are determined to be in a state where it can be connected by short-range wireless communication, determining a mobile terminal to be connected by the short-range wireless communication based on the seating positions of multiple passengers specified by multiple pieces of biometric information corresponding to the multiple mobile terminals; and connecting the determined mobile terminal and the hands-free control vehicle device by the short-range wireless communication, and in a state where the mobile terminal of the passenger who is in the driver's seat of the vehicle is connected by the short-range wireless communication, continuing the connection with the mobile terminal of the driver until a predetermined time has elapsed even if the driver of the vehicle cannot be identified.

[0010] Any combination of the above components and the embodiment of the present invention may be used as an apparatus, a method, a system, a recording medium, or the like. Conversion between a recording medium, a computer program, etc. is also included as an aspect of this embodiment. is valid. Effect of the Invention

[0011] According to this embodiment, the convenience of passengers who have mobile terminals in the vehicle is improved. It can be done. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram showing an example of camera installation in a vehicle. [Diagram 2] 1 is a diagram for explaining a configuration example of a vehicular hands-free control system according to an embodiment; [Diagram 3] FIG. 4 is a diagram illustrating an example of a user list held in a user list holding unit. [Figure 4]FIG. 13 is a diagram showing an example of detection of passengers and their positions in a vehicle. [Diagram 5] 4 is a flowchart showing a flow of face authentication processing in the hands-free control device for a vehicle according to the first embodiment. [Figure 6] 10 is a flowchart showing a flow of face authentication processing of the hands-free control device for a vehicle according to the second embodiment. [Figure 7] 10 is a flowchart showing a flow of face authentication processing in a hands-free control device for a vehicle according to a modified example of the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] This embodiment is a system for implementing a hands-free function for a portable terminal carried by a vehicle passenger. The present invention relates to a hands-free control system for a vehicle. The system uses a camera that captures a wide range of images of the interior of the vehicle, including not only the driver's seat but also the passenger seat and rear seats. Use Mela.

[0014] FIG. 1 is a diagram showing an example of installation of a camera 20 in a vehicle C1. The camera 20 is attached to the rearview mirror. By repurposing the camera used in the In-Cabin Monitoring System Alternatively, a camera dedicated to the hands-free control system may be provided.

[0015] FIG. 2 is a diagram illustrating a configuration example of a vehicular hands-free control system 1 according to an embodiment of the present invention. The vehicular hands-free control system 1 includes a vehicular hands-free control device 10, It is equipped with a camera 20, a microphone 30, a speaker 40, a monitor 50 and an operation unit 60.

[0016] The camera 20 captures the image of the inside of the vehicle and outputs the captured image to the vehicle hands-free control device 10. The camera 20 may be a visible light camera or an infrared camera. Alternatively, the camera may be capable of capturing images in both the visible light range and the infrared range.

[0017] The camera 20 includes a lens, an image sensor, and a signal processing circuit. OS (Complementary Metal Oxide Semiconductor) image sensor or CCD (Charge The image sensor can be a 3D (3D-coupled device) image sensor. The infrared light that enters the sensor is converted into an electrical image signal and output to the signal processing circuit. When taking a photograph, an image sensor having sensitivity in the infrared region is used. The video signal input from the The signal is output to the hands-free control device 10.

[0018] The vehicle hands-free control device 10 includes a processing unit 11, a storage unit 12, a wireless communication unit 13, and a vehicle The vehicle hands-free control device 10 may be mounted in a dedicated housing. Car navigation systems, display audio, drive recorders, may be incorporated as one function of the in-vehicle monitoring system.

[0019] The processing unit 11 includes an image recognition unit 111, a registration unit 112, a passenger detection unit 113, and a determination unit 114. , a determination unit 115, a communication control unit 116, and a function control unit 117. The functions of the processing unit 11 are: It can be realized by cooperation of hardware resources and software resources, or by hardware resources alone. The hardware resources are CPU, ROM, RAM, and GPU (Graphics Processing Unit). Unit), DSP (Digital Signal Processor), ISP (Image Signal Processor), AS IC (Application Specific Integrated Circuit), FPGA (Field-Programmable Ga TE Array) and other LSIs can be used. Firmware and other software resources can be used. Programs are available.

[0020] The storage unit 12 is a non-volatile storage device such as a hard disk drive (HDD) or a solid state drive (SSD). The user list holding unit 121 includes a recording medium having a user list. 121 transmits face recognition data of the vehicle occupant and information about the mobile terminal 2 carried by the occupant. The user list is limited to those who have a driver's license. It is possible for a person to register even if he or she does not have a driver's license.

[0021] FIG. 3 is a diagram showing an example of a user list held in the user list holding unit 121. As shown in FIG. The user list shown in Figure 3 links face authentication data and information about the mobile device 2 for each registered user. The information about the mobile terminal 2 is registered as the name and connection status of the mobile terminal 2. The connection status and AV source are registered. Whether music is automatically played, whether video is automatically played, and whether data communication is used or not are registered. The use / non-use of data communication is determined by the vehicular hands-free control device 10 controlling the mobile terminal 2. It specifies whether or not data communication using mobile phone networks (4G / 5G) is to be performed through the service. Example For example, data communication can be used to stream music and video.

[0022] The AV source is the music data or video data when music is played or video is played. For example, the AV source may be a music file stored in the mobile terminal 2. You can also use the files in your car navigation system or on your DVD player. Use radio and TV broadcasts received by the tuner built into Spray Audio. It can also be inserted into car navigation systems and display audio. You can use audio and video files recorded on a CD / DVD.

[0023] In addition, each user can register an in-car environment other than the AV environment. For example, the driver's seat You can also register the seat position when sitting in the passenger seat, the air conditioning status, etc. The air conditioner status can be registered as cooling, heating, fan switching, set temperature, etc. In addition, the position of the side mirrors can be registered as part of the in-car environment.

[0024] Returning to FIG. 2, the image recognition unit 111 recognizes an object in a frame image of a video input from the camera 20. The face of a person is searched for using a classifier for face detection. The dictionary data generated by learning from a large number of images showing the faces of objects is used. For example, Haar-like features, HOG (Histogram of Gradients) features, LBP (Local Binary ry Patterns) features, etc. can be used.

[0025] The registration unit 112 registers the passenger's face authentication data and information about the portable terminal 2 in a user list. A passenger who wishes to register on the user list must do so by operating the control panel 6 while seated in the front seat. Operate 0 to start the registration mode. When the registration mode is started, the registration unit 112 performs image recognition. The identification unit 111 extracts a feature amount of the face area of ​​the passenger detected in the frame image and identifies the passenger. The system then prompts the user to generate facial recognition data to identify the user.

[0026] When the registration unit 112 acquires the face authentication data of the passenger from the image recognition unit 111, The control unit 116 starts a pairing process with the mobile terminal 2 carried by the passenger. The dual-use hands-free control device 10 and the mobile terminal 2 can be connected via short-range wireless communication. For short-distance wireless communication, Bluetooth (registered trademark) and Wi-Fi (registered trademark) can be used. In the following, in this embodiment, an example in which Bluetooth is used is assumed.

[0027] The registration unit 112 receives the profile of the portable terminal 2 from at least one of the speaker 40 and the monitor 50. First, the registration unit 112 instructs the user to turn on the Bluetooth function. The registration unit 112 instructs the communication control unit 116 to transmit the , and transmits a signal (e.g., an advertising packet) to notify the surroundings of its presence. When the mobile terminal 2 scans the signal, the vehicular hands-free system is displayed on the screen of the mobile terminal 2. The control device 10 is displayed as a connectable device on the screen. When the user selects the vehicle hands-free control device 10, the mobile terminal 2 and the vehicle hands-free control device 1 In the pairing process, the encryption of the communication data between the two is performed. The encryption key used for encryption is exchanged.

[0028] When pairing with the portable terminal 2 is completed, the registration unit 112 performs The name and identification information of the portable terminal 2 are obtained. The name of the portable terminal 2 is not obvious to the user. For example, the passenger can easily use the name of the mobile terminal 2. The user account name may be used. If the name entered is difficult to understand, the passenger may edit the name of the portable terminal 2 from the operation unit 60. It can be collected.

[0029] The passenger inputs the above-mentioned connection status setting items from the operation unit 60. The user list storage section links the face recognition data with the name and connection status of the mobile device. The passenger is registered in the user list in 121. In addition, the passenger can change the in-car environment settings as described above. You can also input the information. In that case, each item of the in-car environment will also be linked and registered.

[0030] The passenger detection unit 113 detects passengers in the vehicle C1 from the image input from the camera 20. Specifically, the passenger detection unit 113 recognizes the face of the passenger by the image recognition unit 111. The facial feature data of the passenger detected in the frame image and the multiple The system matches multiple pieces of facial recognition data to identify the passenger's face.

[0031] The passenger detection unit 113 detects the riding position of at least one passenger riding in the vehicle C1. Specifically, the passenger detection unit 113 detects, for each passenger, whether the passenger is in the driver's seat, the passenger seat, Identify whether it is the right rear seat, left rear seat, or rear center seat.

[0032] 4 is a diagram showing an example of detection of passengers and their positions in the vehicle C1. In the image F1, the image recognition unit 111 detects a person in a detection area A1 for a driver's seat passenger. When the face of an object is detected, the image recognition unit 111 recognizes that a passenger is present in the driver's seat. If a person's face is detected within the detection area A2 for passengers in the passenger seat, a passenger is present in the passenger seat. Similarly, the image recognition unit 111 recognizes a person in the detection area A3 for passengers in the right rear seat. If the image recognition unit 111 detects the face of the passenger, it recognizes that there is a passenger in the right rear seat. If a person's face is detected within the detection area A4 for passengers in the left rear seat, a passenger is present in the left rear seat. In addition, the vehicle shown in Fig. 4 does not have a rear center seat. In this case, a detection area for rear center seat passengers is also set.

[0033] Returning to FIG. 2, the determination unit 114 determines whether the face of the passenger identified by the passenger detection unit 113 is associated with the face of the passenger. It is determined whether the mobile terminal 2 connected to the communication system is in a state where it can be connected by short-range wireless communication. If the control unit 116 recognizes the mobile terminal 2 as a connectable device, the determination unit 114 The system determines that the portable terminal 2 is in a connectable state. If the mobile device 2 is not connected, the mobile device 2 is turned off, or the Bluetooth function is disabled, If it is turned off, the determination unit 114 determines that the portable terminal 2 is not in a connectable state. .

[0034] When there are a plurality of portable terminals 2 that the determination unit 114 has determined to be in a connectable state (i.e. In the case where there are multiple passengers, the determination unit 115 determines whether the multiple portable terminals 2 are linked to each other. The mobile terminal to be connected is determined based on the boarding locations of multiple passengers identified by multiple facial recognition data. Specifically, the determination unit 115 determines the last seat in the seat in which the passenger is seated. A mobile device 2 linked to the facial recognition data of the passenger sitting in the highest seat, The mobile terminal 2 to be connected is determined.

[0035] For example, the seat priorities are set as follows: driver's seat: 1, passenger seat: 2, right rear seat: 3, left rear seat: 4. In this example, when the driver gets off the vehicle, the mobile terminal 2 of the passenger sitting in the passenger seat is set. The vehicle hands-free control device 10 is connected to the vehicle hands-free control device 10. The priority of the seats is set For example, if a person with a higher rank sits in the right rear seat, the priority can be changed. You can also set it to :1.

[0036] The wireless communication unit 13 includes an antenna and transmits and receives signals to and from the mobile terminal 2 using a short-distance wireless communication method. The in-vehicle communication unit 14 executes communication processing for connecting to the in-vehicle network 3. Network 3 is CAN (Controller Area Network), LIN (Local Interconnect Network), Ethernet (registered trademark), etc. can be used. Work 3 includes various ECUs (Electronic Control Units) for controlling the engine and auxiliary equipment. For example, the ECU for controlling the seat position is also connected. The vehicle-mounted network 3 also includes a control unit for an air conditioning system in the vehicle C1. can also be connected.

[0037] In the example shown in FIG. 2, a receiver 5b of a wireless key system is connected to the in-vehicle network 3. The receiver 5b receives a wireless key (smart key, intelligent key) carried by the driver. , also called a remote control key, etc.) 5a. It is a machine.

[0038] The communication control unit 116 controls the wireless communication unit 13 to perform pairing processing with the portable terminal 2, It also performs connection / disconnection processing with the connected mobile terminal 2 and manages the paired devices. The communication control unit 116 controls the in-vehicle communication unit 14 to communicate with various Sends and receives control signals between ECU 4 and devices.

[0039] The function control unit 117 controls various functions of the vehicular hands-free control system 1 (for example, The function control unit 117 controls the following functions: free call function, audio playback function, video playback function, etc. It is also possible to control functions within the portable terminal 2 connected via long distance wireless communication.

[0040] The microphone 30 collects sounds within the vehicle C1 and outputs the sounds to the function control unit 117. The microphone 30 can be used for hands-free calling. For example, one may be installed in each of the front and rear seats, or one may be installed in each seat. At least one microphone 30 may be installed in the car navigation system. systems, display audio, drive recorders, or in-vehicle monitoring systems It may be a repurposed microphone.

[0041] The speaker 40 reproduces and outputs the audio data supplied from the function control unit 117. In the embodiment, the speaker 40 can be used for hands-free calling. For example, one may be installed in the front seat and one in the rear seat. Alternatively, the speaker 40 may be installed for each seat. gaming systems, display audio, car audio systems, drive recorders The speaker may be a repurposed speaker from an in-vehicle monitoring system.

[0042] The monitor 50 reproduces and displays the video data supplied from the function control unit 117. The 50 uses LCD displays, OLED displays, mini LED displays, etc. The monitor 50 may be installed in a plurality of locations in the vehicle C1. One may be installed on each seat and rear seat, or one may be installed on each seat. At least one monitor 50 is used for a car navigation system, a display audio The monitor of the vehicle interior monitoring system is repurposed. It is also possible.

[0043] Example 1 FIG. 5 is a flowchart showing a flow of face authentication processing of the hands-free control device 10 for a vehicle according to the first embodiment. The first embodiment is an example in which only the driver is in the vehicle C1. The processing unit 11 acquires an image of the inside of the vehicle taken by the camera 20 (S10). The identification unit 111 identifies the passenger who is in the driver's seat from within the frame image of the acquired video. Detect a face (S11).

[0044] The passenger detection unit 113 detects the facial feature data of the detected passenger and the facial feature data registered in the user list. The face recognition data stored in the user list is compared (S12). If the data does not exist (S13: No), the face recognition process ends. If there is face authentication data that matches the user list (S13: Yes), the determination unit 114 refers to the user list. The mobile terminal 2 associated with the matching face authentication data is identified, and the mobile terminal 2 The communication control unit 116 requests the communication control unit 116 to connect to the

[0045] When the communication control unit 116 receives the request, it checks whether or not there is a currently connected portable terminal 2. If there is a currently connected mobile terminal 2 (S14: Yes), the communication control unit 11 The currently connected mobile terminal 2 is disconnected from the communication with the currently connected mobile terminal 6 (S15). If not (S14: No), the process of step S15 is skipped. The connection is made to the portable terminal 2 requested by the determination unit 114 (S16).

[0046] The determination unit 114 refers to the user list and, if necessary, issues an AV The function control unit 117 receives a request to switch the AV source. The function control unit 117 switches the AV source in response to the request. Acquire audio or video data from a source and output the audio from the speaker 40; Or, the image is displayed on the monitor 50.

[0047] In the example shown in FIG. 3, the registration information for registrant No. 1 is mobile terminal name: AAA, handshake Mobile phone calls: in use, music playback: in use, video playback: not in use, data communication: in use, AV source: mobile The registration information for passenger No. 2 is mobile terminal name: BBB, hands-free calling : In use, Music playback: None, Video playback: Yes, Data communication: Not in use, AV source: TV broadcast It is delivery.

[0048] When the driver is changed from registered user No. 1 to registered user No. 2, the passenger detection unit 113 Facial feature data of the passenger in the driver's seat position in the image and facial recognition data: The determination unit 114 then sends the command to the communication control unit 116 to confirm that the ID matches the mobile terminal AAA0002. After connecting to the mobile terminal BBB, the function control The function control unit 117 switches the AV source from the mobile terminal 2 to the television broadcast. Switches the driver's seat position to the position for registered user No. 2. Function Control The unit 117 switches the settings of the air conditioner to the settings for registrant No. 2.

[0049] The function control unit 117 controls the function of the mobile terminal 2 to which a new connection has been established via the communication control unit 116. For example, the function control unit 117 can control the sound mode of the mobile terminal 2. You can switch the device to silent mode.

[0050] The process of FIG. 5 may be started at any time. For example, The operation starts when power is supplied to the vehicle hands-free control device 10 by starting the vehicle. In addition, during the period when power is supplied to the vehicular hands-free control device 10, The process from step S10 to step S12 is periodically executed to check whether the passenger in the driver's seat position has changed. Detects changes to the

[0051] Example 2 FIG. 6 is a flowchart showing a flow of face authentication processing of the hands-free control device 10 for a vehicle according to the second embodiment. In the following explanation, a vehicle C1 is parked in a parking lot of a store, and the driver Assume that the driver leaves vehicle C1 to enter the store.

[0052] The processing unit 11 acquires an image of the inside of the vehicle cabin captured by the camera 20 (S20). When the unit 111 detects the absence of the driver from the frame image of the acquired video (S21: Yes), and it is determined whether there are faces of other passengers in the image that have not been matched (S23 If there are no other passengers whose faces have not been matched (S23: No), the facial recognition process is terminated. That is, the state in which communication with the portable terminal 2 is possible while driving is maintained.

[0053] If there is a face of another passenger that has not been matched (S23: Yes), the image recognition unit 111 identifies the face of the passenger in the seat with the next highest priority from the image (S24 The passenger detection unit 113 detects the facial features of the identified passenger and the passenger's face registered in the user list. The multiple face recognition data stored are compared (S25).

[0054] If there is no matching face recognition data in the user list (S26: No), The process proceeds to S23, and the image recognition unit 111 recognizes the seat with the next highest priority from within the image. The face of the passenger in the vehicle is identified (S24). For example, the priority of the seats is set as follows: driver's seat: 1, passenger seat: If the settings are 2, right rear seat: 3, and left rear seat: 4, when the driver is absent, the passenger seat →The faces of the passengers are matched in the following order: right rear seat → left rear seat.

[0055] In step S26, if matching face recognition data exists in the user list (S 26: Yes), the determination unit 114 refers to the user list and associates it with the matching face authentication data. The mobile terminal 2 that is connected to the communication control unit 116 is identified, and the communication control unit 116 is caused to connect to the mobile terminal 2. When the communication control unit 116 receives the request, it communicates with the mobile terminal 2 of the currently connected driver. (S27), and connect to the requested mobile terminal 2 (S28). The process of 7 is performed when the driver's mobile terminal 2 is out of the communication range of the short-range wireless communication and the communication is cut off. If the user list is disabled, the process is skipped. The function control unit 117 refers to the user list and Switch to the settings of the authenticated passenger. For example, the passenger sitting in the front passenger seat or the back seat A passenger answers a call from the mobile terminal 2 of the driver outside the vehicle C1 in a hands-free manner. You can answer.

[0056] In addition, when a plurality of microphones 30 are installed in the vehicle C1, the function control unit 117 When a free call is made, the seat to which the passenger who has the newly connected mobile terminal 2 is seated is the first to be connected. The microphone 30 installed in the closest position to the vehicle C1 picks up the voice of the speaker. When a plurality of car radios 40 are installed in the vehicle C1, the function control unit 117 When speaking, the voice of the other person is output from the speaker 40 installed at the position closest to the seat. do.

[0057] The function control unit 117 controls the function of the mobile terminal 2 to which a new connection has been established via the communication control unit 116. For example, the function control unit 117 can control the sound mode of the mobile terminal 2. You can switch the device to silent mode.

[0058] (Modification of the second embodiment) FIG. 7 is a flow of a face authentication process of the vehicular hands-free control device 10 according to a modified example of the second embodiment. In the flowchart shown in FIG. 6, the driver We explained an example of a situation where the driver gets off the train and is absent. In some cases, the driver may need to get out of the vehicle to remove luggage from the trunk. There may be cases where the customer returns immediately.

[0059] In the flowchart of the modification shown in FIG. 7, the following is performed in comparison with the flowchart shown in FIG. Step S22 is added. When the image recognition unit 111 detects that the driver is absent (S21: (Yes), the determination unit 114 determines whether the receiver 5b receives the signal from the wireless key 5a via the in-vehicle communication unit 14. The determination unit 114 determines whether the receiver 5b is a wireless device or not based on the obtained radio wave intensity. The distance between the line key 5a is estimated.

[0060] The determination unit 114 compares the estimated distance to the wireless key 5a with a set value (S22). If the distance to the line key 5a exceeds the set value (S22: Yes), the process proceeds to step S23. 6. If the distance to the wireless key 5a exceeds the set value, the receiver This also includes the case where the key 5b cannot receive radio waves from the wireless key 5a. If the value is equal to or less than the threshold value (S22: No), the mobile terminal 2 to be connected is not switched, and the driver's mobile terminal The mobile terminal 2 maintains a connection thereto.

[0061] In the example shown in FIG. 7, after the absence of the driver is detected, the process of switching the connected mobile terminal 2 is performed. The condition for the activation is that the distance to the wireless key 5a exceeds a set value. In this regard, the condition for triggering the switching process is that a set time has elapsed since the absence of the driver was detected. Also, the AND of both may be used as the trigger condition for the switching process. In addition, the condition for initiating the switching process may be a vehicle hands-free When the distance from the control device 10 to the mobile terminal 2 carried by the driver exceeds a set value, In addition, as a condition for initiating the switching process, the driver may be The distance exceeds a set value and the set time has elapsed since the absence of the driver was detected. The above AND conditions may be used.

[0062] If the driver is unable to drive due to a dead battery, some malfunction, or an operation error in the driver's mobile terminal 2, Even when the driver is seated in a seat, communication between the mobile terminal 2 and the vehicle hands-free control device 10 is possible. In this case, the image recognition unit 111 may not recognize the absence of the driver. If the communication control unit 116 detects that communication with the driver's mobile terminal 2 is not possible, the process proceeds to step S23. The following switching process of the connected mobile terminal 2 may be initiated.

[0063] As described above, according to the present embodiment, a person carrying the portable terminal 2 in the vehicle C1 Specifically, this will improve the convenience of passengers who have previously driven the vehicle, regardless of who was the previous driver. The driver's mobile terminal 2 can be automatically connected without any trouble, reducing the inconvenience. When the driver is replaced, the mobile terminal 2 of the new driver can be automatically connected. Even if the passenger leaves vehicle C1, the mobile phone of the passenger sitting in the next highest priority seat will be It can automatically connect to the terminal 2, and the hands-free function of the vehicle can be effectively used. In addition, face recognition data When registering, the user account name used in the mobile terminal 2 can be automatically entered.

[0064] The present invention has been described above based on the embodiments. These embodiments are merely examples. The fact that various modifications are possible in the combination of each component and each treatment process, and that such modifications It will be appreciated by those skilled in the art that the embodiments are within the scope of the present invention.

[0065] In the embodiment described above, the function control unit 117 newly connects via the communication control unit 116. In the above example, the sound mode of the established portable terminal 2 is switched to silent mode. In this regard, the function control unit 117 controls the functions of the portable terminal 2 detected by the passenger detection unit 113. For example, the function control unit 117 may change the position of the passenger in the driver's seat. The sound mode of the seated passenger's mobile device 2 should be switched to silent mode, and the driver's seat The sound mode of the portable terminal 2 of the passenger sitting elsewhere may be kept set.

[0066] In the above-described embodiment, the image recognition unit 111 recognizes the frame of the image input from the camera 20. In this regard, the face of a person was detected in the frame image. In addition, biometric information other than the face may be used as the subject of authentication. For example, The iris may be used. Also, the passenger may hold the palm of their hand over the camera 20 to capture the image. A fingerprint or vein image captured within the camera may be used as biometric information.

[0067] In the above-described embodiment, the mobile terminal 2 may be a smartphone or a In this regard, the mobile device 2 is a tablet computer without a calling function. This also includes portable music players, portable game consoles, etc. Hands-free function cannot be used. Even in such a case, by connecting with these mobile terminals 2 by short-range wireless communication, The last 2 can be used as an AV source. [Explanation of symbols]

[0068] C1 vehicle, 1 vehicle hands-free control system, 2 mobile terminal, 3 vehicle network network, 4 ECU, 5a wireless key, 5b receiver, 10 vehicle handset Free control device, 11 processing unit, 111 image recognition unit, 112 registration unit, 113 Passenger detection unit, 114 judgment unit, 115 decision unit, 116 communication control unit, 11 7 function control unit, 12 storage unit, 121 user list holding unit, 13 wireless communication unit , 14 In-vehicle communication unit, 20 Camera, 30 Microphone, 40 Speaker, 50 Monitor, 60 control unit.

Claims

1. A hands-free control device for a vehicle, a passenger detection unit that identifies a passenger who is riding in the vehicle from an image captured by a camera that captures an image of the interior of the vehicle and outputs the captured image to the vehicle hands-free control device, and identifies the riding position of the passenger; a determination unit that determines whether or not a portable terminal of the passenger identified by the passenger detection unit is in a state that allows connection via short-range wireless communication; a determination unit that, when there are multiple portable terminals that the determination unit has determined to be in a state where they can be connected via short-range wireless communication, determines a portable terminal to be connected via the short-range wireless communication based on boarding positions of multiple passengers corresponding to the multiple portable terminals; a communication control unit that connects the mobile terminal determined by the determination unit and the vehicle hands-free control device via the short-range wireless communication, and in a state where the mobile terminal is connected to a mobile terminal of a passenger sitting in the driver's seat of the vehicle via the short-range wireless communication, continues the connection with the driver's mobile terminal until a predetermined time has elapsed even if the passenger detection unit is no longer able to identify the driver of the vehicle; A hands-free control device for a vehicle.

2. 2. The hands-free control device for a vehicle according to claim 1, wherein the determination unit determines the portable terminal of a passenger sitting in a seat with the highest priority among the seats in which the passenger is seated in the vehicle as the portable terminal to be connected via the short-range wireless communication.

3. A vehicular hands-free control method executed by a vehicular hands-free control device, comprising: A step of identifying a passenger in the vehicle from an image captured by a camera that captures an image of the interior of the vehicle and outputs the captured image to the vehicle hands-free control device, and specifying a seating position of the passenger; determining whether the mobile terminal of the identified passenger is in a state where it can be connected via short-range wireless communication; determining a mobile terminal to be connected via the short-range wireless communication based on boarding positions of a plurality of passengers corresponding to the plurality of mobile terminals when a plurality of mobile terminals are determined to be in a state connectable via the short-range wireless communication; a step of connecting the determined portable terminal and the vehicle hands-free control device via the short-range wireless communication, and in a state where the determined portable terminal and the portable terminal of a passenger sitting in the driver's seat of the vehicle are connected via the short-range wireless communication, continuing the connection with the portable terminal of the driver until a predetermined time has elapsed even if the driver of the vehicle cannot be identified; is executed.

Citation Information

Patent Citations

  • Apparatus and method for person identification

    JP2009284442A

  • Communication terminal connection management system

    JP2011114741A

  • On-vehicle terminal and communication method

    JP2014004860A

  • Device and method for telephone countermeasure in using telephone during driving

    WO2005069675A1

  • Vehicle-carried apparatus

    JP2008042577A

Cited By

  • Hands-free control device for vehicle and hands-free control method for vehicle

    JP2025120423A