Personal Information System

The personal information system uses facial recognition and usage history to automatically adjust vehicle equipment settings to match occupant preferences, addressing the inefficiency of manual input and improving service alignment.

JP7593266B2Active Publication Date: 2024-12-03DENSO CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2021132926
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-08-17
Publication Date
2024-12-03
Estimated Expiration
2041-08-17

AI Technical Summary

Technical Problem

Existing systems require time and effort for inputting personal information, making it difficult to provide vehicle equipment services that match occupant preferences.

Method used

A personal information system that utilizes facial images and usage history to identify occupants, store personal information, and control vehicle equipment to provide services matching their characteristics, eliminating the need for manual input.

Benefits of technology

Saves effort in inputting personal information and ensures vehicle equipment services align with occupant preferences, enhancing service reliability and personalization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007593266000001
    Figure 0007593266000001
  • Figure 0007593266000002
    Figure 0007593266000002
  • Figure 0007593266000003
    Figure 0007593266000003
Patent Text Reader

Abstract

To provide a personal information system which facilitates the acquisition of useful personal information and makes it possible to enjoy vehicle equipment's services appropriate to the characteristics of an occupant.SOLUTION: A personal information system which utilizes personal information, comprises: an acquisition unit 110 which identifies an occupant of a vehicle and acquires the state of the occupant; a storage unit 20 which stores use history information about vehicle equipment 10 and occupant state information acquired by the acquisition unit; a personal storage unit 120 which is set for each occupant, and which acquires, for each occupant, the use history information and the state information as the personal information from the storage unit, and successively stores them; and a control unit 130 which utilizes the personal information in the personal storage unit and performs control in the actuation of the vehicle equipment such that services appropriate to the characteristics of each occupant are provided.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to personal information systems. [Background technology]

[0002] The in-vehicle device control system of Patent Document 1 is designed to control (automatically adjust) in-vehicle devices targeted at vehicle occupants.

[0003] Specifically, the passengers transmit their boarding status (who has boarded) from their mobile terminals to the passenger identification system. The personal information list also stores in advance each individual's preferences (for example, preferring a higher air conditioner temperature) as personal information. The access policy list also has in advance the priority order of passengers (ranking data indicating whose preferred information is to be applied first).

[0004] The in-vehicle equipment automatic adjustment system determines and operates the setting conditions of each in-vehicle equipment so as to meet the preferences of the occupant with high priority, taking into consideration the priority of the occupants, based on the information in the personal information list and the access policy list. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2006-82691 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, for example, when setting up a new account and utilizing the personal information of a passenger, the technology of Patent Document 1 mentioned above requires time-consuming input of the personal information, and the personal information to be input tends to be common (name, height, weight, age, etc.), making it difficult to receive useful services from the vehicle equipment.

[0007] An object of the present disclosure is to provide a personal information system that makes it easy to obtain useful personal information and enables occupants to enjoy services of vehicle equipment that suit their characteristics. [Means for solving the problem]

[0008] In order to achieve the above object, the present disclosure employs the following technical means.

[0009] The present disclosure provides a personal information system that utilizes personal information, Based on face image An acquisition unit (110) for identifying a vehicle occupant and acquiring the status of the occupant, and a usage history information of the vehicle device (10) and 、 Crew Occupant identification information A storage unit (20) for storing state information; Based on the identification information of the occupants, The vehicle control system includes a personal storage unit (120) that is set for each occupant, and that retrieves usage history information and status information for each occupant from the storage unit as personal information and stores them sequentially, and a control unit (130) that utilizes the personal information in the personal storage unit to control the provision of services suited to the characteristics of each occupant when operating vehicle equipment, The control unit When an account for operating a vehicle device is generated by a vehicle occupant to operate the vehicle device, The system is characterized by linking personal information to an account set up for each occupant when operating vehicle equipment, and by identifying the target person for the provision of services based on the account.

[0010] According to this disclosure, the personal information of the occupant is sequentially stored in the personal storage unit from the storage unit, which in particular saves the occupant the trouble of inputting the personal information. In addition, the personal information is information corresponding to the characteristics of each occupant based on the usage history information of the vehicle equipment, so that the information can include the characteristics and preferences of each occupant, and it is possible to provide services by the vehicle equipment that are suitable for each occupant.

[0011] The reference characters in parentheses for each of the above means indicate the corresponding relationship with the specific means described in the embodiments below. [Brief description of the drawings]

[0012] [Figure 1] 1 is an explanatory diagram showing an overall configuration of a personal information system according to a first embodiment; [Diagram 2] FIG. 13 is an explanatory diagram showing an overall configuration of a personal information system in a modified example of the first embodiment. [Diagram 3] FIG. 11 is an explanatory diagram showing the overall configuration of a personal information system according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, a number of embodiments for carrying out the present disclosure will be described with reference to the drawings. In each embodiment, the same reference numerals may be used to designate parts corresponding to matters described in the preceding embodiment, and duplicated descriptions may be omitted. In each embodiment, when only a part of the configuration is described, other embodiments described previously may be applied to other parts of the configuration. In addition to combinations of parts that are specifically indicated as being possible in each embodiment, it is also possible to partially combine embodiments even if not indicated, as long as there is no particular problem with the combination.

[0014] (First embodiment) A personal information system 100 according to a first embodiment will be described with reference to Fig. 1. The personal information system 100 utilizes personal information of a vehicle occupant to operate various vehicle devices 10 in a vehicle system mounted on the vehicle (execute provision of services by the vehicle devices 10) in accordance with the characteristics and preferences (properties) of the occupant.

[0015] The occupants of a vehicle may be, for example, the driver of the vehicle alone, or the driver and one or more passengers. The occupants belong to a community formed among family members, friends, acquaintances with common interests, etc. Various types of communities can be set, as described later.

[0016] The various vehicle devices 10 include, for example, an air conditioner, an audio device, an information device, and an automatic driving device. The air conditioner controls the air temperature and the amount of air blown inside the vehicle. The audio device plays videos and music. The information device presents various information (lifestyle information, knowledge information, etc.). The automatic driving device provides the driver with semi-automatic or fully automatic driving assistance regarding vehicle speed, vehicle distance, driving lane setting, etc.

[0017] Each vehicle device 10 has a storage unit 20 that stores various data related to control conditions such as operation input conditions and operation output conditions from the occupant, and occupant status information acquired by an acquisition unit 110 described later. The storage unit 20 includes, for example, a cloud storage unit 21 formed on the Internet, a terminal storage unit 22 of a portable terminal device (terminal device of the present disclosure) carried by the occupant, and a vehicle storage unit 23 such as a hard disk provided in the vehicle device 10.

[0018] The various data related to the above control conditions correspond to the usage history information disclosed herein, and more specifically, are the frequency of use of the vehicle equipment 10 by the occupant, the setting conditions, etc., and indicate whether the frequency of use is high or low, whether the setting conditions are higher or lower than the standard conditions, etc.

[0019] The occupant status information indicates the occupant's identification based on a pre-stored facial image of the occupant, and the occupant's satisfaction level, dissatisfaction level, etc. based on the occupant's facial expression, posture, etc.

[0020] The personal information system 100 includes an acquisition unit 110, a personal storage unit 120, a control unit 130, and the like.

[0021] The acquisition unit 110 identifies occupants in the vehicle and acquires (detects) the occupant's condition (facial expression, posture, etc.). For example, a camera (CMOS camera, CCD camera, infrared camera, etc.) may be used, or a camera and a biosensor (body temperature sensor, heart rate sensor, brain wave sensor, electromyography sensor, etc.) may be used.

[0022] The camera is provided, for example, at the front of the ceiling inside the vehicle cabin, captures images of the faces and bodies of occupants, and outputs the captured image data to the storage unit 20. If the vehicle is equipped with a Driver Status Monitor (registered trademark, DSM) that provides driving support (such as issuing warnings and activating automatic emergency brakes) depending on the driver's state (such as looking away or falling asleep), the camera used for the driver status monitor may be used.

[0023] In addition, the biosensor is attached, for example, to the occupant's body or seat, detects the occupant's biometric data (body temperature, heart rate, brain waves, muscle condition, etc.) and outputs the detected biometric data of the driver to the memory unit 20.

[0024] The personal storage unit 120 is set for each occupant, and includes, for example, a husband storage unit 121, a wife storage unit 122, and a child storage unit 123 for family communities. The personal storage unit 120 also includes, for example, a friend A storage unit 124, a friend B storage unit 125, and the like for communities other than the family, such as a friend community.

[0025] In addition, for family communities, it is possible to set up a memory section for grandparents, etc., in accordance with the structure of the family. Grandparents are relatives from the child's point of view. Furthermore, as a community other than family, it is also possible to create a community of members who have a common hobby or a common lesson, or a community of members who share the same vehicle.

[0026] The personal storage unit 120 (each of the storage units 121-125) is a part that sequentially retrieves and stores (accumulates) the usage history information and the occupant's status information stored in the storage unit 20 of the vehicle device 10 for each occupant as personal information based on the occupant's identification information obtained by the acquisition unit 110. That is, the personal information of each occupant is sorted by name and stored in each of the storage units 121-125 of the personal storage unit 120.

[0027] Regardless of the intentions of each occupant, the usage history information and status information of each occupant are automatically stored in the personal storage unit 120. Information related to the preferences of each occupant is accumulated from the usage history information and the occupant's status information (satisfied, dissatisfied), etc., including information that the occupant himself / herself was not even aware of.

[0028] The control unit 130 utilizes the personal information of each occupant in the personal memory unit 120 (each memory unit 121-125) to control the operation of the vehicle equipment 10 so as to provide services suited to the characteristics (preferences) of each occupant (described in detail below).

[0029] The personal information system 100 of this embodiment is configured as described above, and its operation and effects will be described below.

[0030] The acquisition unit 110 outputs the status information including the acquired identification information of the occupant to the storage unit 20 of the vehicle system. Then, based on the identification information of each occupant in the storage unit 20, the control unit 130 sequentially stores all of the personal information of each occupant in the personal storage unit 120 (each of the storage units 121 to 125).

[0031] Here, when the memory unit 20 is composed of multiple memory units, i.e., the cloud memory unit 21, the terminal memory unit 22, and the vehicle memory unit 23, as described above, the personal information is formed by the control unit 130 linking together the information in each of the memory units 21, 22, and 23.

[0032] When each occupant generates an operating account (an occupant's identification ID, a password, etc.) for operating the vehicle device 10, the control unit 130 links each account with the personal information in the personal storage unit 120 (each of the storage units 121-125). When providing a service (controlling the operation of the vehicle device 10), the control unit 130 identifies the target of the service based on the account, and provides the service according to the characteristics (preferences) of each occupant based on the corresponding personal information.

[0033] As described above, in this embodiment, all of the occupant's personal information is sequentially stored in the personal storage unit 120 (each of the storage units 121-125) from the storage unit 20, which particularly saves the occupant from having to input the personal information. In addition, the personal information is information corresponding to the characteristics of each occupant based on the usage history information of the vehicle device 10, so that the information can include the characteristics and preferences of each occupant, and it is possible to provide services by the vehicle device 10 that are suited to each occupant.

[0034] Furthermore, when the memory unit 20 is made up of multiple memory units (memory units 21-23), the personal information is formed by the control unit 130 linking together the information in each of the memory units 21-23, so that the personal information can be fully utilized without any omissions.

[0035] In addition, the control unit 130 associates personal information with an account for operating the vehicle device 10 set for each occupant, and identifies a target person for providing a service based on the account. This can increase the reliability of the service for the occupant.

[0036] (Modification of the first embodiment) A personal information system 100A in a modified example of the first embodiment is shown in Fig. 2. In the personal information system 100A in this modified example, the account setting described in the first embodiment is omitted. The control unit 130 identifies (recognizes from a facial image) a target person for the provision of a service based on the status information obtained by the acquisition unit 110. In other words, even without setting an account, the control unit 130 estimates a target person for the provision of a service from the status information (facial image) and provides a service based on the personal information of the occupant.

[0037] For example, a case will be described where a grandmother uses a vehicle to go to a hospital. The acquisition unit 110 recognizes that the grandmother has boarded the vehicle from a facial image. The storage unit 20 and the personal storage unit 120 also store the frequency of boarding from the past, and also store the grandmother's health condition (whether she looks healthy, unwell, etc.) from the grandmother's facial expression, posture, heart rate, etc. acquired by the acquisition unit 110.

[0038] The control unit 130 provides the grandmother with information on health care and insurance as presentation information, for example, to the information device. That is, the information device presents optimal care content or insurance information (premiums, guaranteed amounts) based on the grandmother's health condition (personal information).

[0039] This allows the occupant to be identified by the acquisition unit 110 without setting up an account, and makes it possible to provide optimal services based on the occupant's condition information.

[0040] Second embodiment A personal information system 100B in the second embodiment is shown in Fig. 3. In the personal information system 100B in the second embodiment, personal information in the personal storage unit 120 (each of the storage units 121-125) for each occupant can be shared by transmitting and receiving between portable terminals 141, 142 carried by the occupants.

[0041] Specifically, the mobile terminal 141 is for example the husband, and the mobile terminal 142 is for example the wife. The husband transmits a QR code (registered trademark) for activating the wife's personal information in the husband's account from the husband's mobile terminal 141 to the wife's mobile terminal 142.

[0042] When the wife reads the QR code with the mobile terminal 142, the wife's personal information is separated from the personal information of each passenger in the family community. By setting up her own account for this separated personal information, the wife's account and the wife's personal information are linked and can be activated. In other words, the wife can receive services from the vehicle device 10 using her own account that she has set up.

[0043] In this way, by transmitting and receiving information between the portable terminals 141 and 142, it is possible to easily set personal information of a specific passenger for the purpose of providing services.

[0044] In addition, the community to which each occupant belongs may be configured to allow the occupant to move to another community at his / her own will. This allows personal information to be stored according to the community, and enables the occupant to receive services according to his / her will.

[0045] (Other embodiments) The disclosure in this specification and drawings, etc. is not limited to the exemplified embodiments. The disclosure includes the exemplified embodiments and modifications by those skilled in the art based thereon. For example, the disclosure is not limited to the combination of parts and / or elements shown in the embodiments. The disclosure can be implemented by various combinations. The disclosure can have additional parts that can be added to the embodiments. The disclosure includes the omission of parts and / or elements of the embodiments. The disclosure includes the substitution or combination of parts and / or elements between one embodiment and another embodiment. The disclosed technical scope is not limited to the description of the embodiments. Some disclosed technical scopes are indicated by the description of the claims, and should be interpreted as including all modifications within the meaning and scope equivalent to the description of the claims.

[0046] The control unit and its techniques described in the present disclosure may be implemented by a special purpose computer provided by configuring a processor and memory programmed to perform one or more functions embodied in a computer program.

[0047] Alternatively, the controller and techniques described in this disclosure may be implemented in a special purpose computer provided by configuring a processor with one or more special purpose hardware logic circuits.

[0048] Alternatively, the control unit and the techniques described herein may be implemented by one or more special purpose computers configured with a processor and memory programmed to perform one or more functions, in combination with a processor configured with one or more hardware logic circuits.

[0049] The computer program may also be stored in a computer-readable non-transitory tangible recording medium as instructions to be executed by a computer. [Explanation of symbols]

[0050] 10 Vehicle equipment 20 Memory section 21 Cloud Storage 22 Terminal memory section 23 Vehicle memory unit 100, 100A, 100B Personal Information System 110 Acquisition Department 120 Personal storage 130 Control section 141 Mobile phone (for husband) 142 Mobile terminal (for wife)

Claims

1. A personal information system that utilizes personal information, an acquisition unit (110) that identifies a vehicle occupant based on a facial image and acquires a state of the occupant; a storage unit (20) for storing usage history information of the vehicle equipment (10) and status information of the occupant acquired by the acquisition unit and including identification information of the occupant; a personal storage unit (120) that is set for each occupant based on the occupant's identification information, and that retrieves the usage history information and the status information for each occupant from the storage unit as personal information and stores them sequentially; a control unit (130) that utilizes the personal information in the personal storage unit to control the vehicle equipment to provide services suited to the characteristics of each occupant when operating the vehicle equipment, The control unit is a personal information system that links the account set for each occupant when operating the vehicle equipment with the personal information when the occupant creates an account for operating the vehicle equipment in order for the occupant to operate the vehicle equipment, and identifies the target person for providing the service based on the account.

2. The storage unit includes a cloud storage unit (21) on the Internet, a terminal storage unit (22) of the passenger's terminal, and a vehicle storage unit (23) of the vehicle equipment, The personal information system according to claim 1 , wherein the personal information is formed by linking together information stored in the cloud storage unit, the terminal storage unit, and the vehicle storage unit.

3. 3. The personal information system according to claim 1, wherein the personal information stored in the personal storage unit for each of the passengers can be shared by transmitting and receiving the information between portable terminals (141, 142) carried by the passengers.

Citation Information

Patent Citations

  • On-vehicle profile system and driving environment setting method

    JP2002104105A

  • In-vehicle appliance control system to work with particular personal information

    JP2006082691A

  • Vehicle-mounted electronic equipment control system

    JP2007118626A

  • Vehicle control system

    JP2017144834A

  • Control device, information recording device, control method and information recording method

    JP2020196407A