Occupant relationship estimation device, occupant relationship estimation method, and program

Abstract

To provide an occupant relationship estimation device capable of estimating the relationship between a plurality of occupants riding in a mobile body without relying on the analysis of communication between users inside the mobile body.SOLUTION: An occupant relationship estimation device 1 comprises: a registered user information acquisition unit 11 which acquires attribute information of registered users riding in a mobile body 100; and a user relationship estimation unit 12 which, when a first user and a second user riding in the mobile body 100 are registered users, performs first relationship estimation processing to estimate the relationship between the first user and the second user on the basis of the attribute information of the first user and the second user acquired by the registered user information acquisition unit 11, and when the second user is an unregistered user whose attribute information is not stored in a storage device, performs second relationship estimation processing to estimate the relationship between the first user and the second user on the basis of the boarding location of the second user in the mobile body 100.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an occupant relationship estimation device, an occupant relationship estimation method, and a program. [Background technology]

[0002] Conventionally, a content provision system has been proposed that analyzes communication between multiple occupants in a vehicle, estimates the relationships between the occupants, and outputs content selected based on the evolution of the estimated relationships from an in-vehicle device (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2018-133696 Summary of the Invention [Problem to be solved by the invention]

[0004] In the above content provision system, the information used to determine the relationship between occupants is the results of communication analysis, so there is the inconvenience that in situations where there is little communication between occupants in the vehicle, it is not possible to estimate the relationship between occupants. The present application has been made in consideration of this background, and aims to provide a passenger relationship estimation device, a passenger relationship estimation method, and a program that can estimate the relationships between multiple passengers riding in a moving object such as a vehicle without relying on analysis of communication between users on the moving object. [Means for solving the problem]

[0005] A first aspect for achieving the above object is a passenger relationship estimation device comprising: a registered user information acquisition unit that accesses a storage device in which attribute information of registered users using a mobile body is stored, and acquires attribute information of the registered users who are on board the mobile body; and a user relationship estimation unit that, when a first user and a second user are on board the mobile body, if the first user and the second user are registered users, executes a first relationship estimation process to estimate the relationship between the first user and the second user based on the attribute information of the first user and the attribute information of the second user acquired by the registered user information acquisition unit, and, when the second user is an unregistered user whose attribute information is not stored in the storage device, executes a second relationship estimation process to estimate the relationship between the first user and the second user based on the location where the second user boarded the mobile body.

[0006] In the above-mentioned passenger relationship estimation device, the user relationship estimation unit may be configured to store user relationship information indicating the relationship between the first user and the second user estimated by the first relationship estimation process in the storage device, and when a first predetermined time or more has elapsed since the user relationship information was stored in the storage device, output registered relationship confirmation information from an alarm device used in the mobile body that prompts confirmation of the relationship between the first user and the second user indicated by the user relationship information, and when relationship update instruction information instructing an update of the user relationship information is input into an input device used in the mobile body in response to the output of the registered relationship confirmation information from the alarm device, re-estimate the relationship between the first user and the second user by the first relationship estimation process and update the user relationship information stored in the storage device.

[0007] The above-mentioned passenger relationship estimation device may be configured to include a destination recognition unit that recognizes the destination of the moving body, and the user relationship estimation unit may be configured to correct the relationship between the first user and the second user estimated by the second relationship estimation process according to the destination.

[0008] The above-mentioned passenger relationship estimation device may be configured to include a descending vehicle location recognition unit that recognizes the descending vehicle location where the second user descended from the vehicle, and when the previous descending vehicle location recognition unit recognizes that the second user, who is an unregistered user, descended from the vehicle at a specific descending vehicle location, the user relationship estimation unit may be configured to store information indicating the relationship between the first user and the second user estimated by the second relationship estimation process in a storage device for a second predetermined period of time.

[0009] The above-mentioned passenger relationship estimation device may be configured to include a descending vehicle location recognition unit that recognizes the descending vehicle location where the second user descended from the vehicle, and a user registration proposal unit that, when the previous descending vehicle location recognition unit recognizes that the second user, who is an unregistered user, has descended from the vehicle at a specific descending vehicle location a predetermined number of times or more, stores attribute information of the second user in the storage device and outputs registration proposal information from an alarm device used in the vehicle that proposes that the second user become the registered user.

[0010] As a second aspect for achieving the above object, there is provided an occupant relationship estimation method executed by a computer in an occupant relationship estimation device, the occupant relationship estimation method including: a registered user information acquisition step for accessing a storage device in which attribute information of registered users using a mobile body is stored, and acquiring attribute information of the registered users who are on board the mobile body; and a user relationship estimation step for, when a first user and a second user are on board the mobile body, if the first user and the second user are registered users, executing a first relationship estimation process to estimate the relationship between the first user and the second user based on the attribute information of the first user and the attribute information of the second user acquired by the registered user information acquisition step, and, when the second user is an unregistered user whose attribute information is not stored in the storage device, executing a second relationship estimation process to estimate the relationship between the first user and the second user based on the location where the second user boarded the mobile body.

[0011] A third aspect for achieving the above object is a program that causes a computer to function as a registered user information acquisition unit that accesses a storage device in which attribute information of registered users using a mobile body is stored and acquires attribute information of the registered users who are on board the mobile body, and a user relationship estimation unit that, when a first user and a second user are on board the mobile body and the first user and the second user are registered users, executes a first relationship estimation process to estimate the relationship between the first user and the second user based on the attribute information of the first user and the attribute information of the second user acquired by the registered user information acquisition unit, and, when the second user is an unregistered user whose attribute information is not stored in the storage device, executes a second relationship estimation process to estimate the relationship between the first user and the second user based on the location where the second user boarded the mobile body. [Effects of the Invention]

[0012] According to the above-mentioned passenger relationship estimation device, passenger relationship estimation method, and program, the relationship between multiple passengers riding in a moving object such as a vehicle can be estimated without relying on analysis of communication between users on the moving object. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 is an explanatory diagram of a vehicle equipped with an occupant relationship estimation device. [Figure 2] FIG. 2 is a configuration diagram of the passenger relationship estimation device. [Figure 3] FIG. 3 is an explanatory diagram of attribute information of registered users. [Figure 4] FIG. 4 is an explanatory diagram of the relationship levels between users. [Figure 5] FIG. 5 is a flowchart of a process for estimating the relationship level between users. [Figure 6] FIG. 6 is an explanatory diagram of the user registration suggestion screen. [Figure 7]FIG. 7 is an explanatory diagram of the registered relationship confirmation screen. DETAILED DESCRIPTION OF THE INVENTION

[0014] [1. Usage of the passenger relationship estimation device] With reference to FIG. 1, a usage mode of the occupant relationship estimation device 1 of this embodiment will be described. The occupant relationship estimation device 1 is mounted on a vehicle 100, and FIG. 1 shows a situation in which a user U1 is seated in the driver's seat 5, a user U2 is seated in the passenger seat 6, and a user U3 is seated in the left rear seat 7. The vehicle 100 corresponds to a moving body in the present disclosure. The user U1 corresponds to a first user in the present disclosure, and the users U2 and U3 correspond to second users in the present disclosure. The vehicle 100 is equipped with an ECU (Electronic Control Unit) 2 that controls the operation of the vehicle 100, and a navigation device 3 that performs route guidance.

[0015] In this embodiment, vehicle 100 is equipped with a center display 40, a driver's seat speaker 41, a passenger seat display 50a, a passenger seat speaker 51a, a left rear seat display 50b, a left rear seat speaker 51b, a right rear seat display 50c, and a right rear seat speaker 51c as content output devices whose content output is controlled by occupant relationship estimation device 1. The content includes content including video and sound, content that is only video and does not include sound, and content that is only sound and does not include video. Center display 40, passenger seat display 50a, left rear seat display 50b, and right rear seat display 50c are touch panel specifications.

[0016] The passenger relationship estimation device 1 performs wireless communication using a communication standard such as Bluetooth (registered trademark) among a communication terminal 95 carried by a user U1, a communication terminal 90a carried by a user U2, and a communication terminal 90b carried by a user U3. The passenger relationship estimation device 1 estimates the relationship between users U1 to U3 riding in a vehicle 100, and executes a process of outputting content according to the estimated relationship from a content output device.

[0017] [2. Configuration of passenger relationship estimation device] The configuration of the passenger relationship estimation device 1 will be described with reference to Fig. 2. The passenger relationship estimation device 1 is a control unit including a processor 10, a memory 20, a communication unit 30, etc. The processor 10 corresponds to the computer in the present disclosure. The passenger relationship estimation device 1 communicates with a content server 210, a user management server 211, etc. via a communication network 200 using the communication unit 30.

[0018] Furthermore, occupant relationship estimation device 1 communicates wirelessly with communication terminals 90a, 90b, and 95 used in the passenger compartment of vehicle 100 via communication unit 30. Occupant relationship estimation device 1 is connected to ECU 2, navigation device 3, center display 40, driver's seat speaker 41, driver's seat microphone 42, driver's seat camera 43, passenger seat display 50a, passenger seat speaker 51a, passenger seat microphone 52a, passenger seat camera 53a, left rear seat display 50b, left rear seat speaker 51b, left rear seat microphone 52b, left rear seat camera 53b, right rear seat display 50c, right rear seat speaker 51c, right rear seat microphone 52c, and right rear seat camera 53c.

[0019] The memory 20 of the occupant relationship estimation device 1 stores a program 21 for controlling the occupant relationship estimation device 1 and registered user data 22 that records attribute information of registered users who are users of the vehicle 100. The attribute information includes the registered user's ID, name, gender, age, address, preferences, identification information (face image data, unique identification code of the communication terminal used, etc.), etc.

[0020] By loading and executing program 21, processor 10 functions as a registered user information acquisition unit 11, a user relationship estimation unit 12, a destination recognition unit 13, a destination moving object location recognition unit 14, a user registration suggestion unit 15, and a content output control unit. The processing executed by registered user information acquisition unit 11 corresponds to the registered user information acquisition step in the passenger relationship estimation method of the present disclosure, and the processing executed by user relationship estimation unit 12 corresponds to the user relationship estimation step in the passenger relationship estimation method of the present disclosure.

[0021] The registered user information acquisition unit 11 performs facial authentication on users U1 to U3 seated in each of seats 5 to 7 using facial image data of the registered users recorded in the registered user data 22 and facial image portions extracted from images captured by the driver's seat camera 43, passenger seat camera 53a, and left rear seat camera 53b, to determine whether users U1 to U3 are registered users or non-registered users.The registered user information acquisition unit 11 then acquires attribute information of the registered users from the registered user data 22.

[0022] It is also possible to determine whether users U1 to U3 seated at seats 5 to 7 are registered users or non-registered users by processing other than facial recognition. For example, it is also possible to determine whether users U1 to U3 seated at seats 5 to 7 are registered users or non-registered users by obtaining the identification codes of the communication terminals 90a, 90b, and 95 used by users U1 to U3. Furthermore, if attribute information of registered users is stored in the user management server 211, the registered user information acquisition unit 11 may access the user management server 211 via the communication unit 30 to acquire the attribute information of registered users.

[0023] The user relationship estimation unit 12 estimates the relationship between users U1 to U3 riding in the vehicle 100 by the following first relationship estimation process or second relationship estimation process. Below, we will explain the process of estimating the relationship between users U1 and U2 and the relationship between users U1 and U3 when users U1 and U2 are registered users and user U3 is an unregistered user.

[0024] 4, the user relationship estimation unit 12 estimates the relationship between user U1 and user U2 and the relationship between user U1 and user U3 based on a relationship level indicating the depth of the relationship between the users, according to a total score of an attribute information score based on the attribute information, a boarding location score according to the boarding location, and a destination score according to the destination of the vehicle 100. The relationship level is set to, for example, three levels: A (deep relationship), B (medium relationship), and C (shallow relationship).

[0025] The attribute information score, the boarding location score, and the destination score are set, for example, as follows: Attribute information score: +5 if the user is a family member, +3 if the user is a roommate. Boarding location score: User U3's boarding location is User U1's home: +3, User U3's boarding location is User U3's home: +2, User U3's boarding location is other than User U1's home or User U3's home: +1. Destination score: If the destination is user U1's home, +3; if the destination is a leisure facility, +2; if the destination is a restaurant, +1.

[0026] The user relationship estimation unit 12 estimates the relationship level between the registered users, user U1 and user U2, through the following first relationship estimation process. First relationship estimation process...The user relationship estimation unit 12 sets the relationship level between registered users user U1 and user U2 based on the attribute information score based on the attribute information of user U1 and the attribute information of user U2, and the destination score.

[0027] The user relationship estimation unit 12 estimates the relationship level between user U1, who is a registered user, and user U3, who is an unregistered user, by the following second relationship estimation process. Second relationship estimation process: The user relationship estimation unit 12 sets the destination score according to the boarding location score corresponding to the location where the user U3 gets off the vehicle 100 and the destination score.

[0028] Furthermore, even when both user U1 and user U2 are unregistered users, the user relationship estimation unit 12 estimates the relationship level between user U1 and user U3 through the two-relationship estimation process. In this case, when user U1 and user U2 board the vehicle 100 at the same location, the user relationship estimation unit 12 sets the boarding location score to +2.

[0029] The destination recognition unit 13 recognizes the destination of the vehicle 100 set by the navigation device 3 through communication with the navigation device 3. The user relationship estimation unit 12 sets a destination score as described above according to the destination of the vehicle 100. The process by the user relationship estimation unit 12 of adding the destination scores to calculate the total score corresponds to the correction of the relationship in the present disclosure.

[0030] The disembarking vehicle location recognition unit 14 recognizes that the vehicle 100 has stopped through communication with the ECU 2, and when it recognizes that at least one of the users U1 to U3 has disembarked from the vehicle 100, it recognizes the current position of the vehicle 100 through communication with the navigation device 3, thereby recognizing the location where the user U3 disembarked from the vehicle (disembarking vehicle location).

[0031] When the number of times that the dismounting moving object location recognition unit 14 recognizes that the unregistered user U3 has dismounted from the vehicle 100 at a specific location (for example, the home of user U1) reaches or exceeds a predetermined number of times, the user registration suggestion unit 15 displays a user registration suggestion screen 300 (corresponding to the user registration suggestion information of the present disclosure) on the center display 40, as shown in FIG. 6, which suggests registering user U3 as the user of the vehicle 100. The user registration suggestion screen 300 displays a "Register" button 301 and a "Do not register" button 302. In this case, the center display 40 corresponds to the notification device and input device of the present disclosure.

[0032] When the "Register" button 301 is operated in response to the display of the user registration proposal screen 300, the user registration proposal unit 15 writes the attribute information of user U3 into the registered user data 22 and registers user U3 as the user of the vehicle 100. On the other hand, when the "Do not register" button 302 is operated, the user registration proposal unit 15 does not register user U3. The proposal to register user U3 may be made by outputting audio from the driver's seat speaker 41, in which case the driver's seat speaker 41 corresponds to the notification device of the present disclosure. The instruction to register user U3 may be made by inputting audio instructions to the driver's seat microphone 42, in which case the driver's seat microphone 42 corresponds to the input device of the present disclosure.

[0033] Here, when the dismounting moving object location recognition unit 14 recognizes that the user U3 has dismounted from the vehicle 100 at a specific location (for example, the home of the user U1), the user relationship estimation unit 12 may store information indicating the relationship between the user U1 and the user U3 estimated by the second relationship estimation process in the memory 20 for a second predetermined time. As a result, when the user U3 gets into the vehicle 100 before the second predetermined time has elapsed, the user relationship estimation unit 12 can quickly recognize the relationship between the user U1 and the user U3 by referring to the information indicating the relationship between the user U1 and the user U3 stored in the memory 20 without executing the second relationship estimation process again.

[0034] When the relationship level between user U1 and user U2 estimated by the user relationship estimation unit 12 is a predetermined level or higher (e.g., B or higher), or when the relationship level between user U1 and user U3 estimated by the user relationship estimation unit 12 is a predetermined level or higher, the content output control unit 16 outputs content appropriate for the users whose relationship level is a predetermined level or higher from the content output device. For example, when the relationship level between user U1 and user U2 is a predetermined level or higher, the content output control unit 16 outputs content appropriate for the preferences common to user U1 and user U2 from the content output device. Furthermore, when the relationship level between user U1 and user U3 is a predetermined level or higher, the content output control unit 16 outputs content related to the destination of vehicle 100 from the content output device.

[0035] [3. Estimation of the relationship level between users] The procedure for estimating the relationship level between users, which is executed by the passenger relationship estimation device 1 in the situation shown in Fig. 1, will be described according to the flowchart shown in Fig. 5. When the passenger relationship estimation device 1 recognizes that a user has boarded the vehicle 100, it executes the process according to the flowchart shown in Fig. 5.

[0036] In step S1 of Fig. 5, the registered user information acquisition unit 11 determines, through facial recognition processing, whether or not users U1, U2, and U3 seated in seats 5 to 7 of the vehicle 100 are registered users, and acquires attribute information of the registered users from the registered user data 22. In the example of Fig. 1, the registered user information acquisition unit 11 determines that user U1 seated in the driver's seat U1 and user U2 seated in the passenger seat 6 are registered users, and acquires attribute information of users U1 and U2 from the registered user data 22. In addition, the registered user information acquisition unit 11 determines that user U3 seated in the left rear seat 7 is an unregistered user.

[0037] In the following step S2, the user relationship estimation unit 12 determines whether two or more registered users are riding in the vehicle 100. If two or more registered users are riding in the vehicle 100, the user relationship estimation unit 12 proceeds to step S10, and if two or more registered users are not riding in the vehicle 100, the user relationship estimation unit 12 proceeds to step S3.

[0038] In step S10, the user relationship estimation unit 12 estimates the relationship level between registered users U1 and U2 by the first relationship estimation process described above. In the following step S11, the user relationship estimation unit 12 determines whether an unregistered user is on board, and if an unregistered user is on board, proceeds to step S3, and if an unregistered user is not on board, proceeds to step S4.

[0039] In step S3, the user relationship estimation unit 12 estimates the relationship level between user U1, who is a registered user, and user U3, who is an unregistered user, by the second relationship estimation process described above. In the following step S4, the destination recognition unit 13 determines whether or not a destination has been set by the navigation device 3. If a destination has been set, the process proceeds to step S20, and if a destination has not been set, the process proceeds to step S5.

[0040] In step S20, the user relationship estimation unit 12 corrects the relationship score between users U1 and U2 and the relationship score between users U1 and U3 using the destination score corresponding to the destination recognized by the destination recognition unit 13, as described above with reference to Figure 4, and proceeds to step S5.

[0041] In step S5, the content output control unit 16 determines whether there is a combination of users whose relationship level is equal to or higher than a predetermined level (for example, level B or higher). If there is a combination of users whose relationship level is equal to or higher than the predetermined level, the content output control unit 16 proceeds to step S30, and if there is no combination of users whose relationship level is equal to or higher than the predetermined level, the content output control unit 16 proceeds to step S6.

[0042] In step S30, the content output control unit 16 outputs, from the content output device, content corresponding to a combination of users whose relationship level is equal to or higher than a predetermined level. In the example of Fig. 4, the content output control unit 16 outputs, from the content output device, content corresponding to an attribute common to users U1 and U2, content corresponding to a destination common to users U1 and U3, etc.

[0043] 4. Other Embodiments

[0044] In the above embodiment, a vehicle 100 is used as an example of a moving body of the present disclosure, but the present invention can also be applied to estimating the relationship between multiple users on board other types of moving bodies (aircraft, ships, etc.).

[0045] In the above embodiment, the user relationship estimation unit 12 may store information (user relationship information) on the relationship level between registered users U1 and U2 estimated by the first relationship estimation process in the memory 20. Then, when a first predetermined time has elapsed since the user relationship estimation unit 12 stored the user relationship information in the memory 20, the user relationship estimation unit 12 may display a registered relationship confirmation screen 310 (corresponding to the registered relationship confirmation information of the present disclosure) on the center display 40 (corresponding to the notification device of the present disclosure) as shown in FIG. 7 , which prompts the user to confirm the relationship between user U1 and user U2 indicated by the user relationship information. In this way, by using the relationship level recognized from the user relationship information stored in the memory 20 until the first predetermined time has elapsed, the process of estimating the relationship level between user U1 and user U2 each time user U1 and user U2 get into the vehicle 100 can be omitted.

[0046] The registered relationship confirmation screen 310 displays a "Confirm" button 311 and a "Don't Confirm" button 312. In this case, the center display 40 corresponds to the notification device and the input device of the present disclosure. When the "Confirm" button 311 is operated in response to the display of the registered relationship confirmation screen 310, the user relationship estimation unit 12 re-estimates the relationship level between user U1 and user U2 by the first relationship estimation process. Then, the user relationship estimation unit 12 updates the user relationship information of user U1 and user U2 stored in the memory 20 based on the relationship level between user U1 and user U2 estimated by the re-estimated first relationship estimation process. As a result, if the attributes of user U1 or user U2 change during the lapse of the first predetermined time, the relationship level between user U1 and user U2 can be changed in accordance with the change in the attributes, thereby improving the estimation accuracy of the relationship level.

[0047] In the above embodiment, the occupant relationship estimation device 1 outputs content from the displays 50a to 50c, 40 and the speakers 51a to 51c, 41 provided in the vehicle 100. In another embodiment, the content may be output from the display units and speakers of the communication terminals 90a, 90b, 95 via wireless communication with the communication terminals 90a, 90b, 95.

[0048] In the above embodiment, the passenger relationship estimation device 1 provided in the vehicle 100 is shown, but the passenger relationship estimation device of the present disclosure may be configured as a function of the content server 210, etc. In this case, authentication information of users riding in the vehicle 100 is transmitted from the vehicle 100 to the content server 210, and the content server 210 determines whether users U1 to U3 seated in seats 5 to 7 of the vehicle 100 are registered users or unregistered users. Then, the content server 210 executes a first relationship estimation process or a second relationship estimation process to estimate the relationship level between the users U1 to U3.

[0049] Furthermore, the passenger relationship estimation device of the present disclosure may be configured as a function of an app (application program) of communication terminals 90a, 90b, and 95. In this case, the app photographs the users with a built-in camera of the communication terminal and performs facial authentication to determine whether users U1 to U3 are registered users or unregistered users. Then, the app executes a first relationship estimation process or a second relationship estimation process to estimate the relationship level between users U1 to U3.

[0050] In the above embodiment, the destination recognition unit 13 is provided, and the user relationship estimation unit 12 corrects the relationship levels between the users U1 to U3 according to the destination set by the navigation device 3. In another embodiment, the destination recognition unit 13 may be omitted, and the relationship levels may not be corrected according to the destination.

[0051] In the above embodiment, the dismounting moving object location recognition unit 14 and the user registration suggestion unit 15 were provided, and a process was performed to suggest that an unregistered user who has dismounted from the vehicle 100 at a specific location more than the processing limit be made a registered user. However, the dismounting moving object location recognition unit 14 and the user registration suggestion unit 15 may be omitted, and the process of suggesting that the user be made a registered user may not be performed.

[0052] 2 is a schematic diagram showing the configuration of the occupant relationship estimation device 1 divided by main processing content to facilitate understanding of the present invention, and the configuration of the occupant relationship estimation device 1 may be divided by other divisions. Furthermore, the processing of each component may be executed by one hardware unit or multiple hardware units. Furthermore, the processing of each component shown in FIG. 5 may be executed by one program or multiple programs.

[0053] 5. Configurations supported by the above embodiments The above embodiment is a specific example of the following configuration.

[0054] (Configuration 1) A passenger relationship estimation device comprising: a registered user information acquisition unit that accesses a storage device in which attribute information of registered users using a mobile body is stored, and acquires attribute information of the registered users who are riding in the mobile body; and a user relationship estimation unit that, when a first user and a second user are riding in the mobile body, if the first user and the second user are registered users, executes a first relationship estimation process to estimate the relationship between the first user and the second user based on the attribute information of the first user and the attribute information of the second user acquired by the registered user information acquisition unit, and, when the second user is an unregistered user whose attribute information is not stored in the storage device, executes a second relationship estimation process to estimate the relationship between the first user and the second user based on the location where the second user boarded the mobile body. According to the passenger relationship estimation device of configuration 1, the relationships between multiple passengers riding in a moving object such as a vehicle can be estimated without relying on analysis of communication between users in the moving object.

[0055] (Configuration 2) The user relationship estimation unit stores user relationship information indicating the relationship between the first user and the second user estimated by the first relationship estimation process in the storage device, and when a first predetermined time or more has elapsed since the user relationship information was stored in the storage device, outputs registered relationship confirmation information from an alarm device used in the mobile body that prompts confirmation of the relationship between the first user and the second user indicated by the user relationship information, and when relationship update instruction information instructing an update of the user relationship information is input into an input device used in the mobile body in response to the output of the registered relationship confirmation information from the alarm device, the passenger relationship estimation device described in configuration 1 re-estimates the relationship between the first user and the second user by the first relationship estimation process and updates the user relationship information stored in the storage device. According to the passenger relationship estimation device of Configuration 2, until a first predetermined time has elapsed since the relationship between the first user and the second user was estimated, the relationship recognized from the user relationship information stored in the storage device is used, thereby making it possible to omit the process of estimating the relationship between the first user and the second user each time the first user and the second user board a moving object. Then, when the first predetermined time has elapsed, registered relationship confirmation information is output from the notification device and the relationship between the first user and the second user is estimated again, thereby reflecting changes in the attributes of the first user or the second user and improving the accuracy of the estimation of the relationship between the first user and the second user.

[0056] (Configuration 3) A passenger relationship estimation device as described in Configuration 1 or Configuration 2, which includes a destination recognition unit that recognizes the destination of the moving body, and the user relationship estimation unit corrects the relationship between the first user and the second user estimated by the second relationship estimation process according to the destination. According to the passenger relationship estimation device of configuration 3, the estimation of the relationship between the first user and the second user can be corrected according to the destination of the moving body, thereby improving the accuracy of the estimation of the relationship between the first user and the second user.

[0057] (Configuration 4) A passenger relationship estimation device described in any one of configurations 1 to 3, comprising a descending mobile object location recognition unit that recognizes the location where the second user descended from the mobile object, and the user relationship estimation unit, when it recognizes by the previous descending mobile object location recognition unit that the second user, who is an unregistered user, descended from the mobile object at a specific descending mobile object location, stores information indicating the relationship between the first user and the second user estimated by the second relationship estimation process in a storage device for a second predetermined period of time. According to the passenger relationship estimation device of configuration 4, when it is inferred that the first user and the second user have a close relationship and that the second user is likely to continue riding in a mobile vehicle in the future because the second user, who is an unregistered user, has gotten off the mobile vehicle at a specific location, information indicating the relationship between the first user and the second user is stored in a storage device for a second period of time, and a state in which the relationship between the first user and the second user can be referenced is maintained, thereby making it unnecessary to perform processing to estimate the relationship between the first user and the second user each time the second user rides in a mobile vehicle.

[0058] (Configuration 5) An occupant relationship estimation device described in any one of configurations 1 to 4, comprising: a descending mobile object location recognition unit that recognizes the descending mobile object location where the second user descended from the mobile object; and a user registration proposal unit that, when the previous descending mobile object location recognition unit recognizes that the second user, who is an unregistered user, has descended from the mobile object at a specific descending mobile object location a predetermined number of times or more, stores attribute information of the second user in the storage device and outputs registration proposal information from an alarm device used in the mobile object that proposes that the second user be made the registered user. According to the passenger relationship estimation device of configuration 5, when a second user, who is an unregistered user, has gotten off a mobile vehicle at a specific location more than a predetermined number of times, it is estimated that the relationship between the first user and the second user is close and that the second user is likely to continue boarding a mobile vehicle in the future, the device proposes that the second user be designated as a registered user, and by designating the second user as a registered user, it is possible to improve the accuracy of relationship estimation by switching from the first relationship estimation process to the second relationship estimation process.

[0059] (Configuration 6) A passenger relationship estimation method executed by a computer, comprising: a registered user information acquisition step of accessing a storage device in which attribute information of registered users using a mobile body is stored, and acquiring attribute information of the registered users who are on board the mobile body; and a user relationship estimation step of, when a first user and a second user are on board the mobile body, if the first user and the second user are registered users, executing a first relationship estimation process to estimate the relationship between the first user and the second user based on the attribute information of the first user and the attribute information of the second user acquired by the registered user information acquisition step, and when the second user is an unregistered user whose attribute information is not stored in the storage device, executing a second relationship estimation process to estimate the relationship between the first user and the second user based on the location where the second user boarded the mobile body. By executing the passenger relationship estimation method of configuration 6 by a computer, the same effects as those of the passenger relationship estimation device of configuration 1 can be obtained.

[0060] (Configuration 7) A program that causes a computer to function as a registered user information acquisition unit that accesses a storage device in which attribute information of registered users using a mobile body is stored and acquires attribute information of the registered users who are on board the mobile body, and a user relationship estimation unit that, when a first user and a second user are on board the mobile body and the first user and the second user are registered users, executes a first relationship estimation process to estimate the relationship between the first user and the second user based on the attribute information of the first user and the attribute information of the second user acquired by the registered user information acquisition unit, and, when the second user is an unregistered user whose attribute information is not stored in the storage device, executes a second relationship estimation process to estimate the relationship between the first user and the second user based on the location where the second user boarded the mobile body. The configuration of the passenger relationship estimation device of configuration 1 can be realized by executing the program of configuration 7 by a computer. [Explanation of symbols]

[0061] 1...occupant relationship estimation device, 2...ECU, 3...navigation device, 10...processor, 11...registered user information acquisition unit, 12...user relationship estimation unit, 13...destination recognition unit, 14...moving object location recognition unit, 15...user registration suggestion unit, 16...content output control unit, 20...memory, 21...program, 22...registered user data, 30...communication unit, 40...center display, 41...driver's seat speaker, 42...driver's seat microphone, 43...driver's seat camera, 50a...passenger seat display , 51a... passenger seat speaker, 52a... passenger seat microphone, 53a... passenger seat camera, 50b... left rear seat display, 51b... left rear seat speaker, 52b... left rear seat microphone, 53b... left rear seat camera, 50c... right rear seat display, 51c... right rear seat speaker, 52c... right rear seat microphone, 53c... right rear seat camera, 90a, 90b, 95... communication terminal, 100... vehicle (mobile object), 200... communication network, 210... content server, 211... user management server, U1 to U3... users.

Claims

1. a registered user information acquisition unit that accesses a storage device in which attribute information of registered users who use mobile objects is stored, and acquires attribute information of the registered users who are riding in the mobile object; a user relationship estimation unit that, when a first user and a second user are on board the moving object and the first user and the second user are registered users, executes a first relationship estimation process to estimate the relationship between the first user and the second user based on the attribute information of the first user and the attribute information of the second user acquired by the registered user information acquisition unit, and, when the second user is an unregistered user whose attribute information is not stored in the storage device, executes a second relationship estimation process to estimate the relationship between the first user and the second user based on the location where the second user boarded the moving object; A passenger relationship estimation device comprising:

2. The user relationship estimation unit storing user relationship information indicating the relationship between the first user and the second user estimated by the first relationship estimation process in the storage device; when a first predetermined time or more has elapsed since the user relationship information was saved in the storage device, outputting registered relationship confirmation information from a notification device used in the mobile object, the registered relationship confirmation information prompting a user to confirm the relationship between the first user and the second user indicated by the user relationship information; When relationship update instruction information instructing an update of the user relationship information is input to an input device used in the mobile body in response to output of the registered relationship confirmation information from the notification device, the relationship between the first user and the second user is again estimated by the first relationship estimation process, and the user relationship information stored in the storage device is updated. The passenger relationship estimation device according to claim 1 .

3. a destination recognition unit that recognizes a destination of the moving object; The user relationship estimation unit corrects the relationship between the first user and the second user estimated by the second relationship estimation process in accordance with the destination. The passenger relationship estimation device according to claim 1 or 2.

4. a descending mobile object location recognition unit that recognizes a descending mobile object location where the second user descends from the mobile object; The user relationship estimation unit stores, in a storage device for a second predetermined time, information indicating the relationship between the first user and the second user estimated by the second relationship estimation process when the previous dismounting vehicle location recognition unit recognizes that the second user, who is the unregistered user, has dismounted from the vehicle at a specific dismounting vehicle location. The passenger relationship estimation device according to claim 1 or 2.

5. a descending mobile object location recognition unit that recognizes a location where the second user descends from the mobile object; and a user registration suggestion unit that, when it is recognized by the previous dismounting mobile object location recognition unit that the second user, who is the unregistered user, has dismounted from the mobile object at the specific dismounting mobile object location a predetermined number of times or more, stores attribute information of the second user in the storage device and outputs, from a notification device used in the mobile object, registration suggestion information that suggests making the second user the registered user. The passenger relationship estimation device according to claim 1 or 2.

6. A computer-implemented passenger relationship estimation method, comprising: a registered user information acquisition step of accessing a storage device in which attribute information of a registered user who uses a mobile object is stored and acquiring attribute information of the registered user who is riding in the mobile object; a user relationship estimation step for executing a first relationship estimation process to estimate the relationship between the first user and the second user based on the attribute information of the first user and the attribute information of the second user acquired in the registered user information acquisition step when the first user and the second user are on board the moving body, and executing a second relationship estimation process to estimate the relationship between the first user and the second user based on the location where the second user boarded the moving body when the second user is an unregistered user whose attribute information is not stored in the storage device; A passenger relationship estimation method including:

7. Computer, a registered user information acquisition unit that accesses a storage device in which attribute information of registered users who use mobile objects is stored, and acquires attribute information of the registered users who are riding in the mobile object; a user relationship estimation unit that, when a first user and a second user are on board the moving object and the first user and the second user are registered users, executes a first relationship estimation process to estimate the relationship between the first user and the second user based on the attribute information of the first user and the attribute information of the second user acquired by the registered user information acquisition unit, and, when the second user is an unregistered user whose attribute information is not stored in the storage device, executes a second relationship estimation process to estimate the relationship between the first user and the second user based on the location where the second user boarded the moving object; A program that makes it work.

Images