Information providing apparatus and information providing method

Abstract

To provide an information provision device and an information provision method which can suppress the occurrence of such a situation that gives the uncomfortable feeling to a user.SOLUTION: An information provision device decides a topic to be provided to a user on the basis of the current position or destination location of a vehicle, provides first information about the topic to the user by using an output device 2 mounted on the vehicle, estimates the degree of interest indicating the degree of interest of the user to the topic on the basis of a change in the action of the user following provision of the first information, and provides additional second information about the topic to the user by using the output device 2 according to the degree of interest.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information providing apparatus and an information providing method.

Background Art

[0002] An information presentation system is known that is provided in a manned moving body and presents information regarding the travel of the moving body to the driver (Patent Document 1). The information presentation system acquires one or more pieces of information among travel information indicating the travel state of the moving body, external environment information necessary for the travel of the moving body, and driver information related to the driver who operates the moving body from sensors, generates presentation information to be presented to the driver from the acquired information, and causes the driver to perceive the generated presentation information via a plurality of display bodies.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the above prior art, when providing information to the user, the user's interest in the provided information is not considered. Therefore, in the above prior art, there is a problem that detailed additional information is provided about a topic that the user is not interested in, giving the user a sense of discomfort.

[0005] The problem to be solved by the present invention is to provide an information providing apparatus and an information providing method capable of suppressing the occurrence of a situation that gives the user a sense of discomfort.

Means for Solving the Problems

[0006] The present invention determines a topic to be provided to a user based on the current position or destination of a vehicle, provides first information regarding the topic to the user using an output device mounted on the vehicle, estimates a degree of interest indicating the degree of the user's interest in the topic based on a change in the user's behavior accompanying the provision of the first information, and provides additional second information regarding the topic to the user using the output device according to the degree of interest. Moreover, when the degree of interest is equal to or higher than a predetermined first degree of interest and the second information is provided to the user, and the degree of interest is equal to or higher than a predetermined second degree of interest, which is higher than the first degree of interest, cause an output device to display an image including the user and an image of the object indicated by the first information; when the user is having a conversation about a topic different from the determined topic, do not provide the first information to the user; when providing the second information to the user together with an effect using sound, increase the volume of the sound as the degree of interest increases; and when the vehicle occupants are only the driver, execute any one of not providing the first information to the user This solves the above problems.

Advantages of the Invention

[0007] According to the present invention, since information is added according to the degree of interest, it is possible to suppress the occurrence of a situation that gives discomfort to the user.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2A

Figure 2B

Figure 3A

Figure 3B

Figure 3C

Figure 4A

Figure 4B

Figure 4C

Figure 5

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0010] [Configuration of Information Provision System] FIG. 1 is a block diagram showing an information provision system 10 according to the present invention. The information provision system 10 is an in-vehicle system that not only passively provides information according to the instructions of the vehicle occupants, but also actively provides information to the occupants by itself. By actively providing information by the system, two-way communication is established between the system and the occupants, and the satisfaction of the occupants with respect to the system can be improved.

[0011] The information provision system 10 can be mounted not only on a private vehicle that travels under autonomous driving control to a destination set by the occupant, but also on a vehicle used for a rental car or ride-sharing service, a vehicle used for a carpooling service, etc. The carpooling service is a service that assigns a vehicle that transports a user from a boarding place to a getting-off place to the user, for example, a pick-up and drop-off service at an airport, a station, a hotel, etc. using a manned and unmanned taxi. Hereinafter, the occupant of the vehicle on which the information provision system 10 is mounted will also be simply referred to as a "user".

[0012] As shown in FIG. 1, the information provision system 10 includes a detection device 1, an output device 2, an input device 3, map information 4, a vehicle position detection device 5, a navigation device 6, and an information provision device 7. The detection device 1 includes an in-vehicle camera 11, a microphone 12, an out-vehicle camera 13, a vehicle speed sensor 14, an acceleration sensor 15, and a yaw rate sensor 16, and the output device 2 includes a display 21 and a speaker 22. The devices included in the information provision system 10 are connected by a CAN (Controller Area Network) or other in-vehicle LAN and can exchange information with each other.

[0013] The detection device 1 is a device for detecting the user's state. The information providing device 7 uses the detection result of the detection device 1 to recognize the in-vehicle environment. For the recognition of the in-vehicle environment, the detection results of the in-vehicle camera 11 and the microphone 12 are mainly used.

[0014] The in-vehicle camera 11 is a camera installed inside the vehicle. As the in-vehicle camera 11, a camera equipped with an imaging element such as a CCD or a CMOS, an ultrasonic camera, an infrared camera, etc. can be used. The in-vehicle camera 11 is installed at a position where the user's state can be appropriately detected from the image acquired by the in-vehicle camera 11. For example, the in-vehicle camera 11 is installed at a position where it can photograph the user's face so as to recognize the user's expression. The object photographed by the in-vehicle camera 11 is an object existing inside the vehicle, for example, the user's body (such as the face, arms, and legs), the vehicle seat and window, in-vehicle devices such as a display, and the switches of in-vehicle devices.

[0015] The microphone 12 is a device for acquiring the sound inside the vehicle as audio data. As the microphone 12, a stand microphone, a hands-free microphone, a gun microphone, etc. can be used. The microphone 12 may be omnidirectional or may have directivity. Also, the communication method may be either wired or wireless. The sound acquired by the microphone 12 includes the voice uttered by the user, the sound caused by the user's actions, the sound emitted by the speaker 22 of the output device 2, and the operation sound generated when the user operates the input device 3.

[0016] The number of the in-vehicle camera 11 and the microphone 12 can be set to an appropriate value within a range where the user's state can be appropriately detected. Also, the information providing device 7 acquires the detection results of the in-vehicle camera 11 and the microphone 12 at a predetermined time interval as necessary.

[0017] The detection device 1 detects the state of the user as well as objects around the vehicle and the driving state of the vehicle. The outside camera 13, the vehicle speed sensor 14, the acceleration sensor 15, and the yaw rate sensor 16 are mainly used to recognize the driving environment outside the vehicle and the driving state of the vehicle. Hereinafter, the subject vehicle will also be simply referred to as the "vehicle."

[0018] The exterior camera 13 is a camera installed outside the vehicle, and may be the same camera as the interior camera 11. The information providing device 7 recognizes the vehicle's driving environment based on images captured by the exterior camera 13. A single vehicle may be equipped with multiple exterior cameras 13, and may be located, for example, near the front grille, the bottom of the left and right door mirrors, and the rear bumper. This reduces blind spots when recognizing objects around the vehicle. Objects captured by the exterior camera 13 include, for example, lane boundaries, center lines, road markings, medians, guardrails, curbs, highway sidewalls, road signs, traffic lights, pedestrian crossings, and traffic restrictions. Objects also include obstacles that may affect the vehicle's driving, such as automobiles (other vehicles) other than the vehicle itself, motorcycles, bicycles, and pedestrians.

[0019] The vehicle speed sensor 14 is a device for detecting the traveling speed of the vehicle, and for example, outputs a pulse signal corresponding to the rotation speed of the vehicle's wheels, and calculates the traveling speed of the vehicle using the output pulse signal. The acceleration sensor 15 is a device for detecting the acceleration of the vehicle, and for example, measures the movement amount of a weight (mass) supported by a spring and a damper, and calculates the acceleration of the vehicle using the measured movement amount. The yaw rate sensor 16 is a device for detecting the yaw rate, which is the rate of change of the yaw angle of the vehicle, and is, for example, a gyro sensor. In addition to these, the detection device 1 may include a steering angle sensor and an inertial measurement unit.

[0020] The number of vehicle speed sensors 14, acceleration sensors 15, and yaw rate sensors 16 can be set to any appropriate value within a range that allows appropriate detection of the vehicle's running state. The information providing device 7 acquires the detection results of the outside camera 13, vehicle speed sensor 14, acceleration sensor 15, and yaw rate sensor 16 at predetermined time intervals as needed.

[0021] The output device 2 is a device for providing the user with the information output from the information providing device 7, and includes a display 21 and a speaker 22. The display 21 is, for example, a liquid crystal display provided on an instrument panel, a projector such as a head-up display (HUD), etc. The output device 2 may also be a robot equipped with the display 21 and the speaker 22 and capable of two-way communication with a human, or may be the user's smartphone or smartwatch. In this case, the robot, smartphone, and smartwatch are connected to the information providing device 7 so that they can exchange information with each other.

[0022] The input device 3 is a device for the user to input instructions to the information providing device 7, and is, for example, a touch panel that is input by the user's finger or a stylus pen, and a switch attached to the steering wheel of the vehicle. The microphone 12, which is the detection device 1, can also function as the input device 3. Specifically, the microphone 12 detects an instruction by voice from the user, and outputs the detected instruction to the information providing device 7 as an instruction input to the input device 3.

[0023] The positions at which the above-mentioned detection device 1, output device 2 and input device 3 are installed will be described below with reference to FIGS. 2A and 2B.

[0024] Figure 2A is a front view when looking forward from between the driver's seat and the passenger seat in a vehicle in which a user rides. In the vehicle shown in Figure 2A, the driver's seat is provided on the right side with respect to the traveling direction of the road, and the passenger seat is provided on the left side with respect to the traveling direction of the road. In the driver's seat, a steering wheel A1 and an instrument panel A2 are provided in front of the driver. Above the instrument panel A2, a rearview mirror (rearview mirror) A4 is attached to the roof via a bracket A3.

[0025] In this case, the in-vehicle camera 11 is attached to the rearview mirror A4, for example, as shown in Figure 2A, and the microphone 12 is installed at the center portion in the vehicle width direction of the instrument panel A2. Thereby, the face of the user and the voice emitted by the user can be appropriately detected. Further, the display 21 is installed below the microphone 12 at the center portion in the vehicle width direction of the instrument panel A2, which is a position where the user can easily view it. And the speaker 22 is installed inside the instrument panel A2 on the left side of the display 21. The display 21 shown in Figure 2A includes a touch panel as the input device 3. On the other hand, the out-vehicle camera 13, the vehicle speed sensor 14, the acceleration sensor 15, and the yaw rate sensor 16 are installed at positions that cannot be viewed from the passenger compartment, such as bumpers and engine rooms.

[0026] On the other hand, Figure 2B is a front view when looking forward from the rear seat in a vehicle in which a user rides. The vehicle shown in Figure 2B is assumed to have the driver's seat provided on the right side with respect to the traveling direction of the road and the passenger seat provided on the left side with respect to the traveling direction of the road, similar to the vehicle shown in Figure 2A. In this case, for example, as shown in Figure 2B, the display 21a can be attached to the roof B2 via a bracket B1. Further, a display 21b can be installed between the seat back B3 and the headrest B4 on the passenger seat side, and a display 21c can be installed on the seat back B5 on the driver's seat side. The displays 21a to 21c shown in Figure 2B incorporate a microphone and a speaker. Further, the displays 21a to 21c each include a touch panel as the input device 3.

[0027] Note that the arrangements shown in FIGS. 2A to 2B are merely examples, and the positions where the detection device 1, the output device 2, and the input device 3 are installed are not limited to those shown in FIGS. 2A to 2B. For example, in the case shown in FIG. 2A, the in-vehicle camera 11 may be integrated with the rearview mirror A4, and the microphone 12 and the speaker 22 may be integrated. Further, the display portion of the display 21 may be extended in the vehicle width direction of the instrument panel A2, or may be projected onto the windshield A5 in front of the driver's seat as a head-up display. On the other hand, in the case shown in FIG. 2B, in addition to the in-vehicle camera 11 in the front of the passenger compartment as shown in FIG. 2A, an in-vehicle camera may be attached to the roof B2 via a bracket B1. Thereby, the state of the user in the rear seat can be detected more appropriately.

[0028] Returning to FIG. 1, the map information 4 is information used for generating a travel route and / or travel control, and includes road information and facility information, and their attribute information. The road information and the attribute information of the road include information such as the width of the road, the radius of curvature of the road, the structure of the road shoulder, road traffic regulations (speed limit, possibility of lane change), the merging point and branching point of the road, and the position where the number of lanes increases or decreases. Further, the map information 4 may be high-precision map information capable of grasping the movement trajectory for each lane. The high-precision map information includes two-dimensional position information and / or three-dimensional position information at each map coordinate, road / lane boundary information at each map coordinate, road attribute information, lane up / down information, lane identification information, connecting destination lane information, and the like. The map information 4 is stored in a recording medium of a device mounted on the vehicle or a database 9 provided in an external server in a readable state. The information providing device 7 acquires the map information 4 as necessary.

[0029] The vehicle position detection device 5 is a positioning system for calculating the current position of the vehicle. The vehicle position detection device 5 calculates the current position of the vehicle using, for example, radio waves received from a satellite for the GPS (Global Positioning System). Alternatively or additionally, the vehicle position detection device 5 estimates the current position of the vehicle using vehicle speed information acquired from the vehicle speed sensor 14 and acceleration information acquired from the acceleration sensor 15, and compares the estimated current position with the map information 4 to calculate the current position of the vehicle.

[0030] The navigation device 6 is a device that calculates a driving route for traveling from the current position of the vehicle calculated by the vehicle position detection device 5 to a destination set by the user. The navigation device 6 searches for a driving route for the vehicle to reach the destination from the current position using road information, facility information, etc. from the map information 4. The driving route includes information on at least the road the vehicle is traveling on, the traveling lane, and the vehicle's traveling direction, and is displayed, for example, as a linear diagram. There may be multiple driving routes depending on the search conditions. The driving route calculated by the navigation device 6 is output to the information providing device 7 as necessary.

[0031] The information providing device 7 is a device that controls and cooperates with devices included in the information providing system 10 to determine a topic to be provided to a user based on the current location or destination of the vehicle, and provides information on the determined topic to the user. The information providing device 7 is, for example, a computer, and includes a CPU (Central Processing Unit) 71 that is a processor, a ROM (Read Only Memory) 72 that stores a program, and a RAM (Random Access Memory) 73 that functions as an accessible storage device. The CPU 71 is an operating circuit that functions as the information providing device 7 by executing the program stored in the ROM 72.

[0032] In addition, the information providing device 7 can acquire information from an external database 9 via a network as necessary. The network is, for example, a telecommunications line network such as the Internet or a LAN (local area network). The communication method may be wired or wireless, and may utilize mobile communication such as 4G / LTE or 5G.

[0033] [Control Unit] The program used in the information providing device 7 includes a control unit 8 which is a functional block for realizing the function of determining the topic to be provided to the user and the function of providing information to the user. As shown in FIG. 1, the control unit 8 includes a determination unit 81, a provision unit 82, and an estimation unit 83. In FIG. 1, each part is extracted for convenience. Hereinafter, the functions performed by each functional block of the control unit 8 will be described.

[0034] The determination unit 81 has a function of determining a topic to be provided to the user based on the position information. Examples of the position information include the current position of the vehicle, the destination set by the user, and the position on the set driving route. The current position of the vehicle is acquired from the own vehicle position detection device 5, and the set driving route and destination are acquired from the navigation device 6. The topic to be provided to the user is not particularly limited as long as it is determined based on the position information. Examples of the topic include landmarks or symbolic buildings (landmarks) existing around the current position of the vehicle, tourist attractions or historical sites existing around the destination, famous places existing on the set driving route, the history of the destination, the origin of the place name of the current position of the vehicle, famous people whose place of origin exists on the set driving route, recent events occurring near the destination, geographical statistical data (for example, population) around the current position of the vehicle, local cuisine of the destination or local specialties, and the like. Information related to these topics is stored in the map information 4 as facility information, for example, after being associated with the position information.

[0035] The providing unit 82 has a function of providing the user with information regarding the topic determined by the determining unit 81. For providing the information, the output device 2 mounted on the vehicle is used. In particular, when providing the user with information regarding a certain topic for the first time, the information to be provided is displayed on the display 21 as an image. At this time, the voice notification using the speaker 22 is not performed as much as possible, and when generating sound, it is limited to only the minimum effective sound. This is because providing information using voice effects from the beginning may give the user an uncomfortable feeling. Note that, among the information regarding a certain topic, the information provided to the user for the first time is referred to as first information, and the other information is distinguished as second information.

[0036] The first information provided to the user is basic information regarding the topic to be provided to the user. That is, it is information that hints at the topic to be provided to the user, and is not detailed information regarding the topic. This is because the interest in the topic and the knowledge regarding the topic vary for each user. For example, when it is determined that a symbolic building is the topic, as the first information, information that hints at the existence of the building is provided to the user. Also, when it is determined that the battlefield site of the Warring States period is the topic, as the first information, the military flag of the army that fought in the battle is presented to the user. Furthermore, when it is determined that local gourmet is the topic, as the first information, information that hints at cooking or meals is provided to the user. The first information is stored in the map information 4 as facility information in association with the topic. Also, the first information may be stored in the database 9. Hereinafter, specific examples of the first information provided to the user will be described with reference to FIGS. 3A to 3C.

[0037] FIG. 3A is a front view of the display 21a. In FIG. 3A, it is assumed that the topic determined by the determining unit 81 is a radio tower existing near the current position of the vehicle. In this case, in order to hint at the existence of the radio tower to the user, the providing unit 82 displays an image X composed of the radio tower and clouds on the display 21a. The image X is data of an illustration in which the radio tower is deformed, and is stored in the ROM 72 of the information providing device 7 or the database 9.

[0038] FIG. 3B is a front view of the display 21b. In FIG. 3B, it is assumed that the topic determined by the determination unit 81 is a cafe near the destination. In this case, the providing unit 82 displays, on the display 21b, an image Y in which a character is sniffing an aroma to hint at a meal to the user. The image Y may be a still image or a moving image. Like the image X, the image Y is stored in the ROM 72 or the database 9 of the information providing device 7.

[0039] 3C is a front view of the display 21c. In FIG. 3C, it is assumed that the topic determined by the determination unit 81 is a song related to the vicinity of the current location of the vehicle. In this case, the provision unit 82 displays, for example, an image Z of musical notes flowing from left to right on the display 21c to hint to the user at the song or the singer of the song. The image Z is a moving image, and like the image X, is stored in the ROM 72 or the database 9 of the information provision device 7.

[0040] When the first information as described above is displayed on the display 21 installed on the instrument panel A2, it is necessary to comply with the laws and regulations of the country in which the vehicle is traveling and not to interfere with the driver's driving.

[0041] 1 , if the user does not want to have a conversation or if the user's condition is not suitable for providing the first information to the user, the providing unit 82 does not provide the first information to the user. For example, if the driver is the only occupant of the vehicle, the providing unit 82 does not provide the first information to the user. This is because the driver may not be able to concentrate on driving.

[0042] As another example, if at least one of the users other than the driver is asleep, the providing unit 82 does not provide the first information to the users. Specifically, the providing unit 82 uses the in-vehicle camera 11 to capture images of the users' faces, performs pattern matching on the captured images, and determines whether any of the users other than the driver has their eyelids closed. Alternatively or in addition, the providing unit 82 detects the users' voices using the microphone 12, performs voice recognition on the detected voices, and determines whether any of the users other than the driver is breathing heavily or snoring. Then, if the providing unit 82 determines that there is a user with their eyelids closed and snoring among the users, it determines that at least one of the users other than the driver is asleep, and does not provide the first information to the users.

[0043] When it is determined that the driver is asleep, the providing unit 82 immediately notifies the user, using the display 21 and the speaker 22, that the driver is asleep.

[0044] As another example, the providing unit 82 estimates the driver's driving load, and does not provide the first information to the user if the driving load exceeds a predetermined load. The driving load refers to the degree of load required for the driver to recognize, make decisions, and perform operations required to drive while avoiding contact with obstacles. The driving load can be estimated, for example, based on the number of decisions the driver must make and the length of time the driver can use to make decisions. That is, if the driver has many decisions to make and only a short amount of time to make decisions, the driving load is estimated to be higher than if the driver has few decisions to make and only a long amount of time to make decisions. The driving load is estimated using at least one of the driver's state, the vehicle's current position, obstacles present around the vehicle, and the vehicle's driving state.

[0045] For example, when the current position of the vehicle is in an urban area and a plurality of bicycles traveling on the road and vehicles parked on the road shoulder are detected by the out-of-vehicle camera 13, the driver has to make many judgments within a relatively short period of time (for example, 1 to 10 seconds) in order to avoid contact with the bicycles and parked vehicles. Also, in a congested urban area, if the avoidance operation is delayed, it will be impossible to avoid obstacles and the vehicle will come to a stop. Therefore, it is presumed that the driving load on the driver is high.

[0046] Also, when the current position of the vehicle is in a mountainous area and it is determined from the detection results of the acceleration sensor 15 and the yaw rate sensor 16 that the vehicle is repeatedly accelerating / decelerating and turning, the driver has to make a judgment within the time for traveling between curves (for example, 1 to 5 seconds) in order to drive along the mountain road and perform appropriate driving operations. Therefore, in this case, it is presumed that the driving load on the driver is high. Similarly, when the current position of the host vehicle is near a highway on-ramp, when the host vehicle is traveling through an intersection, when the number of blinks of the driver decreases and the number of times of checking surrounding obstacles increases (that is, when the driver is tense), etc., it is also presumed that the driving load on the driver is high.

[0047] On the other hand, when the current position of the vehicle is on a straight motorway with good visibility and it is determined from the detection results of the vehicle speed sensor 14, the acceleration sensor 15 and the yaw rate sensor 16 that the vehicle is traveling straight at a constant speed, there are few matters for the driver to judge, and even if the start of the avoidance operation is delayed, a braking distance can be ensured between the vehicle and the obstacle for the vehicle to stop. Therefore, it is presumed that the driving load on the driver is low.

[0048] A predetermined load that serves as a criterion for whether the providing unit 82 provides the first information can be set as an appropriate load within a range that does not interfere with the driver's recognition and judgment. For example, when driving on an urban area congested with pedestrians, bicycles, and parked vehicles or on a mountain road with continuous curves, the driving load is set as "high", when driving on a non-congested suburban road, the driving load is set as "medium", and when driving straight on a highway with no other vehicles around, if the driving load is set as "low", the driving load "low" is set as the predetermined load. Thereby, the first information can be provided to a driver exposed to a driving load of "medium" or "high", and the occurrence of a situation where the driver cannot concentrate on driving can be suppressed.

[0049] As yet another example, when users are having a conversation about a topic different from the topic determined by the determination unit 81, the providing unit 82 does not provide the first information to the users. Specifically, using the microphone 12, the voice uttered by the user is detected, voice recognition processing is performed on the detected voice, and the topic of the conversation in which the users are talking is recognized. In order to recognize the topic from the content of the conversation, the providing unit 82 performs text mining such as morphological analysis on, for example, the text data of the conversation obtained by voice recognition, and estimates the topic based on the meaning and type (part of speech, conjugation, etc.) of the words that appear, the frequency of appearance of the words, and the appearance pattern. On the other hand, when users are having a conversation about the same topic as the topic determined by the determination unit 81, the first information is provided to the users. At this time, in order to notify the user of the presentation of the first information, a sound effect may be output from the speaker 22.

[0050] The estimation unit 83 has a function of estimating how interested the user is in the topic determined by the determination unit 81. Hereinafter, the degree of the user's interest in the topic is also referred to as "degree of interest". The estimation unit 83 estimates the degree of interest based on the user's reaction when the first information is provided. Specifically, the estimation unit 83 detects the user's behavior before the first information is provided from the output device 2 and the user's behavior after the first information is provided from the output device 2. Then, it recognizes how the user's behavior has changed before and after the provision of the first information due to the provision of the first information, and estimates the degree of interest based on the change.

[0051] The user's actions are detected using the in-vehicle camera 11 and the microphone 12. For example, an image including the user's face is acquired from the in-vehicle camera 11, pattern matching is performed on the acquired image, and the user's eyes are detected. Then, based on the orientation of the user's face and the positions of the iris and pupil in the eyes, the direction the user is looking at is detected. As another example, the voice emitted by the user is acquired from the microphone 12, voice recognition processing is performed on the acquired voice, and the content of the user's conversation is detected as text data. Then, appropriate natural language processing such as word segmentation and part-of-speech tagging is performed on the text data to recognize the content the user is speaking. Also, when an operation is input from an input device 3 such as a touch panel, it is recognized that the user is inputting an operation to the input device 3.

[0052] The change in the user's actions is recognized by comparing the user's actions before and after the provision of the first information. Examples of the change in the user's actions (the user's reaction) include a change in the user's line of sight, a change in the object the user is looking at, a change in the topic of conversation between users, a sleeping user waking up, the user pointing at an object, users starting a conversation with each other, and the user inputting an operation from the input device 3. Then, when there is no change in the user's actions before and after the provision of the first information or when the user takes an action to reject the provision of the first information, the estimation unit 83 determines that the user is not showing interest in the provided topic and estimates that the degree of interest is low. In contrast, when the user's actions change before and after the provision of the first information and the change is not one that rejects the provision of the first information, it is determined that the user is showing interest in the provided topic and the degree of interest is estimated to be high.

[0053] An example of a behavior of refusing to provide the first information is when the user inputs a predetermined operation into the input device 3 after the first information is provided. Examples of predetermined operations include an operation of changing the display 21 on which the first information is displayed and erasing the display of the first information, an operation of lowering the volume of the speaker 22 after announcing the first information together with a sound effect, and an operation of turning off the display 21. If these predetermined operations are input into the input device 3 after the first information is provided, it is estimated that the user is not interested in the topic alluded to in the first information, even if the user's behavior has changed. Therefore, when these behaviors are detected, it is estimated that the user's level of interest is low. Furthermore, if the content of the user's conversation is negative about the topic alluded to in the first information, it is also determined that the user has refused to provide the first information, and it is estimated that the user's level of interest is low.

[0054] On the other hand, if a user is provided with first information related to a certain topic and then engages in a conversation about the topic, it is estimated that the user is interested in the topic implied in the first information. In this case, it is estimated that the user has a higher level of interest than if the user is not engaged in a conversation about the topic implied in the first information after the first information is provided. As described above, the content of the user's conversation is recognized by performing speech recognition processing on the user's voice acquired from the microphone 12. Note that the phrase "a user is conversing on the topic implied in the first information" includes not only a case where the user starts a new conversation after presenting the first information, but also a case where the user has been conversing before presenting the first information and then the topic of the conversation changes due to the presentation of the first information.

[0055] Furthermore, if the first information relates to an object outside the vehicle that is visible to the user from the current location of the vehicle, and the user looks outside the vehicle after the first information is provided, it is estimated that the user is interested in the object outside the vehicle. In this case, the user's level of interest is estimated to be higher than when the user does not look outside the vehicle after the first information about the object outside the vehicle is provided. As described above, whether the user is looking outside the vehicle is determined by performing pattern matching on an image including the user's face and using the detected direction of the user's face and the positions of the iris and pupils. Alternatively or additionally, if the user looks in the direction of the object indicated in the first information after the first information is provided, it is estimated that the user is more interested than when the user does not look in the direction of the object indicated in the first information after the first information is provided.

[0056] Examples of objects include buildings, tourist attractions, historical sites, shrines, temples, restaurants, cafes, and government offices. Whether or not the user can see the object from the current position of the vehicle is determined using the current position of the vehicle acquired from the vehicle position detection device 5 and the position information of the object acquired from the map information 4. For example, the distance between the current position of the vehicle and the object is calculated, and if the distance is equal to or less than a predetermined distance (e.g., 1 to 2000 m) and no obstacle exists between the vehicle and the object, it is determined that the user can see the object from the current position of the vehicle. On the other hand, if the distance between the current position of the vehicle and the object exceeds the predetermined distance or if an obstacle exists between the vehicle and the object, it is determined that the user cannot see the object from the current position of the vehicle.

[0057] Whether the user is facing the direction of the object indicated in the first information is determined using the current position of the vehicle acquired from the vehicle position detection device 5 and the position information of the object acquired from the map information 4. For example, the direction in which the object exists relative to the current position of the vehicle is calculated from the current position of the vehicle and the position information of the object. Then, the direction of the user's line of sight, detected using pattern matching on the image, is compared with the direction in which the object exists. If the direction of the user's line of sight is the same as the direction in which the object exists, it is determined that the user is facing the direction in which the object indicated in the first information exists, and if the direction of the user's line of sight is different from the direction in which the object exists, it is determined that the user is not facing the direction in which the object indicated in the first information exists.

[0058] The estimation unit 83 can estimate the level of interest in several stages according to changes in the user's behavior. For example, the level of interest can be estimated in four stages: "none" indicating no interest in the topic, "low" indicating low interest in the topic, "medium" indicating interest in the topic, and "high" indicating high interest in the topic.

[0059] Specifically, if the user takes an action to refuse the provision of the first information after the first information is provided, such as changing the display on the display 21 and inputting an operation to erase the display of the first information, the level of interest is estimated to be "none." If there is no change in the user's behavior before and after the first information is provided, the level of interest is estimated to be "low." If the user looks at the display 21 displaying the first information after the first information is provided, or if the user faces the direction of the object shown in the first information, the level of interest is estimated to be "medium." If the user engages in a conversation about the topic alluded to in the first information after the first information is provided and seeks further information on the topic, the level of interest is estimated to be "high."

[0060] When multiple users are riding in a vehicle, the degree of interest is estimated according to the number of people interested in the topic hinted at by the first piece of information. For example, when three users are riding in a vehicle and for a certain topic, two users are estimated to have a "high" degree of interest and the remaining one user is estimated to have a "low" degree of interest, the degrees of interest of the three users are averaged, and the degree of interest of all users is estimated to be "medium" or "high". In this case, a value indicating the degree of interest may be set for each stage of the degree of interest, or the set value may be weighted. For example, the degree of interest "none" is set to "0", the degree of interest "low" is set to "1", the degree of interest "medium" is set to "2", and the degree of interest "high" is set to "3". As another example, the degree of interest "none" is set to "-3", the degree of interest "low" is set to "0", the degree of interest "medium" is set to "3", and the degree of interest "high" is set to "6".

[0061] After the providing unit 82 of the present embodiment provides the first piece of information regarding a certain topic, it provides additional information regarding the topic to the user according to the degree of interest estimated by the estimating unit 83. Specifically, when the degree of interest estimated by the estimating unit 83 is lower than a predetermined first degree of interest, no additional information is provided to the user, and when the degree of interest is equal to or higher than the predetermined first degree of interest, additional information is provided to the user. Here, the additional information regarding the topic is referred to as the second piece of information. In this way, by providing the second piece of information according to the degree of interest, it is possible to prevent providing information on topics that the user is not interested in and suppress the occurrence of a situation that gives the user an unpleasant feeling.

[0062] The predetermined first degree of interest can be set as appropriate within a range that can prevent providing information on topics that the user is not interested in and giving the user an unpleasant feeling. For example, when the degree of interest is estimated by dividing it into four stages of "none", "low", "medium", and "high" as described above, the first degree of interest is set to "medium". That is, when the degree of interest is "none" or "low", which is lower than "medium", no additional second piece of information is provided to the user. On the other hand, when the degree of interest is "medium" or "high", which is higher than "medium", additional second piece of information is provided to the user.

[0063] The additional second information is more detailed information about the topic provided to the user than the first information. For example, if it is decided to talk about an iconic building, the first information is provided to the user, hinting at the building's existence, and the second information is provided, including the building's height, completion date, designer, and historical background. If it is decided to talk about the remains of a battlefield from the Warring States period, the first information is provided to the user, including the flag of the army that fought in the battle, and the second information is displayed on the display 21, including the events leading up to the battle. If it is decided to talk about local gourmet food, the first information is provided to the user, hinting at cooking or eating, and the second information is displayed on the display 21, including representative recipes for the local gourmet food and the locations of restaurants that serve the local gourmet food. If it is determined from the content of the user's conversation that the user is searching for an object indicated in the first information, the second information is provided to the user, including the direction to the object. The second information, like the first information, is stored in the map information 4 and / or the database 9.

[0064] The providing unit 82 provides more detailed information for the second information as the degree of interest estimated by the estimating unit 83 increases. Alternatively or additionally, the providing unit 82 increases the amount of the second information as the degree of interest estimated by the estimating unit 83 increases. In this way, the information providing device 7 actively controls the amount and quality of information to be output according to the degree of interest, thereby facilitating communication between the system and the user and further increasing user satisfaction with the system. Furthermore, the providing unit 82 can control the sound output from the speaker 22 according to the degree of interest. For example, when providing the second information to the user, sound effects, background music (BGM), and other sounds are used for presentation. In addition, the providing unit 82 adjusts the volume of the sound output from the speaker 22 according to the degree of interest. For example, the providing unit 82 increases the volume of the sound used for presentation according to the degree of interest, within a range that does not cause discomfort to the user. This can further increase user satisfaction.

[0065] As an example, when a symbolic building is in the spotlight and the degree of interest estimated by the estimation unit 83 is "high", as the second information, information on the height, completion date, designer, and historical background of the building is displayed on the display 21 all at once or sequentially. At the same time, sound effects and background music are output from the speaker 22. On the other hand, when the degree of interest estimated by the estimation unit 83 is "medium", only the height and completion date of the building are displayed on the display 21, and no sound-based production is performed.

[0066] Hereinafter, specific examples of the second information provided to the user will be described with reference to FIGS. 4A to 4C.

[0067] FIG. 4A is a front view of the display 21a, and shows the second information when the degree of interest of the user is estimated to be "high" when the first information shown in FIG. 3A is provided to the user. In FIG. 4A, with the image X shown in FIG. 3A being displayed on the display 21a, the face Xa of the user is also displayed on the display 21a. Thus, when the degree of interest estimated by the estimation unit 83 is higher than a predetermined first degree of interest and is equal to or higher than a predetermined second degree of interest, as the second information, an image of a commemorative photo including the user and the image of the object shown in the first information is displayed on the display 21a.

[0068] The second degree of interest can be appropriately set within a range where the user does not feel uncomfortable taking a commemorative photo with the object related to the provided topic. The data of illustrations and frames used for the image of the commemorative photo are pre-stored in the ROM 72 or the database 9, and are acquired by the information providing device 7 as needed. Also, the image of the commemorative photo can be output to a device (such as a smartphone or a tablet) connected to the information providing device 7 via a network.

[0069] FIG. 4B is a front view of the display 21b and shows second information when the degree of user interest is presumed to be "medium" when the first information shown in FIG. 3B is provided to the user. In FIG. 4B, it is assumed that, based on the image Y shown in FIG. 3B, a user who is hinted at a meal is talking about a restaurant. In this case, the providing unit 82 provides, as the second information, information on a café near the destination that has been determined as the topic. Specifically, information such as the location, menu, and reviews of the café is displayed in the display portion Ya on the left side of the display 21b, and the current position of the vehicle (icon Yc) and the position of the café (icon Yd) are displayed together with map information in the display portion Yb on the right side of the display 21b.

[0070] FIG. 4C is a front view of the display 21c and shows second information when the degree of user interest is presumed to be "high" when the first information shown in FIG. 3C is provided to the user. In FIG. 4C, it is assumed that, based on the image Z shown in FIG. 3C, a user who is hinted at a song familiar to the vicinity of the current position of the vehicle is talking about the singer who sings the song. In this case, the providing unit 82 outputs, as the second information, a song familiar to the vicinity of the current position from the speaker 22. Specifically, the lyrics of the song are displayed in a scrollable state on the left display portion Za of the display 21c, and a video (music video) of the singer singing the song is displayed on the right display portion Zb of the display 21c. The video is acquired from a database 9 or the like via a network.

[0071] The second information may also be a quiz related to the topic provided to the user. The content of the quiz is not particularly limited, but for example, if the topic is geographical statistical data around the vehicle's current location or the destination, a quiz using the statistical data is displayed. As an example, a quiz asking about the population of the city, ward, town, or village where the destination is located is displayed. Also, if the topic is a famous person whose hometown is on the set driving route, a quiz asking about the famous person's age is displayed. Furthermore, if the topic is an animation set in the area around the vehicle's current location, a quiz asking about buildings that appear in the animation is displayed. These quizzes are displayed on the display 21, and sound effects and background music may be output from the speaker 22 along with the display of the quiz.

[0072] When consecutive quizzes are given, the difficulty level of the quizzes is changed according to the percentage of correct answers. In other words, if the user answers a certain quiz correctly, it is assumed that the user has a certain level of knowledge about the provided topic, and the difficulty level of the next quiz is increased. On the other hand, if the user answers a certain quiz incorrectly, it is assumed that the user does not have much knowledge about the provided topic, and the difficulty level of the next quiz is lowered or the field of the next quiz is changed. Furthermore, if the user answers a quiz correctly, famous places related to the quiz may be introduced. For example, if the topic is an animation set in the area around the destination, and the user answers a difficult quiz related to the animation correctly, real famous places that are not generally known and that appear in the animation may be introduced.

[0073] The difficulty of the above-mentioned quiz can be adjusted by the level of detail of the information asked in the quiz. For example, in a quiz asking about geographical statistical data around the vehicle's current location, the difficulty of the quiz will be lowered if basic statistical data such as population is asked, and the difficulty will be increased if the question is about local specialties that are not well known nationwide. Also, changing the topic of the quiz means, for example, changing the topic from the celebrity's background to the celebrity's achievements if a certain celebrity is the topic of discussion.

[0074] [Processing in the Information Provision System] Referring to FIG. 5, the procedure for the information providing apparatus 7 to process information will be described. FIG. 5 is an example of a flowchart showing the processing of information executed in the information provision system 10 of the present embodiment. The processing described below is executed at predetermined time intervals by the CPU 71 which is a processor of the information providing apparatus 7.

[0075] First, in step S1, by the function of the providing unit 82, it is determined whether at least one of the users other than the driver is sleeping. Subsequently, in step S2, it is determined whether the driving load of the driver exceeds a predetermined load. The information providing apparatus 7 acquires detection results from each apparatus of the detection apparatus 1 as necessary. If it is determined in step S1 that at least one of the users other than the driver is sleeping, or if it is determined in step S2 that the driving load of the driver exceeds a predetermined load, the execution of the routine is stopped and the information processing by the CPU 71 of the information providing apparatus 7 is terminated. On the other hand, if it is determined in step S1 that the users other than the driver are not sleeping, and if it is determined in step S2 that the driving load of the driver is below the predetermined load, the process proceeds to step S3.

[0076] In step S3, by the function of the determination unit 81, the current position of the vehicle is acquired from the own vehicle position detection apparatus 5. Subsequently, in step S4, the destination is acquired from the navigation apparatus 6. In the subsequent step S5, it is determined whether the current position of the vehicle or the destination has been acquired. If neither the current position of the vehicle nor the destination has been acquired, the process proceeds to step S3 and the current position of the vehicle is acquired again. If the acquisition of the current position information of the vehicle is repeated a predetermined number of times (for example, 5 times) or more, the execution of the routine may be stopped and the information processing by the CPU 71 of the information providing apparatus 7 may be terminated. On the other hand, if the current position of the vehicle or the destination has been acquired, the process proceeds to step S6.

[0077] In step S6, the function of the determination unit 81 determines a topic to be provided to the user based on the current position or destination of the vehicle. In the subsequent step S7, the function of the provision unit 82 determines whether the user is having a conversation about a topic different from the determined topic. The information providing device 7 obtains a detection result from the microphone 12 as necessary. If it is determined that the user is having a conversation about a topic different from the determined topic, the execution of the routine is stopped and the information processing by the CPU 71 of the information providing device 7 is terminated. On the other hand, if it is determined that the user is not having a conversation about a topic different from the determined topic, the process proceeds to step S8.

[0078] In step S8, the function of the provision unit 82 obtains first information regarding the determined topic from the ROM 72 or the database 9. In the subsequent step S9, the function of the estimation unit 83 detects the user's actions using the in-vehicle camera 11 and the microphone 12. In the subsequent step S10, the first information is provided to the user using the output device 2, and in the subsequent step S11, the user's actions are detected again. Then, in step S12, the function of the estimation unit 83 estimates the user's degree of interest in the provided topic from the change in the user's actions based on the detection results in steps S9 and S11.

[0079] In step S13, it is determined whether the estimated degree of interest is equal to or higher than a predetermined first degree of interest. If it is determined that the degree of interest is less than the predetermined first degree of interest, the execution of the routine is stopped and the information processing by the CPU 71 of the information providing apparatus 7 is terminated. On the other hand, if it is determined that the degree of interest is equal to or higher than the predetermined first degree of interest, the process proceeds to step S14, and the second information is provided to the user using the output device 2. In subsequent step S15, it is determined whether the estimated degree of interest is equal to or higher than a predetermined second degree of interest. If it is determined that the degree of interest is less than the predetermined second degree of interest, the execution of the routine is stopped and the information processing by the CPU 71 of the information providing apparatus 7 is terminated. On the other hand, if it is determined that the degree of interest is equal to or higher than the predetermined second degree of interest, the process proceeds to step S16, and an image including the user and the image of the object indicated by the first information is displayed on the display 21. Thereafter, the execution of the routine is stopped and the information processing by the CPU 71 of the information providing apparatus 7 is terminated. Note that steps S1 to S2, step S5, steps S7 and S15 to S16 are not essential steps and may be provided as necessary.

[0080] [Embodiment of the Present Invention] As described above, according to the present embodiment, a determination unit 81 that determines a topic to be provided to a user based on the current position or destination of a vehicle, a providing unit 82 that provides the first information regarding the topic to the user using the output device 2 mounted on the vehicle, and an estimation unit 83 that estimates a degree of interest indicating the degree of the user's interest in the topic based on a change in the user's behavior accompanying the provision of the first information are provided, and the providing unit 82 provides additional second information regarding the topic to the user using the output device 2 according to the degree of interest, and the information providing apparatus 7 is provided. Thereby, since information is added according to the degree of interest of the user in the provided topic, it is possible to suppress the occurrence of a situation in which information on a topic in which the user has no interest is provided and the user is given discomfort. In addition, since the system itself actively provides information, two-way communication is established between the system and the occupant, and the satisfaction of the occupant with respect to the system can be improved.

[0081] Furthermore, according to the information providing device 7 of this embodiment, the estimation unit 83 detects the user's behavior before the first information is provided and the user's behavior after the first information is provided, and estimates the interest level using the user's behavior before the first information is provided and the user's behavior after the first information is provided, and the providing unit 82 does not provide the second information to the user if the interest level is lower than a predetermined first interest level. This makes it possible to further prevent the user from being provided with information on a topic in which they are not interested, which may cause discomfort to the user.

[0082] Furthermore, according to the information providing device 7 of this embodiment, the estimation unit 83 estimates that the interest level is higher when the user has a conversation about the topic after the first information is provided than when the user has not a conversation about the topic after the first information is provided, thereby enabling a more accurate estimation of the user's interest level.

[0083] Furthermore, according to the information providing device 7 of this embodiment, if the user looks outside the vehicle after the first information about an object outside the vehicle that is visible from the current location is provided, the estimation unit 83 estimates that the interest level is higher than if the user does not look outside the vehicle after the first information about the object outside the vehicle is provided. This makes it possible to more accurately estimate the user's interest level.

[0084] Furthermore, according to the information providing device 7 of this embodiment, when the user faces the direction of the object indicated in the first information after the first information is provided, the estimation unit 83 estimates that the interest level is higher than when the user does not face the direction of the object indicated in the first information after the first information is provided. This makes it possible to estimate the user's interest level more accurately.

[0085] Furthermore, according to the information providing device 7 of this embodiment, the second information includes a quiz related to the topic, which can further increase user satisfaction with the system.

[0086] Further, according to the information providing apparatus 7 of the present embodiment, when the providing unit 82 provides the second information to the user and the degree of interest is equal to or higher than a predetermined first degree of interest, and when the degree of interest is equal to or higher than a predetermined second degree of interest which is higher than the first degree of interest, the providing unit 82 causes the output device 2 to display an image including the user and an image of the object indicated by the first information. Thereby, more effective presentation can be achieved.

[0087] Further, according to the information providing apparatus 7 of the present embodiment, when at least one of the users other than the driver is sleeping, the providing unit 82 does not provide the first information to the user. Thereby, it is possible to more effectively suppress the occurrence of a situation in which information on a topic that the user is not interested in is provided and the user is given discomfort.

[0088] Further, according to the information providing apparatus 7 of the present embodiment, the providing unit 82 estimates the driving load of the driver based on at least one of the current position of the vehicle, obstacles existing around the vehicle, and the driving state of the vehicle, and when the driving load exceeds a predetermined load, the providing unit 82 does not provide the first information to the user. Thereby, it is possible to suppress the occurrence of a situation in which the driver cannot concentrate on driving.

[0089] Further, according to the information providing apparatus 7 of the present embodiment, when the user is having a conversation about a topic different from the topic determined by the determination unit, the providing unit 82 does not provide the first information to the user. Thereby, it is possible to suppress the interruption of the conversation between the users and the occurrence of a situation in which the user is given discomfort.

[0090] Further, according to the information providing apparatus 7 of the present embodiment, the higher the degree of interest, the more detailed the second information is made about the topic and / or the amount of the second information is increased. Thereby, the amount and quality of the information to be output can be actively controlled according to the degree of interest. As a result, the communication between the system and the user becomes smooth, and the satisfaction of the user with respect to the system can be further enhanced.

[0091] Furthermore, according to the information providing device 7 of the present embodiment, the providing unit 82 displays the first information as an image on the output device 2, rather than notifying the user by voice. This makes it possible to further prevent the user from feeling uncomfortable when information on a topic in which the user is not interested is provided.

[0092] Furthermore, according to the information providing device 7 of the present embodiment, the providing unit 82 provides the second information to the user together with a sound effect, thereby further increasing the user's satisfaction with the system.

[0093] Furthermore, according to the information providing device 7 of this embodiment, the providing unit 82 increases the volume of the sound as the interest level increases, thereby achieving a more effective presentation.

[0094] Furthermore, according to this embodiment, an information provision method executed by a processor is provided, in which the processor determines a topic to be provided to a user based on the current location or destination of the vehicle, provides first information related to the topic to the user using an output device 2 mounted on the vehicle, estimates a level of interest indicating the user's level of interest in the topic based on a change in the user's behavior following the provision of the first information, and provides additional second information related to the topic to the user using the output device 2 according to the level of interest. This provides additional information according to the user's level of interest in the provided topic, thereby preventing the provision of information on a topic that the user is not interested in, which may cause discomfort to the user. Furthermore, by the system itself actively providing information, two-way communication between the system and the occupant is established, thereby increasing the occupant's satisfaction with the system. [Explanation of symbols]

[0095] 10. Information provision system 1...Detection device 11...In-car camera 12...Microphone 13...Exterior camera 14...Vehicle speed sensor 15…Acceleration sensor 16…Yaw rate sensor 2…Output device 21, 21a, 21b, 21c…Display 22…Speaker 3…Input device 4…Map information 5…Self-vehicle position detection device 6…Navigation device 7…Information providing device 71…CPU (Processor) 72…ROM 73…RAM 8…Control unit 81…Decision unit 82…Provision unit 83…Estimation unit 9…Database A1…Steering wheel A2…Instrument panel A3…Bracket A4…Rearview mirror A5…Windshield B1…Bracket B2…Roof B3, B5…Seat back B4…Headrest X, Y, Z…Image Xa…User's face Ya, Yb, Za, Zb…Display part Yc, Yd…Icon

Claims

1. A determination unit that determines a topic to be provided to a user based on the current position or destination of a vehicle; A providing unit that provides the user with first information regarding the topic using an output device mounted on the vehicle; An estimation unit that estimates an interest level indicating the degree of the user's interest in the topic based on a change in the user's behavior accompanying the provision of the first information, and includes: The providing unit: According to the interest level, additional second information regarding the topic is provided to the user using the output device; When the interest level is equal to or higher than a predetermined first interest level and the second information is provided to the user, when the interest level is equal to or higher than a predetermined second interest level that is higher than the first interest level, an information providing device that causes the output device to display an image including the user and an image of an object indicated by the first information.

2. A determination unit that determines a topic to be provided to a user based on the current position or destination of a vehicle; A providing unit that provides the user with first information regarding the topic using an output device mounted on the vehicle; An estimation unit that estimates an interest level indicating the degree of the user's interest in the topic based on a change in the user's behavior accompanying the provision of the first information, and includes: The providing unit: According to the interest level, additional second information regarding the topic is provided to the user using the output device; When the user is having a conversation about a topic different from the topic determined by the determination unit, the information providing device that does not provide the first information to the user.

3. A determination unit that determines a topic to be provided to a user based on the current position or destination of a vehicle; A providing unit that provides the user with first information regarding the topic using an output device mounted on the vehicle; An estimation unit that estimates an interest level indicating the degree of the user's interest in the topic based on a change in the user's behavior accompanying the provision of the first information, and includes: The providing unit: According to the interest level, additional second information regarding the topic is provided to the user using the output device; The second information is provided to the user together with an effect using sound; The information providing device that increases the volume of the sound as the interest level increases.

4. A determination unit that determines a topic to be provided to a user based on the current position or destination of a vehicle; A providing unit that provides the user with first information regarding the topic using an output device mounted on the vehicle; An estimation unit that estimates an interest level indicating the degree of the user's interest in the topic based on a change in the user's behavior accompanying the provision of the first information; and the like. The providing unit provides additional second information regarding the topic to the user using the output device according to the interest level. An information providing device that does not provide the first information to the user when the occupant of the vehicle is only the driver.

5. The estimating unit detects the user's behavior before the provision of the first information and the user's behavior after the provision of the first information. estimates the interest level using the user's behavior before the provision of the first information and the user's behavior after the provision of the first information. The providing unit The information providing device according to any one of claims 1 to 4, wherein when the interest level is lower than a predetermined first interest level, the second information is not provided to the user.

6. The estimating unit estimates that the interest level is higher when the user is having a conversation about the topic after the provision of the first information than when the user is not having a conversation about the topic after the provision of the first information. The information providing device according to any one of claims 1 to 5.

7. The estimating unit estimates that the interest level is higher when the user is looking outside the vehicle after the provision of the first information regarding an object outside the vehicle visible from the current position than when the user is not looking outside the vehicle after the provision of the first information regarding the object outside the vehicle. The information providing device according to any one of claims 1 to 6.

8. The estimating unit estimates that the interest level is higher when the user is facing the direction in which the object indicated by the first information exists after the provision of the first information than when the user is not facing the direction in which the object indicated by the first information exists after the provision of the first information. The information providing device according to any one of claims 1 to 7.

9. The second information includes a quiz regarding the topic. The information providing device according to any one of claims 1 to 8.

10. When the providing unit provides the second information to the user and the degree of interest is equal to or higher than a predetermined first degree of interest, and when the degree of interest is equal to or higher than a predetermined second degree of interest that is higher than the first degree of interest, the information providing apparatus according to any one of claims 2 to 4 causes the output device to display an image including the user and an image of an object indicated by the first information.

11. When at least one of the users other than the driver is sleeping, the information providing apparatus according to any one of claims 1 to 10 does not provide the first information to the user.

12. The providing unit estimates the driving load of the driver based on at least one of the current position of the vehicle, obstacles existing around the vehicle, and the driving state of the vehicle, and when the driving load exceeds a predetermined load, the information providing apparatus according to any one of claims 1 to 11 does not provide the first information to the user.

13. When the user is having a conversation about a topic different from the topic determined by the determining unit, the information providing apparatus according to any one of claims 1, 3, and 4 does not provide the first information to the user.

14. The higher the degree of interest, the more detailed the second information is about the topic and / or the greater the amount of the second information, according to the information providing apparatus according to any one of claims 1 to 13.

15. The providing unit causes the output device to display the first information as an image without notifying it by voice, according to the information providing apparatus according to any one of claims 1 to 14.

16. The providing unit provides the second information to the user together with an effect using sound, according to the information providing apparatus according to any one of claims 1, 2, and 4.

17. The higher the degree of interest, the louder the sound, according to the information providing apparatus according to claim 16.

18. In an information providing method executed by a processor, the processor determines a topic to be provided to a user based on the current position or destination of a vehicle, provides the first information related to the topic to the user using an output device mounted on the vehicle, estimates a degree of interest indicating the user's interest in the topic based on a change in the user's behavior accompanying the provision of the first information, and provides additional second information related to the topic to the user using the output device according to the degree of interest. An information providing method for causing an output device to display an image including the user and an image of an object indicated by the first information when the degree of interest is equal to or higher than a predetermined first degree of interest and the second information is provided to the user, and the degree of interest is equal to or higher than a predetermined second degree of interest that is higher than the first degree of interest.

19. In an information providing method executed by a processor, the processor determines a topic to be provided to a user based on the current position or destination of a vehicle, provides first information regarding the topic to the user using an output device mounted on the vehicle, estimates a degree of interest indicating the degree of the user's interest in the topic based on a change in the user's behavior accompanying the provision of the first information, provides additional second information regarding the topic to the user using the output device according to the degree of interest, and does not provide the first information to the user when the user is having a conversation about a topic different from the topic determined based on the current position or destination of the vehicle.

20. In an information providing method executed by a processor, the processor determines a topic to be provided to a user based on the current position or destination of a vehicle, provides first information regarding the topic to the user using an output device mounted on the vehicle, estimates a degree of interest indicating the degree of the user's interest in the topic based on a change in the user's behavior accompanying the provision of the first information, provides additional second information regarding the topic to the user using the output device according to the degree of interest, provides the second information to the user together with an effect using sound, and increases the volume of the sound as the degree of interest increases.

21. In an information providing method executed by a processor, the processor determines a topic to be provided to a user based on the current position or destination of a vehicle, provides first information regarding the topic to the user using an output device mounted on the vehicle, estimates a degree of interest indicating the degree of the user's interest in the topic based on a change in the user's behavior accompanying the provision of the first information, provides additional second information regarding the topic to the user using the output device according to the degree of interest, and does not provide the first information to the user when the vehicle has only a driver as an occupant.

Images