Notification control device, notification control method, notification control program, vehicle notification system, and vehicle system

Abstract

To provide a technique capable of performing an easy-to-understand notification while reducing the annoyance caused by an excessive notification.SOLUTION: An exemplary notification control device is a notification control device that performs a control in regard to a notification of information. and calculates a first index value that indicates an ease of recognition of a notification required by a notification subject in accordance with a first estimation result estimated by first input information input from an external source, performs a temporal determination of a notification stimulation amount indicating a strength of a stimulation applied to the notification subject by the notification on the basis of the first index value, calculates a second index value that indicates an emergency required when performing the notification to the notification subject in accordance with a second estimation result estimated by second input information input from the external source, adjusts the notification stimulation amount that has been temporally determined on the basis of the second index value, and determines the notification stimulation amount.SELECTED DRAWING: Figure 9

Description

[Technical field]

[0001] The present invention relates to a control technique for notifying information. [Background technology]

[0002] For example, while driving a vehicle, various types of information, such as information related to driving, information related to the vehicle state, and general information such as entertainment information and Internet information, are notified in various forms, such as visual information and audio information using a display, a speaker, etc. Various efforts have been made to provide appropriate information notification depending on the importance of the information, the driver's state, etc. (For example, see Patent Documents 1 and 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-85526 A [Patent Document 2] JP 2014-123826 A Summary of the Invention [Problem to be solved by the invention]

[0004] For example, in a vehicle, various conditions including the surrounding environmental conditions and the human conditions of the driver and the like change from moment to moment. Under such circumstances, it becomes necessary to control the notification of information in response to various changes in conditions such as environmental changes, and the conventional configurations are not adequately able to handle such changes, and more appropriate notification control is desired. For example, the frequency and amount of notifications may increase, which may annoy the recipient or make it difficult to understand the notification contents, and more appropriate notification control is desired.

[0005] In view of the above, an object of the present invention is to provide a technique capable of providing easy-to-understand notifications while reducing the annoyance caused by excessive notifications. [Means for solving the problem]

[0006] An exemplary notification control device of the present invention is a notification control device that performs control related to notification of information. The notification control device calculates a first index value indicating the ease of recognition of the notification required by the notification recipient according to a first estimation result estimated based on first input information input from the outside, provisionally determines a notification stimulus amount indicating the intensity of the stimulus that the notification will provide to the notification recipient based on the first index value, calculates a second index value indicating the urgency required when providing the notification to the notification recipient according to a second estimation result estimated based on second input information input from the outside, adjusts the provisionally determined notification stimulus amount based on the second index value, and determines the notification stimulus amount. Effect of the Invention

[0007] According to the exemplary embodiment of the present invention, a notification stimulus amount indicating the strength of the stimulus (stimulus given to the visual, auditory, etc.) given by the notification of information to the notification target is determined using a first index value and a second index value. Since the first index value is an index value indicating the ease of recognition of the notification required by the notification target, the notification stimulus amount can be determined so that the notification target can recognize (understand) the notification content by considering the index value. Furthermore, since the second index value is an index value indicating the urgency required when notifying the notification target of information, the notification stimulus amount can be determined by making an adjustment taking the index value into consideration so that information with low urgency is not excessively notified. For this reason, according to the exemplary embodiment of the present invention, it is possible to perform an easy-to-understand notification while reducing the annoyance caused by excessive notifications. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 shows a schematic configuration of an information processing system. [Diagram 2] A block diagram showing a schematic configuration of a notification control device. [Diagram 3] Schematic diagram showing the structure of the sensitivity table [Figure 4] Schematic diagram showing the configuration of a concentration table [Diagram 5]Schematic diagram showing the configuration of a look-up table for notification stimulus amount [Figure 6] A schematic diagram showing the configuration of an urgency table [Figure 7] Schematic diagram showing the configuration of a safe driving level table [Figure 8] Schematic diagram showing the composition of the emotion quotient table [Figure 9] 1 is a flowchart illustrating a flow of a notification control process executed by a notification control device. [Figure 10] A diagram showing an example of a screen where the user can set the desired priority sensation (notification method). DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Exemplary embodiments of the present invention will now be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference characters and description thereof will not be repeated.

[0010] <1. Information processing system> 1 is a diagram showing a schematic configuration of an information processing system SYS1 according to an embodiment of the present invention. In this embodiment, the information processing system SYS1 is a vehicle system applied to a vehicle. Hereinafter, the information processing system SYS1 will be referred to as a vehicle system SYS1. Note that the information processing system of the present invention is not limited to use in vehicles, and can be applied to various uses, such as use in moving objects other than vehicles, use in homes, use in factories, or use in offices.

[0011] As shown in FIG. 1, the vehicle system SYS1 includes a notification control device 1, a notification device 2, and an information source device 3. The notification control device 1 and the notification device 2, and the notification control device 1 and the information source device 3 are each provided so as to be able to communicate with each other by wire or wirelessly. The notification control device 1 and the notification device 2 constitute a notification system SYS2. In this embodiment, the notification system SYS2 is a vehicle notification system applied to a vehicle. That is, the vehicle notification system SYS2 includes the notification control device 1 and the notification device 2. The notification system of the present invention is not limited to use in vehicles, and can be applied to various uses, such as use in moving objects other than vehicles, use in homes, factories, or offices.

[0012] The notification control device 1 performs control related to the notification of information. The control operation of the notification control device 1 also includes the control of the notification device 2. In detail, the notification control device 1 determines the mode of notification for a notification target who is the subject of the notification of information, and causes the notification device 2 to perform notification according to the determined notification mode. In this embodiment, the notification target is a driver (a driver) as an example. In other words, the notification control device 1 controls the notification for the driver. The details of the notification control device 1 will be described later.

[0013] In this embodiment, the notification control device 1 is mounted on a vehicle to which a vehicle system SYS1 (vehicle notification system SYS2) is applied. However, at least a part of the functions of the notification control device 1 may be functions of a server device that is provided so as to be able to communicate with a communication device mounted on the vehicle via a communication line such as the Internet. In addition, the notification control device 1 may be, for example, a device included in a navigation device that provides route guidance to a destination, or a device partly included in the navigation device. In addition, the notification control device 1 may be, for example, a device included in a safety monitoring device that monitors the behavior of the vehicle and the surrounding conditions of the vehicle and notifies of alarms, etc., or a device partly included in the safety monitoring device.

[0014] In this embodiment, as shown in Fig. 1, various sensing information is input to the notification control device 1. At least some of the devices such as sensors that acquire the various sensing information may be included in the vehicle system SYS1. The devices included in the vehicle system SYS1 may include not only devices mounted on the vehicle, but also devices that are capable of communicating with the communication devices mounted on the vehicle via a communication line such as the Internet, for example, a smartphone that the driver carries into the vehicle. Details of the various sensing information will be described later.

[0015] The notification device 2 notifies the driver of information in response to a command from the notification control device 1. The notification device 2 notifies the driver of information by using at least one of the driver's vision, hearing, and touch in response to a command from the notification control device 1. In detail, the notification device 2 is composed of multiple types of devices. In this embodiment, the multiple types of devices are a display device 21, an audio output device 22, and a vibration generating device 23.

[0016] The display device 21 is a means for notifying the driver of information by utilizing his / her vision. The display device 21 is arranged, for example, at a position where the driver of the vehicle to which the vehicle system SYS1 (vehicle notification system SYS2) is applied can easily see the display contents. For example, the display device 21 is a liquid crystal display device or an organic EL display device arranged on the dashboard of the vehicle. For example, the display device 21 is a head-up display (HUD) that projects information on the windshield of the vehicle. For example, the display device 21 is an indicator lamp arranged on a meter panel, a room mirror, or a side mirror. The display device 21 may be a part of a stationary or portable navigation device or a safety monitoring device mounted on the vehicle. The display device 21 may be a display input device having an input function such as a touch panel.

[0017] The audio output device 22 is a means for notifying information to a driver by utilizing the driver's sense of hearing. The audio output device 22 is, for example, a speaker disposed in a position where the driver of the vehicle to which the vehicle system SYS1 (vehicle notification system SYS2) is applied can easily hear the audio. The audio output device 22 may be a part of a stationary or portable navigation device or a safety monitoring device mounted on the vehicle.

[0018] The vibration generator 23 is a means for notifying the driver of information by utilizing his / her sense of touch. The vibration generator 23 includes, for example, a vibrator disposed at a position where the driver of the vehicle can feel vibration. The vibrator is disposed, for example, in the driver's seat. In detail, the vibrator is disposed in a seat portion supporting the driver's buttocks, or in a backrest portion supporting the back of the driver with the buttocks resting on the seat portion. The vibrator may be, for example, a vibrator having an electric / magnetic circuit configuration in which the diaphragm of a speaker (structure suitable for acoustic conversion) is replaced with a diaphragm suitable for vibration transmission, or a vibrator having a configuration using a piezoelectric element.

[0019] In this embodiment, the configuration allows three senses, sight, hearing, and touch, to be used when notifying information, but this is merely an example. The types of senses that can be used when notifying information may be, for example, one or two. For example, the types of senses that can be used when notifying information may be two, sight and hearing. Furthermore, the notification device 2 may be composed of one type of device or multiple devices other than three.

[0020] The information source device 3 is a device that serves as an information source of information to be notified to a notification target person. In detail, the information source device 3 is an information source of information to be notified to a driver. The notification control device 1 receives information to be notified to the driver from the information source device 3 and controls the notification. The notification control device 1 controls the notification device 2 to notify the driver of the notification information input from the information source device 3 in various ways.

[0021] The information source device 3 is mounted, for example, on a vehicle to which the vehicle system SYS1 is applied. The information source device 3 may be configured to read out information stored in a storage medium (not shown) and output the information to the notification control device 1. The information source device 3 may also be configured to generate information itself and output the information to the notification control device 1. The information source device 3 may also be configured to receive information from another device, such as a server device, and output the information to the notification control device 1.

[0022] The information (notification information) output from the information source device 3 may be, for example, information about driving, information about the vehicle state, entertainment information, Internet information such as news, or information including at least two of these pieces of information. The information source device 3 may be composed of only one device, or may be composed of multiple devices. The information source device 3 may be, for example, a navigation device, a safety monitoring device, an entertainment information providing device, a server device that provides Internet information such as news, or a configuration including at least two of these. The entertainment information providing device is a device that provides entertainment information such as music, movies, games, or virtual experiences. At least a part of the functions of the entertainment information providing device may be functions of a server device that is provided so as to be able to communicate with a communication device mounted on the vehicle via a communication line such as the Internet.

[0023] <2. Notification control device> Fig. 2 is a block diagram showing a schematic configuration of a notification control device 1 according to an embodiment of the present invention. Note that Fig. 2 shows components necessary for explaining the features of the embodiment, and omits the description of general components. As shown in Fig. 2, the notification control device 1 includes a controller 11 and a memory 12. The notification control device 1 is a so-called computer device, and includes an input / output unit (not shown) in addition to the controller 11 and the memory 12.

[0024] The controller 11 includes an arithmetic circuit that performs arithmetic processing. The arithmetic circuit is specifically configured with a processor. The processor includes, for example, a CPU (Central Processing Unit). The controller 11 may include one processor or multiple processors. When the controller 11 includes multiple processors, it is sufficient that the processors are capable of communicating with each other.

[0025] The memory 12 includes a volatile memory and a non-volatile memory. The volatile memory is specifically a RAM (Random Access Memory). The non-volatile memory is specifically a ROM (Read Only Memory). The non-volatile memory may also be a flash memory, a hard disk drive, or the like. The non-volatile memory stores a computer-readable program (computer program) 121 and data. The data includes various tables 122 to 127, which will be described later.

[0026] The function of the controller 11 is realized by the processor executing arithmetic processing according to the program 121 stored in the memory 12. The number of the programs 121 that realize the function of the controller 11 may be one or more. In this embodiment, the program 121 stored in the memory 12 includes a notification control program (a program for determining the amount of notification stimulus) that causes the computer to execute a method for determining the amount of notification stimulus when notifying information. The amount of notification stimulus is an amount indicating the strength (magnitude) of the stimulus that the notification of information gives to the notification target (the driver in this embodiment). If the amount of notification stimulus is large, the stimulus given to the notification target is strong, and the notification (notification content) is easily conveyed to the notification target. If the amount of notification stimulus is small, the stimulus given to the notification target is weak, and the notification (notification content) is difficult to convey to the notification target. If the amount of notification stimulus is too large, the notification target may feel bothered by the notification. If the amount of notification stimulus is too small, the notification target may not recognize (understand) the notification. The notification control program is a program that causes the computer device to execute the adjustment of the amount of notification stimulus to an appropriate amount.

[0027] The program 121 stored in the memory 12 may be provided by, for example, a computer-readable nonvolatile recording medium. The nonvolatile recording medium may be, for example, an optical recording medium (for example, an optical disk), a magneto-optical recording medium (for example, a magneto-optical disk), a USB memory, or an SD card, in addition to the above-mentioned nonvolatile memory. As another example, the program 121 may be configured to be provided from a program providing server via a communication line such as the Internet (a so-called configuration to be provided by download).

[0028] The functions of the controller 11 may be realized by an arithmetic circuit executing arithmetic processing according to a program, i.e., by software, but may also be realized by other methods. At least a part of the functions of the controller 11 may be realized by using, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). That is, at least a part of the functions of the controller 11 may be realized by hardware using a dedicated IC or the like. At least a part of the functions of the controller 11 may also be realized by using both software and hardware.

[0029] As shown in Fig. 2, the controller 11 includes, as its functional units, a notification information acquisition unit 111, a sensing information acquisition unit 112, a first index value calculation unit 113, a notification stimulus amount tentative determination unit 114, a second index value calculation unit 115, a notification stimulus amount adjustment unit 116, and a notification command unit 117. Note that each of the functional units 111 to 117 is a conceptual component. A function executed by one component may be distributed to multiple components. Furthermore, functions possessed by multiple components may be integrated into one component.

[0030] The notification information acquisition unit 111 acquires notification information to be notified to the driver from the information source device 3. The notification information is, for example, information regarding route guidance, information indicating the environment around the vehicle, information notifying of dangers existing around the vehicle, entertainment information, or Internet information.

[0031] The sensing information acquisition unit 112 acquires sensing information detected by various sensors from outside the notification control device 1. The sensing information may be the detection information itself detected by the sensor, or information (processed information) obtained by processing the detection information. The sensing information includes, for example, information related to the environment inside and outside the vehicle, information related to the mental and physical states of the driver, information indicating the driving situation of the vehicle, and the like. Various sensors for acquiring the sensing information are arranged in appropriate positions on the vehicle or the driver depending on the target to be detected.

[0032] The first index value calculation unit 113 calculates a first index value indicating the ease of recognition of a notification required by the driver (at the current time) at the time of notification, according to a first estimation result estimated by first input information input from outside the notification control device 1. That is, the notification control device 1 (controller 11) calculates a first index value indicating the ease of recognition of a notification required by a notification target person (driver), according to a first estimation result estimated by first input information input from outside.

[0033] The ease of recognizing a notification is a concept including the ease with which the driver notices and understands the notification. The first input information input from the outside includes, for example, information acquired by the sensing information acquisition unit 112. However, the first input information input from the outside may include information input by a user such as a driver using an input device (not shown).

[0034] In detail, the first estimation result includes an estimation result of the sensitivity and concentration level of the notification target (driver) to detect a notification. That is, the notification control device 1 (controller 11) obtains a first index value according to the estimation result of the sensitivity and concentration level of the notification target (driver) to detect a notification. The driver's sensitivity and concentration level to a notification affect the driver's ease of recognizing a notification (ease of noticing and ease of understanding). For this reason, by estimating the sensitivity and concentration level, it is possible to obtain the ease of recognizing a notification that is required by the driver when notifying information.

[0035] More specifically, the sensitivity for detecting the driver's notification can be determined by the driver's personal characteristics (ability: eyesight, hearing, etc.) and external factors acting on the driver. If the driver's personal characteristics are high, the sensitivity is estimated to be high, and if the personal characteristics are low, the sensitivity is estimated to be low. In addition, the external factors are factors that hinder the detection of notifications, such as noise inside the vehicle, and if the external factors are large, the sensitivity is estimated to be low, and if the external factors are small, the sensitivity is estimated to be high. The personal characteristics and external factors can be numerical values ​​that are classified into levels according to criteria previously determined by experiments, etc., and the sensitivity can be obtained according to the numerical values. For the quantification for the level classification, a conversion table (not shown) or a relational expression for level classification created based on experiments, etc. is used.

[0036] The personal characteristics and the external factors are included in the first input information. The personal characteristics may be configured to be stored in advance in the memory 12 by a user (such as a driver) using an input device (not shown) to input to the notification control device 1. The external factors (such as noise inside the vehicle) may be configured to be obtained based on information (sensing information) from a sensor provided in the vehicle.

[0037] The sensitivity is given as a numerical value according to the level, and in this embodiment, it can be calculated based on a sensitivity table 122 (see FIG. 2) that is created in advance by performing experiments or the like. However, the sensitivity may be calculated by a relational expression instead of the sensitivity table 122. FIG. 3 is a schematic diagram showing the configuration of the sensitivity table 122 according to the embodiment of the present invention.

[0038] 3, the sensitivity table 122 includes a visual table 122a, an auditory table 122b, and a tactile table 122c. In other words, in this embodiment, the sensitivities are calculated separately for each of the visual, auditory, and tactile senses. In other words, in this embodiment, the visual sensitivity, the auditory sensitivity, and the tactile sensitivity are calculated by using the sensitivity table 122.

[0039] Each of the sense tables 122a to 122c is a two-dimensional table with the horizontal axis representing personal characteristics and the vertical axis representing external factors. In the example shown in Fig. 3, the horizontal axis (personal characteristics) and the vertical axis (external factors) are both expressed as numerical values ​​divided into levels. In the case of the visual table 122a, for example, the personal characteristic is eyesight, and the external factor is the brightness inside the vehicle. In the case of the auditory table 122b, for example, the personal characteristic is hearing, and the external factor is noise inside the vehicle. In the case of the tactile table 122c, for example, the personal characteristic is the ability to sense vibration, and the external factor is the vibration of the vehicle.

[0040] In each of the sense tables 122a to 122c, the intersection between the personal characteristic and the external factor is the desired sensitivity of the sense. To explain with a specific example, if the driver's personal characteristic, eyesight, is a numerical value (a numerical value divided into levels) "HL2" and the external factor (brightness inside the vehicle) is a numerical value (a numerical value divided into levels) "EFL1", the visual sensitivity is a numerical value "SE21". Note that, although the present embodiment is configured so that the sensitivity is determined in the notification control device 1, the sensitivity may be determined in a device separate from the notification control device 1 and input to the notification control device 1 as the first input information.

[0041] The driver's concentration level is a factor for judging the degree to which the driver can recognize (understand) the notification when the information is notified. In other words, the driver's concentration level is related to the ease with which the driver can recognize (notice or understand) the notification. The driver's concentration level is estimated to be higher the more concentrated the driver is.

[0042] The driver's concentration level can be estimated from, for example, the driver's brain waves, heart rate, gaze, facial expression, or driving behavior. The driver's brain waves and the like are included in the first input information. The driver's brain wave and heart rate information can be obtained, for example, by attaching a dedicated biosensor to the driver. The driver's gaze and facial expression information can be obtained, for example, by performing image analysis of an image captured by a camera that is installed so as to be able to capture the driver. The driver's driving behavior can be obtained, for example, by analyzing information obtained from a vehicle speed sensor, a steering angle sensor, and the like attached to the vehicle.

[0043] The concentration level is given as a numerical value according to the level, and in this embodiment, is calculated based on a concentration level table 123 (see FIG. 2) that is created in advance by conducting experiments or the like. However, the concentration level may be calculated by a relational expression instead of the concentration level table 123. The more the driver is concentrated, the higher the concentration level is.

[0044] FIG. 4 is a schematic diagram showing the configuration of the concentration level table 123 according to an embodiment of the present invention. The index value range in FIG. 4 refers to the range of index values ​​indicating the driver's concentration state obtained from the above-mentioned electroencephalogram measurement or the like. The concentration level is given as a level value obtained by classifying the index value according to the magnitude of the value. For example, when the index value range (numerical range) of the obtained index value is "IV03 or more and less than IV04" (IV03 and IV04 are numerical values), the driver's concentration level is calculated as a numerical value "CN03". Note that, although the concentration level is calculated in the notification control device 1 in this embodiment, the concentration level may be calculated in a device other than the notification control device 1 and input to the notification control device 1 as the first input information.

[0045] The first index value, which is determined according to the estimation results of the driver's sensitivity and concentration level, is calculated in detail by the following formula (1). With this configuration, it is possible to easily quantify the ease of recognition (ease of noticing, ease of understanding) of a notification required by the driver (notification target) when notifying information. First index value = C1 - sensitivity - concentration (1) C1: any constant The arbitrary constant C1 is determined based on an experiment, a simulation, etc. The sensitivity and the concentration level may be appropriately multiplied by a weighting coefficient.

[0046] As described above, in this embodiment, the sensitivity is calculated for each of the multiple senses. To this end, in detail, the first index value is calculated separately for each of the multiple senses. The first index value is calculated for each of the vision, hearing, and touch. The first index value for the vision is calculated by the following formula (1A). The first index value for the hearing is calculated by the following formula (1B). The first index value for the touch is calculated by the following formula (1C).

[0047] First index value (visual) = C1a - visual sensitivity - concentration (1A) C1a : any constant First index value (hearing) = C1b - hearing sensitivity - concentration (1B) C1b : any constant First index value (tactile) = C1c - tactile sensitivity - concentration (1C) C1c : any constant

[0048] The notification stimulus amount tentative determination unit 114 (see FIG. 2) tentatively determines the notification stimulus amount indicating the intensity of the stimulus that the notification gives to the driver, based on a first index value indicating the ease of recognition of the notification required by the driver. That is, the notification control device 1 (controller 11) tentatively determines the notification stimulus amount indicating the intensity of the stimulus that the notification gives to the notification target (driver), based on the first index value. In this embodiment, the notification stimulus amount is tentatively determined by using the notification stimulus amount reference table 127 stored in the memory 12.

[0049] Fig. 5 is a schematic diagram showing the configuration of a notification stimulus amount reference table 127 according to an embodiment of the present invention. In the example shown in Fig. 5, there are three output types indicating the classification of the output means: "display", "sound", and "vibration". "Display" indicates that notification is performed by a display device 21 (see Fig. 1) that utilizes the driver's vision. "Sound" indicates that notification is performed by a voice output device 22 (see Fig. 1) that utilizes the driver's hearing. "Vibration" indicates that notification is performed by a vibration generating device 23 (see Fig. 1) that utilizes the driver's sense of touch.

[0050] At least one notification format (notification format) exists for each output type. The notification format classifies the notification form when each output means performs notification. In the example shown in FIG. 5, the notification format in the display (display device 21) includes "figure" and "character", which are different notification formats. Also, at least one item exists for each notification format. The items correspond to control elements that require adjustment of the notification stimulus amount when performing notification in each notification format. In the example shown in FIG. 5, the notification format "figure" includes "size" and "color", which are different control elements. For each item, a plurality of control values ​​that classify the notification stimulus amount into levels are prepared so that they can be selected, and when setting the notification stimulus amount, one control value is selected and set from the plurality of control values. For example, in the example shown in FIG. 5, for the item "size" of the notification format "figure", any one of integers "0" to "10" is set as the control value. The larger the value of the control value, the larger the notification stimulus amount. For example, when the notification stimulus amount of the item "size" of the notification format "figure" is "10", it is set as a large figure. In addition, the "color" item of the notification format "shape" is set to different colors corresponding to the notification stimulus amount (control value). That is, a notification stimulus amount is determined for each color. For example, when the notification format is "voice (sound)", items for setting the notification stimulus amount may include volume, pitch, tempo, melody, intonation (volume fluctuation range), etc. For example, when the notification format is "vibration", items for setting the notification stimulus amount may include amplitude (vibration strength), frequency, vibration pattern (on / off and vibration fluctuation switching pattern, etc.).

[0051] In Fig. 5, "ease of recognition" provided for each notification stimulus amount indicates the ease of recognition of the notification by the driver when the corresponding notification stimulus amount is set. The ease of recognition is an evaluation value obtained, for example, by an experiment, a simulation, or a questionnaire for the user (driver). A high evaluation value is given to an amount of notification stimulus that is easy for the driver to recognize.

[0052] In the example shown in FIG. 5, when the notification format is set to "graphic" and the notification stimulus amount for the item "size" is set to "0", the evaluation value of "ease of recognition" is "A1". The evaluation value "A1" is usually a small value because the notification stimulus amount is "0". When the notification format is set to "graphic" and the notification stimulus amount for the item "size" is set to "10", the evaluation value of "ease of recognition" is "B1". The evaluation value "B1" is usually a large value because the notification stimulus amount is "10".

[0053] In detail, the provisional determination of the notification stimulus amount is performed for each item determined according to the notification format. For example, in the example shown in Fig. 5, when "shape" is used as the notification format, the provisional determination of the notification stimulus amount is performed for the items "size" and "color". When the provisional determination of the notification stimulus amount for each item is performed, a combination of notification stimulus amounts is selected such that a first total value, which is the total of the evaluation values ​​of the ease of recognition previously set for each notification stimulus amount, is equal to the first index value.

[0054] The first index value is a value calculated by the first index value calculation unit 113, and in this embodiment, as described above, the first index value is calculated for each of the three senses (sight, hearing, touch). For this purpose, in detail, the provisional determination of the notification stimulus amount is performed separately for each sense. For example, if it is determined that a visual "figure" and an auditory "voice" are to be used as the notification format, the provisional determination of the notification stimulus amount for the "figure" and the provisional determination of the notification stimulus amount for the "voice" are performed separately.

[0055] Specifically, it is assumed that the first index value (visual) calculated by the above formula (1A) is "8". In this case, the notification stimulation amount of each item ("size", "color", ...) of the notification format "shape" is determined (selected) so that the total value (first total value) of "ease of recognition" (evaluation value) in FIG. 5 is "8". Also, it is assumed that the first index value (auditory) calculated by the above formula (1B) is "9". In this case, the notification stimulation amount of each item ("size", "pitch", ...) of the notification format "voice" is determined (selected) so that the total value (first total value) of "ease of recognition" (evaluation value) in FIG. 5 is "9".

[0056] It is possible that multiple combinations of notification stimulus amounts for each item that result in the first total value being the same as the first index value can be selected. In such a case, all of the multiple combinations may be selected as candidates for determining the notification stimulus amount for the provisional determination stage of the notification stimulus amount. In addition, in the above example, multiple notification formats are used for one piece of notification information, but this is an example, and the number of notification formats used for one piece of notification information may be one or more (including three or more).

[0057] The first index value is a value obtained by an estimation result using sensing information, etc., and represents the ease of recognizing the notification required by the driver at that time (present). For this reason, when the notification stimulus amount for each item is provisionally determined based on the first index value as described above, it is possible to provisionally determine an appropriate notification stimulus amount that makes it easy for the driver to recognize (understand) the notification in the environment in which the driver is currently placed.

[0058] The second index value calculation unit 115 (see FIG. 2) calculates a second index value indicating the urgency required when notifying the driver, according to the second estimation result estimated by the second input information input from outside the notification control device 1. That is, the notification control device 1 (controller 11) calculates a second index value indicating the urgency required when notifying the notification target (driver), according to the second estimation result estimated by the second input information input from outside. Note that the second input information is different from the first input information described above, and the second estimation result estimated by the second input information is also a different type of estimation result from the first estimation result described above.

[0059] The urgency required for notifying the driver can be said to be a concept indicating the necessity or importance of notifying the driver. The second input information input from the outside includes, for example, information acquired by the sensing information acquisition unit 112. However, the second input information input from the outside may include information input by a user such as the driver using an input device (not shown).

[0060] In detail, the second estimation result includes the urgency based on the content of the notification, the safety of the behavior of the notification target (driver), and the estimation result of the emotion of the notification target (driver). That is, the notification control device 1 (controller 11) obtains the second index value according to the estimation result of the urgency based on the content of the notification, the safety of the behavior of the notification target (driver), and the emotion of the notification target (driver). In this embodiment, the safety of the behavior of the notification target is the safe driving degree of the driver. The urgency of the notification content, the safe driving degree of the driver, and the emotion of the driver affect the urgency required when notifying the driver. For this reason, the urgency required when notifying the driver can be obtained by estimating the urgency of the notification content, the safe driving degree of the driver, and the emotion of the driver.

[0061] More specifically, the urgency based on the content of the notification is, for example, the degree of urgency determined from the content of the notification itself. For example, if the content of the notification is a warning (alert) for safe driving, the urgency is determined to be high from the viewpoint of ensuring safety. Also, for example, if the content of the notification is general information such as weather information obtained via the Internet, the information is not necessarily important from the viewpoint of ensuring safety, and therefore the urgency is determined to be low. The urgency is given as a numerical value according to the level, and in this embodiment, is calculated based on the urgency table 124 (see FIG. 2) created in advance by conducting experiments or the like. However, the urgency may be calculated by a relational expression instead of the urgency table 124. The higher the urgency, the higher the value.

[0062] Fig. 6 is a schematic diagram showing a configuration of an urgency table 124 according to an embodiment of the present invention. The notification types in Fig. 6 are obtained by classifying the notification information according to its contents. The notification types may be classified by the information source device 3 that inputs the notification information to the notification control device 1, and the classification information may be input from the information source device 3 to the notification control device 1 together with the notification information. As another example, the notification control device 1 may analyze the contents of the input notification information and classify the contents. In the former case, the classification information corresponds to the above-mentioned second input information, and in the latter case, the notification information itself corresponds to the second input information.

[0063] In the example shown in Fig. 6, the notification types include "alert" given to information that notifies of dangers while driving, "route guidance" given to navigation information, and "entertainment" given to entertainment information. Each notification type is given a level value indicating the degree of urgency determined in advance through experiments, etc. For example, if the notification content of the notification information input to the notification control device 1 is guidance for turning right or left, the type of the notification is classified as "route guidance," and the numerical value "EM02" is obtained as the degree of urgency.

[0064] The urgency level based on the notification content may be determined not only based on the notification content itself, but also based on the conditions inside and outside the vehicle. For example, even if the notification type is classified as the same "route guidance," if it is estimated from in-vehicle information obtained by a camera or the like that the driver is looking away, the level value of the urgency level may be set higher than when the driver is not looking away. Also, even if the notification type is classified as the same "alarm," if it is determined that the urgency is higher, such as the distance to an obstacle being short, based on information obtained by a millimeter wave radar or the like.

[0065] In addition, in this embodiment, the urgency is determined in the notification control device 1, but the urgency may also be determined by a device other than the notification control device 1, such as a vehicle collision avoidance device, and input to the notification control device 1 as second input information.

[0066] The safety level of the behavior of the notification target is a judgment factor for judging the urgency (necessity) of the notification when notifying the notification target of information. As described above, in this embodiment, the safety level of the behavior is the safe driving level. In other words, taking this into consideration, the safe driving level of the driver is a judgment factor for judging the urgency of the notification when notifying the driver of information. That is, the safe driving level is related to the urgency of the notification. When the driver is not driving safely (when the safe driving level is low), it is better to notify the driver early, and it is preferable that the urgency of the notification is high. When the driver is driving safely (when the safe driving level is high), if the notification is in an emergency mode, the driver may be exaggerated in the fact that he or she knows, which may cause the driver to feel annoyed. That is, when the driver is driving safely (when the safe driving level is high), it is preferable not to make the urgency high. From this perspective, the safe driving level of the driver is included in the factors for calculating the second index value indicating the urgency required when notifying the driver.

[0067] The safe driving level is given as a numerical value according to the level, and in this embodiment, is calculated based on a safe driving level table 125 (see FIG. 2) that is created in advance by conducting experiments or the like. However, the safe driving level may be calculated by a relational expression instead of the safe driving level table 125. The safer the driving is, the higher the safe driving level is.

[0068] FIG. 7 is a schematic diagram showing the configuration of the safe driving level table 125 according to the embodiment of the present invention. In the example shown in FIG. 7, a numerical value indicating the safe driving level is assigned to each combination pattern of a plurality of evaluation results obtained by evaluating whether or not the vehicle is driving safely (GOOD or NG) for each item related to safe driving during driving. The evaluation result of the item "speed" is, for example, a result of evaluating whether or not the legal speed limit is observed based on vehicle information during driving. The evaluation result of the item "brake" is, for example, a result of evaluating whether or not the vehicle is suddenly braked based on brake operation information during driving. The evaluation result of the item "steering" is, for example, a result of evaluating whether or not the vehicle is swaying in the traveling direction based on steering operation information during driving.

[0069] The numerical value indicating the degree of safe driving is determined by the results of experiments, etc. Also, the number and types of items such as "speed" in the table are examples and may be changed as appropriate. Also, in the example shown in FIG. 7, the evaluation results of each item are two types, "GOOD" and "NG", but the evaluation may be three or more levels. Also, the evaluation of each item may be performed by the notification control device 1 or by another device. In the former case, the sensing information input from a sensor provided in the vehicle, such as a vehicle speed sensor, corresponds to the above-mentioned second input information. In the latter case, the evaluation results of each item related to safe driving become the second input information. Also, the evaluation of safe driving may be the driver's evaluation of his / her own driving and the evaluation information input by an input device.

[0070] A specific example of calculating a safe driving level using the safe driving level table 125 shown in FIG. 7 will be described. Assume that the driver's current driving evaluation results are "GOOD" for speed and braking, and "NG" for steering. In this case, the safe driving level becomes a numerical value "SD02" according to the table shown in FIG. 7. Note that, although this embodiment is configured to calculate the safe driving level in the notification control device 1, the safe driving level may also be calculated by a device other than the notification control device 1 and input to the notification control device 1 as second input information.

[0071] The emotion of the driver (notification target) is a judgment factor for judging the urgency (necessity) of notification when notifying the driver of information. That is, the emotion of the driver is related to the urgency of the notification. For example, if the driver is irritated, it can be judged that the driver is likely to feel bothered by the notification of information in an emergency mode. For this reason, it is considered preferable to lower the urgency of the notification when the driver is irritated. Also, for example, if the driver is calm, it can be judged that the driver is likely to calmly accept the notification of information in an emergency mode without feeling bothered. For this reason, if the driver is calm, it is considered that there is no problem even if the urgency of the notification is high. From this point of view, the emotion of the driver is included in the factor for calculating the second index value indicating the urgency required when notifying the driver.

[0072] In the above, the relationship between the driver's emotions and the urgency of the notification has been described based on whether the driver feels bothered. However, this concept is merely an example, and the relationship between the driver's emotions and the urgency of the notification can be understood in a different way. For example, the relationship between the driver's emotions and the urgency of the notification can be understood based on the driver's safety. When the driver is irritated, there is a possibility that the driver's awareness of safety is reduced, and it may be preferable for safety to perform the notification in an emergency mode. For this reason, when the driver is irritated, it is considered preferable to increase the urgency of the notification. Also, for example, when the driver is calm, it can be determined that the driver is likely to notice the notification even if the driver does not have a reduced awareness of safety and the notification is not in an emergency mode. For this reason, when the driver is calm, it is considered that there is little problem even if the urgency of the notification is low.

[0073] As can be seen from the above explanation, the way emotions included in the elements when calculating the second index value are handled varies depending on how the handling criteria are determined. In this respect, it is preferable to configure the system so that the user can select the handling criteria for using emotion data.

[0074] Emotions are converted into numerical values ​​(hereinafter referred to as emotion quotients) after the above-mentioned handling criteria are determined. Emotions are converted into emotion quotients based on an emotion quotient table 126 (see FIG. 2) that has been created in advance by conducting experiments or the like.

[0075] FIG. 8 is a schematic diagram showing the configuration of the emotion quotient table 126 according to the embodiment of the present invention. The emotion types in FIG. 8 are classifications of emotions acquired by a means for estimating the driver's emotion. The means for estimating the driver's emotion measures the driver's brain waves, heart rate, facial expressions, driving behavior, etc. using a sensor, and estimates the driver's emotion by executing information processing of the measurement information obtained by the measurement. The means for estimating the emotion may be included in the notification control device 1, or may be configured by a separate device. In the former case, the sensing information input from the sensor that measures the brain waves, etc. corresponds to the above-mentioned second input information. In the latter case, the emotion classification information corresponds to the second input information.

[0076] In the example shown in FIG. 8, the types of emotions include "irritation," "melancholy," and "calmness." An emotion index determined in advance by experiments or the like is assigned to each emotion type. For example, when "calmness" is estimated as the driver's emotion, a numerical value "EI03" is obtained as the emotion index. Note that, although the emotion index is obtained in the notification control device 1 in this embodiment, the emotion index may be obtained in a device other than the notification control device 1 and input to the notification control device 1 as second input information.

[0077] The second index value determined according to the urgency based on the notification content, the safe driving level of the driver, and the estimation result of the emotion is calculated in detail by the following formula (2). With this configuration, the urgency required when notifying the driver (notification target) of information can be easily quantified. Second index value = C2 + urgency - driving safety - emotion index (2) C2: any constant Sentiment quotient: As mentioned above, the converted value of emotion into a numerical value. The arbitrary constant C2 is determined based on an experiment, a simulation, etc. Furthermore, the urgency level, the safe driving level, and the emotion index may be appropriately multiplied by a weighting coefficient.

[0078] The urgency required for notifying the driver may vary depending on, for example, the number of times the same notification is repeated, the driver's familiarity (e.g., the driver is accustomed to driving on a road that the driver always drives), etc. In consideration of such points, specific information such as the number of times the same notification is repeated and the driver's familiarity may be learned, and the second index value may be calculated taking into account the learned information. For example, an arbitrary constant C2 may be varied depending on the learned information.

[0079] The notification stimulus amount adjustment unit 116 (see FIG. 2) adjusts the notification stimulus amount provisionally determined by the notification stimulus amount provisional determination unit 114 based on a second index value indicating the urgency required when notifying the driver (notification target person), and makes a final determination of the notification stimulus amount. That is, the notification control device 1 (controller 11) adjusts the notification stimulus amount provisionally determined based on the second index value, and makes a determination of the notification stimulus amount.

[0080] According to this configuration, the notification stimulus amount provisionally determined so that the driver (notification target) can easily understand can be adjusted from the viewpoint of the urgency of the notification to determine the final notification stimulus amount. Notifications that do not necessarily need to be notified in an emergency manner from the viewpoint of urgency can be adjusted so as not to be excessive notifications. In other words, according to the notification control device 1 (notification control method) of this embodiment, it is possible to perform easy-to-understand notifications while reducing the annoyance caused by excessive notifications.

[0081] In detail, the notification stimulus amount adjustment unit 116 adjusts and determines the amount of notification stimulus by using the notification stimulus amount reference table 127 shown in Fig. 5. When adjusting and determining the amount of notification stimulus, the notification stimulus amount adjustment unit 116 uses a numerical value given by "urgency" in the notification stimulus amount reference table 127 to adjust and determine the amount of notification stimulus.

[0082] The "urgency" in FIG. 5 is provided corresponding to each notification stimulus amount. The "urgency" provided corresponding to each notification stimulus amount indicates the degree of urgency of the notification conveyed to the driver (perceived by the driver) when the corresponding notification stimulus amount is set. The "urgency" is an evaluation value obtained, for example, by an experiment, a simulation, or a questionnaire for users (drivers). The more easily the notification stimulus amount conveys the urgency to the driver, the higher the evaluation value of the urgency will be.

[0083] The notification stimulus amount is adjusted based on an integrated value obtained by integrating the evaluation values ​​of urgency set in advance for each provisionally determined notification stimulus amount and the second index value, and the notification stimulus amount for each sense is determined. When notification is performed using multiple senses, the notification stimulus amount is adjusted using the evaluation value of urgency and the second index value for the multiple senses collectively. Therefore, when notification is performed using multiple senses, the notification stimulus amounts for different senses can be adjusted, and the possibility of excessive notification can be reduced. In this embodiment, as will be understood from the following description, the integrated value is a total value obtained by summing up all the evaluation values ​​of urgency set in advance for each provisionally determined notification stimulus amount.

[0084] When determining the notification stimulus amount by adjustment after the provisional determination, a combination of notification stimulus amounts that satisfies both the first condition and the second condition described below is selected. The selected combination is determined as the final notification stimulus amount. First condition: A first total value obtained by totaling the evaluation values ​​of the ease of recognition set for each amount of notification stimulation (see FIG. 5) is equal to or greater than a first index value. Second condition: A second total value obtained by totaling the urgency evaluation values ​​(see FIG. 5) set for each notification stimulus amount is equal to the second index value.

[0085] As described above, the first index value is calculated separately for each sense, so the first condition is judged separately for each sense. On the other hand, the second index value is not calculated separately for each sense, so the first condition is judged collectively for all senses.

[0086] A concrete example will be given. It is assumed that only a "graphic" is to be used as the notification method. The first index value, which indicates the ease of recognition of the notification required by the driver and is calculated using (Formula 1A), is "8", and the second index value, which indicates the urgency required when notifying the driver and is calculated using (2), is "18". In addition, it is assumed that the total value (second total value) of the provisionally determined notification stimulus amounts, calculated by adding up the urgency evaluation values ​​(see FIG. 5) set for each notification stimulus amount, is "26".

[0087] In this case, if the notification stimulation amount remains at the time of provisional determination, the first condition is satisfied, but the second condition is not satisfied because the second total value ("26") and the second index value ("18") are different. If the notification is made with the provisionally determined notification stimulation amount, the notification stimulation amount may be excessive in terms of urgency, and the driver may feel bothered by the notification. For this reason, under the constraint that the first condition is satisfied (the first total value is "8" (= first index value) or more), the notification stimulation amount values ​​for each item ("size", "color", ...) determined in the provisional setting are changed so that the second total value becomes the same value as the second index value ("18"). The combination of the notification stimulation amounts for which the second total value and the second index value become the same as a result of this adjustment is set as the determined value of the notification stimulation amount.

[0088] As another example, it is assumed that it is decided to use visual "figure" and auditory "voice" as the notification method. Then, the first index value (visual) indicating the ease of recognition of the notification required by the driver, calculated by (Formula 1A), is "8", and the first index value (auditory) indicating the ease of recognition of the notification required by the driver, calculated by (Formula 1B), is "9". Furthermore, the second index value indicating the urgency required when notifying the driver, calculated by (Formula 2), is "30". Furthermore, it is assumed that the total value (second total value) of the provisionally determined notification stimulus amounts, which is the sum of the evaluation values ​​of urgency (see FIG. 5) set for each notification stimulus amount, is "25". Note that the second total value is the total of the evaluation values ​​of "urgency" corresponding to all notification stimulus amounts provisionally set separately for vision and hearing.

[0089] In this case, if the provisionally determined notification stimulus amount is used, the first condition will be satisfied, but the second condition will not be satisfied because the second total value ("25") and the second index value ("30") are different. If the provisionally determined notification stimulus amount is used, the notification stimulus amount may be insufficient in terms of urgency, and the urgency may not be conveyed to the driver. For this reason, under the constraint that the first condition must be satisfied for each sensation, the notification stimulus amount value for each item determined in the provisional setting is changed, and the second total value is adjusted to the same value as the second index value ("30"). The combination of notification stimulus amounts for which the second total value and the second index value are the same as a result of this adjustment is set as the determined value of the notification stimulus amount.

[0090] In this example, unlike the example described above, since multiple senses are used for notification, the constraint of satisfying the first condition for each sense arises. That is, when changing the value of the notification stimulation amount for each item ("size", "color", ...) of the notification method "shape", it is necessary to ensure that the first total value does not fall below "8" (= first index value (visual)). Furthermore, when changing the value of the notification stimulation amount for each item ("size", "height", ...) of the notification method "voice", it is necessary to ensure that the first total value does not fall below "9" (= first index value (auditory)).

[0091] As can be seen from the above, the amount of notification stimulation is adjusted and determined so that the first total value does not fall below the first index value and so that the second total value is the same as the second index value, thereby making it possible to provide easy-to-understand notifications while reducing the annoyance caused by excessive notifications.

[0092] As described above, at the stage of provisionally determining the notification stimulus amount, there may be a possibility that a combination of multiple notification stimulus amounts is a candidate. In such a case, the above-mentioned adjustment process may be performed for each candidate, and the candidate with the first total value closest to the first index value may be selected. If multiple candidates remain even after such process, any one of them may be finally selected. When multiple sensations are used for notification, a notification form that prioritizes a sensation that matches the user's (driver's) pre-registered preference may be selected from the multiple candidates.

[0093] In addition, in the above-mentioned adjustment process, it may occur that the second total value cannot be reduced to the same as the second index value. If the second total value cannot be reduced to the second index value, the driver may be notified excessively. For this reason, if the second total value cannot be reduced to the same as the second index value, the notification itself may be canceled. In addition, if there are multiple notification formats (for example, "text" and "voice"), some of the notification formats may be reduced (for example, to only "voice").

[0094] In addition, in the above-mentioned adjustment process, it may occur that the second total value cannot be increased to the second index value. If the second total value cannot be increased to the second index value, the driver may not receive enough notification. For this reason, if the second total value cannot be increased to the second index value, the notification format may be increased. For example, if the notification format was scheduled to be only "voice", notification by "text" may be added.

[0095] The notification command unit 117 (see FIG. 2) instructs the notification device 2 to notify with the determined notification stimulus amount. That is, the notification control device 1 (controller 11) instructs the notification device 2 to notify with the determined notification stimulus amount. In response to this, the notification device 2 notifies the driver with the notification stimulus amount according to the instruction. According to the vehicle system SYS1 and the vehicle notification system SYS2 of this embodiment, it is possible to provide an easy-to-understand notification while reducing the annoyance caused by excessive notifications.

[0096] <3. Notification control method> Next, a notification control process (notification control method) executed by the notification control device 1 will be described.

[0097] 9 is a flowchart illustrating the flow of a notification control process executed by a notification control device 1 according to an embodiment of the present invention. This flowchart shows the technical contents of a computer program that causes a computer device to realize the notification control process. The computer program is stored in various non-volatile recording media that can be read by a computer and is provided (sold, distributed, etc.). The computer program may be composed of only one program, or may be composed of multiple programs that work together.

[0098] The process shown in Fig. 9 can be started when the vehicle starts and various controls for notifying information can be executed. The process shown in Fig. 9 may be executed from the start-ready time point. The process shown in Fig. 9 may be executed at an appropriate timing after the start-ready time point, that is, at a timing when notification control is required, or during a time period when notification control is required.

[0099] In step S1, the controller 11 (notification information acquisition unit 111) monitors whether or not information (notification information) to be notified to the driver has been acquired from the information source device 3. If the notification information has been acquired (Yes in step S1), the process proceeds to the next step S2. If the notification information has not been acquired (No in step S1), the process of step S1 is repeated.

[0100] In step S2, the controller 11 (first index value calculation unit 113) performs a first estimation process to estimate the sensitivity for detecting the driver's notification and the driver's concentration level using information (first input information) input from the outside. As a result of the first estimation process, a first estimation result is obtained. As described above, the estimation process is performed separately for the sensitivity of vision, hearing, and touch. The estimation of visual sensitivity is performed using the visual table 122a (see FIG. 3). The estimation of auditory sensitivity is performed using the auditory table 122b (see FIG. 3). The estimation of tactile sensitivity is performed using the tactile table 122c (see FIG. 3). The estimation of the concentration level is performed using the concentration level table 123 (see FIG. 4). When the first estimation result is obtained, the process proceeds to the next step S3.

[0101] In addition, the sensitivity may be estimated only for the senses required for notification. For example, if it is determined that notification is to be performed only visually (by the display device 21), only the visual sensitivity may be estimated.

[0102] In addition, the type of sensation (notification format) to be used for notification may be determined, for example, according to the content of the information to be notified. For example, when the information to be notified is a right or left turn guide in route guidance, the notification format may be automatically selected by a predetermined process to use a visual "figure" and an auditory "voice". As another example, the notification format may be selected using sensing information. For example, when it is determined that the driver is looking away, at least one of an auditory "voice" and a tactile "vibration" may be selected as the notification format.

[0103] In step S3, the controller 11 (first index value calculation unit 113) calculates a first index value indicating the ease of recognition of the notification required by the driver according to the first estimation result. The first index value is calculated using the above-mentioned formula (1) (specifically, formula (1A), formula (1B), and formula (1C)). The first index value may be calculated only for the senses required for the notification. For example, when the notification format is a visual "figure" and an auditory "voice", the visual first index value may be calculated using formula (1A) and the auditory first index value may be calculated using formula (1B), and the tactile first index value may not be calculated using formula (1C). When the first index value is calculated, the process proceeds to the next step S4.

[0104] In step S4, the controller 11 (notification stimulus amount provisional determination unit 114) provisionally determines the notification stimulus amount indicating the intensity of the stimulus that the notification provides to the driver. As described above, the notification stimulus amount is provisionally determined using the notification stimulus amount reference table 127 (see FIG. 5). After the notification stimulus amount is provisionally determined, the process proceeds to the next step S5.

[0105] In step S5, the controller 11 (second index value calculation unit 115) performs a second estimation process to estimate the urgency based on the notification content, the safe driving level of the driver, and the driver's emotions, using information input from the outside (second input information). As a result of the second estimation process, a second estimation result is obtained. As described above, the urgency is estimated using the urgency table 124 (see FIG. 6). The safe driving level is estimated using the safe driving level table 125 (see FIG. 7). The emotion estimation result is given as an emotion quotient that converts the emotion into a numerical value, and the emotion quotient is obtained using the emotion quotient table 126 (see FIG. 8). When the second estimation result is obtained, the process proceeds to the next step S6.

[0106] In step S6, the controller 11 (second index value calculation unit 115) calculates a second index value indicating the urgency required for notifying the driver according to the second estimation result. The second index value is calculated using the above-mentioned formula (2). Once the second index value is calculated, the process proceeds to the next step S7.

[0107] The series of processes for obtaining the second index value in steps S5 and S6 may be performed before the provisional determination process of the amount of stimulus to be notified in step S4. That is, the provisional determination process of the amount of stimulus to be notified in step S4 may be performed after the first index value and the second index value are obtained.

[0108] In step S7, the controller 11 (notification stimulus amount adjustment unit 116) adjusts the notification stimulus amount provisionally determined earlier (in step S4). As described above, the notification stimulus amount is adjusted using the notification stimulus amount reference table 127 (see FIG. 5). Upon completion of the adjustment of the notification stimulus amount, the notification stimulus amount is finally determined. Once the notification stimulus amount is finally determined, processing proceeds to the next step S8.

[0109] In step S8, the controller 11 (notification command unit 117) instructs the notification device 2 to perform notification with the determined notification stimulation amount. In response to this, at least one of the display device 21, the audio output device 22, and the vibration generating device 23 constituting the notification device 2 notifies the driver of the information. When the notification command is issued to the notification device 2, the process proceeds to the next step S9.

[0110] In step S9, the controller 11 (notification information acquisition unit 111, etc.) determines whether or not there is a reason to end the notification to the driver. Examples of the reason to end the notification include a notification off command by the driver to stop the notification function, a failure of a device related to the notification such as the notification device 2, and a command to turn off the vehicle power. If there is a reason to end the notification (Yes in step S9), the flow shown in Fig. 9 ends. If there is no reason to end the notification (No in step S9), the process returns to step S1, and the processes from step S1 onwards are repeated.

[0111] <4. Modifications> In the embodiment described above, when adjusting the provisionally determined notification stimulus amount (when performing the adjustment process), a combination of notification stimulus amounts was determined (selected) so as to satisfy both the first condition and the second condition described below. First condition: A first total value obtained by totaling the evaluation values ​​of the ease of recognition set for each amount of notification stimulation (see FIG. 5) is equal to or greater than a first index value. Second condition: A second total value, which is the total of the evaluation values ​​of urgency set for each notification stimulus amount (see FIG. 5), is equal to the second index value. However, this adjustment process is merely an example, and the adjustment process may be performed using other methods.

[0112] For example, in the adjustment process when it is decided to use a plurality of senses for notification, the adjustment process may be configured to prioritize a specific sense. The specific sense to be prioritized may be, for example, a sense to which the driver (notification target) has a high sensitivity (obtained using the sensitivity table 122 shown in FIG. 3) or a sense to which a user such as a driver wishes to give priority. For example, the user (driver) may be configured to be able to select a sense (notification means) to be given priority using a setting screen as shown in FIG. 10.

[0113] Fig. 10 is a diagram showing an example of a screen for setting the sensation (notification means) that the user wishes to prioritize. In the example shown in Fig. 10, any one of display (visual), sound (auditory), and vibration (tactile) can be selected, and the notification means with a black circle in a white circle is the notification means selected by the user. That is, in the example shown in Fig. 10, the user wishes to prioritize display (display by the display device 21).

[0114] When the prioritized sense is determined, the adjustment process may be performed using weighting based on the priority information. A specific example will be described below. It is determined that the visual "figure" and the auditory "voice" are to be used as the notification method. In addition, the second index value, which indicates the urgency required when notifying the driver and is calculated by the formula (2), is "30".

[0115] In the above embodiment, the notification stimulation amount of each item is adjusted so that the second total value is the same as the second index value under the constraint of satisfying the first condition, without considering which of the visual and the auditory is prioritized. In this example, when adjusting each notification stimulation amount so that it is the same as the second index value, the second index value is allocated according to a weighting determined based on the priority information. For example, the weighting determined by the priority information is 80% for visual and 20% for auditory. In this case, the notification stimulation amount of each item of the "graphic" notification format is adjusted under the constraint of satisfying the first condition so that the sum of the urgency (evaluation value) of each item of the "voice" notification format is "24 (=30×0.8)". Also, the notification stimulation amount of each item of the "voice" notification format is adjusted under the constraint of satisfying the first condition so that the sum of the urgency (evaluation value) of each item of the "voice" notification format is "6 (=30×0.2)".

[0116] The weights determined by the priority information may be predetermined by, for example, a designer. If the priority information is not set, the weights of the respective sensations may be set equally (for example, 50% each), and the second index values ​​of the respective sensations may be allocated and adjustment processing may be performed.

[0117] <5. Points to note> Various technical features disclosed in the description of the invention may be modified in various ways without departing from the spirit of the technical creation. Furthermore, the embodiments and modifications disclosed in the description of the invention may be combined to the extent possible. [Explanation of symbols]

[0118] 1. Notification control device 2...Notification device 3... Information source device 121...Program SYS1: Information processing system, vehicle system SYS2...Notification system, vehicle notification system

Claims

1. A notification control device that performs control related to notification of information, calculating a first index value indicating an ease of recognition of the notification required by a notification target person according to a first estimation result estimated from first input information input from an outside; A provisional determination of a notification stimulus amount indicating an intensity of a stimulus that the notification provides to the notification target person is made based on the first index value; calculating a second index value indicating a level of urgency required when sending the notification to the notification target person, according to a second estimation result estimated based on second input information input from an outside; The notification amount is determined by adjusting the provisionally determined notification amount based on the second index value. Notification control device.

2. The first index value is calculated separately for each of a plurality of sensations, The provisional determination of the amount of notification stimulation is performed separately for each of the senses, The notification control device of claim 1, wherein the adjustment is performed based on an integrated value obtained by integrating predetermined urgency evaluation values ​​for each of the provisionally determined notification stimulation amounts and the second index value, and the notification stimulation amount for each of the senses is determined.

3. The notification control device according to claim 1 , wherein the first estimation result includes an estimation result of a sensitivity and a concentration level of the notification target person for detecting the notification.

4. The notification control device according to claim 3 , wherein the first index value is calculated by the following formula (1): The first index value=C1−the sensitivity−the concentration degree (1) C1: Any constant

5. The notification control device according to claim 1 , wherein the second estimation result includes an estimation result of a degree of urgency based on a content of the notification, a degree of safety of an action of the notification target person, and an emotion of the notification target person.

6. The notification control device according to claim 4 , wherein the second index value is calculated by the following formula (2): The second index value=C2+the urgency level−the safety level−emotion index (2) C2: Any constant Emotion quotient: The converted value of the emotion

7. The provisional determination of the notification stimulus amount is performed for each item determined according to the notification format, A notification control device as described in claim 1 or 2, wherein when the notification stimulus amount for each item is provisionally determined, a combination of the notification stimulus amounts is selected such that a first total value, which is the sum of the evaluation values ​​of ease of recognition previously set for each notification stimulus amount, is the same as the first index value.

8. The notification control device described in claim 7, wherein when determining the notification stimulus amount by the adjustment, a combination of the notification stimulus amounts is selected in which the first total value is greater than or equal to the first index value and a second total value obtained by summing up the urgency evaluation values ​​preset for each notification stimulus amount is equal to the second index value.

9. calculating a first index value indicating an ease of recognition of the notification required by a target of the information notification according to an estimation result of the sensitivity and concentration of the target of the information notification to detect the notification; A provisional determination of a notification stimulus amount indicating an intensity of a stimulus that the notification provides to the subject is made based on the first index value; calculating a second index value indicating a degree of urgency required when sending the notification to the target person, according to a degree of urgency based on the content of the notification, a degree of safety of the target person's behavior, and an estimation result of the target person's emotion; The notification amount is determined by adjusting the provisionally determined notification amount based on the second index value. Notification control methods.

10. calculating a first index value indicating the ease of recognition of the notification required by the subject of information notification according to an estimation result of the sensitivity and concentration of the subject of information notification to detect the notification; tentatively determining a notification stimulus amount indicating an intensity of a stimulus that the notification provides to the subject based on the first index value; calculating a second index value indicating a degree of urgency required for sending the notification to the target, according to a degree of urgency based on the content of the notification, a degree of safety of the target's behavior, and an estimation result of the target's emotion; adjusting the provisionally determined amount of stimulation to be notified based on the second index value, and determining the amount of stimulation to be notified; A notification control program that causes a computer to execute the above.

11. A notification control device that controls a notification to a driver; a notification device that performs the notification in response to a command from the notification control device; Equipped with The notification control device includes: calculating a first index value indicating an ease of recognition of the notification required by the driver according to an estimation result of the driver's sensitivity to detect the notification and the degree of concentration; A provisional determination of a notification stimulus amount indicating a strength of a stimulus that the notification provides to the driver is made based on the first index value; calculating a second index value indicating a level of urgency required when providing the notification to the driver, according to a level of urgency based on the content of the notification, a level of safe driving of the driver, and an estimation result of an emotion of the driver; The notification amount is determined by adjusting the provisionally determined notification amount based on the second index value. instructing the notification device to notify the user based on the determined notification stimulus amount; Vehicle notification system.

12. An information source device that serves as a source of information to be notified to a driver; A notification control device that receives information to be notified to the driver from the information source device and controls the notification; a notification device that performs the notification in response to a command from the notification control device; Equipped with The notification control device includes: calculating a first index value indicating an ease of recognition of the notification required by the driver according to an estimation result of the driver's sensitivity to detect the notification and the degree of concentration; A provisional determination of a notification stimulus amount indicating a strength of a stimulus that the notification provides to the driver is made based on the first index value; calculating a second index value indicating a level of urgency required when providing the notification to the driver, according to a level of urgency based on the content of the notification, a level of safe driving of the driver, and an estimation result of an emotion of the driver; The notification amount is determined by adjusting the provisionally determined notification amount based on the second index value. instructing the notification device to notify the user based on the determined notification stimulus amount; Vehicle systems.

Images