Notification control device, method and program, and in-vehicle notification system

Abstract

To notify a user of information using an appropriate notification format while suppressing information notification in an inappropriate notification format.SOLUTION: In a notification control device, a controller controls which of a plurality of types of notification formats is used to notify a target person of target information, based on characteristics of the target person and the target information.SELECTED DRAWING: Figure 12

Description

[Technical field]

[0001] The present invention relates to a notification control device, a method, and a program, and an in-vehicle notification system. [Background technology]

[0002] In various devices, the types and amounts of information notified to users are increasing. For example, in the case of information notification in an automobile, many different types of information are now notified, such as notification of obstacles around the vehicle, notification of the status of various in-vehicle devices, route guidance information, entertainment information obtained from the Internet, etc. In addition, with the development of various notification devices, information may be notified in various notification formats such as video display, audio output, and vibration output.

[0003] There is a concern that if there is a lot of information to be notified, the user will find the notifications annoying and important information will not be conveyed properly. For this reason, a method has been developed in which, in a configuration capable of notifying information in a plurality of notification formats, a notification format of information is selected according to the importance and urgency of the information to be notified (see Patent Document 1 below). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2009-294791 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, it is believed that there are many different parameters to consider in order to provide appropriate information notification. It is hoped that information notification technology can be developed that can notify users of information in an appropriate notification format while suppressing information notification in an inappropriate notification format (thus reducing user discomfort).

[0006] An object of the present invention is to provide an information notification technique that can notify a user of information using an appropriate notification format while suppressing information notification in an inappropriate notification format. [Means for solving the problem]

[0007] The notification control device according to the present invention includes a controller that controls which of a plurality of notification formats is to be used to notify a target person of the target information, based on characteristics of the target person and characteristics of the target information. Effect of the Invention

[0008] By configuring the target information to be notified using any of a plurality of types of notification formats, the target information can be notified in an appropriate notification format at any time. In this case, in the present invention, a notification format can be selected and used according to the characteristics of the target person (e.g., the sensitivity of the target person to notifications, the learning degree (familiarity) of the target person to notifications), and appropriate notification according to the characteristics of the target person is possible. In addition, in the present invention, a notification format can be selected and used according to the characteristics of the target information (e.g., the urgency of the target information, the simplicity of the target information), and appropriate notification according to the characteristics of the target information is possible. By taking these characteristics into consideration, information can be notified to the user using an appropriate notification format while suppressing information notification in an inappropriate notification format. By suppressing information notification in an inappropriate notification format, the discomfort felt by the target person due to excessive notifications can be reduced, and the target person can easily recognize the information that should truly be conveyed. [Brief description of the drawings]

[0009] [Figure 1] FIG. 2 is a diagram showing the relationship between a person who should be notified and other components according to an embodiment of the present invention. [Diagram 2] 1 is an external perspective view of a seat provided in a vehicle according to an embodiment of the present invention; [Diagram 3] 1 is a diagram showing an internal configuration of an in-vehicle system according to an embodiment of the present invention; [Figure 4] 1 is a diagram illustrating an internal configuration of a notification control device according to an embodiment of the present invention. [Diagram 5] FIG. 2 is a diagram illustrating an internal configuration of a sensing unit according to the embodiment of the present invention. [Figure 6] FIG. 2 is a diagram illustrating an internal configuration of an information output unit according to the embodiment of the present invention. [Figure 7] 1 is a diagram showing an internal configuration of a vibration device according to an embodiment of the present invention. [Figure 8] 1 is a diagram illustrating an example of an internal configuration of a vibration device according to an embodiment of the present invention. [Figure 9] FIG. 2 is a diagram illustrating an installation position of a vibrator on a seat according to an embodiment of the present invention. [Figure 10] 1A to 1C are explanatory diagrams of a plurality of types of vibration output methods according to an embodiment of the present invention. [Figure 11] FIG. 2 is a diagram illustrating a schematic diagram of features of multiple notification formats according to an embodiment of the present invention. [Figure 12] FIG. 2 is a diagram showing how certain notification information is notified in five notification formats according to an embodiment of the present invention. [Figure 13] FIG. 2 is a diagram showing how certain notification information is notified in five notification formats according to an embodiment of the present invention. [Figure 14] 5 is an operation flowchart of a controller in a notification control device according to an embodiment of the present invention. [Figure 15] 3A to 3C are diagrams showing a notification history table and a learning degree table stored in a memory of the notification control device according to the embodiment of the present invention. [Figure 16] FIG. 11 is a diagram showing a determination table stored in a memory of a notification control device according to Example EX1 of the embodiment of the present invention. [Figure 17] FIG. 11 is a diagram showing an example of reference values ​​in a judgment table according to Example EX1 belonging to an embodiment of the present invention. [Figure 18] 11 is a flowchart of a notification format selection process according to Example EX1 of the embodiment of the present invention. [Figure 19] FIG. 11 is a diagram showing how some items in the judgment table are classified as conforming items in Example EX1 belonging to an embodiment of the present invention. [Figure 20] FIG. 11 is a diagram showing a result of a first extraction process according to Example EX1 belonging to an embodiment of the present invention. [Figure 21] FIG. 11 is a diagram showing a result of the second extraction process according to Example EX1 belonging to the embodiment of the present invention. [Figure 22] FIG. 11 is a diagram showing a relationship between a vehicle and an object according to Example EX7_A belonging to an embodiment of the present invention. [Figure 23] FIG. 11 is a diagram showing a relationship between a vehicle and an intersection according to Example EX7_B of the embodiment of the present invention. [Figure 24] FIG. 11 is a functional block diagram of a controller in a notification control device according to Example EX8 of the embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, examples of embodiments of the present invention will be described in detail with reference to the drawings. In each of the drawings, the same parts are given the same reference numerals, and duplicated descriptions of the same parts are omitted as a rule. In this specification, for the sake of simplicity, by writing a symbol or code referring to information, signal, physical quantity, functional part, circuit, element, or part, the name of the information, signal, physical quantity, functional part, circuit, element, or part corresponding to the symbol or code may be omitted or abbreviated.

[0011] FIG. 1 shows the relationship between a person U1 and other components assumed in an embodiment of the present invention. The person U1 is a target person who receives a notification, and is hereinafter referred to as the target person U1. The vehicle V1 is any type of vehicle. Herein, the vehicle V1 is assumed to be an automobile or the like that runs on a road surface. The target person U1 is an occupant of the vehicle V1. In this embodiment, it is assumed that the target person U1 is the driver of the vehicle V1. Hereinafter, when the term "driver" is simply used, this refers to the driver of the vehicle V1 (hence the target person U1). However, the target person U1 may be an occupant other than the driver (i.e., a passenger in the vehicle V1).

[0012] An in-vehicle system SYS is installed in a vehicle V1. The in-vehicle system SYS has a notification function for sending various notifications to a target person U1, and when focusing on the notification function, the in-vehicle system SYS functions as an in-vehicle notification system. The in-vehicle system SYS may have functions other than the notification function (e.g., a driving assistance function, a navigation function), and therefore the in-vehicle system SYS can be said to include an in-vehicle notification system.

[0013] A seat ST1 is installed in the cabin of the vehicle V1. The subject U1 sits in the seat ST1. FIG. 2 is an external perspective view of the seat ST1. Here, it is assumed that the subject U1 is the driver, so the seat ST1 is the driver's seat. Hereinafter, when simply referred to as the cabin, it refers to the cabin of the vehicle V1 unless otherwise specified. In addition, hereinafter, when simply referred to as the inside of the vehicle, it refers to the internal area of ​​the vehicle V1 unless otherwise specified, and when simply referred to as the outside of the vehicle, it refers to the external area of ​​the vehicle V1 unless otherwise specified.

[0014] The direction from the driver's seat of vehicle V1 toward the steering wheel is defined as "forward," and the direction from the steering wheel of vehicle V1 toward the driver's seat is defined as "rearward." The direction perpendicular to the front-rear direction and parallel to the road surface on which vehicle V1 is traveling is defined as the left-right direction. The direction perpendicular to the front-rear direction and perpendicular to the left-right direction is defined as the up-down direction. Subject U1 is sitting in seat ST1 facing forward. The front-rear direction, left-right direction, and up-down direction correspond to the front-rear direction, left-right direction, and up-down direction as seen from subject U1. Unless otherwise specified below, the traveling direction of vehicle V1 is assumed to be forward.

[0015] For more specific explanation, the relationships between the mutually perpendicular X-axis, Y-axis, and Z-axis and the front-to-back, left-to-right, and up-to-down directions are defined as follows: The X-axis direction is parallel to the left-to-right direction. The Y-axis is parallel to the front-to-back direction. The Z-axis is parallel to the up-to-down direction. The direction from left to right coincides with the direction from negative to positive on the X-axis. The direction from rear to front coincides with the direction from negative to positive on the Y-axis. The direction from bottom to top coincides with the direction from negative to positive on the Z-axis.

[0016] As shown in Fig. 2, the seat ST1 has a seat surface ST1a and a backrest ST1b. When the subject U1 sits on the seat ST1, the backs of the thighs and buttocks of the subject U1 come into contact with the seat surface ST1a, and the back of the subject U1 comes into contact with the backrest ST1b. More specifically, the seat surface ST1a has a seat surface that is approximately parallel to the X-axis and the Y-axis, and when the subject U1 sits on the seat ST1, the backs of the thighs and buttocks of the subject U1 come into contact with the seat surface. The backrest ST1b has a seat surface that is approximately parallel to the X-axis and the Z-axis, and when the subject U1 sits on the seat ST1, the back of the subject U1 comes into contact with the backrest surface.

[0017] 3 shows a schematic block diagram of the in-vehicle system SYS. The in-vehicle system SYS includes a notification control device 10, a vehicle control device 20, an actuator unit 30, a sensing unit 40, and an information output unit 50. The components of the in-vehicle system SYS can transmit and receive any signals and information to and from each other through an in-vehicle network formed in the vehicle V1. The in-vehicle network includes, for example, a CAN (Controller Area Network) and an AVCLAN (Audio Visual Communication Local Area Network).

[0018] The notification control device 10 performs various controls to realize notification to the target person U1. Under the control of the notification control device 10, the information output unit 50 operates to perform actual notification. That is, various notifications are performed for the target person U1 through cooperation between the notification control device 10 and the information output unit 50. It can also be considered that the notification control device 10 and the information output unit 50 form an information notification device. The information output unit 50 includes a display device, a speaker, etc., as will be described in detail later.

[0019] The vehicle control device 20 controls the running of the vehicle V1 using the actuator unit 30. The actuator unit 30 has various driving components constituted by a motor and the like that realize the running of the vehicle V1. Specifically, the actuator unit 30 includes an engine and a motor that generate the driving force of the vehicle V1, a steering actuator that drives the steering of the vehicle V1, and a brake actuator that drives the brakes of the vehicle V1. Here, the notification control device 10 and the vehicle control device 20 are shown separately, but the notification control device 10 and the vehicle control device 20 may be included in a single in-vehicle device.

[0020] The sensing unit 40 includes a sensor that detects the driving operation of the vehicle V1 by the driver of the vehicle V1, a sensor that detects various states of the vehicle V1, and a sensor that detects conditions inside and outside the vehicle.

[0021] 4 shows the internal configuration of the notification control device 10. The notification control device 10 includes a controller 11, a memory 12, and a communication unit 13. In the case where a single in-vehicle device including the notification control device 10 and the vehicle control device 20 is provided in the in-vehicle system SYS, the controller 11, the memory 12, and the communication unit 13 may be understood as the controller, memory, and communication unit provided in the single in-vehicle device.

[0022] The controller 11 includes a calculation processing unit including a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit) as hardware resources. The controller 11 may execute a program recorded in the memory 12 or any other recording medium (not shown) to realize any function, operation, and processing to be realized by the controller 11. In the following description, when the controller 11 notifies the subject U1, this means that the controller 11 notifies the subject U1 using the information output unit 50, and at this time, the controller 11 controls the information output unit 50 so that the information to be notified is output from the information output unit 50 to the subject U1.

[0023] The memory 12 is configured to include a non-volatile memory such as a ROM (Read only memory) or a flash memory, and a volatile memory such as a RAM (Random access memory). The memory 12 stores various data referenced by the controller 11, as well as various programs to be executed by the controller 11.

[0024] The communication unit 13 transmits and receives any signal between the notification control device 10 and a counterpart device different from the notification control device 10. The counterpart device for the communication unit 13 includes components of the in-vehicle system SYS shown in FIG. 3 other than the notification control device 10. The communication unit 13 can communicate with the counterpart device via an in-vehicle network formed in the vehicle V1. The counterpart device for the communication unit 13 can further include an external device (e.g., a server device connected to the Internet) provided outside the vehicle V1. Note that the controller 11 can transmit and receive any information to and from the counterpart device using the communication unit 13, but hereinafter, a description of the communication unit 13 may be omitted.

[0025] 5 shows the internal configuration of the sensing unit 40. The sensing unit 40 includes an exterior camera 41, an interior camera 42, an exterior microphone 43, and an interior microphone 44.

[0026] The exterior camera 41 consists of one or more cameras that capture the outside of the vehicle V1. The exterior camera 41 has a shooting area set outside the vehicle V1, and generates an exterior camera image by capturing the scene within the shooting area. The exterior camera image is an image captured in the shooting area of ​​the exterior camera 41. Image information showing the exterior camera image is referred to as exterior image information. The exterior image information is transmitted to the notification control device 10 and the vehicle control device 20. The exterior camera 41 captures images at a predetermined frame rate.

[0027] The in-vehicle camera 42 is composed of one or more cameras that capture the interior of the vehicle V1. The in-vehicle camera 42 has a capture area set inside the vehicle V1 (i.e., inside the vehicle cabin of the vehicle V1), and generates an in-vehicle camera image by capturing the state of the capture area. The in-vehicle camera image is an image captured in the capture area of ​​the in-vehicle camera 42. Image information showing the in-vehicle camera image is called in-vehicle image information. The in-vehicle image information is transmitted to the notification control device 10 and the vehicle control device 20. The in-vehicle camera 42 captures images at a predetermined frame rate. The subject U1 is located within the capture area of ​​the in-vehicle camera 42, and therefore the in-vehicle camera image includes an image of the subject U1. It is assumed that the face of the subject U1 is included within the capture area of ​​the in-vehicle camera 42, and therefore the in-vehicle camera image includes a facial image of the subject U1 (a captured image of the face of the subject U1). In addition, when a passenger other than the subject U1 is present in the vehicle, the passenger other than the subject U1 is also assumed to be located within the capture area of ​​the in-vehicle camera 42.

[0028] The exterior microphone 43 picks up ambient sounds around the location where it is installed and converts the picked up sounds into electrical signals. The electrical signals obtained by the conversion of the exterior microphone 43 are called exterior microphone signals. The exterior microphone signals are transmitted to the notification control device 10 and the vehicle control device 20. The exterior microphone 43 is installed at a specified position on the body of the vehicle V1 and picks up sounds generated outside the vehicle V1. Note that the exterior microphone 43 may be omitted.

[0029] The in-vehicle microphone 44 picks up ambient sounds around the location where the microphone 44 is installed and converts the picked up sounds into electrical signals. The electrical signals obtained by the conversion of the in-vehicle microphone 44 are referred to as in-vehicle microphone signals. The in-vehicle microphone signals are transmitted to the notification control device 10 and the vehicle control device 20. The in-vehicle microphone 44 is installed inside the cabin of the vehicle V1, and therefore the in-vehicle microphone signals represent electrical signals of sounds inside the cabin.

[0030] The sensing unit 40 further includes sensors 45a to 45k. The sensors 45a, 45b, and 45c are an accelerator pedal sensor, a brake pedal sensor, and a steering wheel sensor, respectively. The vehicle V1 is provided with operation parts that receive driving operations from the driver, and the operation parts include an accelerator pedal, a brake pedal, and a steering wheel. The sensors 45d, 45e, 45f, and 45g are a vehicle speed sensor, a steering angle sensor, a G sensor, and a distance measurement sensor, respectively. The sensors 45h, 45i, 45j, and 45k are a GPS sensor, a temperature sensor, a rainfall sensor, and an illuminance sensor, respectively.

[0031] The accelerator pedal sensor 45a detects the operation of the accelerator pedal of the vehicle V1 by the driver of the vehicle V1, and generates and outputs accelerator pedal operation information indicating the operation of the accelerator pedal. The brake pedal sensor 45b detects the operation of the brake pedal of the vehicle V1 by the driver of the vehicle V1, and generates and outputs brake pedal operation information indicating the operation of the brake pedal. The steering wheel sensor 45c detects the operation of the steering wheel of the vehicle V1 by the driver of the vehicle V1, and generates and outputs steering wheel operation information indicating the operation of the steering wheel.

[0032] The vehicle speed sensor 45d detects the speed of the vehicle V1, and generates and outputs vehicle speed information (vehicle speed pulse) representing the detected speed. The steering angle sensor 45e detects the steering angle (steering angle) of the vehicle V1, and generates and outputs steering angle information representing the detected steering angle. The G sensor 45f detects acceleration in a predetermined axial direction applied to the vehicle V1, and generates and outputs the detection result of the acceleration as acceleration information. The G sensor 45f may detect acceleration in two mutually orthogonal axial directions, or may detect acceleration in three mutually orthogonal axial directions.

[0033] The distance measurement sensor 45g generates and outputs distance measurement information by performing distance measurement. In the distance measurement by the distance measurement sensor 45g, the distance between the vehicle V1 and a solid object (three-dimensional object) located within a distance measurement area around the vehicle V1 is detected, and the orientation of the solid object as viewed from the vehicle V1 is also detected. These detection results are included in the distance measurement information. The distance measurement sensor 45g may be configured with a LIDAR (Light Detection and Ranging) that performs distance measurement using light, or may be configured with a radar that performs distance measurement using radio waves. The distance measurement sensor 45g may be configured with a combination of LIDAR and radar.

[0034] The GPS sensor 45h receives signals from a plurality of GPS satellites that form a GPS (Global Positioning System), and generates and outputs vehicle position information based on the reception results. The vehicle position information generated by the GPS sensor 45h represents the current location (current position) of the vehicle V1 by longitude and latitude, or represents the current location of the host vehicle V1 by longitude, latitude, and altitude.

[0035] The temperature sensor 45i detects the temperature inside the vehicle V1, and generates and outputs temperature information representing the detected temperature. The rainfall sensor 45j detects whether it is raining outside the vehicle V1, and generates and outputs rainfall information representing the detection result. The rainfall sensor 45j may detect whether it is raining by detecting whether water droplets are attached to the windshield of the vehicle V1. The illuminance sensor 45k detects the illuminance outside the vehicle V1 and the illuminance inside the vehicle V1, and generates and outputs illuminance information representing the detected illuminance.

[0036] Other sensors (for example, a shift lever sensor, a door lock sensor) are also provided in the sensing unit 40.

[0037] 6 shows the internal configuration of the information output unit 50. The information output unit 50 includes a display device 51, a speaker 52, and a vibration device 53. Under the control of the notification control device 10, the information output unit 50 outputs to the subject U1 information to be notified to the subject U1.

[0038] The display device 51 has a display screen 51a consisting of a liquid crystal display panel or the like, and displays any image according to the control of the notification control device 10, the vehicle control device 20, or a display control device not shown. The display device 51 is installed at an appropriate location in the cabin of the vehicle V1 so that each occupant of the vehicle V1 (at least the target person U1) can see the display content of the display device 51. A plurality of display devices 51 may be installed in the cabin of the vehicle V1. The display device 51 may be a component of a car navigation system installed in the vehicle V1. The car navigation system may be included in the in-vehicle system SYS. In the following description, unless otherwise specified, display refers to display on the display device 51. Display on the display device 51 specifically refers to display on the display screen 51a provided on the display device 51.

[0039] The speaker 52 outputs any sound (message, music, etc.) under the control of the notification control device 10, the vehicle control device 20, or an audio device (not shown). The speaker 52 is installed at an appropriate location in the cabin of the vehicle V1 so that each occupant of the vehicle V1 (at least the target person U1) can hear the output sound of the speaker 52. A plurality of speakers 52 may be installed in the cabin of the vehicle V1. In the following description, the output of sound or audio refers to the output of sound or audio from the speaker 52, unless otherwise specified.

[0040] As shown in FIG. 7, the vibration device 53 includes a plurality of vibration units 54 each having a drive circuit 55 and a vibrator 56. The plurality of vibration units 54 have the same configuration. However, the total number of vibration units 54 may be one. The notification control device 10 can supply an acoustic signal Ain to each vibration unit 54. The acoustic signal Ain supplied to the vibration unit 54 is hereinafter referred to as an input acoustic signal Ain. In each vibration unit U, the drive circuit 55 amplifies the input acoustic signal Ain and supplies the amplified input acoustic signal Ain, that is, the drive acoustic signal Adrv, to the vibrator 56. The vibrator 56 is an electroacoustic converter (vibration converter) made of an electromagnetic circuit such as a magnet and a coil, or made of a piezoelectric element, and converts the drive acoustic signal Adrv, which is an electric signal supplied to itself, into mechanical vibration. That is, the vibrator 56 receives the drive acoustic signal Adrv and generates vibration according to the drive acoustic signal Adrv (therefore generates vibration according to the input acoustic signal Ain). The vibration generated by the vibration device 53 (specifically, the vibration generated by the vibrator 56) is transmitted to the subject U1. In this example, the vibration unit 54 outputs vibration using the input acoustic signal Ain, but the vibration unit 54 may be driven by a vibration signal obtained by performing appropriate signal processing on the input acoustic signal Ain (i.e., the vibration signal is input to the vibration unit 54). The above signal processing includes, for example, a frequency division process or a frequency shift process that reduces the frequency of the input acoustic signal Ain. By the above signal processing, a signal (drive signal) suitable for transmitting vibration to the subject U1 can be obtained.

[0041] The notification control device 10 (controller 11) can adjust the vibration intensity of the vibrator 56 by adjusting the amplitude of the input acoustic signal Ain or by adjusting the amplification factor of the drive circuit 55 for each vibration unit 54. The notification control device 10 (controller 11) can selectively supply the acoustic signal Ain to only some of the vibration units 54 out of the multiple vibration units 54.

[0042] As long as the desired vibration can be applied to the subject U1, the installation position of the vibrator 56 is arbitrary, but here, the vibrator 56 is provided on the seat ST1. Furthermore, in order to individually apply vibration to the left, center, and right parts of the body of the subject U1, the plurality of vibration units 54 are provided with vibration units 54L, 54C, and 54R shown in FIG. 8 as three vibration units 54. The input acoustic signals Ain for the vibration units 54L, 54C, and 54R are particularly referred to as input acoustic signals AinL, AinC, and AinR, respectively. The drive circuits 55 in the vibration units 54L, 54C, and 54R are particularly referred to as drive circuits 55L, 55C, and 55R, respectively. The vibrators 56 in the vibration units 54L, 54C, and 54R are particularly referred to as vibrators 56L, 56C, and 56R, respectively. Therefore, the transducer 56L generates vibrations according to the input acoustic signal AinL, the transducer 56C generates vibrations according to the input acoustic signal AinC, and the transducer 56R generates vibrations according to the input acoustic signal AinR.

[0043] With reference to Fig. 9(a) and (b), possible installation positions of the vibrator 56 will be described. Fig. 9(a) is a plan view of the seat ST1 as viewed from above, and Fig. 9(b) is a plan view of the seat ST1 as viewed from behind. As shown in Fig. 9(a), the seat ST1a has a central area Ca, a left area La located to the left of the central area Ca, and a right area Ra located to the right of the central area Ca. As shown in Fig. 9(b), the backrest ST1b has a central area Cb, a left area Lb located to the left of the central area Cb, and a right area Rb located to the right of the central area Cb.

[0044] As a method for arranging the transducer 56, any of the following first to third arrangement methods can be adopted. In the first arrangement method, the transducer 56L is arranged in the left region La, the transducer 56C is arranged in the center region Ca, and the transducer 56R is arranged in the right region Ra. In the second arrangement method, the transducer 56L is arranged in the left region Lb, the transducer 56C is arranged in the center region Cb, and the transducer 56R is arranged in the right region Rb. In the third arrangement method, two each of the vibration units 54L, 54C, and 54R are provided in the vibration device 53. In the third arrangement method, the two transducers 56L in the two vibration units 54L are referred to as a first transducer 56L1 and a second transducer 56L2. Similarly, the two transducers 56C in the two vibration units 54C are referred to as the first transducer 56C1 and the second transducer 56C2, and the two transducers 56R in the two vibration units 54R are referred to as the first transducer 56R1 and the second transducer 56R2. In the third arrangement method, the first transducer 56L1 is arranged in the left region La, the first transducer 56C1 is arranged in the central region Ca, and the first transducer 56R1 is arranged in the right region Ra. In addition, in the third arrangement method, the second transducer 56L2 is arranged in the left region Lb, the second transducer 56C2 is arranged in the central region Cb, and the second transducer 56R2 is arranged in the right region Rb. In the third arrangement method, a driving acoustic signal Adrv based on a common input acoustic signal AinL is supplied to the transducers 56L1 and 56L2. Similarly, a driving acoustic signal Adrv based on a common input acoustic signal AinC is supplied to the transducers 56C1 and 56C2, and a driving acoustic signal Adrv based on a common input acoustic signal AinR is supplied to the transducers 56R1 and 56R2.

[0045] [Left side vibration output, center vibration output, right side vibration output, overall vibration output] The controller 11 can perform left vibration output, center vibration output, right vibration output, or whole vibration output. Figures 10(a), (b), (c), and (d) show an overview of the left, center, right, and whole vibration outputs when the second arrangement method is adopted, but the same applies when the first or third arrangement method is adopted.

[0046] In the left vibration output, the controller 11 supplies the input acoustic signal Ain (i.e., AinL) only to the vibration unit 54L among the vibration units 54L, 54C, and 54R. Therefore, in the left vibration output, among the transducers 56L, 56C, and 56R, only the transducer 56L vibrates in response to the input acoustic signal AinL, and as a result, vibration by the transducer 56L is imparted only to the left portion of the body of the subject U1.

[0047] At the central vibration output, the controller 11 supplies the input acoustic signal Ain (i.e., AinC) only to the vibration unit 54C among the vibration units 54L, 54C, and 54R. Therefore, at the central vibration output, only the transducer 56C among the transducers 56L, 56C, and 56R vibrates in response to the input acoustic signal AinC, and as a result, vibration by the transducer 56C is imparted only to the central part of the body of the subject U1.

[0048] In the right vibration output, the controller 11 supplies the input acoustic signal Ain (i.e., AinR) only to the vibration unit 54R among the vibration units 54L, 54C, and 54R. Therefore, in the right vibration output, among the transducers 56L, 56C, and 56R, only the transducer 56R vibrates in response to the input acoustic signal AinR, and as a result, vibration by the transducer 56R is imparted only to the right part of the body of the subject U1.

[0049] In the whole vibration output, the controller 11 supplies the input sound signal Ain to all of the vibration units 54L, 54C, and 54R. Therefore, in the whole vibration output, the vibrators 56L, 56C, and 56R vibrate according to the input sound signals AinL, AinC, and AinR. As a result, in the whole vibration output, the vibrations are given by the vibrators 56L, 56C, and 56R to the whole left, center, and right parts of the body of the subject U1. Note that the left part of the body of the subject U1 refers to the part of the body of the subject U1 to the left of the midline. Similarly, the right part of the body of the subject U1 refers to the part of the body of the subject U1 to the right of the midline. The center part of the body of the subject U1 refers to the part between the left part and the right part, and is the part that includes the midline.

[0050] [Information notification processing] The controller 11 performs an information notification process as a process for notifying the target person U1 of various information. In the information notification process, the controller 11 notifies the target person U1 of one or more of the first to n-th types of information in one or more of the first to m-th notification formats. Each of m and n represents an arbitrary integer of 2 or more. However, in the following embodiment, it is assumed that "m=5", and an outline of the first to fifth notification formats is shown in FIG. 10. Any of the first to n types of information, that is, the i-th type of information, is referred to as the i-th notification information. The i-th notification information is information expressed in a language. i represents an arbitrary integer.

[0051] The first notification format is a text notification format in which text indicating the i-th notification information is displayed on the display device 51. In the first notification format, an image of the text itself indicating the i-th notification information is displayed on the display device 51. The second notification format is a graphic notification format in which a graphic representing the i-th notification information is displayed on the display device 51. The graphic includes illustrations and pictograms. In the second notification format, an image of a graphic associated with the i-th notification information is displayed on the display device 51. The first and second notification formats are notification formats that affect the vision of the target U1. Although text display is excellent in the accuracy of information transmission, graphic display may be advantageous in terms of the speed of information transmission. By preparing the first and second notification formats, information transmission (notification of the i-th notification information) can be performed in an appropriate notification format according to the situation of the target U1 and the content of the transmission, etc.

[0052] The third notification format is an audio notification format in which an audio signal of words indicating the i-th notification information is output as audio from the speaker 52. In the third notification format, the words indicating the i-th notification information themselves are reproduced and output as sound from the speaker 52. The fourth notification format is an audio notification format in which an audio signal associated with the i-th notification information and other than words (for example, an audio signal with a different melody, tempo, etc. depending on the information content) is output as sound from the speaker 52. In the fourth notification format, an audio signal associated with the i-th notification information is reproduced and output as sound from the speaker 52. The third and fourth notification formats are notification formats that affect the hearing of the target U1. Although audio output is excellent in accuracy of information transmission, audio output other than words may be advantageous in terms of speed of information transmission. By preparing the third and fourth notification formats, information transmission (notification of the i-th notification information) can be performed in an appropriate notification format according to the situation of the target U1 and the transmission content, etc.

[0053] The fifth notification format is a vibration notification format in which vibrations associated with the i-th notification information are generated by the vibration device 53. In the fifth notification format, vibrations associated with the i-th notification information are generated by the vibration device 53, and the generated vibrations are transmitted to the subject U1. The fifth notification format is a notification format that acts on the tactile sense of the subject U1. A notification format that acts on the tactile sense does not need to rely on vision or hearing, and is therefore less likely to affect the driving operation, etc., of the subject U1, and in this respect may be more advantageous than notification formats that act on vision or hearing.

[0054] Figure 12(a) to (e) show the i A This shows the situation where notification information is notified to the target U1 in the first to fifth notification formats. A represents a natural number less than or equal to n. A The notification information is information for calling attention to the possibility of electric two-wheeled vehicles or the like being caught when the vehicle V1 turns left. A In the notification of the notification information, the character string 611 of "Watch out for collisions when turning left" is displayed on the display screen 51a. A In the notification of the notification information, a figure 612 associated with "Watch out for collisions when turning left" is displayed on the display screen 51a.A In the notification of the notification information, the words 613 "Be careful of being caught when turning left" are outputted by voice from the speaker 52. A In the notification of notification information, sounds that do not correspond to words and are the i-th A A sound 614 (here, a buzzing sound) associated with the notification information is output from the speaker 52. A In the notification of notification information, A Vibration 615 associated with the notification information (here, vibration by left-side vibration output that is perceived as "buzzing") is generated by the vibration device 53 and transmitted to the subject U1.

[0055] Figure 13(a) to (e) show the i B This shows the situation where notification information is notified to the target U1 in the first to fifth notification formats. B i A represents a natural number less than or equal to n. B The notification information is information for alerting the driver that the vehicle V1 is speeding. B In the notification of the notification information, the character string 621 of "Caution: Speeding" is displayed on the display screen 51a. B In the notification of the notification information, a figure 622 associated with "Caution: Speed ​​Limit" is displayed on the display screen 51a. B In the notification of the notification information, the words "Please be careful not to exceed the speed limit" 623 are output as voice from the speaker 52. B In the notification of notification information, sounds that do not correspond to words and are the i-th B A sound 624 (here, a sound that sounds like "buzz, buzz") associated with the notification information is output from the speaker 52. B In the notification of notification information, B A vibration 625 (here, a vibration with a central vibration output that is perceived as "buzzing, buzzing") associated with the notification information is generated by the vibration device 53 and transmitted to the subject U1. BThe character string 621, the figure 622, the words 623, the sound 624, and the vibration 625 related to the notification information are respectively the i-th A The notification information is different from the character string 611, the figure 612, the words 613, the sound 614, and the vibration 615.

[0056] The controller 11 performs the i-th A The notification information can be notified using any one or more of the first to fifth notification formats. B The same applies to the notification information. A and i B The same applies to each notification information other than the notification information. By being able to selectively notify the target person U1 of one notification information using any one or more of the first to fifth notification formats, it is possible to transmit information (notify the i-th notification information) in an appropriate notification format according to the target person U1's situation and the content to be transmitted. Note that, although only the first to fifth notification formats are focused on here, notification formats that affect the sense of smell or taste may also be included in the first to m-th notification formats.

[0057] [Operational flowchart for information notification processing] 14 shows an operation flowchart of the controller 11. Each process of steps S11 to S20 shown in FIG. 14 is executed by the controller 11. However, the process of step S19 is realized by cooperation between the controller 11 and the information output unit 50.

[0058] The controller 11 is also started when the vehicle V1 is started, and the operation of the controller 11 starts from the process of step S11. In step S11, the controller 11 performs a process of determining whether the notification conditions are satisfied. Notification conditions associated with each piece of notification information are set in advance in the controller 11. The notification conditions associated with the first to n-th notification information are referred to as the first to n-th notification conditions, respectively. In the process of determining whether the notification conditions are satisfied, the controller 11 determines whether the first to n-th notification conditions are satisfied. The determination result is checked in step S12 following step S11. If any of the notification conditions is satisfied (Y in step S12), the controller 11 transitions to step S13, and if none of the notification conditions is satisfied (N in step S12), the controller 11 returns to step S11 and repeats the processes of steps S11 and S12.

[0059] Hereinafter, the process from step S13 onward will be described, assuming that transition to step S13 occurs due to the establishment of the i-th notification condition. Notification information that is actually notified to the target U1 is also referred to as target information. Here, it is assumed that the i-th notification condition is established, so it is understood that the i-th notification information is the target information. When the i-th notification condition is established, the process of steps S13 to S17 is executed. The order of execution of the process of steps S13 to S17 is arbitrary. In the flowchart of FIG. 14, the process of steps S13 to S17 is executed after the determination of step S12 is "yes", but all or part of the process of steps S13 to S17 may be performed before step S11 or between steps S11 and S12.

[0060] --Sensitivity estimation process-- In step S13, the controller 11 performs a sensitivity estimation process. In the sensitivity estimation process, the controller 11 estimates and identifies the visual sensitivity SSa, the auditory sensitivity SSb, and the tactile sensitivity SSc of the subject U1 based on each piece of information obtained by the sensing unit 40 (see FIG. 5). The visual sensitivity SSa, the auditory sensitivity SSb, and the tactile sensitivity SSc are sensitivity information that do not depend on whether the target information is the first to n-th notification information. The visual sensitivity SSa, the auditory sensitivity SSb, and the tactile sensitivity SSc are each expressed by a number with multiple levels, and for the sake of concrete explanation, they are expressed here by integers between 0 and 5 (however, decimals may be included).

[0061] The sensitivity of the subject U1 (visual sensitivity SSa, auditory sensitivity SSb, and tactile sensitivity SSc) belongs to the characteristics of the subject U1. The sensitivity of the subject U1 is the sensitivity of the subject U1 to a notification from the notification control device 10 (in other words, a notification from the information output unit 50), and represents the ease with which the notification by the subject U1 is recognized. The controller 11 can estimate the sensitivity of the subject U1 (visual sensitivity SSa, auditory sensitivity SSb, and tactile sensitivity SSc) based on the surrounding environment information representing the surrounding environment of the subject U1. The visual sensitivity SSa represents the sensitivity of the subject U1 to a notification when any notification information is notified to the subject U1 in a notification format (first or second notification format) that affects the subject U1's vision. The auditory sensitivity SSb represents the sensitivity of the subject U1 to a tower notification when any notification information is notified to the subject U1 in a notification format (third or fourth notification format) that affects the subject U1's hearing. The tactile sensitivity SSc represents the sensitivity of the subject U1 to any notification information when the subject U1 is notified of the notification information in a notification format (fifth notification format) that affects the subject U1's sense of touch.

[0062] The visual sensitivity SSa represents the visual sensitivity of the subject U1 and indicates the ease with which the subject U1 recognizes a visual notification (hence, the ease with which the subject U1 recognizes a notification in the first or second notification format). The higher the visual sensitivity of the subject U1 is determined to be (i.e., the easier it is determined that the subject U1 recognizes notification information by his / her vision), the higher the visual sensitivity SSa is. The controller 11 may estimate the visual sensitivity SSa based on illuminance information from the illuminance sensor 45k (i.e., based on the illuminance inside the vehicle or the illuminance outside the vehicle). The illuminance information belongs to the surrounding environment information of the subject U1. Prior to the start of the operation of FIG. 14, the controller 11 may perform a setup process and obtain sensitivity personal information from the subject U1, which is the basis for estimating the visual, auditory, and tactile sensitivities of the subject U1, in the setup process. In this case, the controller 11 may estimate the visual sensitivity SSa based on the sensitivity personal information. In addition, the visual sensitivity SSa may be estimated according to the result of judging whether the subject U1 is looking away based on the in-vehicle image information.

[0063] The hearing sensitivity SSb represents the hearing sensitivity of the subject U1 and indicates the ease with which the subject U1 recognizes any notification by its hearing (hence, the ease with which the subject U1 recognizes a notification by the third or fourth notification format). The higher the hearing sensitivity of the subject U1 is judged to be (i.e., the easier it is judged that the notification information is recognized by the hearing of the subject U1), the higher the hearing sensitivity SSb is. The controller 11 may estimate the hearing sensitivity SSb based on the in-vehicle microphone signal. In this case, for example, the controller 11 may calculate the equivalent sound level in the vehicle cabin based on the in-vehicle microphone signal, and may estimate the hearing sensitivity SSb higher as the equivalent sound level is lower, and may estimate the hearing sensitivity SSb lower as the equivalent sound level is higher. The in-vehicle microphone signal and the equivalent sound level belong to the surrounding environment information of the subject U1. The controller 11 may estimate the hearing sensitivity SSb based on the above-mentioned sensitivity personal information.

[0064] The tactile sensitivity SSc represents the tactile sensitivity of the subject U1, and represents the ease with which the subject U1 recognizes any notification by the tactile sense (hence, the ease with which the notification by the fifth notification format is recognized). The higher the tactile sensitivity of the subject U1 is determined to be (i.e., the easier it is determined that the notification information is recognized by the subject U1's tactile sense), the higher the tactile sensitivity SSc is. The controller 11 may estimate the tactile sensitivity SSc based on the in-car image information. In this case, for example, the controller 11 can estimate the thickness and type of the clothes worn by the subject U1 based on the in-car image information, and estimate the tactile sensitivity SSc based on the estimated thickness and type of the clothes. The controller 11 can estimate the tactile sensitivity SSc higher as the estimated thickness is smaller, and can estimate the tactile sensitivity SSc lower as the estimated thickness is larger. In this case, the estimated result of the tactile sensitivity SSc can be corrected according to a predetermined rule according to the estimated type of clothes. The thickness and type of clothing worn by the subject U1 can also be said to belong to the surrounding environment information of the subject U1. The controller 11 may also estimate the road surface condition on which the vehicle V1 is traveling based on the acceleration information from the G sensor 45f and the outside image information from the outside camera 41. Then, the tactile sensitivity SSc may be estimated by estimating the ease with which the subject U1 perceives the vibrations caused by the vibration device 53 based on the estimated road surface condition. The controller 11 may estimate the tactile sensitivity SSc based on the above sensitivity personal information.

[0065] --Simplicity estimation process-- In step S14, the controller 11 performs a simplicity estimation process. In the simplicity estimation process, the controller 11 estimates and identifies the simplicity of the target information (i-th notification information). The simplicity is referred to by the symbol "SPL" as appropriate. The simplicity of the first to n-th notification information is represented as simplicity SPL[1] to SPL[n], respectively. Each simplicity is expressed by a number with multiple stages, and for the sake of concrete explanation, it is assumed here that it is expressed by an integer between 0 and 5 (however, decimals may be included).

[0066] Simplicity belongs to the characteristics of the notification information (hence, the simplicity SPL[i] belongs to the characteristics of the i-th notification information). The higher the simplicity of the i-th notification information is judged to be (i.e., the simpler the i-th notification information is), the higher the simplicity SPL[i] will be. U Notification information is V If it is simpler than notification information, then “SPL[i U ]>SPL[i V ]”(i U and i V are different integers). For example, the i U If the notification information is "speeding warning" and the i V If the notification information is "There is a junction 200m ahead on the left," U ]>SPL[i V ]”

[0067] The simplicity level SPL[i] is estimated based on the length of the sentence when the i-th notification information is expressed as a sentence, the number of phrases in the sentence, and the simplicity of the sentence structure. The shorter the length of the sentence when the i-th notification information is expressed as a sentence, the higher the simplicity level SPL[i], the fewer the number of phrases in the sentence, and the simpler the sentence structure, the higher the simplicity level SPL[i].

[0068] In addition, among the first to n-th notification information, the contents of some of the notification information may be fixed, and the simplicity of the notification information with the fixed contents may be set in advance to be unchanging. That is, for example, if the first notification information indicates a fixed content "Caution: icy road", the simplicity SPL[1] corresponding to the fixed content "Caution: icy road" may be set in advance to be unchanging.

[0069] -- Urgency estimation process -- In step S15, the controller 11 performs an urgency estimation process. In the urgency estimation process, the controller 11 estimates and identifies the urgency of the target information (i-th notified information). The urgency is referred to by the symbol "UGT" as appropriate. The urgency of the first to n-th notified information is represented as urgency UGT[1] to UGT[n], respectively. Each urgency is expressed by a number with multiple levels, and for the sake of concrete explanation, it is assumed here that the urgency is expressed by an integer between 0 and 5 (however, decimals may be included).

[0070] The urgency belongs to the characteristics of the notification information (therefore, the urgency UGT[i] belongs to the characteristics of the i-th notification information). The higher the urgency of the i-th notification information is determined to be (i.e., the higher the urgency of notifying the target U1 of the i-th notification information), the higher the urgency UGT[i]. U The urgency of notifying the notification information to the target U1 and the first V When comparing the urgency of notifying the target U1 of the notification information, if the urgency of the former is higher than the latter, "UGT[i U ]>UGT[i V For example, the i U If the notification information is "50m ahead, there is a left turn point" and the i V If the notification information is "There is a left turn point 500m ahead," U ]>UGT[i V ]”

[0071] When notifying the target person U1 of a point (such as a left turn point) or an object (another vehicle running parallel to or passing by) that should be recognized by the target person U1 by the i-th notification information, the controller 11 can estimate the urgency UGT[i] based on the estimated arrival time. The estimated arrival time here represents the remaining time until the vehicle V1 reaches the point that should be recognized by the target person U1, or the remaining time until the distance between the object that should be recognized by the target person U1 and the vehicle V1 becomes the smallest during the traveling process of the vehicle V1. The controller 11 can derive the estimated arrival time based on the distance measurement information and the outside-vehicle image information. When deriving the estimated arrival time, map information may also be referenced. The map information represents a map of an area including the traveling area of ​​the vehicle V1, and is stored in the memory 12 or provided to the notification control device 10 from another device (such as a server device). In addition, the urgency UGT[i] may be derived by referring to each piece of information acquired by the sensing unit 40.

[0072] Among the first to n-th notification information, the urgency of some notification information that is not related to the estimated arrival time etc. may be set in advance to be unchanging. That is, for example, if the first notification information indicates a fixed content "Caution: icy road", the urgency UGT[1] corresponding to the fixed content "Caution: icy road" may be set in advance to be unchanging.

[0073] --Learning degree estimation process-- In step S16, the controller 11 performs a learning degree estimation process. In the learning degree estimation process, the controller 11 estimates and specifies the learning degree of the target U1 based on the notification history table 121 (see FIG. 15) described later. The learning degree of the target U1 belongs to the characteristics of the target U1. The learning degree of the target U1 is the learning degree of the target U1 with respect to the notification from the notification control device 10 (in other words, the notification from the information output unit 50), and represents the degree of familiarity of the target U1 with receiving notifications. The learning degree is appropriately referred to by the symbol "LD". The controller 11 can estimate the learning degree LD for each notification format and for each notification information. Among the learning degree LD, the learning degree of the target U1 with respect to notifying the target U1 of the i-th notification information in the j-th notification format is referred to as the learning degree LD[i,j]. The i in the learning degree LD[i,j] represents an integer of 1 to n, and the j in the learning degree LD[i,j] represents an integer of 1 to m (here, an integer of 1 to 5). The learning degree LD[i,j] is expressed by a number with multiple stages, and for the sake of concrete explanation, it is assumed here that it is expressed by an integer between 0 and 5 (however, it may include a decimal point).

[0074] The learning degree LD[i,j] represents the degree of familiarity of the target U1 with the i-th notification information being notified to the target U1 in the j-th notification format, and the higher the degree of familiarity, the higher the learning degree LD[i,j]. It is considered that the higher the learning degree LD[i,j], the easier it is for the target U1 to accurately convey the content of the i-th notification information when the i-th notification information is notified to the target U1 in the j-th notification format.

[0075] Fig. 15 shows the structures of a notification history table 121 and a learning degree table 122 stored in the non-volatile memory within the memory 12. The notification history table 121 is notification history information representing the history of notifications to the target person U1 for each notification format and each notification information. The notification history table 121 consists of information on the number of notifications NUM[1,1] to NUM[n,m] (here, “m = 5”). The number of notifications NUM[i,j] represents the number of times the i-th notification information has been notified to the target person U1 in the j-th notification format in the past. The initial values of each of the number of notifications NUM[1,1] to NUM[n,m] are zero. Each time the controller 11 notifies the target person U1 with the i-th notification information in the j-th notification format, the controller 11 adds 1 to the number of notifications NUM[i,j].

[0076] The learning degree table 122 is learning degree information consisting of information on the learning degrees LD[1,1] to LD[n,m] (here, “m = 5”). The controller 11 estimates the learning degree LD[i,j] based on the number of notifications NUM[i,j] for each notification format and each notification information. The controller 11 stores the estimated learning degree LD[i,j] in the learning degree table 122. When “0 ≦ NUM[i,j] < TH[1]” holds, “LD[i,j] = 0” is set. When “TH[1] ≦ NUM[i,j] < TH[2]” holds, “LD[i,j] = 1” is set. When “TH[2] ≦ NUM[i,j] < TH[3]” holds, “LD[i,j] = 2” is set. When “TH[3] ≦ NUM[i,j] < TH[4]” holds, “LD[i,j] = 3” is set. When “TH[4] ≦ NUM[i,j] < TH[5]” holds, “LD[i,j] = 4” is set. When “TH[5] ≦ NUM[i,j]” holds, “LD[i,j] = 5” is set. The threshold values TH[1] to TH[5] are integers satisfying “0 < TH[1] < TH[2] < TH[3] < TH[4] < TH[5]”.

[0077] That is, regarding the target information (the i-th notification information), for each notification format, the controller 11 refers to the number of repetitions (i.e., the notification count NUM[i,j]) of notifying the target person U1 of information of the same type as the target information in that notification format. Then, based on the notification count NUM[i,j], the controller 11 estimates the learning degree LD[i,j] of the target person U1 with respect to the notification of the target information (the i-th notification information) in the j-th notification format.

[0078] Currently, assuming that the target information is the i-th notification information, in step S16, the learning degrees LD[i,1] to LD[i,5] are estimated. For example, at the stage of step S16, if the notification count NUM[i,1] satisfies "TH[2] ≦ NUM[i,1] < TH[3]", the learning degree LD[i,1] with respect to the target information is estimated to be 2. Also, for example, at the stage of step S16, if the notification count NUM[i,2] satisfies "TH[4] ≦ NUM[i,2] < TH[5]", the learning degree LD[i,2] with respect to the target information is estimated to be 4. The learning degrees LD[i,3] to LD[i,5] with respect to the target information are also estimated in the same way.

[0079] --Co-rider estimation process-- In step S17, the controller 11 performs a co-rider estimation process. In the co-rider estimation process, the controller 11 estimates and identifies the presence or absence of co-riders based on the in-vehicle image information. A co-rider refers to a passenger other than the target person U1 (i.e., a person who is on board the vehicle V1 and is other than the target person U1). The controller 11 may also refer to the in-vehicle microphone signal in addition to the in-vehicle image information to perform the co-rider estimation process. In the co-rider estimation process, the controller 11 may also estimate the number of co-riders.

[0080] --Notification format selection process-- When the i-th notification condition is satisfied (Y in step S12) and the processes of steps S13 to S17 are executed, the controller 11 executes a notification format selection process in step S18. In the notification format selection process, the controller 11 selects and sets, as an output notification format, from among the first to fifth notification formats, a notification format that is actually used to notify the target person U1 of the target information based on each estimation result of steps S13 to S17. At this time, the controller 11 judges, based on each estimation result of steps S13 to S17, for each notification format (i.e., for each of the first to fifth notification formats), whether the notification format is suitable for notifying the target person U1 of the target information. Then, the controller 11 sets the notification format that is determined to be suitable as the output notification format. Only one of the first to fifth notification formats may be set as the output notification format, or two or more notification formats may be set as the output notification format. A specific example of the notification format selection process will be described later.

[0081] --Notification output processing-- In step S19 following step S18, the controller 11 performs a notification output process using the information output unit 50. In the notification output process, the controller 11 notifies the target person U1 of the target information using the output notification format selected and set in the notification format selection process. The notification of the target information is realized by outputting the target information from the information output unit 50 to the target person U1. That is, the information output unit 50 outputs the target information to the target person U1 using one or more notification formats set as the output notification format among the first to fifth notification formats, thereby realizing the notification of the target information to the target person U1.

[0082] Therefore, the target information is the i-th one described above with reference to Figs. 12(a) to 12(e). AIn the case of notification information, the notification output process is as follows. If the output notification format includes the first notification format, a character string 611 of "Watch out for cars getting caught when turning left" is displayed on the display screen 51a in the notification output process. If the output notification format includes the second notification format, a graphic 612 associated with "Watch out for cars getting caught when turning left" is displayed on the display screen 51a in the notification output process. If the output notification format includes the third notification format, the words 613 of "Watch out for cars getting caught when turning left" are output as audio from the speaker 52 in the notification output process. If the output notification format includes the fourth notification format, a sound 614 that does not correspond to words and is associated with the target information is output from the speaker 52 in the notification output process. If the output notification format includes the fifth notification format, a vibration 615 associated with the target information is generated by the vibration device 53 and transmitted to the target person U1 in the notification output process. If the target information is the i A The same applies to the case of notification information other than notification information.

[0083] --Notification history update process-- In step S20 following step S19, the controller 11 performs a notification history update process. In the notification history update process, the controller 11 updates the notification history table 121 (see FIG. 15) to reflect the execution result of the notification output process in step S19 in the notification history table 121. That is, for example, when the target information is the n-th notification information and the target information is notified to the target U1 in only the first and second notification formats in the notification output process, the controller 11 involved in the notification history update process adds 1 to the notification count NUM[n,1] and NUM[n,2]. Alternatively, for example, when the target information is the n-th notification information and the target information is notified to the target U1 in only the third notification format in the notification output process, the controller 11 involved in the notification history update process adds 1 to the notification count NUM[n,3]. The same applies when the n-th notification information as the target information is notified to the target U1 in the fourth or fifth notification format in the notification output process. The same applies when the target information is any of the first to (n-1)th notification information. When the controller 11 updates the notification history table 121, the controller 11 may also update the learning degree table 122 so that the update result of the notification history table 121 can be determined.

[0084] After step S20, the process returns to step S11, and the series of processes starting from step S11 is repeated.

[0085] Below, in multiple embodiments, further specific operation examples, application techniques, modified techniques, etc. related to the in-vehicle system SYS (particularly the notification control device 10) will be described. The matters described above in this embodiment are applied to each of the following embodiments unless otherwise specified and unless there is a contradiction. If there are matters in each embodiment that contradict the matters described above, the description in each embodiment may take precedence. Furthermore, unless there is a contradiction, matters described in any of the multiple embodiments shown below can also be applied to any other embodiment (i.e., any two or more of the multiple embodiments can also be combined).

[0086] <<Example EX1>> 16 shows the structure of the judgment table 123 stored in the non-volatile memory in the memory 12. The controller 11 performs the above-mentioned notification format selection process (see step S18 in FIG. 14) based on the judgment table 123.

[0087] A total of 20 items G are defined in the judgment table 123, and a numerical range is set for each item G. The total of 20 items G are composed of items G[1,1] to G[5,4]. Each of the items G[1,1] to G[5,4] is associated with one of the first to fifth notification formats. The four items G[i,1] to G[i,4] are associated with the i-th notification format (where i is an integer between 1 and 5). Also, each of the items G[1,1] to G[5,4] is associated with one of the first to fourth indices. The five items G[1,j] to G[5,j] are associated with the j-th index (where j is an integer between 1 and 4). The first index is an index related to sensitivity. The second index is an index related to simplicity and urgency (in this example, the difference (simplicity-urgency)). The third index is an index related to simplicity. The fourth indicator is an indicator related to the degree of learning.

[0088] The numerical range set for each item G in the judgment table 123 is a part of the numerical range of 0 to 5 inclusive, or coincides with the numerical range of 0 to 5 inclusive. Each numerical range can be set arbitrarily, but in the following, for the sake of concrete explanation, the reference numerical example W1 shown in FIG. 17 will be referred to as appropriate, and unless otherwise specified, each numerical range according to the reference numerical example W1 is assumed to be preset in the judgment table 123.

[0089] In the reference numerical example W1, the numerical range of item G[1,1] is the numerical range of 4 or more and 5 or less, the numerical range of item G[2,1] is the numerical range of 4 or more and 5 or less, the numerical range of item G[3,1] is the numerical range of 2 or more and 5 or less, the numerical range of item G[4,1] is the numerical range of 0 or more and 5 or less, and the numerical range of item G[5,1] is the numerical range of 0 or more and 5 or less.

[0090] In the reference numerical example W1, the numerical range of item G[1,2] is the numerical range of 4 or more and 5 or less, the numerical range of item G[2,2] is the numerical range of 2 or more and 5 or less, the numerical range of item G[3,2] is the numerical range of 4 or more and 5 or less, the numerical range of item G[4,2] is the numerical range of 0 or more and 5 or less, and the numerical range of item G[5,2] is the numerical range of 0 or more and 5 or less.

[0091] In the reference numerical example W1, the numerical range of item G[1,3] is a numerical range of 0 or more and 5 or less, the numerical range of item G[2,3] is a numerical range of 2 or more and 5 or less, the numerical range of item G[3,3] is a numerical range of 0 or more and 5 or less, the numerical range of item G[4,3] is a numerical range of 4 or more and 5 or less, and the numerical range of item G[5,3] is a numerical range of 2 or more and 5 or less.

[0092] In the reference numerical example W1, the numerical range of item G[1,4] is the numerical range of 0 or more and 5 or less, the numerical range of item G[2,4] is the numerical range of 2 or more and 5 or less, the numerical range of item G[3,4] is the numerical range of 0 or more and 5 or less, the numerical range of item G[4,4] is the numerical range of 4 or more and 5 or less, and the numerical range of item G[5,4] is the numerical range of 4 or more and 5 or less.

[0093] Fig. 18 shows a flowchart of the notification format selection process according to the embodiment EX1. The notification format selection process according to the embodiment EX1 consists of steps S18a to S18d. After step S18a, steps S18b and S18c are executed, and then step S18d is executed. The order of steps S18b and S18c is arbitrary, and steps S18b and S18c may be executed simultaneously.

[0094] --Item classification processing-- In step S18a, the controller 11 performs an item classification process. In the item classification process, the controller 11 classifies each of the items G[1,1] to G[5,4] into a conforming item or a non-conforming item based on the estimation results of steps S13 to S16, the learning degree table 122, and the judgment table 123.

[0095] The item classification process will be described assuming that the target information is the i-th notification information. In Fig. 19, items that match when a numerical example W2 is further assumed under a reference numerical example W1 are shown in a bold frame.

[0096] When the value of the visual sensitivity SSa belongs to the numerical range of the item G[1,1] corresponding to the first notification format and the first index, the item G[1,1] is classified as a conforming item. When the value of the visual sensitivity SSa deviates from the numerical range of the item G[1,1], the item G[1,1] is classified as a non-conforming item. When the value of the visual sensitivity SSa belongs to the numerical range of the item G[2,1] corresponding to the second notification format and the first index, the item G[2,1] is classified as a conforming item. When the value of the visual sensitivity SSa deviates from the numerical range of the item G[2,1], the item G[2,1] is classified as a non-conforming item. As shown in FIG. 19, in the numerical example W2, the visual sensitivity SSa is less than 4. Therefore, under the reference numerical example W1, in the numerical example W2, the items G[1,1] and G[2,1] are classified as non-conforming items.

[0097] When the value of the hearing sensitivity SSb belongs to the numerical range of the item G[3,1] corresponding to the third notification format and the first index, the item G[3,1] is classified as a conforming item. When the value of the hearing sensitivity SSb deviates from the numerical range of the item G[3,1], the item G[3,1] is classified as a non-conforming item. When the value of the hearing sensitivity SSb belongs to the numerical range of the item G[4,1] corresponding to the fourth notification format and the first index, the item G[4,1] is classified as a conforming item. When the value of the hearing sensitivity SSb deviates from the numerical range of the item G[4,1], the item G[4,1] is classified as a non-conforming item. As shown in FIG. 19, in the numerical example W2, the hearing sensitivity SSb is 0 or 1. Therefore, under the reference numerical example W1, in the numerical example W2, the item G[3,1] is classified as a non-conforming item and the item G[4,1] is classified as a conforming item.

[0098] When the value of the tactile sensitivity SSc belongs to the numerical range of the item G[5,1] corresponding to the fifth notification format and the first indicator, the item G[5,1] is classified as a compliant item. When the value of the tactile sensitivity SSc deviates from the numerical range of the item G[5,1], the item G[5,1] is classified as a non-compliant item. As shown in FIG. 19, in the numerical example W2, the tactile sensitivity SSc is any value between 0 and 5. Therefore, under the reference numerical example W1, in the numerical example W2, the item G[5,1] is classified as a compliant item.

[0099] When the value of the simplicity SPL[i] of the target information (i-th notification information) belongs to the numerical range of the item G[1,3] corresponding to the first notification format and the third index, the item G[1,3] is classified as a conforming item. When the value of the simplicity SPL[i] of the target information (i-th notification information) deviates from the numerical range of the item G[1,3], the item G[1,3] is classified as a non-conforming item. The same applies to the other items G[2,3] to G[5,3] corresponding to the third index. That is, when the value of the simplicity SPL[i] of the target information (i-th notification information) belongs to the numerical range of the item G[j,3] corresponding to the j-th notification format and the third index, the item G[j,3] is classified as a conforming item. When the value of the simplicity SPL[i] of the target information (i-th notification information) deviates from the numerical range of the item G[j,3], the item G[j,3] is classified as a non-conforming item (where j is an integer between 1 and 5). 19, in the numerical example W2, the simplicity SPL[i] is any value between 2 and 5. Therefore, under the reference numerical example W1, in the numerical example W2, the items G[1,3], G[2,3], G[3,3], and G[5,3] are classified as conforming items, and the item G[4,3] is classified as a non-conforming item.

[0100] When the difference (SPL[i]-UGT[i]) between the simplicity SPL[i] and the urgency UGT[i] in the target information (i-th notification information) falls within the numerical range of the item G[1,2] corresponding to the first notification format and the second index, the item G[1,2] is classified as a compliant item. When the difference (SPL[i]-UGT[i]) falls outside the numerical range of the item G[1,2], the item G[1,2] is classified as a non-compliant item. The same applies to the other items G[2,2] to G[5,2] corresponding to the second index. That is, when the difference (SPL[i]-UGT[i]) between the simplicity SPL[i] and the urgency UGT[i] in the target information (i-th notification information) falls within the numerical range of the item G[j,2] corresponding to the j-th notification format and the second index, the item G[j,2] is classified as a compliant item. When the difference (SPL[i]-UGT[i]) falls outside the numerical range of item G[j,2], item G[j,2] is classified as a non-compliant item (where j is an integer between 1 and 5). As shown in FIG. 19, in numerical example W2, the difference (SPL[i]-UGT[i]) is 0 or 1. Therefore, under the reference numerical example W1, in numerical example W2, items G[4,2] and G[5,2] are classified as compliant items and items G[1,2], G[2,2], and G[3,2] are classified as non-compliant items. Note that when the difference (SPL[i]-UGT[i]) is negative, the controller 11 considers the difference (SPL[i]-UGT[i]) to be zero and classifies items G[1,2] to G[5,2] as compliant or non-compliant items.

[0101] When the value of the learning degree LD[i,1] corresponding to the target information (i-th notification information) and the first notification format belongs to the numerical range of the item G[1,4] corresponding to the first notification format and the fourth index, the item G[1,4] is classified as a conforming item. When the value of the learning degree LD[i,1] deviates from the numerical range of the item G[1,4], the item G[1,4] is classified as a non-conforming item. The same is true for the other items G[2,4] to G[5,4] corresponding to the fourth index. That is, when the value of the learning degree LD[i,j] corresponding to the target information (i-th notification information) and the j-th notification format belongs to the numerical range of the item G[j,4] corresponding to the j-th notification format and the fourth index, the item G[j,4] is classified as a conforming item. When the value of the learning degree LD[i,j] deviates from the numerical range of the item G[j,4], the item G[j,4] is classified as a non-conforming item (where j is an integer between 1 and 5). As shown in FIG. 19, in the numerical example W2, the learning degrees LD[i,1] and LD[i,3] corresponding to the first and third notification formats are arbitrary, between 0 and 5. Also, in the numerical example W2, the learning degree LD[i,2] corresponding to the second notification format is 0 or 1. Also, in the numerical example W2, the learning degrees LD[i,4] and LD[i,5] corresponding to the fourth and fifth notification formats are arbitrary, between 0 and 3. Therefore, under the reference numerical example W1, in the numerical example W2, the items G[1,4] and G[3,4] are classified as conforming items, and the items G[2,4], G[4,4], and G[5,4] are classified as non-conforming items.

[0102] --First extraction process-- In step S18b, the controller 11 performs a first extraction process (see FIG. 18). In the first extraction process, the controller 11 extracts a notification format that satisfies the learning degree requirement condition from among the first to fifth notification formats as the notification format A1. It is preferable that the judgment table 123 is formed so that the notification format A1 includes one or more notification formats. Of the items G of the fourth index, the notification format corresponding to the item G classified as a conforming item satisfies the learning degree requirement condition. Therefore, in the numerical example EX2 of FIG. 19, only the first and third notification formats satisfy the learning degree requirement condition.

[0103] The learning degree requirement conditions will be explained in detail. The first notification format satisfies the learning degree requirement conditions when item G[1,4] is classified as a conforming item, and does not satisfy the learning degree requirement conditions when item G[1,4] is classified as a non-conforming item. The same applies to the second to fifth notification formats. That is, the jth notification format satisfies the learning degree requirement conditions when item G[j,4] is classified as a conforming item, and does not satisfy the learning degree requirement conditions when item G[j,4] is classified as a non-conforming item (where j is an integer between 1 and 5). Whether item G[j,4] is classified as a conforming item is determined by whether the corresponding learning degree falls within the numerical range of item G[j,4].

[0104] Therefore, it can be said that the following operation is performed by the controller 11 in the first extraction process. The controller 11 judges whether the learning degree LD[i,1] for notifying the target information (i-th notification information) to the target U1 in the first notification format belongs to the numerical range of the item G[1,4]. If the learning degree LD[i,1] belongs to the numerical range of the item G[1,4], the controller 11 judges that the first notification format satisfies the learning degree requirement condition. If the learning degree LD[i,1] deviates from the numerical range of the item G[1,4], the controller 11 judges that the first notification format does not satisfy the learning degree requirement condition. The same judgment is performed for the second to fifth notification formats. That is, the controller 11 judges whether the learning degree LD[i,j] for notifying the target information (i-th notification information) to the target U1 in the j-th notification format belongs to the numerical range of the item G[j,4] (where j is an integer between 1 and 5). If the learning degree LD[i,j] belongs to the numerical range of item G[j,4], the controller 11 determines that the j-th notification format satisfies the learning degree requirement condition. If the learning degree LD[i,j] deviates from the numerical range of item G[j,4], the controller 11 determines that the j-th notification format does not satisfy the learning degree requirement condition.

[0105] Furthermore, in the first extraction process, the controller 11 extracts a notification format A2 from one or more notification formats A1 based on the simplicity and urgency of the target information (see FIG. 18). In principle, one or more of the one or more notification formats A1 are extracted as the notification format A2. All notification formats A1 may be extracted and set as the notification format A2. When there is only one notification format A1, the controller 11 may unconditionally set the single notification format A1 as the notification format A2.

[0106] Now, assuming that the notification format A1 is two or more, a method for extracting the notification format A2 from two or more notification formats A1 will be explained. The total number of items classified as conforming items among the items G[1,2] to G[1,4] corresponding to the first notification format is the number of conforming items J. A [1] The number of conforming items is J A [1] does not depend on whether the item G[1,1] related to the first index (sensitivity) is classified as a compliant item. The same applies to the second to fifth notification formats. In other words, the total number of items classified as compliant items among items G[j,2] to G[j,4] corresponding to the jth notification format is the number of compliant items J. A [j], where j is an integer greater than or equal to 1 and less than or equal to 5.

[0107] Controller 11 is compatible with J A [1]~J A [5], the maximum number of conforming items corresponding to each notification format A1 is identified, and the notification format A1 corresponding to the identified maximum number is set as the notification format A2. In the numerical example W2 of FIG. 19, only the first and third notification formats are extracted as the notification format A1, and the number of conforming items J corresponding to the first and third notification formats is A [1] and J A [3] are both 2. Therefore, as shown in Fig. 20, the maximum number of conforming items related to the notification format A1 is 2, and the notification format A1 corresponding to the maximum number (i.e., the first and third notification formats) is set as the notification format A2. The manner in which the first and third notification formats are set and extracted as the notification format A2 in the first extraction process is shown by a thick dashed frame in Fig. 20.

[0108] --Second extraction process-- In step S18c, the controller 11 performs a second extraction process (see FIG. 18). In the second extraction process, the controller 11 extracts a notification format that satisfies the sensitivity requirement condition from among the first to fifth notification formats as notification format B1. It is preferable that the judgment table 123 is formed so that the notification format B1 includes one or more notification formats. Of the items G of the first index, the notification format corresponding to the item G classified as a matching item satisfies the sensitivity requirement condition. Therefore, in the numerical example EX2 of FIG. 19, only the fourth and fifth notification formats satisfy the sensitivity requirement condition.

[0109] The sensitivity requirement conditions will be explained in detail. The first notification format satisfies the sensitivity requirement conditions when item G[1,1] is classified as a compliant item, and does not satisfy the sensitivity requirement conditions when item G[1,1] is classified as a non-compliant item. The same applies to the second to fifth notification formats. That is, the jth notification format satisfies the sensitivity requirement conditions when item G[j,1] is classified as a compliant item, and does not satisfy the sensitivity requirement conditions when item G[j,1] is classified as a non-compliant item (where j is an integer between 1 and 5). Whether item G[j,1] is classified as a compliant item is determined by whether the corresponding sensitivity of subject U1 falls within the numerical range of item G[j,1].

[0110] Therefore, it can be said that the following operation is performed by the controller 11 in the second extraction process. The controller 11 determines whether the sensitivity to notify the target information to the target U1 in the first notification format, i.e., the visual sensitivity SSa, belongs to the numerical range of the item G[1,1]. If the visual sensitivity SSa belongs to the numerical range of the item G[1,1], the controller 11 determines that the first notification format satisfies the sensitivity requirement condition, and if the visual sensitivity SSa deviates from the numerical range of the item G[1,1], the controller 11 determines that the first notification format does not satisfy the sensitivity requirement condition. Similarly, the controller 11 determines whether the sensitivity to notify the target information to the target U1 in the second notification format, i.e., the visual sensitivity SSa, belongs to the numerical range of the item G[2,1]. If the visual sensitivity SSa belongs to the numerical range of the item G[2,1], the controller 11 determines that the second notification format satisfies the sensitivity requirement condition, and if the visual sensitivity SSa deviates from the numerical range of the item G[2,1], the controller 11 determines that the second notification format does not satisfy the sensitivity requirement condition. The same is true for the third to fifth notification formats. However, the sensitivity for notifying the target information to the target U1 in the third or fourth notification format is the hearing sensitivity SSb, and the sensitivity for notifying the target information to the target U1 in the fifth notification format is the tactile sensitivity SSc. Therefore, the controller 11 judges whether the hearing sensitivity SSb belongs to the numerical range of the item G[3,1] and the numerical range of the item G[4,1]. If the hearing sensitivity SSb belongs to the numerical range of the item G[3,1], the controller 11 judges that the third notification format satisfies the sensitivity requirement condition, and if the hearing sensitivity SSb deviates from the numerical range of the item G[3,1], the controller 11 judges that the third notification format does not satisfy the sensitivity requirement condition. If the hearing sensitivity SSb belongs to the numerical range of the item G[4,1], the controller 11 judges that the fourth notification format satisfies the sensitivity requirement condition, and if the hearing sensitivity SSb deviates from the numerical range of the item G[4,1], the controller 11 judges that the fourth notification format does not satisfy the sensitivity requirement condition. The controller 11 determines whether the tactile sensitivity SSc belongs to the numerical range of item G[5,1]. If the tactile sensitivity SSc belongs to the numerical range of item G[5,1], the controller 11 determines that the fifth notification format satisfies the sensitivity requirement condition, and if the tactile sensitivity SSc deviates from the numerical range of item G[5,1], the controller 11 determines that the fifth notification format does not satisfy the sensitivity requirement condition.

[0111] Furthermore, in the second extraction process, the controller 11 extracts a notification format B2 from one or more notification formats B1 based on the simplicity and urgency of the target information and the learning level of the target user U1 (the learning level of the target user U1 with respect to the target information). In principle, one or more of the one or more notification formats B1 are extracted as the notification format B2. All notification formats B1 may be extracted and set as the notification format B2. When there is only one notification format B1, the controller 11 may unconditionally set the single notification format B1 as the notification format B2.

[0112] Now, assuming that the notification format B1 is 2 or more, a method for extracting the notification format B2 from the 2 or more notification formats B1 will be explained. The total number of items classified as conforming items among the items G[1,1] to G[1,4] corresponding to the first notification format is the number of conforming items J. B The same applies to the second to fifth notification formats. That is, the total number of items classified as conforming items among items G[j,1] to G[j,4] corresponding to the jth notification format is called the number of conforming items J. B [j], where j is an integer greater than or equal to 1 and less than or equal to 5.

[0113] Controller 11 is compatible with J B [1]~J B [5], the maximum number of conforming items corresponding to each notification format B1 is identified, and the notification format B1 corresponding to the identified maximum number is set as the notification format B2. In the numerical example W2 of FIG. 19, only the fourth and fifth notification formats are extracted as the notification format B1, and the number of conforming items J corresponding to the fourth and fifth notification formats is B [4] and J B [5] is 2 and 3. Therefore, as shown in Fig. 21, the maximum number of conforming items related to the notification format B1 is 3, and the notification format B1 corresponding to the maximum number (i.e., the fifth notification format) is set as the notification format B2. The manner in which the fifth notification format is set and extracted as the notification format B2 in the second extraction process is shown by a thick dashed frame in Fig. 21.

[0114] --Setting the output notification format-- In step S18d, the controller 11 sets the notification formats A2 and B2 as the output notification formats (see FIG. 18). That is, the notification formats A2 and B2 are all included in the output notification formats. Under the reference numerical example W1, in the numerical example W2, the first and third notification formats and the fifth notification format are included in the output notification formats (FIGS. 20 and 21).

[0115] As a result, in the numerical example W2, in the notification output process of step S19 (see FIG. 14), the target information is notified to the target U1 in each of the first, third, and fifth notification formats. A If it is notification information, a character string 611 is displayed on the display screen 51a, a word 613 is output as voice from the speaker 52, and a vibration 615 is generated by the vibration device 53 in a notification output process.

[0116] --Consideration of the technology related to Example EX1-- As can be understood from the above explanation (see FIG. 14, etc.), the controller 11 controls which of multiple notification formats to use to notify the target information to the target U1 based on the characteristics of the target U1 and the characteristics of the target information. The characteristics of the target U1 include sensitivity (SSa, SSb, SSc) and learning level (LD). The characteristics of the target information include urgency (UGT) and simplicity (SPL). Information that is not classified as urgency and simplicity may be included in the characteristics of the target information. For example, the importance of the target information may be included in the characteristics of the target information.

[0117] By configuring the target information to be notified using any of a plurality of notification formats, the target information can be notified in an appropriate notification format at any given time. In this case, by selecting and using a notification format according to the characteristics of the target person U1, appropriate notification according to the characteristics of the target person U1 is possible. In addition, by selecting and using a notification format according to the characteristics of the target information, appropriate notification according to the characteristics of the target information is possible. By taking these characteristics into consideration, it is possible to notify the target person U1 of information using an appropriate notification format while suppressing information notification in an inappropriate notification format. As a result, it is possible to reduce the discomfort felt by the target person U1, and the information that truly needs to be conveyed is notified to the target person U1 in an easy-to-understand manner (it becomes easier to recognize).

[0118] The characteristics of the target person U1 include the learning degree of the target person U1 with respect to notification. Based on the notification history information (notification history table 121), the controller 11 estimates the learning degree of the target person U1 with respect to the target information being notified to the target person U1 in each notification format for each notification format. Then, based on the learning degree estimated for each notification format, the controller 11 controls which of the multiple notification formats is used to notify the target person U1 of the target information. In step S16 of FIG. 14, the learning degrees LD[i,1] to LD[i,5] of the target person U1 with respect to notifying the i-th notification information as the target information to the target person U1 in the first to fifth notification formats are estimated.

[0119] When the subject U1 becomes accustomed to receiving notifications of certain information in a certain common format (when learning has progressed), when the subject U1 receives notification of the same type of information in that notification format, the subject U1 can accurately and immediately recognize the content of the notification. Conversely, when the subject U1 is not accustomed to the notification, it may not be easy to accurately or immediately recognize the content of the notification. The notification control device 10 determines the notification format to be used for notifying the target information by taking such accustomization (degree of learning) into consideration. This makes it possible to avoid, for example, a situation in which information is notified only in an unfamiliar notification format, and as a result, the subject U1 can reliably recognize the information to be notified.

[0120] The characteristics of the target person U1 further include the sensitivity of the target person U1 to notifications. The controller 11 estimates the sensitivity of the target person U1 to notifications in each notification format based on the surrounding environment information of the target person U1. Then, the controller 11 controls which of the multiple notification formats is used to notify the target person U1 of the target information based on the estimated sensitivity for each notification format. In step S13 of FIG. 14, visual sensitivity SSa is estimated as the sensitivity of the target person U1 to the notification formats (first and second notification formats) that affect the vision of the target person U1. Auditory sensitivity SSb is estimated as the sensitivity of the target person U1 to the notification formats (third and fourth notification formats) that affect the hearing of the target person U1. Tactile sensitivity SSc is estimated as the sensitivity of the target person U1 to the notification format (fifth notification format) that affects the tactile sense of the target person U1.

[0121] A notification in a notification format corresponding to low sensitivity is difficult for the target person U1 to recognize, and a notification in a notification format corresponding to high sensitivity is easy for the target person U1 to recognize. Therefore, by determining the notification format to be used taking into consideration the sensitivity of the target person U1, it is possible to ensure that the target person U1 recognizes the information to be notified.

[0122] The characteristics of the target information include the simplicity (SPL) of the target information and the urgency (UGT) of the target information identified by the controller 11. In steps S14 and S15 of FIG. 14, the simplicity (SPL) of the target information and the urgency (UGT) of the target information are identified by estimation. For each notification format, the controller 11 determines whether the notification format is suitable for notifying the target information to the target U1 based on the learning level and sensitivity of the target U1 and the simplicity and urgency of the target information. The notification format determined to be suitable is called an output notification format (see steps S18 and 18 of FIG. 14). Then, the controller 11 notifies the target U1 of the target information using the output notification format (step S19 of FIG. 14).

[0123] As described above, the determination of the output notification format based on the learning degree and sensitivity of the target U1 leads to the target U1 reliably recognizing the information to be notified. Furthermore, if the target information is complex, it is desirable to use a notification format that can reliably transmit information even with complex content, such as a notification format by character display or by voice output of words. Conversely, if the target information is simple, it is possible to use a notification format that can realize intuitive information transmission in a short time, such as a notification format by graphic display, by sound output other than words, or by vibration. Since the controller 11 determines the output notification format taking into account the simplicity of the target information, it is possible to perform information notification that balances reliable information transmission and intuitive information transmission in a short time. Furthermore, when the urgency of the target information is low, there is no problem in using a notification format that can reliably transmit information, such as a notification format by character display or by voice output of words. However, when the urgency of the target information is high, it is desirable to use a notification format that can realize intuitive information transmission in a short time, such as a notification format by graphic display, by sound output other than words, or by vibration. Since the controller 11 determines the output notification format in consideration of the urgency of the target information, it is possible to perform information notification with a good balance between reliable information transmission and intuitive information transmission within a short period of time.

[0124] More specifically, the controller 11 judges whether the learning degree LD[i,j] of the target U1 with respect to the notification of the target information (i-th notification information) in the j-th notification format belongs to a set range (a numerical range of item G[j,4]). Based on the result of the judgment, it is judged whether the j-th notification format satisfies the learning degree request condition. The above judgment is performed for each integer j that satisfies "1≦j≦5", so that it is individually judged whether the first to fifth notification formats satisfy the learning degree request condition, and a notification format A1 that satisfies the learning degree request condition is extracted (step S18b in FIG. 18). Then, from one or more notification formats A1, a notification format A2 extracted based on the simplicity and urgency of the target information is included in the output notification format (steps S18b and S18d). On the other hand, the controller 11 judges whether the sensitivity of the target U1 with respect to the notification of the target information (i-th notification information) in the j-th notification format belongs to another set range (a numerical range of item G[j,1]). Based on the result of the judgment, it is judged whether the j-th notification format satisfies the sensitivity requirement condition. The above judgment is performed for each integer j that satisfies "1≦j≦5", and it is judged individually whether the first to fifth notification formats satisfy the sensitivity requirement condition, and a notification format B1 that satisfies the sensitivity requirement condition is extracted (step S18c in FIG. 18). Then, from one or more notification formats B1, a notification format B2 extracted based on the simplicity and urgency of the target information and the learning level of the target user U1 is included in the output notification format (steps S18c and S18d).

[0125] When extracting the notification format A2, it is essential to satisfy the requirements regarding the learning degree. For this reason, for example, when the learning degree is low, it is possible to include in the notification format A2 a notification format (such as text display) that allows accurate information transmission (and therefore includes in the output notification format), thereby ensuring reliable information transmission. Or, for example, when the learning degree is high, it is possible to include in the notification format A2 a notification format (such as vibration) that allows intuitive information transmission (and therefore includes in the output notification format), thereby enabling prompt information transmission that does not impede driving operations, etc. However, since the notification format A2 is extracted without considering sensitivity, depending on the situation, it may be difficult for the target person U1 to receive a notification using only the notification format A2. Therefore, the notification format B2 is extracted taking into consideration the sensitivity of the target person U1. This allows information to be notified in a notification format that is easy to notice according to the sensitivity of the target person U1. In addition, notification formats that do not satisfy the learning degree requirement conditions are not included in the notification format A2. For this reason, if only notification format A2 is included in the output notification format, the learning degree for the notification format that does not satisfy the learning degree requirement condition will not increase (the target user U1 will not become accustomed to the notification format). By including notification format B2, which does not require satisfaction of the learning degree requirement condition, in the output notification format, it is possible to increase the learning degree for the notification format that does not satisfy the learning degree requirement condition.

[0126] For example, the i-th A Consider that notification information is repeatedly notified to the target U1 as target information. In the first situation, which corresponds to the initial situation, A The learning degree for the notification information is zero for each notification format. In this case, items G[1,4] and G[3,4] corresponding to the first and third notification formats are classified as conforming items, while items G[2,4], G[4,4] and G[5,4] corresponding to the second, fourth and fifth notification formats are classified as non-conforming items. Therefore, in the first situation, the second, fourth and fifth notification formats do not satisfy the learning degree requirement. This is because the i-th notification by the second, fourth or fifth notification format A This means that the notification information, that is, the display of the graphic 612, the output of the sound 614, or the output of the vibration 615, does not properly convey the notification content "Be careful of being hit when turning left" to the target person U1.

[0127] In the first situation, the fifth notification format is included in notification format B2, so that the first, third and fifth formats contain the target information (i A It is assumed that notification information) is notified to the target U1. At this time, in the notification output process, the target U1 receives a vibration 615 along with a display of the character string 611 "Watch out for collisions when turning left" and a voice output of the words 613 "Watch out for collisions when turning left." After this, the same notification output process as the notification output process in the first situation is repeatedly executed, and each time, the target information (i A Each time the notification is received, the target U1 learns that the vibration 615 indicates "be careful of collisions when turning left" and, in conjunction with this, A The learning degree for notifying notification information in the fifth notification format (LD[i A ,5]) is increasing.

[0128] Starting from the numerical example W2 (see FIG. 19), A The learning degree for notifying notification information in the fifth notification format (LD[i A When the number of matching items J[5,4]) increases to 4 or more, the second situation is reached. In the second situation, the item G[5,4] corresponding to the fifth notification format is classified as a matching item. Therefore, in the second situation, unlike in FIG. 20, only the fifth notification format is extracted as the notification format A2 (the number of matching items J A [1]~J A [5] Number of matching items J A [5] is the maximum at “4”. In the second situation, the notification format B2 is only the fifth notification format, as in FIG. 21. As a result, the i-th notification format in the second situation is A The notification information is given only by outputting the vibration 615. In the second situation, the subject U1 has sufficiently learned that the vibration 615 indicates "be careful of collisions when turning left", and therefore can quickly and intuitively understand "be careful of collisions when turning left" by receiving the vibration 615 without relying on vision or hearing.

[0129] We have given specific examples of how learning progresses by focusing on the first, third, and fifth notification formats, but the same applies to other combinations of notification formats.

[0130] The first and third notification formats have an advantage in that they enable reliable information transmission even if the notification contents are complex or the corresponding learning level is low. However, in order for the subject U1 to recognize the notification in the first notification format, he / she needs to turn his / her gaze to the display screen 51a to read the characters, and it takes a relatively long time to recognize the information (and he / she needs to turn his / her gaze to the display screen 51a). It also takes a relatively long time to recognize the information in the third notification format. In contrast, the second, fourth, and fifth notification formats may be less accurate in transmitting information than the first and third notification formats, but as the subject U1 becomes accustomed to them, he / she can intuitively grasp the information in a short time. In addition, it is considered that abstract notifications such as graphic display, non-verbal sound output, or vibration output are less likely to cause annoyance to the subject U1 than concrete notifications such as character display or voice output of words. For this reason, from the viewpoint of less annoyance, it is preferable to convey information to the subject U1 using abstract notifications, but it is necessary to convey information to the subject U1 using concrete notifications until the subject U1's learning progresses.

[0131] It is preferable to set the judgment table 123 in consideration of these circumstances. For example, as in the reference numerical example W1 (FIG. 17), for the fourth index, the lower limit of each numerical range of items G[2,4], G[4,4], and G[5,4] should be set higher than the lower limit of each numerical range of items G[1,4] and G[3,4]. This makes it difficult for items G[2,4], G[4,4], and G[5,4] to be classified as conforming items in comparison with items G[1,4] and G[3,4] (the second, fourth, and fifth notification formats are relatively unlikely to be included in the notification format A2) until the learning (familiarization) of the subject U1 progresses to a certain extent. Since a graphical display is considered to enable the subject U1 to grasp information more easily than non-verbal acoustic or vibration output, the lower limit of the numerical range of item G[2,4] may be set lower than the lower limit of each of the numerical ranges of items G[4,4] and G[5,4], as shown in the reference numerical example W1 (Figure 17).

[0132] In the reference numerical example W1 (see FIG. 17), the numerical ranges of the items G[1,1] and G[2,1] related to the first index and the visual sensitivity SSa are the same. However, even if the visual sensitivity SSa is low and it is difficult to see the character display, it is considered that it is often possible to see the graphic display. For this reason, the lower limit value of the numerical range of the item G[2,1] may be set lower than the lower limit value of the numerical range of the item G[1,1]. Similarly, even if the hearing sensitivity SSb is low and the subject U1 has difficulty hearing the words output by voice, the subject U1 can easily recognize that sounds other than words (e.g., beeps) have been output. For this reason, as in the reference numerical example W1 (FIG. 17), the lower limit value of the numerical range of the item G[4,1] may be set lower than the lower limit value of the numerical range of the item G[3,1].

[0133] Considering that it is more difficult to convey complex information through graphic display than through text display, the lower limit of the numerical range of item G[2,3] may be set higher than the lower limit of the numerical range of item G[1,3], as in the reference numerical example W1 (FIG. 17). Similarly, considering that it is more difficult to convey complex information through non-verbal acoustic output than through verbal audio output, the lower limit of the numerical range of item G[4,3] may be set higher than the lower limit of the numerical range of item G[3,3], as in the reference numerical example W1 (FIG. 17). Since it is often difficult to convey complex information through vibration, it is preferable to set the lower limit of the numerical range of item G[5,3] higher than 0, as in the reference numerical example W1 (FIG. 17).

[0134] The range of values ​​of the items G[1,2] to G[5,2] corresponding to the second index is set in consideration of the balance between simplicity and urgency. When the urgency UGT[i] of the target information, which is the i-th notification information, is high, the notification by the first or third notification format is often not appropriate because it takes a relatively long time to recognize the notification content compared to the notification by the second, fourth, or fifth notification format. And when the urgency UGT[i] of the target information, which is the i-th notification information, is high, the difference (SPL[i]-UGT[i]) decreases. In consideration of these, as in the reference numerical example W1 (FIG. 17), it is preferable to set the lower limit value of each of the numerical ranges of the items G[1,2] and G[3,2] higher than the lower limit value of each of the numerical ranges of the items G[2,2], G[4,2], and G[5,2] for the second index. As a result, when the urgency is high, the items G[1,2] and G[3,2] are less likely to be classified as suitable items in comparison with the items G[2,2], G[4,2], and G[5,2]. In addition, it is considered that a graphic display requires a relatively long time to recognize the notification content because it requires the gaze to be directed toward the display screen 51a compared to the non-verbal acoustic output or vibration output. For this reason, as in the reference numerical example W1 (FIG. 17), the lower limit value of the numerical range of the item G[2,2] may be set higher than the lower limit values ​​of the numerical ranges of the items G[4,2] and G[5,2]. As a result, when the urgency is high, the item G[2,2] is less likely to be classified as suitable items in comparison with the items G[4,2] and G[5,2].

[0135] <<Example EX2>> An embodiment EX2 will be described. In the notification format selection process (see Figs. 14 and 18), the output notification format may be selected and set in consideration of the estimation result of the passenger estimation process.

[0136] The controller 11 may make the first, second and fifth notification formats more likely to be included in the output notification format than the third and fourth notification formats when it is estimated that a passenger is present, compared to when it is estimated that a passenger is not present. This is to prevent the voice output or sound output by the third or fourth notification format from being unnecessarily heard by the passenger. For example, when it is estimated that a passenger is present, the controller 11 may increase the lower limit value of each of the numerical ranges of the items G[3,1] to G[3,4] and G[4,1] to G[4,4], compared to when it is estimated that a passenger is not present. The increase may be realized by a correction process for the lower limit value of each of the numerical ranges of the items G[3,1] to G[3,4] and G[4,1] to G[4,4], or by a switching process of the determination table 123. This makes it less likely that the third and fourth notification formats will be included in the output notification format.

[0137] Alternatively, when it is estimated that a passenger is present, the controller 11 may exclude the third and fourth notification formats from the output notification formats, regardless of the processing results of steps S18b and S18c in FIG.

[0138] <<Example EX3>> In the notification format selection process (see FIG. 14 and FIG. 18), the urgency UGT[i] of the target information (i-th notification information) is greater than or equal to the threshold TH UGT When the threshold value TH exceeds the threshold value TH, the controller 11 may include the emergency notification format in the output notification format, regardless of the processing results of steps S18b and S18c in FIG. 18. Here, the emergency notification format includes any one or more of the second, fourth, and fifth notification formats. The emergency notification format may be all of the second, fourth, and fifth notification formats. UGT has a preset positive value (e.g., 4).

[0139] The urgency UGT[i] is the threshold TH UGT If the urgency level UGT[i] exceeds the threshold TH, the notification formats A2 and B2 extracted in the first and second extraction processes in steps S18b and S18c may be included in the output notification format. UGTIn the above case, when the first notification format is included in the notification format A2 or B2, the first notification format may be included in the output notification format. The same applies to the other notification formats. However, at least the emergency notification format is included in the output notification format.

[0140] Or the urgency UGT[i] is the threshold TH UGT When the urgency level UGT[i] exceeds the threshold TH, even if the first or third notification format is extracted as the notification format A2 or B2, the first or third notification format may be excluded from the output notification format. UGT If the number of notification requests exceeds this limit, the notification format selection process in FIG. 18 may not be executed, and only the emergency notification format may be set as the output notification format.

[0141] <<Example EX4>> An example EX4 will be described. Assume a case CS4 in which, during a period in which certain notification information is notified to the target U1 as first target information, other notification information needs to be notified to the target U1 as second target information.

[0142] In case CS4, the controller 11 may exclude the notification format used for notifying the first target information from the output notification format used for notifying the second target information. This is because it may be difficult to notify the first and second target information simultaneously using a common notification format, and may cause confusion for the target U1.

[0143] That is, for example, in case CS4, during the period when the first target information is notified using the fifth notification format, the fifth notification format is excluded from the output notification formats of the second target information, regardless of the processing results of steps S18b and S18c for the second target information. The same applies to the first to fourth notification formats.

[0144] <<Example EX5>> The embodiment EX5 will be described. In the embodiment EX1 (see FIG. 18), the output notification format may be set using only one of the first extraction process in step S18b and the second extraction process in step S18c. That is, in the embodiment EX1, only the notification format A2 extracted in the first extraction process may be set as the output notification format. Alternatively, in the embodiment EX1, only the notification format B2 extracted in the second extraction process may be set as the output notification format.

[0145] <<Example EX6>> A description will be given of an embodiment EX6. A predetermined numerical range may be set for each item G in the judgment table 123. However, the numerical range for each item G in the judgment table 123 may be changed (updated).

[0146] For example, the controller 11 may change (update) each of the numerical ranges G[j,1] to G[j,4] related to the j-th notification format based on the reaction of the target person U1 when the target person U1 is notified of the i-th notification information as target information in the j-th notification format. The reaction of the target person U1 includes the facial expression and movement of the target person U1 determined from the in-vehicle image information, the speech of the target person U1 determined from the in-vehicle microphone signal, and the driving operation of the vehicle V1 by the target person U1.

[0147] As a specific example, the i-th B Assume a case CS6 in which the notification information is notified to the target U1 as the target information by the fourth notification format. In case CS6, B Consider a case where the target person U1 performs a driving operation (depressing the accelerator pedal) to increase the speed of the vehicle V1 after notification of the notification information. In this case, the controller 11 performs the i-th notification in the fourth notification format. B It may be determined that the notification information has not been correctly transmitted to the target person U1, and the lower limit value of each numerical range of items G[4,1] to G[4,4] may be increased.

[0148] <<Example EX7_A>> Example EX7_A will be described. In Example EX7_A and Examples EX7_B to EX7_F described later, it is assumed that the output notification format includes the fifth notification format. When notifying the target information to the target U1 by the fifth notification format, the controller 11 can perform vibration control α. When the vibration control α is performed, the execution of the vibration control α corresponds to notifying the target information to the target U1 in the fifth notification format.

[0149] The controller 11 can execute vibration control α when the target information is information related to an object that generates sound, and can notify the target person U1 of the target information by the vibration control α. In Fig. 22, an object OBJ1 is a three-dimensional object located in the vicinity of the vehicle V1 and is an object that generates sound. An example of the object OBJ1 is a vehicle other than the vehicle V1 (hereinafter, referred to as another vehicle). For example, the other vehicle travels in the same direction as the vehicle V1, or travels in a direction different from the traveling direction of the vehicle V1.

[0150] The controller 11 can execute an object detection process to detect each object existing around the vehicle V1 on the outside camera image based on the outside image information. Detection in the object detection process includes detection of the type of each object existing around the vehicle V1. Therefore, the controller 11 can detect the type of each object existing around the vehicle V1 by the object detection process and determine whether each object is an object that generates sound or not based on the type detection result. The controller 11 identifies the type of object OBJ1 and the positional relationship between the vehicle V1 and the object OBJ1 based on the outside image information and the distance measurement information. In FIG. 22, d1 represents the distance between the vehicle V1 and the object OBJ1. The positional relationship between the vehicle V1 and the object OBJ1 also includes information on the distance d1.

[0151] The vibration control α when the object OBJ1 is the notification target will be described. When the object OBJ1 is the notification target, the target information is information indicating the presence or approach of the object OBJ1, and the vibration control α notifies the target U1 of the presence or approach of the object OBJ1. Note that the presence of the object OBJ1 specifically refers to the presence of the object OBJ1 in the vicinity of the vehicle V1, and the approach of the object OBJ1 specifically refers to the object OBJ1 approaching the vehicle V1.

[0152] In the vibration control α for the object OBJ1, the controller 11 causes the vibration device 53 to generate vibrations corresponding to the sound generated by the object OBJ1, thereby applying vibrations corresponding to the sound generated by the object OBJ1 to the target person U1.

[0153] The controller 11 collects the sound generated by the object OBJ1 using the external microphone 43, and generates an audio signal (hereinafter, audio signal S A1 The external microphone 43 has a microphone array consisting of a plurality of microphones installed on the body of the vehicle V1. The controller 11 uses a known sound source separation technique to generate an audio signal S from the output audio signals of each microphone in the microphone array based on the positional relationship between the vehicle V1 and the object OBJ1. A1 can be generated separately.

[0154] Alternatively, a plurality of types of sound signals corresponding to a plurality of types of objects may be stored in advance in the memory 12. Of the plurality of types of objects, one type of object corresponds to the object OBJ1. The plurality of types of objects includes, for example, three types of objects: a truck, a motorbike (electric two-wheeled vehicle), and a passenger car. The sound signal corresponding to the object OBJ1 and stored in the memory 12 is referred to as the sound signal S. A2 Hereinafter, the acoustic signal S A1 Or S A2 The object acoustic signal S A It is called.

[0155] In the vibration control α for the object OBJ1, the controller 11 controls the object acoustic signal S Ais provided to the vibration device 53 as an input sound signal Ain. As a result, vibration corresponding to the sound generated by the object OBJ1 is generated by the vibration device 53. When the vibration device 53 of FIG. 8 is used, the object sound signal S A are supplied to the vibration device 53 as any one or two of the input acoustic signals AinL, AinC, and AinR, or as the input acoustic signals AinL, AinC, and AinR.

[0156] The controller 11 divides the external area of ​​the vehicle V1 into an external left area located on the left side of the vehicle V1, an external right area located on the right side of the vehicle V1, and an external center area located between the external left area and the external right area. When the object OBJ1 is located in the external left area, the controller 11 related to the vibration control α detects the object sound signal S A is supplied as an input sound signal AinL only to the vibration unit 54L, thereby vibrating only the vibrator 56L. At this time, the subject U1 feels vibration only on the left side of his body. When the object OBJ1 is located in the right side area outside the vehicle, the controller 11 related to the vibration control α controls the object sound signal S A is supplied as an input sound signal AinR only to the vibration unit 54R, thereby vibrating only the vibrator 56R. At this time, the subject U1 feels vibration only on the right side of his / her body. When the object OBJ1 is located in the central area outside the vehicle, the controller 11 related to the vibration control α controls the object sound signal S A is supplied as an input acoustic signal AinC only to the vibration unit 54C, thereby vibrating only the transducer 56C. At this time, the subject U1 feels vibration only in the center of his / her body.

[0157] Since the external microphone 43 is installed on the body of the vehicle V1, the sound generated by the object OBJ1 is picked up by the external microphone 43, and an acoustic signal S A1 The frequency of the acoustic signal S is affected by the Doppler effect. Therefore, in a case where an object OBJ1 approaches the vehicle V1 from the front and then moves away from the vehicle V1 toward the rear, A1 The frequency of the sound signal S A1 The object acoustic signal S AWhen the vibration control α is used as the vibration control α, the subject U1 perceives the change in the positional relationship (sense of distance) between the vehicle V1 and the object OBJ1 in real time. The controller 11 simulates the Doppler effect and increases the acoustic signal S A1 The signal may be processed to increase the frequency of the audio signal S A1 The object acoustic signal S A The object sound signal S A The frequency of the vibration generated by the vibration device 53 (and therefore the vibration transmitted to the subject U1) changes in conjunction with the change in the frequency of the acoustic signal S. A1 The signal may be processed to increase the intensity of the audio signal S A1 The object acoustic signal S A Alternatively, the controller 11 may use the acoustic signal S A1 The amplification factor of the driver circuit 55 receiving the audio signal S may be increased. A1 In conjunction with a change in the intensity of the vibration generated by the vibration device 53 (and therefore the vibration transmitted to the subject U1), the intensity of the vibration generated by the vibration device 53 (and therefore the vibration transmitted to the subject U1) changes.

[0158] acoustic signal S A2 Similarly, the controller 11 mimics the Doppler effect and increases the acoustic signal S as the distance d1 decreases. A2 The signal may be processed to increase the frequency of the audio signal S A2 The object acoustic signal S A The controller 11 may use the acoustic signal S as the distance d1 is shorter. A2 The signal may be processed to increase the intensity of the audio signal S A2 The object acoustic signal S A Alternatively, the controller 11 may use the acoustic signal S A2 The amplification factor of the driver circuit 55 receiving the audio signal S may be increased. A2 In conjunction with an increase in the change in the amplitude of the vibration generated by the vibration device 53 (and therefore the vibration transmitted to the subject U1), the intensity of the vibration generated by the vibration device 53 (and therefore the vibration transmitted to the subject U1) changes.

[0159] By using the vibration control α, vibrations corresponding to the sound generated by the object OBJ1 can be applied to the target person U1, thereby intuitively notifying the target person U1 of the presence of the notification target (object OBJ1), etc.

[0160] By setting the vibration position according to the direction of the object OBJ1 as seen from the vehicle V1 and adjusting the vibration frequency or vibration strength according to the distance d1, the direction and distance of the notification target can be communicated to the target U1 in real time by vibration. Such vibration can give the target U1 the sensation that the object OBJ1 is moving.

[0161] <<Example EX7_B>> An example EX7_B will be described. When the controller 11 notifies the target information to the target U1 by the fifth notification format, the controller 11 can perform vibration control β. When the vibration control β is performed, the execution of the vibration control β corresponds to the notification of the target information to the target U1 by the fifth notification format.

[0162] The controller 11 can execute vibration control β when the target information is information having a directional component, and can notify the target person U1 of the target information by vibration control β. The vibration control β can be executed whether the target information is information about an object that generates sound or not. In the vibration control β, the contents of the target information can be notified to the target person U1 while taking into account the directional component and distance component of the target information.

[0163] An example of vibration control β will be described with reference to Fig. 23. Assume that a vehicle V1 is traveling toward an intersection 710 where it is possible to turn left or right. The distance between the vehicle V1 and the intersection 710 (for example, the shortest distance between the vehicle V1 and the intersection 710) is referred to as distance d2. The controller 11 can identify the distance d2 based on map information and vehicle position information.

[0164] Case CS7 is a case in which the notification information indicating "Be careful of collisions when turning left" is notified to the target U1 by vibration control β as target information. B1For example, when the vehicle V1 is scheduled to turn left at the intersection 710 along the travel route set by the navigation system, the case where the distance d2 is equal to or smaller than the threshold distance is called case CS7. B1 Alternatively, a case where an operation indicating an intention to turn left is input to the turn signal of the vehicle V1 before the intersection 710 corresponds to case CS7. B1 Case CS7 B1 In the vibration control β according to B1 is supplied as an input acoustic signal AinL only to the vibration unit 54L, thereby vibrating only the transducer 56L. At this time, the subject U1 feels the vibration only on the left side of his / her body, and his / her attention is drawn to the left side.

[0165] Case CS7 is a case in which notification information indicating "Watch out for oncoming vehicles when turning right" is notified to the target U1 by vibration control β as target information. B2 For example, when the vehicle V1 is scheduled to turn right at the intersection 710 along the travel route set by the navigation system, the case where the distance d2 is equal to or smaller than the threshold distance is called case CS7. B2 Alternatively, a case where an operation indicating an intention to turn right is input to the turn signal of the vehicle V1 before the intersection 710 corresponds to case CS7. B2 Case CS7 B2 In the vibration control β according to B2 is supplied as an input acoustic signal AinR only to the vibration unit 54R, thereby vibrating only the transducer 56R. At this time, the subject U1 feels the vibration only on the right side of his / her body, and his / her attention is drawn to the right side.

[0166] As can be understood from the above explanation, in vibration control β, the target information is notified to the target U1 by vibrating one of the multiple vibrators (vibrator 56L or 56R in the above example) according to the content of the target information. This allows the information to be recognized by the target U1 to have a directional component (i.e., the amount of transmitted information increases). In other words, the vibration by vibration control β has a directional feeling.

[0167] Based on the acoustic signal previously stored in the memory 12, an acoustic signal S B1 and S B2 is formed. B1 Or S B2 The frequency of the acoustic signal S is set within a range of 50 to 100 Hz (Hertz), for example. B1 Or S B2 For example, the controller 11 may change the frequency of the acoustic signal S as the distance d2 decreases. B1 Or S B2 The frequency of the controller 11 can be increased. B1 The acoustic signal S B1 The controller 11 may increase the intensity of the signal or the amplification factor of the driver circuit 55L. B2 The acoustic signal S B2 or the amplification factor of the driver circuit 55R may be increased.

[0168] acoustic signal S B1 and the acoustic signal S B2 The audio signals may be a common audio signal or may be different from each other. B1 In the first vibration pattern, the transducer 56L is vibrated. B2 For example, the first vibration pattern is a vibration pattern that is perceived by the subject U1 as "buzzing." At this time, the controller 11 vibrates the acoustic signal S B1 The second vibration pattern is a vibration pattern that is perceived by the subject U1 as a "buzzing" sound. In this case, the controller 11 outputs the acoustic signal S B2 to the vibration unit 54R for the second time, the operation of which is executed twice with an interval therebetween. The second time is longer than the first time. The first and second vibration patterns may be made to coincide with each other.

[0169] In this way, in the vibration control β, the contents, direction components, and distance components of the target information can be notified to the target person U1 by the vibration position, vibration intensity, vibration frequency, and vibration pattern.

[0170] <<Example EX7_C>> The embodiment EX7_C will be described. When the controller 11 notifies the target information to the target U1 by the fifth notification format, the controller 11 can perform vibration control γ. When the vibration control γ is performed, the execution of the vibration control γ corresponds to the notification of the target information to the target U1 by the fifth notification format.

[0171] When the target information does not include a directional component, the controller 11 can execute the vibration control γ and can notify the target information to the target person U1 by the vibration control γ. Note that the vibration control γ may be performed even when the target information includes a directional component or when the target information is information about an object that generates a sound.

[0172] Case CS7 is a case in which the notification information indicating "Caution: Speeding" is notified to the target U1 by vibration control γ as target information. C1 It is called Case CS7. C1 In the above, the controller 11 outputs an acoustic signal S C1 is supplied to the vibration device 53 to vibrate the vibration device 53.

[0173] Case CS7 is a case in which the notification information indicating "Caution: Sudden Acceleration" is notified to the target U1 by vibration control γ as target information. C2 It is called Case CS7. C2 In the above, the controller 11 outputs an acoustic signal S C2 is supplied to the vibration device 53 to vibrate the vibration device 53.

[0174] Case CS7 C1 , CS7 C2 In each of the above, the controller 11 receives an audio signal S C1 , S C2 is supplied as the input acoustic signal AinC only to the vibration unit 54C. In this case, only the transducer 56C vibrates. C1, CS7 C2 In each of the above, the controller 11 receives an audio signal S C1 , S C2 are supplied as input acoustic signals AinL, AinC, and AinR to the vibration units 54L, 54C, and 54R, respectively. In this case, all of the transducers 56L, 56C, and 56R vibrate. In this way, the vibration caused by the vibration control γ is a vibration without a sense of direction.

[0175] Based on the acoustic signal previously stored in the memory 12, an acoustic signal S C1 and S C2 The vibration strength when notifying certain notification information with the vibration control γ may be made different from the vibration strength when notifying other notification information with the vibration control γ. C1 Or S C2 The frequency of the acoustic signal S is set within the range of 50 to 100 Hz (Hertz), for example. C1 and the frequency of the acoustic signal S C2 The frequencies of the vibration patterns may be different from each other. The vibration pattern when notifying certain notification information with the vibration control γ may be different from the vibration pattern when notifying other notification information with the vibration control γ. C2 In the above, before notifying the subject U1 of "Caution: Sudden Acceleration" in a notification format other than the fifth notification format (for example, the first or second notification format), vibration control γ may be performed to make the subject U1 more likely to notice the notification.

[0176] In this way, in the vibration control γ, the contents of the target information can be notified to the target person U1 by vibration intensity, vibration frequency, and vibration pattern. Alternatively, before notifying the target information to the target person U1 by a notification format other than the fifth notification format (for example, the first or second notification format), the vibration control γ can be performed as a sign to make the target person U1 easily aware of the notification.

[0177] <<Example EX7_D>> An example EX7_D will be described. When the controller 11 notifies the target person U1 of the target information in the fifth notification format, the controller 11 can select and execute any one of the vibration controls α, β, and γ according to the contents of the target information.

[0178] At this time, the controller 11 selects and executes vibration control α when the target information is information about an object that generates sound (or vibration). The controller 11 selects and executes vibration control β when the target information differs from information about an object that generates sound and the target information has a directional component. The controller 11 selects and executes vibration control γ when the target information differs from information about an object that generates sound and the target information does not include a directional component. These selections enable notification by vibration according to the target information.

[0179] <<Example EX7_E>> An example EX7_E will be described. In the case where the target information is notified to the subject U1 by the fifth notification format, when the object OBJ1 (see FIG. 22) is the notification target, the controller 11 may switch between vibration control β and γ according to the distance d1. Specifically, the controller 11 notifies the target information by vibration control β in a first period in which the distance d1 is equal to or greater than a predetermined distance, from the viewpoint that it is not necessary to arouse the subject U1 to pay great attention. In a second period in which the distance d1 is less than the predetermined distance, the controller 11 notifies the target information by vibration control γ in order to arouse the subject U1 to pay great attention and to convey the approach degree of the object OBJ1 to the subject U1 in real time.

[0180] In the first period, when the object OBJ1 is located in the left region of the vehicle V1, the above-mentioned case CS7 B1 In the first period, when the object OBJ1 is located in the right area of ​​the vehicle V1, the above-mentioned case CS7 is generated. B2 It is advisable to have the vibration device 53 generate a vibration similar to that described above to alert the subject U1 to look to the right.

[0181] Also, consider a case where a junction exists ahead of the vehicle V1 on the left side, and the object information that "there is a junction on the left side of the traveling direction of the vehicle V1" is notified in the fifth notification format. In this case, the controller 11 notifies the object information that "there is a junction on the left side of the traveling direction of the vehicle V1" by using vibration control β. This notification is the same as the above-mentioned case CS7. B1 The vibration control device 53 may generate a vibration similar to that in the embodiment EX7_A. After that, when the vehicle V1 approaches the merging point and another vehicle approaches the vehicle V1 as a merging vehicle, the controller 11 may perform the vibration control α described in the embodiment EX7_A by regarding the merging vehicle as the object OBJ1.

[0182] <<Example EX7_F>> An example EX7_F will be described. When the notification target is an object OBJ1 (see FIG. 22), in the notification by the fifth notification format, the controller 11 may move the vibration position according to the change in the distance d1. In this case, the controller 11 can execute the following approach flow process during the period when the distance d1 is decreasing. The vibration position refers to the position where the vibration occurs on the seat ST1.

[0183] In the approach flow process, after the vibration position is set to the first position, the process of moving the vibration position to the second position is executed once or repeatedly executed at intervals. The second position is located behind the first position. The approach flow process can give the subject U1 a sensation that an object OBJ1 that should be noticed is approaching the vehicle V1. When the vehicle V1 and the object OBJ1 pass each other, the approach flow process may be executed during the period when the distance d1 is decreasing, and may be executed for a while even after the distance d1 changes from decreasing to increasing.

[0184] The first position may be in the seat portion ST1a, and the second position may be in the backrest portion ST1b. Alternatively, the vibration device 53 may be formed so that the vibration position can be changed in the front-rear direction in the seat portion ST1a, in which case the first position and the second position are both in the seat portion ST1a. When changing the vibration position from the first position to the second position, the vibration position may be moved from the first position to the second position via an intermediate position. The intermediate position is between the first position and the second position.

[0185] When the object OBJ1 is the notification target and the object OBJ1 moves from the left side to the right side of the vehicle V1, the controller 11 may perform a process to change the vibration position from the third position to a fourth position that is located to the right of the third position. Conversely, when the object OBJ1 is the notification target and the object OBJ1 moves from the right side to the left side of the vehicle V1, the controller 11 may perform a process to change the vibration position from the fourth position to the third position.

[0186] <<Example EX8>> Example EX8 will be described. Fig. 24 shows a functional block diagram of the controller 11. The controller 11 is provided with functional blocks F1 to F5. Each function of the functional blocks F1 to F5 may be realized by causing the controller 11 to execute a program recorded in the memory 12, the database 20, or any other recording medium (not shown). The relationship between each functional block and the flowchart of Fig. 14 will be described.

[0187] Functional block F1 is a notification determination unit that performs processing to determine whether the notification condition is met in step S11. Functional block F2 is an estimation processing unit that performs each estimation processing in steps S13 to S17. Functional block F3 is a selection processing unit that performs notification format selection processing in step S18. Functional block F4 is an output processing unit that performs notification output processing in step S19. Functional block F5 is an update processing unit that performs notification history update processing in step S20.

[0188] <<Example EX9>> Example EX9 will be described. Example EX9 lists modified techniques or applied techniques for the above items.

[0189] Although a passenger car or truck traveling on a public road is mainly assumed as the vehicle V1, the type of the vehicle V1 is arbitrary. The vehicle V1 may be an industrial vehicle such as a forklift, or an agricultural vehicle such as a tractor. For example, the notification control device 10 and the system SYS may be mounted on an airplane, ship, or train, in which case the target person U1 is a passenger of the airplane, ship, or train. In addition, the notification control device 10 and the system SYS may be applied to any purpose.

[0190] A program for causing a computer device to execute any of the methods described in the embodiments of the present invention, and a non-volatile recording medium on which the program is recorded, are included in the scope of the embodiments of the present invention. The program for causing a computer device to execute any of the methods described in the embodiments of the present invention may be a subprogram incorporated into any main program or called by any main program. The notification control device 10 is a type of computer device. Any of the processes in the embodiments of the present invention may be realized by hardware such as a semiconductor integrated circuit, software equivalent to the above program, or a combination of hardware and software.

[0191] The embodiments of the present invention can be modified in various ways as appropriate within the scope of the technical ideas set forth in the claims. The above embodiments are merely examples of the present invention, and the meanings of the terms of the present invention and each component are not limited to those described in the above embodiments. The specific numerical values ​​shown in the above description are merely examples, and can be changed to various numerical values ​​as a matter of course. [Explanation of symbols]

[0192] SYS In-vehicle system V1 Vehicle U1 Target ST1 Seat ST1a Seat part ST1b Backrest 10 Notification Control Device 11 Controller 12. Memory 13. Communications Department 20 Vehicle control device 30 Actuator section 40 Sensing section 50 Information output section 51 Display device 51a Display screen 52 Speaker 53 Vibration device 54, 54L, 54C, 54R vibration unit 55, 55L, 55C, 55R drive circuit 56, 56L, 56C, 56R resonator La, Lb left area Ca, Cb central region Ra, Rb right area 121 Notification History Table 122 Learning Degree Table 123 Judgment Table

Claims

1. A controller is provided for controlling which of a plurality of notification formats is to be used to notify the target information to the target person based on the characteristics of the target person and the characteristics of the target information. , notification control device.

2. The characteristics of the subject include a learning level of the subject with respect to the notification; The controller performs the control based on the learning level of the subject in each notification format. The notification control device according to claim 1 .

3. The characteristics of the subject further include the subject's sensitivity to notifications; The controller performs the control based on the sensitivity of the subject to each notification format. The notification control device according to claim 2 .

4. The characteristics of the target information include a simplicity of the target information and an urgency of the target information; The controller determines, for each notification format, whether the notification format is suitable for notifying the target information to the target person based on the learning level and sensitivity of the target person and the simplicity and urgency of the target information, and notifies the target person of the target information using an output notification format that is a notification format determined to be suitable. The notification control device according to claim 3 .

5. The controller: For each of the notification formats, it is determined whether the learning level of the target person with respect to being notified of the target information in that notification format falls within a set range, and based on the determination result, it is determined whether the notification format satisfies a learning level requirement condition, and a notification format extracted based on the simplicity and urgency of the target information is included in the output notification format from among the notification formats that satisfy the learning level requirement condition among the multiple types of notification formats; and For each of the notification formats, it is determined whether the sensitivity of the subject to the subject being notified of the target information in that notification format belongs to another setting range, and based on the determination result, it is determined whether the notification format satisfies a sensitivity requirement condition, and a notification format extracted from among the notification formats that satisfy the sensitivity requirement condition among the multiple types of notification formats based on the simplicity and urgency of the target information and the learning level of the subject is included in the output notification format. The notification control device according to claim 4 .

6. The controller estimates, for each of the notification formats, a learning level of the subject regarding notifications in the notification format based on a repetition number of times that the subject has been notified of information of the same type as the target information in the notification format. The notification control device according to claim 2 .

7. The multiple types of notification formats include a notification format that affects the subject's vision, a notification format that affects the subject's hearing, and a notification format that affects the subject's tactile sense. A notification control device according to any one of claims 1 to 6.

8. The notification format that affects the visual sense of the subject includes a notification format using text display and a notification format using graphics display as different types of notification formats. The notification control device according to claim 7 .

9. The notification format acting on the subject's hearing includes a notification format by outputting a speech sound signal and a notification format by outputting a non-speech sound signal as different types of notification formats. The notification control device according to claim 7 .

10. The notification form that affects the subject's tactile sense includes a vibration notification form by giving vibration to the subject, When notifying the subject of the target information in the vibration notification format, if the target information is information about an object that generates a sound, the controller is configured to be able to notify the subject of the target information by specific vibration control, and to give the subject a vibration corresponding to the sound generated by the object in the specific vibration control. The notification control device according to claim 7 .

11. The notification form that affects the subject's tactile sense includes a vibration notification form by giving vibration to the subject, The notification in the vibration notification format is performed using a plurality of vibrators that apply vibrations to different positions on the subject's body, When notifying the subject of the target information in the vibration notification format, the controller notifies the subject of the target information by vibrating a vibrator corresponding to the content of the target information among the plurality of vibrators. The notification control device according to claim 7 .

12. An in-vehicle notification system installed in a vehicle, A notification control device according to any one of claims 1 to 6, an information output unit that outputs the target information to the target person using one or more notification formats among the plurality of types of notification formats; The subject is an occupant of the vehicle. ,In-vehicle notification system.

13. Based on the characteristics of the target person and the characteristics of the target information, one of a plurality of notification formats is controlled to be used to notify the target person of the target information. ,Notification control methods.

14. A notification control method is executed by a computer to control which of a plurality of notification formats is to be used to notify a target person of the target information based on the characteristics of the target person and the characteristics of the target information. , notification control program.

Images