Driving assistance system, vehicle, recording medium having computer program recorded thereon, and driving assistance method

Abstract

Provided is a driving assistance system that can more effectively guide the driving behavior of a driver by stimulating the driver's auditory senses without executing complicated processing. A management server 20 executes a behavior data acquisition process for repeatedly acquiring driver behavior data based on sound effects while changing the output condition of the sound effects to be output into a vehicle 1 and a sound effect output control process for outputting the sound effects into the vehicle 1, and when the results obtained by these processes satisfy a preset setting condition, executes a specific process for specifying the output condition corresponding to the results as an optimized output condition.

Description

[Technical Field]

[0001] The present disclosure relates to a driving assistance system, a vehicle, a recording medium having a computer program recorded thereon, and a driving assistance method. [Background technology]

[0002] The skill level of a driver varies depending on the driver. This skill level affects ride comfort and road safety. In response to this, various devices have been proposed that assess a driver's driving behavior and notify the driver of the results of the assessment, as well as devices that provide advice.

[0003] For example, Patent Document 1 proposes a driving assistance device that accurately determines the driving operation state and allows the driver to know information about the overall evaluation of the driving operation state during the current drive, thereby enabling the driver to improve their driving skills for the next drive.

[0004] Specifically, such a driving assistance device is configured to comprehensively evaluate the driving operation state during the current drive while determining whether the driving state is smooth or shaky based on the change in acceleration and jerk and judgment criteria set using a vibration model. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-224762 Summary of the Invention [Problem to be solved by the invention]

[0006] However, the driving assistance device described in Patent Document 1 only evaluates a series of driving operations performed while driving, and does not go so far as to appropriately guide the driving behavior of the driver.

[0007] The present disclosure has been made in consideration of the above problems, and an object of the present disclosure is to provide a driving assistance system etc. that can more effectively guide the driving behavior of a driver by stimulating the driver's hearing, without performing complicated processing. [Means for solving the problem]

[0008] In order to solve the above problem, a driving assistance system according to a first aspect of the present disclosure is a driving assistance system that assists a driver who drives a vehicle, one or more processors; and one or more memories communicatively coupled to the one or more processors; the processor: executes a data acquisition process for acquiring data indicating a behavior of the vehicle as behavior data while the vehicle is traveling at least in a predetermined section; a sound effect output control process for outputting a sound effect according to a behavior stability obtained from the behavior data in the predetermined section after the vehicle has passed through the predetermined section, and for executing control to stimulate the sense of hearing of the driver; The data acquisition process and the sound effect output control process are repeatedly executed while changing the output conditions of the sound effects, and when the results of the repeatedly executed data acquisition process and sound effect output control process satisfy preset setting conditions, a specific process is executed to identify the output conditions corresponding to the results as optimal output conditions.

[0009] In order to solve the above problem, a vehicle according to a second aspect of the present disclosure includes: of driving Driver In a vehicle equipped with a driving assistance device that assists The driving assistance device executes a data acquisition process for acquiring data indicating a behavior of the vehicle as behavior data while the vehicle is traveling at least in a predetermined section; executes a sound effect output control process for executing control to output a sound effect according to a behavior stability obtained from the behavior data in the predetermined section after passing through the predetermined section; The data acquisition process and the sound effect output control process are repeatedly executed while changing the output conditions of the sound effects, and when the results of the repeatedly executed data acquisition process and sound effect output control process satisfy preset setting conditions, a specific process is executed to identify the output conditions corresponding to the results as optimal output conditions.

[0010] In order to solve the above problem, a recording medium having a computer program recorded thereon according to a third aspect of the present disclosure is of driving Driver A recording medium recording a computer program applied to a driving assistance system that assists On the computer, executing a data acquisition process for acquiring data indicating a behavior of the vehicle as behavior data while the vehicle is traveling at least in a predetermined section; executing a sound effect output control process for performing control to output a sound effect according to a behavior stability obtained from the behavior data in the predetermined section after passing through the predetermined section; The data acquisition process and the sound effect output control process are repeatedly executed while changing the output conditions of the sound effects, and when the results of the repeatedly executed data acquisition process and sound effect output control process satisfy preset setting conditions, the output conditions corresponding to the results are set as optimal output conditions, and a specific process is executed to identify them.

[0011] In order to solve the above problem, a driving assistance method according to a fourth aspect of the present disclosure includes: of driving Driver A driving assistance method for assisting a driver, The computer executes a data acquisition process for acquiring data indicating a behavior of the vehicle as behavior data while the vehicle is traveling at least in a predetermined section; executes a sound effect output control process for executing control to output a sound effect according to a behavior stability obtained from the behavior data in the predetermined section after passing through the predetermined section; The method has a configuration including repeatedly executing the data acquisition process and the sound effect output control process while changing the output conditions of the sound effect, and when the results of the repeatedly executed data acquisition process and sound effect output control process satisfy preset setting conditions, executing a specific process to identify the output conditions corresponding to the results as optimal output conditions. [Effects of the Invention]

[0012] With the above-described configuration, the driving assistance system and the like of the present disclosure can stimulate the driver's hearing, thereby guiding the driver's driving behavior more effectively and without the need for complicated processing. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is an example of a system configuration diagram showing a configuration of a driving assistance network system for a vehicle according to a first embodiment of the present disclosure. [Figure 2] 1 is a schematic diagram showing an example of the configuration of a vehicle equipped with an information processing system according to a first embodiment. [Figure 3] 1 is a block diagram showing an example of the configuration of an information processing system according to a first embodiment. [Figure 4] 2 is a block diagram showing an example of the configuration of a management server according to the first embodiment. FIG. [Figure 5] 5A to 5C are diagrams for explaining the sound effect optimization output condition specification process according to the first embodiment. [Figure 6] 4 is an example of driver data stored in a driver data storage unit of the first embodiment. [Figure 7]4 is an example of group data stored in a driver data storage unit of the first embodiment. [Figure 8] 10A and 10B are diagrams for explaining a sound effect output control process including a process for setting sound effect output control data for behavior analysis, which is executed by a data analysis unit in the first embodiment. [Figure 9] 10A and 10B are diagrams for explaining an output condition specifying process including resetting of sound effect output control data for behavior analysis, which is executed by the data analysis unit of the first embodiment. [Figure 10] 10 is a flowchart showing the operation of a sound effect optimization output condition specification process executed by the management server of the first embodiment. [Figure 11] 10 is a flowchart showing the operation of a sound effect optimization output condition specification process executed by the management server of the first embodiment. [Figure 12] 5 is a flowchart showing an operation on the vehicle 1 side regarding a sound effect optimization output condition specification process executed by the information processing system of the first embodiment. [Figure 13] FIG. 10 is a diagram for explaining the sound effect optimization output condition specification process according to the second embodiment of the present disclosure. [Figure 14] 10 is a flowchart showing the operation of a sound effect optimization output condition specification process executed by the management server of the second embodiment. [Figure 15] 10 is a flowchart showing the operation of a sound effect optimization output condition specification process executed by the management server of the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0014] [A] Features of the embodiments of the present disclosure (1) The embodiment of the present disclosure is In a driving assistance system that assists a driver who drives a vehicle, one or more processors; and one or more memories communicatively coupled to the one or more processors; the processor: executes a data acquisition process for acquiring data indicating a behavior of the vehicle as behavior data while the vehicle is traveling at least in a predetermined section; a sound effect output control process for outputting a sound effect according to a behavior stability obtained from the behavior data in the predetermined section after the vehicle has passed through the predetermined section, and for executing control to stimulate the sense of hearing of the driver; The data acquisition process and the sound effect output control process are repeatedly executed while changing the output conditions of the sound effects, and when the results of the repeatedly executed data acquisition process and sound effect output control process satisfy preset setting conditions, a specific process is executed to identify the output conditions corresponding to the results as optimal output conditions.

[0015] In addition, the embodiments of the present disclosure can also be realized by a driving assistance device mounted on a vehicle that executes each of the above processes, a recording medium on which a computer program for executing each of the above processes is recorded, or a driving assistance method that executes each of the above processes.

[0016] With this configuration, the driving assistance system of the present disclosure can automatically identify optimal sound effect output conditions for the driver that increase behavioral stability, such as the output timing, type, or tone of the sound effect. Therefore, by simply providing the driver with the automatically identified sound effect output conditions, the driving assistance system of the present disclosure can appropriately stimulate the driver's hearing so as to increase behavioral stability. As a result, the driving assistance system of the present disclosure can more effectively guide the driver's driving behavior to stabilize the vehicle's behavior without performing complex processing.

[0017] Note that a "predetermined section" refers to a distance section or a time section through which a vehicle passes, such as a section divided by a predetermined driving distance, a section divided by a predetermined driving time, or a section divided by a reference point such as an intersection with traffic lights.

[0018] "Vehicle behavior" refers to the movement (action) of the vehicle, such as stopping, accelerating, decelerating, constant speed, and turning behavior, based on the driver's steering, accelerator, or brake operations. "Behavior stability" refers to the degree of behavioral change (state change) in the vehicle behavior, and high behavior stability means that the behavioral change in the vehicle behavior is small or smooth.

[0019] For example, in the case where a driving assistance system is realized in a cloud-based manner using a server that executes various processes, the "sound effect output control process" refers to a control process for outputting sound effects in a vehicle, such as providing and setting the output conditions. Also, in the case where a driving assistance system is realized in a stand-alone manner using an information processing device mounted on a vehicle, the "sound effect output control process" refers to the output control itself when sound effects are directly output into the vehicle.

[0020] The "output conditions" include, for example, the output timing of the sound effect, the number of times it is output, the tone (tone interval (pitch), strength, number of sounds), volume, or tempo.

[0021] The sound effects include, for example, the sound of winning a medal, the sound of applause, the sound of fireworks, or a chord composed of multiple sounds of different pitches or tones. In particular, the sound effects are preferably sounds that stabilize the vehicle's behavior, or that can make the driver feel a sense of accomplishment or comfort the more stable the vehicle's behavior. However, the sound effects may also be sounds that give the driver a more negative impression the less stable the vehicle's behavior. In addition, the sound effects of this embodiment change depending on the above-mentioned output conditions.

[0022] The "set conditions" include, for example, conditions for increasing or decreasing the behavior stability, and conditions based on stability indicators such as the angular velocity, jerk, angular velocity, or angular acceleration of the vehicle.

[0023] (2) Furthermore, the embodiment of the present disclosure is the processor: executes an information acquisition process for acquiring driver characteristic information indicating the characteristics of the driver; The specifying process may include specifying the optimum output condition for a predetermined driver characteristic.

[0024] With this configuration, the driving assistance system of the present disclosure can automatically identify the output conditions for sound effects according to differences in individual ability, such as differences between a novice and an experienced driver, or differences in reaction speed to sound effects or differences in the ability to learn driving skills based on sound effects.

[0025] "Driver characteristics" refers to the driving characteristics intended by the driver when driving a vehicle, or characteristics related to the driver's abilities when driving. In particular, driving characteristics include driving characteristics achieved by the driver's accelerator, brake, steering, etc. Characteristics related to abilities include differences in reaction speed to sounds and differences in learning ability for driving. Furthermore, "information acquisition processing" refers to acquiring information on the accelerator, brake, or steering of the vehicle.

[0026] (3) Furthermore, the embodiment of the present disclosure is the processor: executes an information acquisition process for acquiring information on the driving environment of the vehicle; The identification process may include identifying the optimum output condition for a predetermined driving environment.

[0027] With this configuration, the driving assistance system of the present disclosure can automatically identify the output conditions for sound effects that can stabilize the behavior of the vehicle depending on the driving environment.

[0028] The driving environment refers to traffic environments such as an environment with many pedestrians and bicycles, the presence or absence of oncoming vehicles or obstacles, an environment with heavy traffic or an environment with a high risk of accidents, road environments such as school routes during school hours, road shapes or road widths, and weather conditions (clear skies, rainfall, and snowfall).In addition, the "information acquisition process" includes processes for acquiring vehicle position information, the area in which the vehicle is traveling, time information, or the situation around the vehicle, instead of the information related to the driving environment.

[0029] (4) Furthermore, the embodiment of the present disclosure is the processor: The output conditions may include at least one of the conditions of output timing, number of times of output, tone, volume, length, and tempo of the sound effect.

[0030] With this configuration, the driving assistance system of the present disclosure can automatically identify the output conditions of the sound effect, such as the output timing, number of outputs, tone, volume, length, or tempo of the sound effect.

[0031] Note that "length" indicates the length of playback time, and "tempo" indicates the length of time required to play (output) a single sequence when a sound effect is composed of a sequence of multiple sounds.

[0032] (5) Furthermore, the embodiment of the present disclosure is the processor: When the results of the repeatedly executed data acquisition process and sound effect output control process satisfy a preset condition by the specifying process, the sound effect output control process and the data acquisition process are stopped; executing, as an output condition fixing control process, control for fixing the output condition of the sound effect to the optimal output condition identified when the sound effect output control process and the data acquisition process are stopped, to stimulate the sense of hearing of the driver; The behavior data may be acquired based on the output condition fixing control process, and the specific process may be resumed when the behavior stability obtained from the acquired behavior data satisfies a given special output condition.

[0033] With this configuration, the driving assistance system etc. of the present disclosure can reset the optimized output conditions when it is possible to set more optimal output conditions, thereby updating the sound effect output conditions as needed. Therefore, the driving assistance system etc. of the present disclosure can maintain the sound effect output conditions that always provide the driver with optimal vehicle stability when providing driving assistance.

[0034] The "first specific output condition" includes, for example, the absence of change in behavior stability or the change becoming smaller than a predetermined value. Here, the absence of change in behavior stability indicates that the behavior stability has reached a limit value, and the change becoming smaller than a predetermined value indicates that the behavior stability has reached the vicinity of the limit value.

[0035] The "second specific output condition" includes a condition in which there is a possibility that the vehicle's behavior stability may be further improved, such as when the behavior stability of the reference data for behavior stability provided from an external source is higher than the vehicle's behavior stability.

[0036] (6) Furthermore, the embodiment of the present disclosure is the processor: When the specific process is resumed, a setting condition different from the setting condition before the restart may be used.

[0037] With this configuration, the driving assistance system of the present disclosure can maintain the output conditions of the sound effects that always provide the driver with optimal vehicle stability.

[0038] (7) Furthermore, the embodiment of the present disclosure is the processor: If the number of behavior data acquired by the data acquisition process is insufficient, control may be performed to acquire additional behavior data, or a process may be executed to correct the behavior stability obtained from the behavior data already acquired.

[0039] With this configuration, the driving assistance system etc. of the present disclosure can supplement the amount of data by additionally acquiring or correcting data even when the number of drivers collecting behavior data is small, such as one driver. Therefore, the driving assistance system of the present disclosure can set optimal output conditions for sound effects even when the number of drivers is small.

[0040] [B] Details of the embodiments of the present disclosure Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0041] [B1] First embodiment [B1.1] Driver assistance network system First, an overview of a driving assistance network system S for a vehicle 1 according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a system configuration diagram showing the configuration of the driving assistance network system S for a vehicle 1 according to the present embodiment.

[0042] In addition, to prevent the diagram from becoming too complicated, Fig. 1 shows only vehicles 1 (including information processing systems 10) used by some drivers. That is, in an actual driving assistance network system S, there are many more vehicles 1 than are shown in Fig. 1.

[0043] The driving assistance network system S of this embodiment collects data (hereinafter referred to as "behavior data") indicating the behavior of each vehicle 1 obtained in response to driving operations based on auditory stimuli for multiple drivers. The driving assistance network system S is a system for identifying optimal output conditions (hereinafter referred to as "optimized output conditions") for sound effects that stabilize the behavior of the vehicle 1 based on the collected behavior data. That is, the driving assistance network system S of this embodiment has a configuration for executing a specification process (hereinafter referred to as "sound effect optimized output condition specification process") that specifies optimal output conditions for sound effects that stabilize the behavior of the vehicle 1 based on auditory stimuli for multiple drivers.

[0044] As shown in Figure 1, the driving assistance network system S of this embodiment is composed of an information processing system 10 installed in a vehicle 1 to be assisted with driving, and a management server 20 that works in conjunction with each information processing system 10 to provide driving assistance to the driver.

[0045] The vehicle 1 is not particularly limited as long as it is a four-wheeled automobile, a motorcycle, or any other vehicle that can be driven by a driver and can move at a predetermined speed.

[0046] The information processing system 10 is a device mounted on each vehicle 1, and is connected to the management server 20 via a network such as the Internet or a public line network. In particular, the information processing system 10 is configured to establish wireless and wired communication lines with the management server 20 via a base station BS to transmit and receive various data. The information processing system 10 also works in conjunction with the management server 20 to execute vehicle 1-side processing for the sound effect optimization output condition specification process.

[0047] Specifically, the information processing system 10 is configured to receive data on sound effect output conditions (hereinafter referred to as "output condition data") set in the management server 20, and output predetermined sound effects based on the received output conditions. The information processing system 10 is also configured to collect data on the behavior of the vehicle 1 based on the driver's driving (hereinafter referred to as "behavior data") while the sound effects are being output, and provide the collected behavior data to the management server 20.

[0048] The management server 20 is a device that is communicably connected to the information processing system 10 installed in each vehicle 1 via a network using cloud computing technology. The management server 20 of this embodiment may be configured as one server (device, processor) or may be configured as multiple servers (devices, processors). The management server 20 has various databases (broadly speaking, storage devices, memories) that store various information used for driving assistance for each driver, including the sound effect optimization output condition specification process.

[0049] In addition, the management server 20 of this embodiment may access a database (broadly speaking, a storage device, memory) connected via a network, or, for example, another server device (not shown) that manages a database (broadly speaking, a storage device, memory).

[0050] The management server 20 is configured to work in conjunction with the information processing system 10 of each vehicle 1 and to execute each process in the sound effect optimization output condition identification process, including providing and controlling data to the information processing system 10, in order to more effectively provide driving assistance to the driver based on auditory stimulation.

[0051] In particular, the management server 20 is configured to change the output conditions of the sound effects to be heard by the driver, provide each output condition to each information processing system 10, and acquire behavior data of multiple drivers for each output condition from the information processing system 10 of each vehicle 1. The management server 20 is also configured to automatically identify optimized output conditions for sound effects that will increase the behavior stability of the vehicle 1 for the driver who is the target of driving assistance, based on the behavior data of each vehicle 1 for each acquired output condition. Furthermore, the management server 20 is configured to provide the identified optimized output conditions to the information processing system 10 of the corresponding vehicle 1 in order to output predetermined sound effects inside the vehicle 1 driven by the driver.

[0052] The sound effects of this embodiment include, for example, the sound of winning a medal, the sound of applause, the sound of fireworks, or a chord made up of multiple sounds with different pitches or tones. The output conditions of the sound effects include, for example, the conditions for outputting the sound effects, such as the output timing, number of outputs, tone (pitch, strength, number of sounds), volume, length, or tempo, or a combination of two or more of these.

[0053] [B1.2] Vehicles Next, an example of the overall configuration of the vehicle of this embodiment will be described with reference to Fig. 2. Fig. 2 is a schematic diagram showing an example of the configuration of a vehicle 1 equipped with an information processing system 10 of this embodiment.

[0054] As shown in Fig. 2, the vehicle 1 is configured as a four-wheel drive vehicle in which drive torque output from a drive power source 9 that generates drive torque for the vehicle is transmitted to a front left wheel 3LF, a front right wheel 3RF, a rear left wheel 3LR, and a rear right wheel 3RR (hereinafter collectively referred to as "wheels 3" unless a distinction is required). The drive power source 9 may be an internal combustion engine such as a gasoline engine or a diesel engine, a drive motor, or may be equipped with both an internal combustion engine and a drive motor.

[0055] The vehicle 1 may be, for example, an electric vehicle equipped with two drive motors, a front-wheel drive motor and a rear-wheel drive motor, or an electric vehicle equipped with drive motors corresponding to each of the wheels 3. If the vehicle 1 is an electric vehicle or a hybrid electric vehicle, the vehicle 1 is equipped with a secondary battery that stores power to be supplied to the drive motors, and a motor or a generator such as a fuel cell that generates power to charge the battery.

[0056] The vehicle 1 is equipped with a driving force source 9, an electric steering device 43, and a brake fluid pressure control unit 2 as devices used to control the operation of the vehicle 1. The driving force source 9 outputs driving torque that is transmitted to the front drive shaft 5F and the rear drive shaft 5R via a transmission, a front wheel differential mechanism 7F, and a rear wheel differential mechanism 7R (not shown). The operation of the driving force source 9 and the transmission is controlled by a vehicle control device 40 that includes one or more electronic control units (ECUs: Electronic Control Units).

[0057] The front-wheel drive shaft 5F is provided with an electric steering device 43. The electric steering device 43 includes an electric motor and a gear mechanism (not shown), and is controlled by the vehicle control device 40 to adjust the steering angles of the left front wheel 3LF and the right front wheel 3RF. During manual driving, the vehicle control device 40 controls the electric steering device 43 based on the steering angle of the steering wheel 41 operated by the driver. The electric steering device 43 may be a hydraulic power steering device.

[0058] The brake system of the vehicle 1 is configured as a hydraulic brake system. A brake fluid pressure control unit 2 adjusts the hydraulic pressure supplied to brake calipers 21LF, 21RF, 21LR, and 21RR (hereinafter collectively referred to as "brake calipers 21" unless a distinction is required) provided on the front, rear, left, and right drive wheels 3LF, 3RF, 3LR, and 3RR, respectively, to generate braking force. The drive of the brake fluid pressure control unit 2 is controlled by a vehicle control device 40. If the vehicle 1 is an electric vehicle or a hybrid electric vehicle, the brake fluid pressure control unit 2 is used in conjunction with regenerative braking using the drive motor.

[0059] The vehicle control device 40 includes one or more electronic control devices that control the drive of the driving force source 9 that outputs the driving torque of the vehicle 1, the electric steering device 43 that controls the steering wheel 41 or the steering angle of the steering wheels, and the brake fluid pressure control unit 2 that controls the braking force of the vehicle 1. The vehicle control device 40 may also have a function of controlling the drive of a transmission that changes the speed of the output output from the driving force source 9 and transmits it to the wheels 3. When the vehicle 1 is being manually driven, the vehicle control device 40 acquires information on the amount of operation by the driver, and controls the drive of the driving force source 9 that outputs the driving torque of the vehicle 1, the electric steering device 43 that controls the steering wheel 41 or the steering angle of the steering wheels, and the brake fluid pressure control unit 2 that controls the braking force of the vehicle 1.

[0060] [B1.3] Information Processing Systems Next, an example of the configuration of the information processing system 10 mounted on the vehicle 1 of this embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the configuration of the information processing system 10 according to this embodiment.

[0061] (Outline of information processing system) The information processing system 10, in conjunction with the management server 20, acquires data indicating the behavior of the vehicle 1 while the vehicle 1 is traveling, and executes processing to output sounds that stimulate the driver's hearing and stabilize the behavior of the vehicle 1. Furthermore, since the behavior of the vehicle 1 mainly reflects the driver's steering operation state, accelerator operation state, and brake operation state, the information processing system 10 has a configuration that allows the driver to intuitively recognize an evaluation of the driver's own driving operation state in real time.

[0062] 3, the information processing system 10 includes a vehicle body behavior measurement device 11, a vehicle surroundings condition detection device 13, a weather information detection device 15, a vehicle position information detection device 17, a sound output device 19, and an information processing device 100. The vehicle body behavior measurement device 11, the vehicle surroundings condition detection device 13, the weather information detection device 15, the vehicle position information detection device 17, and the sound output device 19 are communicably connected to the information processing device 100 via a dedicated line or a communication bus such as a CAN (Controller Area Network).

[0063] It is preferable that the information processing system 10 of this embodiment has a configuration that works in conjunction with a navigation system (not shown) installed in the vehicle 1, or has the functions of a navigation system including the vehicle position information detection device 17, but this is not limited to this.

[0064] (Vehicle behavior measurement device) The vehicle body behavior measurement device 11 is a device that measures data indicating the behavior of the vehicle 1. The vehicle body behavior measurement device 11 includes, for example, at least one of a vehicle speed sensor, an acceleration sensor, and an angular velocity sensor.

[0065] For example, the vehicle speed sensor detects the rotational speed of the drive shaft of the vehicle 1. The acceleration sensor detects at least longitudinal acceleration, which is acceleration in the longitudinal direction of the vehicle body, and lateral acceleration, which is acceleration in the width direction of the vehicle. The acceleration sensor may also detect vertical acceleration, which is acceleration in the height direction of the vehicle body. The angular velocity sensor detects the rate of change of each of the rotation angle around an axis in the longitudinal direction of the vehicle body (roll angle), the rotation angle around an axis in the width direction of the vehicle body (pitch angle), and the rotation angle around an axis in the height direction of the vehicle body (yaw angle). The angular velocity sensor may also be a yaw rate sensor that detects the rate of change of the yaw angle.

[0066] In addition, the vehicle body behavior measurement device 11 detects data that changes due to driving operations such as steering, accelerator, and brake operations by the driver as behavior data of the corresponding vehicle 1, and outputs the detected behavior data to the information processing device 100.

[0067] The vehicle body behavior measurement device 11 may include a sensor capable of measuring data that reflects the behavior of the vehicle 1, in addition to the vehicle speed sensor, acceleration sensor, and angular velocity sensor.

[0068] (Vehicle Surrounding Condition Detection Device) The vehicle surroundings detection device 13 is a device that detects information about the surroundings of the vehicle 1. For example, the vehicle surroundings detection device 13 is configured to include at least one of a stereo camera, a monocular camera, a LiDAR (Light Detection and Ranging / Laser Imaging Detection and Ranging), and a radar sensor. In the example of the vehicle 1 shown in FIG. 1, the vehicle surroundings detection device 13 is provided with a pair of left and right front-facing cameras 13LF, 13RF and a LiDAR 13S.

[0069] Specifically, the vehicle surroundings detection device 13 detects objects around the vehicle 1, such as other vehicles, bicycles, pedestrians, road signs, and other obstacles, based on the acquired data, and calculates the distance to these objects, as well as the relative speed and relative position. Furthermore, the vehicle surroundings detection device 13 detects information about the surroundings of the vehicle 1, such as the width of the road, based on the acquired data (hereinafter referred to as "surroundings information"). Furthermore, the vehicle surroundings detection device 13 outputs the detected surroundings information to the information processing device 100.

[0070] The vehicle surroundings situation detection device 13 may include a device capable of detecting information about the surroundings of the vehicle 1 in addition to the stereo camera, monocular camera, LiDAR, and radar sensor.

[0071] (Weather Information Detector) Weather information detection device 15 is a device that detects information about the weather in the driving area of ​​vehicle 1. For example, weather information detection device 15 is configured to include at least one of a stereo camera, a monocular camera, a rain sensor, a wind pressure gauge, and an acceleration sensor.

[0072] The weather information detection device 15 detects rainfall, snowfall, snow accumulation, and road ice based on imaging data from the stereo camera or monocular camera. The weather information detection device 15 also estimates the amount of rainfall based on detection data from a rain sensor. Furthermore, the weather information detection device 15 detects wind speed and direction based on detection data from an anemometer. Furthermore, the weather information detection device 15 estimates wind speed and direction based on a sensor signal from an acceleration sensor. The weather information detection device 15 then outputs information related to the detected weather (hereinafter referred to as "weather condition information") to the information processing device 100.

[0073] In addition to the stereo camera, monocular camera, rain sensor, anemometer, and acceleration sensor, the weather information detection device 15 may also include devices capable of detecting information about the weather in the driving area of ​​the vehicle 1. The weather information detection device 15 may also receive information from an external system, such as telematics, to acquire information about the weather in the driving area (hereinafter referred to as "received weather information"). In this case, the weather information detection device 15 outputs the detected received weather information to the information processing device 100.

[0074] (Vehicle position information detection device) The vehicle position information detection device 17 receives a positioning signal transmitted from a global navigation satellite system (GNSS) such as a global positioning system (GPS), and measures the position of the vehicle 1. Then, the vehicle position information detection device 17 outputs information on the measured position of the vehicle 1 (including information on latitude, longitude, and time) to the information processing device 100 as position information.

[0075] The vehicle position information detection device 17 of this embodiment may function as part of a navigation system (not shown) that assists the driver and guides the vehicle 1 to a destination. In this case, the vehicle position information detection device 17 refers to map data of the navigation system (not shown) based on the measured position of the vehicle 1, identifies the current position of the vehicle, and outputs the identified position information to the information processing device 100.

[0076] The vehicle position information detection device 17 may measure the position of the vehicle 1 by receiving a positioning signal transmitted from another system such as a quasi-zenith satellite system instead of or in addition to the GNSS.

[0077] (sound output device) The sound output device 19 is a device that outputs sounds that can be recognized by the driver, and the output of the sound output device 19 is controlled by the information processing device 100. In particular, the sound output device 19 has a playback unit that plays sound effect data stored in the information processing device 100 or sound effect data provided from the management server 20. In addition to the playback unit, the sound output device 19 also has components for outputting sounds to stimulate the driver's hearing inside the vehicle 1, such as a D / A converter that converts the digital signal of the played sound effect into an analog signal, an amplifier that amplifies the analog signal, and a speaker.

[0078] 2, the sound output device 19 has four speakers 31LF, 31RF, 31LR, and 31RR provided at the front, rear, left, and right sides of the vehicle 1. The sound output device 19 may have speakers provided in the vehicle 1, or may be a speaker dedicated to the information processing system 10.

[0079] (Information processing device) The information processing device 100 has one or more processors such as CPUs, and by executing a computer program in conjunction with the management server 20, collects and provides behavior data when providing driving assistance to the driver based on auditory stimulation, and controls the output of sound effects.

[0080] In particular, the information processing device 100 is configured to be able to acquire various data or information output from the vehicle body behavior measurement device 11, the vehicle surroundings detection device 13, the weather information detection device 15, and the vehicle position information detection device 17.

[0081] 3, the information processing device 100 has a processing unit 110, an operation input unit 120, a storage unit 140, an information storage medium 150, and a communication unit 170. Note that some of these may be omitted. Some or all of the information processing device 100 may be configured with updatable components such as firmware, or may be program modules executed by commands from a CPU or the like.

[0082] The processing unit 110 performs various processes of this embodiment by reading and executing application programs (hereinafter also referred to as "apps") stored in the information storage medium 150. Note that any type of app may be stored in the information storage medium 150. The processing unit 110 of this embodiment may also read programs and data stored in the information storage medium 150, temporarily store the read programs and data in the storage unit 140, and perform processing based on the programs and data.

[0083] In particular, the processing unit 110 performs various processes using the main memory in the memory unit 140 as a work area. The functions of the processing unit 110 are realized by hardware such as various processors (CPU, DSP, etc.) and application programs. Specifically, the processing unit 110 is composed of a communication control unit 111, an input reception processing unit 112, a data processing unit 113, an output control unit 114, and a timer management unit 119. Note that some of these may be omitted.

[0084] The communication control unit 111 performs processing to transmit and receive data to and from the management server 20. In particular, the communication control unit 111 receives data transmitted from the management server 20 and executes control processing such as processing to store the received data in the storage unit 140 and processing to transmit various types of data to the management server 20.

[0085] The input reception processing unit 112 recognizes input information input by the user from the operation input unit 120 , and outputs the recognized information to the data processing unit 113 .

[0086] The data processing unit 113 provides the input information recognized by the input reception processing unit 112 to the management server 20 .

[0087] The data processing unit 113 also acquires behavior data, surrounding condition information, weather detection information, or received weather information (hereinafter collectively referred to as "weather information"), or position information output from the vehicle body behavior measurement device 11, the vehicle surrounding condition detection device 13, the weather information detection device 15, and the vehicle position information detection device 17. The data processing unit 113 provides the acquired behavior data and each piece of information to the output control unit 114 or the management server 20.

[0088] The output control unit 114 acquires control data for outputting sound effects (hereinafter referred to as "sound effect output control data") provided from the management server 20, or the sound effect output control data and sound effect data. The output control unit 114 also controls the sound output device 19 based on the sound effect output control data provided from the management server 20, or based on the sound effect output control data and the sound effect data provided from the management server 20.

[0089] The timer management unit 119 has a function of measuring the current date and time and from a predetermined timing, and outputs the current time and the measurement result when the predetermined timing arrives.

[0090] The operation input unit 120 is a device used when given information is input by the driver, and has a configuration for outputting the information input by the driver (hereinafter referred to as "input information") to the processing unit 110.

[0091] For example, the operation input unit 120 includes a detection unit (not shown) that detects input information (input signals) from the driver, and is configured with a lever, a button, a dial-type operation device, a microphone, a touch panel display, a keyboard, a mouse, or a camera for receiving input by gestures. In particular, when the operation input unit 120 is configured with a microphone, the detection unit 122 configures a voice recognition device that receives input by the voice of a passenger such as a driver. In addition, when the operation input unit 120 is configured with a camera, the detection unit configures an image recognition device that receives input of gestures captured by the camera.

[0092] The operation input unit 120 receives information relating to the attributes of the driver as input information. The information relating to the attributes of the driver is information relating to the driving skills of the driver, and includes, for example, at least one of the following information: the driver's age, the number of years since obtaining a driver's license, driving frequency, the number of years since the last driving session, etc.

[0093] The information on the driver's attributes may include other information that can estimate the driver's driving skills. Such information may be input in the form of a questionnaire in which the driver or the like answers questions presented by the information processing device 100. Furthermore, data that has been determined or accumulated in advance may be input as such information.

[0094] The operation input unit 120 may receive, as input information, information about a sound desired as a sound effect. For example, the operation input unit 120 may be configured to work in conjunction with the processing unit 110 to enable the driver or the like to select a sound (musical instrument sound or various sound effects) desired from among tones or types of sounds pre-stored in the storage unit 140 or the like. The sound data to be selected includes sound effect data pre-stored in the storage unit 140 and sound effect data provided by the management server 20.

[0095] The storage unit 140 serves as a work area for the processing unit 110 and the like, and its functions are realized by hardware such as RAM (VRAM). The storage unit 140 of this embodiment includes a main storage unit 141 used as a work area, and a data storage unit 142 that stores computer programs, table data, reference data, sound data, and the like used when executing each process.

[0096] Note that some of these may be omitted. The computer program is a program for causing a processor to execute various operations to be executed by the information processing device 100. The computer program may be recorded on a recording medium built into the information processing device 100 or on any recording medium that can be externally attached to the information processing device 100.

[0097] The information storage medium 150 is computer-readable, and may store various types of data including an ID corresponding to each information processing system 10, in addition to various applications and an OS (operating system).

[0098] That is, the information storage medium 150 stores applications for causing a computer to function as each part of this embodiment (applications for causing a computer to execute the processing of each part), an ID for communicating with each information processing system 10, and the like.

[0099] For example, the information storage medium 150 may be a magnetic medium such as a hard disk, a floppy disk, and a magnetic tape, an optical recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD (Digital Versatile Disk), and a Blu-ray (registered trademark), a magneto-optical medium such as a floptical disk, a memory element such as a RAM and a ROM, a flash memory such as a USB (Universal Serial Bus) memory and an SSD (Solid State Drive), or any other medium capable of storing a program.

[0100] The communication unit 170 performs various controls for communicating with the outside (for example, the management server 20), and its functions are configured by hardware such as various processors or communication ASICs, computer programs, and the like.

[0101] [B1.4] Management Server Next, an example of the configuration of the management server 20 according to this embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the configuration of the management server 20 according to this embodiment.

[0102] The management server 20 has one or more processors such as CPUs, and executes a computer program to execute sound effect optimization output condition specification processing in conjunction with each information processing system 10.

[0103] In particular, the management server 20 of this embodiment acquires and analyzes behavior data of the vehicle 1 based on the auditory stimulation of each driver, and identifies sound effect output conditions that provide high behavior stability for each driver as optimized output conditions. Then, the management server 20 provides optimized sound effect output control data to the information processing system 10 of the corresponding vehicle 1 as data for controlling the output of sound effects by the information processing system 10 according to the identified optimized output conditions.

[0104] Note that part or all of the management server 20 may be configured with updatable components such as firmware, or may be a program module executed by commands from a CPU or the like. The computer program is a computer program that causes a processor to execute various operations that should be performed by the management server 20. The computer program executed by the processor may be recorded on a recording medium that functions as a storage unit (memory) 240 provided in the management server 20, or may be recorded on a recording medium built into the management server 20 or any recording medium that can be externally attached to the management server 20.

[0105] For example, recording media for recording computer programs may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs (Compact Disk Read Only Memory), DVDs (Digital Versatile Disks), and Blu-ray (registered trademark), magneto-optical media such as floptical disks, memory elements such as RAMs and ROMs, and flash memories such as USB (Universal Serial Bus) memories and SSDs (Solid State Drives), as well as other media capable of storing programs.

[0106] 4, the management server 20 has a processing unit 210, a storage unit 240, an information storage medium 250, and a communication unit 270. The processing unit 210 is made up of a communication control unit 211, a data acquisition unit 212, a data analysis unit 213, a data provision processing unit 214, or a timer management unit 219. Note that some of these units may be omitted.

[0107] The communication control unit 211 performs processing to transmit and receive data to and from each information processing system 10. In particular, the communication control unit 211 performs control processing such as processing to receive data transmitted from each information processing system 10 and store the received data in the storage unit 240, and processing to transmit various types of data to the information processing system 10 of each vehicle 1.

[0108] The data acquisition unit 212 acquires behavior data from the information processing system 10 of each vehicle 1 and outputs it to the data analysis unit 213 .

[0109] The data analysis unit 213 sets sound effect output control data (hereinafter referred to as "sound effect output control data for behavior analysis"), which is data for analyzing the behavior of each driver's vehicle 1 and is provided to the information processing system 10, and in which the output conditions for sound effects to be output within the vehicle 1 are predetermined.

[0110] The data acquisition unit 212 may specify the type of sound effect to be output inside the vehicle 1 when setting the sound effect output control data for behavior analysis.

[0111] The data providing processing unit 214 provides the behavior analysis sound effect output control data set by the data analysis unit 213 to the information processing system 10 of each vehicle 1 via the communication unit 270 under the control of the communication control unit 211 .

[0112] The timer management unit 219 has the function of measuring the current date and time or from a specified timing, and outputs the current time and measurement results when the specified timing arrives or when a specified request is received.

[0113] The storage unit 240 serves as a work area for the processing unit 210 and the like, and its functions are realized by hardware such as RAM (VRAM). The storage unit 240 of this embodiment includes a main storage unit 241 used as a work area, a data storage unit 242 in which computer programs, table data, and reference data used when executing each process are stored, and a driver data storage unit 243 in which driver data is stored.

[0114] It is also possible to omit some of these components. The computer program is a program that causes a processor to execute various operations that should be performed by the management server 20. The computer program may be recorded on a recording medium built into the management server 20 or on any recording medium that can be externally attached to the management server 20.

[0115] The information storage medium 250 is computer-readable, and may store various types of data including IDs corresponding to the information processing systems 10, in addition to various applications and an OS (operating system).

[0116] That is, the information storage medium 250 stores applications for causing a computer to function as each part of this embodiment (applications for causing a computer to execute the processing of each part), an ID for communicating with each information processing system 10, and the like.

[0117] For example, the information storage medium 250 may be a magnetic medium such as a hard disk, a floppy disk, and a magnetic tape, an optical recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD (Digital Versatile Disk), and a Blu-ray (registered trademark), a magneto-optical medium such as a floptical disk, a memory element such as a RAM and a ROM, a flash memory such as a USB (Universal Serial Bus) memory and an SSD (Solid State Drive), or any other medium capable of storing a program.

[0118] The communication unit 270 performs various controls for communicating with the outside (for example, each information processing system 10), and its functions are composed of hardware such as various processors or communication ASICs, computer programs, etc.

[0119] [B1.5] Sound effect optimization output condition specification process of this embodiment [B1.5.1] Overview Next, a sound effect optimization output condition specification process for specifying an optimized output condition for a sound effect in driving assistance for a driver based on auditory stimulation according to this embodiment will be described with reference to Fig. 5. Fig. 5 is a diagram for explaining the sound effect optimization output condition specification process according to this embodiment.

[0120] The management server 20 of this embodiment has a configuration for executing the following processing as a sound effect optimization output condition identification processing. The management server 20 executes a behavior data acquisition processing that acquires behavior data of each vehicle 1 from each vehicle 1 while the vehicle 1 is traveling at least through a predetermined section. After passing through a predetermined section, the management server 20 executes a sound effect output control processing that executes control to output sound effects into the vehicle 1 according to the behavior stability obtained from the behavior data of the vehicle 1 in the predetermined section. The management server 20 repeatedly executes the behavior data acquisition processing and the sound effect output control processing while changing the sound effect output conditions, and if the results obtained by these processings satisfy the preset setting conditions, executes an identification processing that identifies the output conditions corresponding to the results as optimized output conditions.

[0121] In particular, the management server 20 of this embodiment selects a plurality of groups each consisting of one or more drivers who have been grouped in advance as a premise for the behavior data acquisition process and the sound effect output control process. Then, the management server 20 sets sound effect output control data for behavior analysis (hereinafter referred to as "behavior analysis reference data") that has different output conditions for sound effects in the vehicle 1 for each selected group, and provides the data to the information processing system 10 of each vehicle 1.

[0122] Furthermore, the management server 20 of this embodiment uses at least one of the sound effect output timing, output count, tone, volume, length, and tempo as the sound effect output conditions of this embodiment, as described above. The management server 20 then executes a behavior data acquisition process and a sound effect output control process while changing these output conditions or a combination thereof, and executes a process (hereinafter referred to as an "output condition specification process") to specify provisional optimal output conditions for the sound effects as a result of this process. Finally, if the provisional optimal output conditions resulting from this process satisfy preset setting conditions (hereinafter referred to as "behavior stabilization conditions"), the management server 20 specifies the provisional optimal output conditions as optimized output conditions.

[0123] Specifically, as shown in Fig. 5, the management server 20 executes a behavior data acquisition process to acquire each piece of behavior data collected based on the sound effect output control data for behavior analysis, including the reference data for behavior analysis, after passing through a predetermined section. As shown in Fig. 5, when the management server 20 acquires each piece of behavior data, it sets new sound effect output control data for behavior analysis, with different output conditions for each group, based on the acquired behavior data for each group. Then, as the sound effect output control process, the management server 20 provides the set sound effect output control data for behavior analysis to the information processing system 10 of each vehicle 1, and executes a behavior data acquisition process to acquire each piece of behavior data, and repeatedly repeats these processes.

[0124] Furthermore, as shown in Fig. 5, in the output condition identification process, the management server 20 compares the behavior stability of each group obtained from the behavior data to identify a provisional optimal output condition for the sound effect, and identifies the group for which the output condition is set as a specific group. As shown in Fig. 5, the management server 20 executes a determination process to determine whether or not the processing result (e.g., the output condition for the sound effect of the specific group) obtained by repeatedly executing the behavior data acquisition process and the sound effect output control process satisfies a predetermined behavior stabilization condition. At this time, if the execution result satisfies the behavior stabilization condition in the determination process, the management server 20 identifies the output condition identified as the provisional optimal output condition (e.g., the output condition for the sound effect of the specific group) as the sound effect optimization output condition.

[0125] In this way, the management server 20 of this embodiment is configured to repeatedly execute the sound effect output control process and the behavior data acquisition process based thereon while changing the sound effect output conditions for each group, while also executing the output condition specification process, and ultimately specifying the optimal sound effect output conditions.

[0126] As shown in FIG. 5, for example, after passing through a predetermined section for behavior analysis (hereinafter referred to as a "behavior analysis section"), each information processing system 10 collects behavior data indicating the vehicle's behavior based on sound effects played while traveling through the behavior analysis section, and provides the collected data to the management server 20.

[0127] Furthermore, when the sound effect optimization output conditions are identified as described above, the management server 20 provides control data in which the optimized output conditions are defined (hereinafter referred to as "optimized sound effect output control data") to the information processing system 10. Then, the information processing system 10 plays back sound effect data based on the optimized sound effect output control data in sections desired by the driver or sections where stable behavior is essential (hereinafter also referred to as "application sections"), and outputs predetermined sound effects inside the vehicle 1.

[0128] With this configuration, the management server 20 of this embodiment or the driving assistance network system S including it can automatically identify the optimal output conditions for sound effects to provide auditory stimulation to the driver being assisted, if it can collect actual vehicle behavior data based on the driver's driving operations.

[0129] Furthermore, the management server 20 of this embodiment or the driving assistance network system S including it can collect data on the actual vehicle behavior in response to the driver's auditory stimuli, and can therefore accurately identify the output conditions for sound effects that will increase the behavioral stability of the driver being assisted.

[0130] In other words, the management server 20 of this embodiment or the driving assistance network system S including it can automatically identify the optimal output conditions for the driver, such as the optimal output timing, type of sound, or tone of sound effects that will increase behavior stability.

[0131] The management server 20 of this embodiment or the driving assistance network system S including it can precisely stimulate the driver's hearing so as to increase the driver's behavioral stability by simply providing the driver with the automatically identified sound effect output conditions.

[0132] [B1.5.2] Driver and Group Data Next, the driver data and group data used in the sound effect optimization output condition specification process of this embodiment will be described with reference to Fig. 6 and Fig. 7. Fig. 6 is an example of driver data stored in the driver data storage unit 243 of this embodiment, and Fig. 7 is an example of group data stored in the driver data storage unit 243 of this embodiment.

[0133] The driver data storage unit 243 stores data relating to each driver (hereinafter referred to as "driver data") and data relating to each group (hereinafter referred to as "group data").

[0134] As shown in Figure 6, the driver data includes attribute information, a vehicle ID for identifying each vehicle 1 driven by each driver, a system ID for identifying the information processing system 10 installed in the vehicle 1, and the like, all associated with a driver ID for identifying each driver.

[0135] The group data is data relating to a group selected in advance in order to analyze the behavior of each driver of the vehicle 1, and is data for identifying the drivers belonging to each group. Specifically, as shown in Fig. 7, the group data includes the driver IDs belonging to each group.

[0136] The group data of this embodiment may include, instead of or together with the driver ID, the vehicle ID of the vehicle 1, the system ID of the information processing system 10, or a combination of these. Furthermore, each group may be pre-grouped by any method, such as randomly, but it is preferable to group drivers who drive vehicles 1 that satisfy essential conditions for driving the vehicles 1, such as the same driving section, the same driving distance, or the same driving time.

[0137] [B1.5.3] Processing related to the process of identifying sound effect optimization output conditions in information processing systems Next, each process executed by the information processing system 10 in relation to the sound effect optimization output condition specification process of this embodiment will be described.

[0138] (Sound effect output control based on behavior analysis sound effect output control data) In order to provide the management server 20 with behavior data of each vehicle 1, the output control unit 114 performs sound effect output control for each sound effect output control data for behavior analysis (including the reference data for behavior analysis described below) that has different sound effect output conditions in the behavior analysis section.

[0139] Specifically, under the control of the communication control unit 111, the output control unit 114 acquires each piece of sound effect output control data for behavior analysis that has different sound effect output conditions via the communication unit 170, and stores the acquired sound effect output control data for behavior analysis in the storage unit 140. Furthermore, when the output control unit 114 detects the start point or start timing of a behavior analysis interval, it plays predetermined sound effect data based on the stored sound effect output control data for behavior analysis, and causes the sound output device 19 to output the sound effect. Then, when the output control unit 114 detects the end point or end timing of the behavior analysis interval, it stops the playback of the sound effect data based on the sound effect output control data for behavior analysis.

[0140] For example, the output control unit 114 detects the passage of the start point and end point of the behavior analysis section based on the position information acquired from the vehicle position information detection device 17. The output control unit 114 may detect the behavior analysis section based on, for example, the current time output from the timer management unit 119, known status information output from the vehicle surroundings detection device 13, or weather information output from the weather information detection device 15. The output control unit 114 may also detect the behavior analysis section based on, for example, a combination of two or more of the position information, the current time, known status information, and weather information.

[0141] (Collecting behavior data and sending it to the management server) When sound effects are reproduced based on the sound effect output control data for behavior analysis, the data processing unit 113 collects behavior data for each predetermined timing output from the vehicle body behavior measurement device 11. Furthermore, under the control of the communication control unit 111, the data processing unit 113 transmits each collected behavior data as a behavior data group to the management server 20 via the communication unit 170.

[0142] In particular, the data processing unit 113 collects each behavior data at predetermined timings while the vehicle 1 is traveling in a behavior analysis section, such as a section divided into sections at predetermined travel distances, a section divided into sections at predetermined travel times, or a section divided into sections at reference points such as intersections with traffic lights. Furthermore, the data processing unit 113 collects, as behavior data, values ​​of acceleration, angular velocity, jerk, or angular acceleration, or values ​​of two or more of these, at predetermined timings.

[0143] The data processing unit 113 may transmit a group of data in which the collected behavior data are arranged in chronological order to the management server 20, or may transmit the collected behavior data sequentially to the management server 20. In this case, it is preferable that the data processing unit 113 transmits the group of behavior data to the management server 20 by type of behavior analysis sound effect output control data (hereinafter referred to as "data type") while attaching the driver ID stored in the storage unit 140, or by attaching a data type ID.

[0144] Furthermore, in this embodiment, it is sufficient to collect one or more pieces of behavior data for each vehicle 1 and for each behavior analysis section and transmit them to the management server 20. However, in order to reflect the appropriate behavior of each vehicle 1, it is preferable that the data processing unit 113 collects and transmits multiple pieces of behavior data to the management server 20.

[0145] (Sound effect output control based on optimized sound effect output control data) The output control unit 114 executes output control of sound effects based on the optimized sound effect output control data in applicable sections such as sections desired by the driver.

[0146] In particular, under the control of the communication control unit 111, the output control unit 114 acquires optimized sound effect output control data via the communication unit 170 and stores the acquired optimized sound effect output control data in the storage unit 140. Furthermore, when the output control unit 114 detects the start point or start timing of the application section, it plays predetermined sound effect data based on the stored optimized sound effect output control data and causes the sound output device 19 to output the sound effect. When the output control unit 114 detects the end point or end timing of the application section, it stops the playback of the sound effect data based on the optimized sound effect output control data.

[0147] [B1.5.4] Each process of the sound effect optimization output condition specification process on the management server [B1.5.4.1] Setting of reference data for behavior analysis Next, a description will be given of a process for setting the behavior analysis reference data, which is executed by the data analysis unit 213 before the data acquisition process and the sound effect output control process of this embodiment are executed.

[0148] The data analysis unit 213 sets sound effect output control data that differs for each selected group and has a predetermined output condition as behavior analysis reference data.

[0149] In particular, the data analysis unit 213 divides a plurality of drivers traveling in a predetermined section into a plurality of groups randomly or according to a predetermined algorithm, and stores the driver IDs of the drivers belonging to each group in the driver data storage unit 243. Furthermore, the data acquisition unit 212 sets, for each group, behavior analysis reference data that specifies the output conditions of sound effects, such as the output timing of sound effects, according to an algorithm that can identify optimized output conditions based on the behavior data.

[0150] For example, when using binary search to identify the optimized output conditions, the data analysis unit 213 uses behavior analysis reference data that specifies the earliest timing from the start of behavior analysis, the latest timing from the start of behavior analysis, and the intermediate timing (median) between them. In this case, when the behaviors are divided into three groups, the data analysis unit 213 sets behavior analysis sound effect output control data with different output timings that output sound effects 1 second, 3 seconds, or 5 seconds after the start of behavior analysis, such as the start of driving.

[0151] In this embodiment, as described above, three groups are used as an example to acquire behavior data under predetermined sound effect output conditions, but as long as two or more groups are selected, it is possible to apply this to the processing related to driving assistance based on auditory stimulation of this embodiment. However, in order to accurately analyze the behavioral trends of the vehicle 1, three or more groups are preferable.

[0152] Furthermore, in this embodiment, the optimized output conditions are identified using a binary search, but other search algorithms such as a linear search using predetermined output conditions may also be used.

[0153] [B1.5.4.2] Behavior data acquisition processing Next, a behavior data acquisition process based on the behavior analysis reference data or the behavior analysis sound effect output control data executed by the data acquisition unit 212 of this embodiment will be described.

[0154] (Behavior data acquisition process based on behavior analysis reference data) Under the control of the communication control unit 211, the data acquisition unit 212 acquires behavior data collected by the information processing system 10 of each vehicle 1 based on the reference data for behavior analysis via the communication unit 270, and outputs each acquired behavior data to the data analysis unit 213.

[0155] Specifically, the data acquisition unit 212 acquires behavior data that indicates the behavior of each vehicle 1 in the behavior analysis section, which data is collected by the information processing system 10 mounted on each vehicle 1 while the vehicle 1 is traveling in the behavior analysis section, from each information processing system 10. That is, when sound effects are output-controlled based on behavior analysis reference data assigned to each driver in the behavior analysis section, the data acquisition unit 212 acquires one or more behavior data collected in each vehicle 1 for each group.

[0156] It should be noted that the data acquisition unit 212 of this embodiment only needs to acquire one or more pieces of behavior data for each vehicle 1 and for each behavior analysis section, but it is preferable to acquire multiple pieces of behavior data in order to reflect the appropriate behavior of each vehicle 1. However, in the following, unless otherwise specified, "behavior data" will be explained as "one or multiple pieces of behavior data."

[0157] (Behavior data acquisition processing based on behavior analysis sound effect output control data) Under the control of the communication control unit 211, the data acquisition unit 212 acquires, via the communication unit 270, the behavior data collected by the information processing system 10 of each vehicle 1 based on the behavior analysis sound effect output control data, in the same manner as in the case of the behavior analysis reference data. Then, the data acquisition unit 212 outputs each acquired behavior data to the data analysis unit 213.

[0158] [B1.5.4.3] Sound effect output control processing including setting processing of sound effect output control data for behavior analysis Next, a sound effect output control process including a process for setting sound effect output control data for behavior analysis executed by the data analysis unit 213 of this embodiment will be described with reference to Fig. 8. Fig. 8 is a diagram for explaining the sound effect output control process including a process for setting sound effect output control data for behavior analysis executed by the data analysis unit 213 of this embodiment.

[0159] (Setting process for behavior analysis sound effect output control data) As described above, when each piece of behavior data based on the behavior analysis reference data is acquired from each vehicle 1, the data analysis unit 213 calculates an index value indicating the behavior stability of each vehicle 1 (hereinafter referred to as a "behavior stability index value") based on each piece of behavior data for each vehicle 1. Then, the data analysis unit 213 calculates the behavior stability index value of each vehicle 1 for each group, and identifies the group having the index value indicating the optimal behavior stability as a specific group from among the groups. Furthermore, the data analysis unit 213 determines the sound effect output conditions set for the specific group as provisional sound effect optimization output conditions, and sets new sound effect output control data for behavior analysis based on the determined provisional sound effect optimization output conditions.

[0160] Specifically, the data analysis unit 213 calculates an index value of behavior stability for each vehicle 1 based on the values ​​(data values) of vehicle speed, acceleration (longitudinal acceleration, lateral acceleration, up / down acceleration) or angular velocity (angular velocity of yaw angle, roll angle, pitch angle) indicated by each behavior data.

[0161] In particular, the data analysis unit 213 performs at least one of smoothing, absolute value conversion, and differentiation on the vehicle speed, acceleration, or angular velocity to calculate a value indicating the magnitude of the behavior of the vehicle 1. For example, the data analysis unit 213 performs smoothing, absolute value conversion, and differentiation on the data values ​​of the vehicle speed, acceleration, or angular velocity to calculate the absolute value of the acceleration, the jerk of the absolute value of the acceleration (jerk), or the jerk of the absolute value of the angular velocity (angular acceleration). However, the data analysis unit 213 may use the calculated absolute value of the acceleration, angular velocity, jerk, or angular acceleration as the index value. Note that using the absolute value of the jerk or angular acceleration as the index value reduces the influence of changes in the vehicle speed, acceleration, or angular velocity due to the trajectory of the road or the acceleration or deceleration of other vehicles, and allows for more accurate evaluation of changes in the behavior of the vehicle 1 caused by the driver's driving operation state.

[0162] Furthermore, the data analysis unit 213 may calculate one index value using a plurality of data values ​​among the acceleration, angular velocity, jerk, or absolute value of angular acceleration. The data analysis unit 213 may replace the data values ​​of each behavior data to be used with the same index (for example, a value from 0 to 100), and use the average value of the values ​​obtained by replacing all the data values ​​to be used with the same index as the index value.

[0163] Regarding acceleration and jerk, the data analysis unit 213 calculates at least one of longitudinal acceleration, lateral acceleration, and vertical acceleration separately. Furthermore, regarding angular velocity and angular acceleration, the data analysis unit 213 calculates at least one of yaw angle, roll angle, and pitch angle separately. In particular, the index value calculated by the data analysis unit 213 increases as the behavior of the vehicle 1 increases, and decreases as the behavior decreases.

[0164] The data analysis unit 213 calculates a representative value from the behavior stability index values ​​calculated from the multiple pieces of behavior data for each driver. For example, the data analysis unit 213 may set the maximum value from the multiple index values ​​as the representative value, or may set a statistical value such as the average value as the representative value. After calculating the behavior stability index value for each driver, the data analysis unit 213 calculates the behavior stability index value for each group based on the behavior stability index values ​​for each driver in each group. For example, the data analysis unit 213 calculates the average value of the index values ​​for each driver in each group as the behavior stability index value for each group.

[0165] After calculating the behavioral stability index value of each group, the data analysis unit 213 determines, as a specific group, a group having an index value that satisfies a predetermined condition from among the behavioral stability index values ​​of each group.

[0166] Furthermore, the data analysis unit 213 identifies the sound effect output conditions set for a specific group as provisional optimized output conditions, and sets new sound effect output control data for behavior analysis based on the identified provisional optimized output conditions. That is, the data analysis unit 213 sets, for each group, sound effect output control data for behavior analysis that specifies the provisional optimized output conditions and the output conditions determined based on the provisional optimized output conditions.

[0167] Specifically, the data analysis unit 213 determines the output conditions of the sound effect output control data for behavior analysis to be newly set based on the provisional optimized output conditions and the output conditions when the reference data for behavior analysis was set. Furthermore, the data analysis unit 213 determines the output conditions for a group that is one less than the group when the reference data for behavior analysis was set, as the newly determined output conditions. For example, if the reference data for behavior analysis is set for three groups, the data analysis unit 213 determines the output conditions of one of the groups as the provisional sound effect output conditions, and determines new output conditions for the other two groups.

[0168] In particular, when a binary search is used as the search algorithm, to set output conditions for different output timings, the data analysis unit 213 sets the earliest and latest settable timings as new output conditions, centered around the provisional output condition. In this case, the data analysis unit 213 sets two pieces of sound effect output control data for behavior analysis having the new output conditions, along with the sound effect output control data for behavior analysis having the provisional output condition.

[0169] For example, as shown in Fig. 8, assume that the behavior analysis reference data, in which the output timing of the sound effect from the start of the behavior analysis section is set to "1 second later," "3 seconds later," or "5 seconds later," is set for three groups A, B, and C. In this case, the behavior stability index value for group B "3 seconds later" is assumed to be the smallest.

[0170] In this case, the data analysis unit 213 determines group B "3 seconds later" as the specific group, and determines the output conditions set for group B as provisional optimized output conditions. Furthermore, the data analysis unit 213 sets output conditions for two groups (specifically, A and C) based on a binary search algorithm using the output conditions for group B "3 seconds later" as a reference. That is, the data analysis unit 213 determines the output timing for groups A and C to be "2 seconds later," which is the earliest and latest settable timing for sound effects from the start of the behavior analysis period. Then, after determining the output conditions for sound effects at the next timing for each group, the data analysis unit 213 sets sound effect output control data for behavior analysis for acquiring behavior data based on the determined output conditions.

[0171] (Sound effect output control processing) As a sound effect output control process, the data providing processing unit 214 provides each sound effect output control data for behavior analysis, which includes data on new output conditions, as well as the reference data for behavior analysis, to the corresponding information processing system 10 via the communication unit 270 under the control of the communication control unit 211.

[0172] That is, as a sound effect output control process, the data providing processing unit 214 provides each sound effect output control data for behavior analysis to the corresponding information processing system 10, and causes each information processing system 10 to control the output of sound effects in accordance with the sound effect output control data for behavior analysis.

[0173] In addition, since there is no change to the sound effect output control data for behavior analysis having provisional optimized output conditions, the data providing processing unit 214 may control the output of sound effects for the relevant information processing system 10 in accordance with the sound effect output control data for behavior analysis that has already been provided.

[0174] [B1.5.4.4] Output condition specification process including resetting of sound effect output control data for behavior analysis Next, the output condition specification process including resetting of the sound effect output control data for behavior analysis executed by the data analysis unit 213 of this embodiment will be described with reference to Fig. 9. Fig. 9 is a diagram for explaining the output condition specification process including resetting of the sound effect output control data for behavior analysis executed by the data analysis unit 213 of this embodiment.

[0175] Similar to the case of setting new sound effect output control data for behavior analysis based on behavior data collected by the behavior analysis reference data, when the data analysis unit 213 acquires behavior data from each vehicle 1, it calculates an index value for behavior stability for each vehicle 1. Then, based on the index value for behavior stability of each vehicle 1 calculated as described above, the data analysis unit 213 calculates an index value for behavior stability for each group, and identifies a specific group having an index value that indicates optimal behavior stability from among the multiple groups based on the index value for behavior stability of each group.

[0176] Furthermore, when the data analysis unit 213 identifies a specific group, it executes a determination process to determine whether or not an index value indicating the behavior stability of the specific group or a result such as the number of repeated executions (hereinafter referred to as a "repeated execution result") satisfies a predetermined behavior stabilization condition. At this time, if the repeated execution result satisfies the predetermined behavior stabilization condition, the data analysis unit 213 executes an output condition determination process to determine the output condition of the sound effect set for the specific group as the optimized output condition.

[0177] For example, as shown in Fig. 9, when the data analysis unit 213 determines that the difference in index value between the smallest group and other groups is within a predetermined range as a behavior stabilization condition, the data analysis unit 213 specifies the output condition of the group with the smallest index value as the optimized output condition. Particularly in this embodiment, as a determination process, the data analysis unit 213 determines that the difference in index value between the smallest group and other groups is within the predetermined range when the difference is less than 10% or within a range where no significant difference is found in a statistical test (so-called error range).

[0178] 9 shows that when the sound effect output timings for groups A, B, and C are 3 seconds later, 2 seconds later, and 4 seconds later, group C, which is "4 seconds later," is a specific group. In particular, FIG. 9 shows an example in which the behavior stability index value of group C satisfies a predetermined behavior stabilization condition, and the sound effect output conditions set for group C are identified as optimized output conditions. That is, in the example of FIG. 9, the index value of group C, which is a specific group, is the smallest index value, and the difference between this index value and the index values ​​of the other groups A and B (output timings "3 seconds later" and "2 seconds later") is within a predetermined range (e.g., less than 10%).

[0179] On the other hand, if the results of repeated execution, such as an index value indicating the behavior stability of a specific group, do not satisfy the predetermined behavior stabilization condition, the data analysis unit 213 determines the output conditions of the sound effects set for the specific group as provisional optimized output conditions, as described above. Also, the data analysis unit 213 determines new output conditions for the sound effect output control data for behavior analysis to be newly set, based on the provisional optimized output conditions and the output conditions when the behavior analysis reference data was set, as described above.

[0180] In the above example, if the difference between the index value of the specific group (output timing "after 4 seconds") and the index values ​​of the other groups (output timings "after 3 seconds" and "after 2 seconds") is not within a predetermined range, the data analysis unit 213 sets the output condition of the specific group as the provisional optimized output condition. In this case, the data analysis unit 213 determines the output conditions for the two groups based on a search algorithm such as a binary search algorithm, using the output condition of the specific group "after 4 seconds" as a reference. In this case, the data analysis unit 213 determines output timings for sound effects 3.5 seconds and 4.5 seconds after the start of the behavior analysis interval as output conditions other than the provisional optimized output condition.

[0181] Similarly to the above, the data analysis unit 213 determines the sound effect output conditions for the next timing of each group, and then sets sound effect output control data for behavior analysis for acquiring behavior data based on the determined output conditions. In this case, the data provision processing unit 214 provides the newly set sound effect output control data for behavior analysis to the corresponding vehicle 1 as sound effect output control processing.

[0182] [B1.6] Operation of this embodiment [B1.6.1] Management Server Operation Next, the operation of the sound effect optimization output condition specification process executed by the management server 20 of this embodiment will be described with reference to Fig. 10 and Fig. 11. Fig. 10 and Fig. 11 are flowcharts showing the operation of the sound effect optimization output condition specification process executed by the management server 20 of this embodiment.

[0183] In this operation, it is assumed that a plurality of groups each consisting of one or more drivers grouped in advance have already been selected, and the driver IDs belonging to each group have already been stored in the driver data storage unit 243.

[0184] In addition, in this operation, it is assumed that a specific driver has started driving the vehicle 1, and that when auditory stimulation is performed while driving in a specified section, a predetermined sound effect is output and controlled by the information processing system 10.

[0185] First, when the data analysis unit 213 receives an instruction to execute a sound effect optimization output condition specification process, such as an operation instruction from a specific driver or an instruction from an application (step S101), it sets reference data for behavior analysis for each predetermined group (step S102).

[0186] Next, the data providing processing unit 214 transmits the behavior analysis reference data for each set group to each of the information processing systems 10 of the corresponding vehicle 1 based on the group data stored in the driver data storage unit 243 (step S103). Note that the data providing processing unit 214 may randomly set a group to which behavior analysis reference data is to be transmitted, or may set a group to which behavior analysis reference data is to be transmitted in accordance with a rule predetermined by an app or the like.

[0187] Next, the data acquisition unit 212 starts acquiring the behavior data transmitted from each information processing system 10 (step S104). In particular, the data acquisition unit 212 may receive all the behavior data for a predetermined section for each information processing system 10 at once, or may receive the collected behavior data for each information processing system 10.

[0188] Next, the data acquisition unit 104 determines whether or not behavior data after passing through a predetermined section has been received from all the information processing systems 10 belonging to each group (step S105). At this time, if the data acquisition unit 204 determines that behavior data after passing through a predetermined section has been received from all the drivers belonging to each group, it proceeds to the process of step S107, and if it determines that behavior data has not been received from all the drivers, it waits for a predetermined time (step S106) and executes the process of step S105 again.

[0189] Next, the data analysis unit 213 calculates an index value indicating the behavior stability of each vehicle 1 for each group based on the acquired behavior data, and identifies the group with the index value indicating the optimal behavior stability as a specific group from among the multiple groups (step S107).

[0190] Next, the data analysis unit 213 determines the sound effect output conditions set for the specific group as provisional optimized sound effect output conditions, and determines the sound effect output conditions for analyzing the next behavior stability based on the determined provisional optimized sound effect output conditions (step S108).

[0191] Next, the data analysis unit 213 sets new behavior analysis sound effect output control data for each group based on the output conditions determined in the process of step S108, including the provisional optimized sound effect output conditions (step S109).

[0192] Next, the data providing processing unit 214 transmits the behavior analysis sound effect output control data of each set group to each of the information processing systems 10 of the corresponding vehicle 1 based on the group data stored in the driver data storage unit 243 (step S110). Note that, similar to step S103, the data providing processing unit 214 may randomly set a group to which the behavior analysis sound effect output control data is to be transmitted, or may set a group to which the behavior analysis sound effect output control data is to be transmitted in accordance with a rule predetermined by an app or the like.

[0193] Next, similarly to step S104, the data acquisition unit 212 starts acquiring the behavior data transmitted from each information processing system 10 (step S111).

[0194] Next, the data acquisition unit 104 determines whether or not behavior data after passing through a predetermined section has been received from all drivers belonging to each group, similar to the process of step S105 (step S112). At this time, if the data acquisition unit 204 determines that behavior data after passing through a predetermined section has been received from all drivers belonging to each group, it proceeds to the process of step S114, and if it determines that the behavior data has not been received, it waits for a predetermined time (step S113) and then executes the process of step S112 again.

[0195] Next, similarly to step S107, the data analysis unit 213 calculates the behavior stability index value of each vehicle 1 for each group based on the acquired behavior data, and identifies a specific group from among the multiple groups (step S114).

[0196] Next, the data analysis unit 213 determines whether or not the index value indicating the behavior stability of the specific group satisfies a predetermined behavior stabilization condition (step S115). At this time, if the data analysis unit 213 determines that the index value indicating the behavior stability of the specific group satisfies the behavior stabilization condition, it proceeds to the processing of step S116, and if it determines that the index value does not satisfy the behavior stabilization condition, it proceeds to the processing of step S108.

[0197] Next, the data analysis unit 213 executes an output condition specification process to specify the output conditions of the sound effects set in the specific group as the optimized output conditions (step S116), and ends this operation.

[0198] When providing driving assistance based on the auditory stimulation of a specified driver, the data providing processing unit 214 transmits optimized sound effect output control data to the corresponding information processing system 10 for controlling the output of sound effects based on the optimized output conditions identified by the processing of step S116.

[0199] In addition, when the information processing system 10 of a specified driver receives the optimized sound effect output control data transmitted from the management server 20, it plays sound effect data based on the received optimized sound effect output control data while driving in the applicable section, and outputs the specified sound effect inside the vehicle 1.

[0200] [B1.6.2] Information processing system operation Next, the operation on the vehicle 1 side regarding the sound effect optimization output condition specification process executed by the information processing system 10 of this embodiment will be described with reference to Fig. 12. Fig. 12 is a flowchart showing the operation on the vehicle 1 side regarding the sound effect optimization output condition specification process executed by the information processing system 10 of this embodiment.

[0201] In this operation, it is assumed that a specific driver has started driving the vehicle 1, and that when auditory stimulation is performed while driving a specified section, a predetermined sound effect is output and controlled by the information processing system 10.

[0202] First, when the output control unit 114 receives sound effect output control data for behavior analysis including reference data for behavior analysis transmitted from the management server 20 (step S201), it stores the data in the memory unit 140 and waits for execution of sound effect output control (step S202).

[0203] Next, when the output control unit 114 detects the start point or start timing of the behavior analysis section (step S203), it starts playing predetermined sound effect data based on the sound effect output control data for behavior analysis stored in the storage unit 140 (step S204). Note that when the output control unit 114 starts playing the sound effect data, it causes the sound output device 19 to output sound effects according to the output conditions during the playback of the sound effect data.

[0204] Next, the data processing unit 113 instructs the vehicle body behavior measurement device 11 to start detecting behavior data, and starts collecting the behavior data (step S205). When the vehicle body behavior measurement device 11 is instructed to start detecting behavior data, it detects behavior data at predetermined intervals until it is instructed to stop collecting the behavior data, and outputs the detected behavior data to the data processing unit 113.

[0205] Next, when the output control unit 114 detects the end point or end timing of the behavior analysis section during the playback of the sound effect data (step S206), it stops the playback of the sound effect data based on the sound effect output control data for behavior analysis (step S207).

[0206] Next, the data processing unit 113 instructs the vehicle body behavior measurement device 11 to end the detection of behavior data, stops collecting the behavior data (step S208), and under the control of the communication control unit 111, transmits the collected behavior data to the management server 20 via the communication unit 170 (step S209), thereby ending this operation.

[0207] [B1.7] [B1.7.1] Variation 1: Implementing part or all of the sound effect optimization output condition specification process Next, a modified example of this embodiment will be described, in which part or all of the processing related to the sound effect optimization output condition specification processing is performed.

[0208] In the present embodiment, some or all of the processes related to the sound effect optimization output condition specification process executed by the management server 20 may be executed by the information processing system 10 mounted on the vehicle 1. Specifically, the information processing system 10 may have a configuration to execute some or all of the processes among the process of setting sound effect output control data for behavior analysis including reference data for behavior analysis, the behavior data acquisition process, the sound effect output control process, and the output condition specification process.

[0209] In particular, when the information processing system 10 acquires behavior data from another information processing system 10 or provides behavior analysis sound effect output control data to another information processing system 10, the information processing system 10 transmits and receives data to the other information processing system 10 via the management server 20. However, the information processing system 10 may directly connect to a communication line with the other information processing system 10 via a network and transmit and receive data directly.

[0210] In addition, when the sound effect output control processing is executed in the information processing system 10, the information processing device 100 included in the information processing system 10 executes processing to directly control the sound output device 19 based on the sound effect output control data for behavior analysis as the sound effect output control processing.

[0211] [B1.7.2] Variation 2: Sound effect optimization output condition specification process based on driver characteristics Next, a modified example of this embodiment, in which sound effect optimization output condition specification processing is performed based on driver characteristics, will be described.

[0212] (Outline of the process for identifying sound effect optimization output conditions based on driver characteristics) The management server 20 of this embodiment may execute a sound effect optimized output condition specification process for a predetermined driver characteristic. That is, the management server 20 executes an information acquisition process for acquiring information on a specific driver characteristic (hereinafter referred to as "driver characteristic information") from each information processing system 10 or the driver data storage unit 243. Then, the management server 20 may specify a provisional optimized output condition and a final optimized output condition for the specific driver characteristic as the sound effect output condition specification process.

[0213] In particular, the driver characteristics refer to the driving characteristics intended by the driver when driving the vehicle 1, or characteristics related to the abilities used by the driver when driving (hereinafter referred to as "ability characteristics"). Furthermore, for example, the driving characteristics include driving characteristics realized by the driver's accelerator, brake, steering, etc., and the ability characteristics include differences in reaction speed to sounds and differences in learning ability for driving, etc.

[0214] With this configuration, in this modified example, the optimal output conditions can be automatically identified according to the level of driving proficiency between a novice and an experienced driver, or individual ability differences such as differences in reaction speed to sound effects or differences in learning ability for driving skills corresponding to sound effects.

[0215] In this modified example, it is preferable that driver characteristic information is acquired before the output condition specification process is executed, and a group corresponding to the driver characteristics (vehicle 1) for which behavior data collection is to be executed is selected in advance based on the driver characteristic information. However, as in the above embodiment, groups may be assigned in advance, behavior data may be acquired in association with the driver characteristics, and the optimized output conditions for sound effects may be specified using only the behavior data of the corresponding driver characteristics in each group.

[0216] The predetermined driver characteristics may be characteristics specified in advance by an app or the like, or may be composed of two or more characteristics. The predetermined driver characteristics may be characteristics of a driver that provides optimized output conditions for sound effects, or characteristics determined by the selection of the driver.

[0217] (Driver characteristic information acquisition process) The data acquisition unit 212 executes an information acquisition process to acquire, as driver characteristic information, from the information processing system 10 of the vehicle 1, the driver's level of driving proficiency determined by questionnaire responses to the driver, tests based on sound effects, or the driving operation history of the vehicle 1, or the reaction speed to sound effects or the level of learning ability for driving skills according to sound effects.

[0218] In addition, the data acquisition unit 212 may acquire, from the driver data storage unit 243, the driving proficiency level of each driver, which is stored in advance, or the reaction speed to sound effects or the learning ability for driving skills corresponding to sound effects, as driver characteristic information.

[0219] In addition, the data acquisition unit 212 also acquires questionnaire responses to the driver, test results based on sound effects, or driving operation history from the information processing system 10, and identifies the driver characteristics based on the acquired responses, etc., which is also included in acquiring driver characteristics.

[0220] For example, the data acquisition unit 212 identifies the driver characteristics of each driver based on responses to a questionnaire in which the driver or the like answers to questions presented by the information processing system 10. The data acquisition unit 212 may also determine the level of the driver's driving operation skill based on the number of years since obtaining a driver's license, the frequency of driving in the past year, driving time or mileage, and the number of days since the last drive. Furthermore, the data acquisition unit 212 may refer to the driver's driving operation history and identify the level of the driver's driving operation skill based on the stability of behavior such as the cumulative value of acceleration or jerk, the number of times a threshold has been exceeded, and the number of times a corrective operation has been performed.

[0221] (Output condition specific processing based on driver characteristics) The data analysis unit 213 determines the type of driver characteristic for specifying the optimized output conditions for sound effects based on input operation instructions and instructions to execute the sound effect optimization output condition specification process. The data analysis unit 213 groups multiple drivers based on the determined driver characteristics and selects groups for acquiring behavior data having common driver characteristics but different sound effect output conditions. The data analysis unit 213 also executes, for each group, a process for setting behavior analysis reference data and behavior analysis sound effect output control data, and a sound effect output control process based on these, while also executing an output condition specification process for specifying provisional sound effect output conditions corresponding to the determined driver characteristics. Then, when the results of repeated execution, such as the behavior stability of a specific group, satisfy the behavior stabilization condition, the data analysis unit 213 specifies the output condition corresponding to the repeated execution result as the optimized output condition for sound effects.

[0222] As in the above embodiment, the data acquisition unit 212 acquires each behavior data collected based on the behavior analysis sound effect output control data including the behavior analysis reference data.

[0223] [B1.7.3] Variation 3: Sound effect optimization output condition specification process based on driving environment Next, a modification of this embodiment, namely, a sound effect optimization output condition specification process based on the running environment of the vehicle 1, will be described.

[0224] (Outline of the process for identifying sound effect output conditions for optimization based on the vehicle's driving environment) The management server 20 of this embodiment may execute a sound effect optimization output condition specification process for a predetermined driving environment. That is, the management server 20 may execute an information acquisition process for acquiring information on the driving environment (hereinafter referred to as "driving environment information") from each information processing system 10, and specify an optimized output condition for the predetermined driving environment as the sound effect optimization output condition specification process.

[0225] In particular, the driving environment refers to traffic environments such as an environment with many pedestrians and bicycles, the presence or absence of oncoming vehicles or obstacles, an environment with heavy traffic or an environment with a high risk of accidents, road environments such as school routes during school hours, road shape or width, and weather conditions (sunny, rainy, and snowy).

[0226] With this configuration, the management server 20 of this modified example can automatically identify the output conditions for sound effects that can stabilize the behavior of the vehicle depending on the driving environment.

[0227] In this modification, it is preferable that the driving environment for specifying the optimized output conditions for sound effects is determined in advance in accordance with an instruction from the driver or an instruction from the application. Therefore, in this modification, similar to the present embodiment, it is preferable that behavior data of drivers who have driven in the same driving environment as the set driving environment is extracted from among the drivers previously selected for each group, and the optimized output conditions for sound effects are specified based on the extracted behavior data.

[0228] The predetermined driving environment may be composed of two or more driving environments. The predetermined driving environment may be a driving environment that is likely to be driven by the driver who provides the optimized output conditions for sound effects, or may be a driving environment determined by the selection of the driver.

[0229] (Information acquisition processing of driving environment information and data acquisition processing of behavior data) The data acquisition unit 212 acquires the traveling environment information together with the behavior data from the information processing system 10 of the vehicle 1, and labels the acquired behavior data for each group according to a predetermined type of traveling environment.

[0230] Specifically, the data acquisition unit 212 acquires, as driving environment information, surrounding situation information indicating the situation around the vehicle 1, such as road width, or weather information (weather situation information or received weather information) such as the presence or absence of rainfall, the amount of rainfall, or wind conditions. Furthermore, the data acquisition unit 212 refers to a map from the information processing system 10 of the vehicle 1, such as an area with many pedestrians or bicycles or an area with heavy traffic, and acquires location information including information indicating the environment of the area in which the current location is currently traveling, such as an area with many pedestrians or bicycles.

[0231] Furthermore, after labeling the acquired behavior data for each group, the data acquisition unit 212 assigns the type of each labeled running environment to each group and outputs the data to the data analysis unit 213. Note that the data acquisition unit 212 may acquire behavior data to which the running environment has already been labeled from the information processing system 10. In this case, the information processing device 100 of the information processing system 10 labels the collected behavior data with the type of predetermined running environment in accordance with the type of predetermined running environment.

[0232] Furthermore, the data acquisition unit 212 may acquire behavior data that has been labeled with a type of driving environment in advance from the information processing system 10. In this case, the information processing system 10 performs labeling of the type of driving environment when collecting the behavior data. Also, in this case, each piece of behavior data has driving environment type information that indicates the type of the labeled driving environment.

[0233] (Sound effect optimization output condition specification process based on driving environment) The data analysis unit 213 determines the type of driving environment for specifying the optimized output conditions for sound effects based on the input operation instructions and the instruction to execute the specific process. As in the first embodiment, the data analysis unit 213 works in conjunction with the data acquisition unit 212 to set reference data for behavior analysis and sound effect output control data for behavior analysis for each selected group, and to control the sound effect output based on these. In particular, the data analysis unit 213 sets sound effect output control data for behavior analysis based on the behavior data labeled for the determined driving environment, and to control the sound effect output based on these.

[0234] Furthermore, the data analysis unit 213 repeats the process of setting sound effect output control data for behavior analysis and the process of sound effect output control based on the data, along with the behavior data acquisition process in the data acquisition unit 212, and executes a specification process to specify provisional output conditions for sound effects corresponding to the determined driving environment. Then, when the result of the repeated execution, such as the behavior stability of a specific group, satisfies the behavior stabilization condition, the data analysis unit 213 specifies the output conditions corresponding to the repeated execution result as the optimized output conditions for sound effects.

[0235] [B1.7.4] Variation 4: Restart of sound effect optimization output condition specification process Next, a modification of this embodiment, in which the sound effect optimizing output condition specifying process is restarted, will be described.

[0236] (If better behavioral stability is obtained) The management server 20 of this embodiment may resume the output condition identification process when, while executing the output control of sound effects based on the optimized sound effect output control data, it detects that the behavior stability is higher than the behavior stability obtained by the output condition.

[0237] That is, the management server 20 stops the behavior data acquisition process, etc., when the processing result (i.e., the output conditions of a specific group of sound effects) of the repeatedly executed behavior data acquisition process, etc., by the sound effect optimization output condition identification process, satisfies a preset behavior stabilization condition. Furthermore, the management server 20 executes an output condition fixing control process, which is a control for fixing the output conditions of sound effects to the optimal output conditions (i.e., the sound effect optimization output conditions) identified when the behavior data acquisition process, etc. was stopped, to stimulate the driver's hearing. Then, the management server 20 acquires behavior data based on the output condition fixing control process, and resumes the sound effect optimization output condition identification process when the behavior stability obtained by the acquired behavior data satisfies a given first special output condition.

[0238] Specifically, when the data analysis unit 213 identifies the sound effect optimization output conditions, it provides sound effect output control data (optimized sound effect output control data) based on the optimized output conditions to the information processing system 10 of the target vehicle 1 as an output condition fixing control process.

[0239] Furthermore, the data acquisition unit 212 acquires the latest behavior stability of the vehicle 1 from a database (not shown) or the like, and stores it in the driver data storage unit 243. Then, the data analysis unit 213 calculates an index value indicating the behavior stability of the vehicle 1 from the behavior data based on the sound effect optimization output condition acquired from the information processing system 10, and compares the calculated index value with the acquired latest behavior stability. Then, when the first special output condition is met, that is, the latest behavior stability is a value indicating higher behavior stability than the calculated index value, the data analysis unit 213 resumes the sound effect optimization output condition identification process.

[0240] For example, the latest behavior stability of the vehicle 1 may be obtained by a sound effect optimization output condition specification process executed at a timing different from the timing at which the index value of the comparison target was calculated, such as the latest timing. Also, for example, the latest behavior stability of the vehicle 1 may be obtained by a sound effect optimization output condition specification process executed for a vehicle or group different from the vehicle or group to which the vehicle was assigned when the index value of the comparison target was calculated.

[0241] When the sound effect optimization output condition specification process is resumed, the output condition specification process including the behavior data acquisition process and the resetting of the sound effect output control data for behavior analysis is repeatedly executed. In particular, the output condition specification process including the behavior data acquisition process and the resetting of the sound effect output control data for behavior analysis in this case is the same as in the above embodiment, so a description thereof will be omitted. However, in this case, it is preferable to use a condition different from the behavior stabilization condition before the restart.

[0242] Furthermore, in this modified example, unlike the above, the sound effect optimization output condition specification process may be resumed based on an instruction from the app or an operation instruction from the driver, etc. In this case, for example, the data analysis unit 213 resumes the sound effect optimization output condition specification process when a predetermined period has elapsed since the storage date and time of the stored optimized output conditions, when the driver characteristics have changed, or when the driving environment has changed.

[0243] (When behavior stability based on sound effect optimization output conditions decreases) The management server 20 of this embodiment may resume the output condition identification process when a decrease in behavior stability based on the sound effect optimization output condition is detected while executing sound effect output control based on the optimized sound effect output control data.

[0244] In particular, when the behavior stability obtained from the behavior data collected based on the output condition fixing control process satisfies a given second special output condition, the management server 20 determines that the behavior stability based on the sound effect optimization output condition has decreased and resumes the sound effect optimization output condition identification process.

[0245] Specifically, as in the above-described modified example, when the data analysis unit 213 resumes the sound effect optimization output condition identification process, it provides sound effect output control data (optimized sound effect output control data) based on the optimized output conditions to the information processing system 10 of the target vehicle 1 as an output condition fixing control process.

[0246] Furthermore, the data acquisition unit 212 stores the behavior stability based on the sound effect optimization output condition in the driver data storage unit 243. Then, the data analysis unit 213 calculates an index value indicating the behavior stability of the vehicle 1 based on the behavior data acquired from the information processing system 10, and compares the calculated index value with the stored behavior stability. Then, when the calculated index value indicates a lower behavior stability than the stored behavior stability and the second special output condition is met, the data analysis unit 213 resumes the output condition identification process.

[0247] When the sound effect optimization output condition specification process is resumed, the output condition specification process including the behavior data acquisition process and the resetting of the sound effect output control data for behavior analysis is repeatedly executed. In particular, the output condition specification process including the behavior data acquisition process and the resetting of the sound effect output control data for behavior analysis in this case is the same as in the above embodiment, so a description thereof will be omitted. However, in this case, it is preferable to use a condition different from the behavior stabilization condition before the restart.

[0248] [B1.7.5] Other variations In this embodiment, the optimized output conditions for sound effects are provided to a specific driver, but may be shared among a plurality of drivers, including other drivers.

[0249] In this embodiment, an index value indicating the behavior stability of a specific group is used as the result of repeated execution of the output condition specification process, but the number of times the output condition specification process is performed may also be used.

[0250] In this embodiment, the stabilization condition is satisfied when the behavior stability converges to a specific value by repeatedly executing the behavior data acquisition process, and the output condition at that time may be specified as the optimized output condition. In this case, the convergence to the specific output condition may be detected not only when the specific group specified at that time is detected to be replaced multiple times, but also when the convergence to the specific output condition is detected.

[0251] [B2] Second embodiment [B2.1] Driver assistance network system Next, an overview of the driving assistance network system S of this embodiment and the sound effect optimization output condition specification process of this embodiment will be described with reference to Fig. 13. Fig. 13 is a diagram for explaining the sound effect optimization output condition specification process of this embodiment.

[0252] The driving assistance network system S of this embodiment is characterized in that it executes an optimization condition specification process that specifies the optimized output conditions for sound effects based only on the behavior data of a specific driver. That is, the driving assistance network system S of this embodiment is a system that specifies the optimized output conditions for sound effects based only on the behavior data of an individual driver, instead of the first embodiment, which specifies the optimized output conditions for sound effects based on the behavior data of multiple drivers. The management server 20 of this embodiment has a configuration that executes the process related to this characteristic point.

[0253] In particular, the management server 20 of this embodiment executes a behavior data acquisition process for acquiring each behavior data collected for a specific vehicle 1 based on the type (i.e., data type) of sound effect output control data for behavior analysis, including behavior analysis reference data, as shown in Fig. 13. For example, as shown in Fig. 13, the management server 20 executes the behavior data acquisition process after passing through a predetermined section. Furthermore, as shown in Fig. 13, upon acquiring each behavior data, the management server 20 sets new sound effect output control data for behavior analysis, with different output conditions for each data type, based on the acquired behavior data of each data type. Then, as shown in Fig. 13, the management server 20 further provides the set sound effect output control data for behavior analysis to the information processing system 10 of the specific vehicle 1 as the sound effect output control process, executes a behavior data acquisition process for acquiring each behavior data, and repeatedly repeats these processes.

[0254] Furthermore, as shown in Fig. 13, the management server 20 performs an output condition identification process in which it compares the behavior stability of each data type obtained from the behavior data to identify a provisional optimal output condition for the sound effect, and identifies the data type for which the output condition is set. Then, as shown in Fig. 13, the management server 20 executes a determination process in which it determines whether the output condition for the sound effect of a specific data type satisfies a predetermined behavior stabilization condition. At this time, if the determination process determines that the provisional optimal output condition for the specific data type satisfies the behavior stabilization condition, the management server 20 identifies the output condition as a sound effect optimization output condition.

[0255] As in the first embodiment, the management server 20 is configured to repeatedly execute a sound effect output control process and a behavior data acquisition process based thereon while changing the sound effect output conditions and data type, and then execute an output condition identification process, ultimately identifying the optimal sound effect output conditions.

[0256] As shown in FIG. 13, after passing through the behavior analysis section, each information processing system 10 collects behavior data indicating the vehicle behavior based on the sound effects played while traveling through the behavior analysis section and provides the collected data to the management server 20.

[0257] Furthermore, when the sound effect optimization output conditions are identified as described above, the management server 20 provides optimized sound effect output control data to the information processing system 10, as shown in Fig. 13. Then, the information processing system 10 plays back sound effect data based on the optimized sound effect output control data in the applicable section, and outputs predetermined sound effects inside the vehicle 1, as shown in Fig. 13.

[0258] With this configuration, the management server 20 of this embodiment or the driving assistance network system S including it can automatically identify the optimal output conditions for the driver, such as the optimal output timing, type of sound, or tone of sound effects that will increase behavior stability, as in the first embodiment.

[0259] The driving assistance system of this embodiment can appropriately stimulate the driver's hearing so as to increase the driver's behavioral stability by simply providing the driver with the automatically identified sound effect output conditions.

[0260] The driving assistance network system S of this embodiment has the same configuration as the first embodiment except for the above-mentioned features, and therefore the same components are given the same reference numerals and their description is omitted. Also, for the following items, differences from the first embodiment will be mainly described. In particular, the information processing system 10 of this embodiment has the same configuration and operation as the first embodiment except for using a plurality of different behavior analysis sound effect output control data, and therefore its description is omitted.

[0261] [B2.2] Data acquisition processing and sound effect output control processing Next, a data acquisition process and a sound effect output control process, which are processes executed by the management server 20 of this embodiment and include setting of sound effect output control data for behavior analysis, will be described.

[0262] (Data acquisition processing and sound effect output control processing) Unlike the first embodiment, the management server 20 of this embodiment repeatedly executes a data acquisition process and a sound effect output control process, including setting sound effect output control data for behavior analysis, for each individual driver, and executes an output condition specification process to specify provisional output conditions for sound effects.

[0263] Specifically, similar to the first embodiment, the data analysis unit 213 sets a plurality of sound effect output control data for behavior analysis, each of which has different output conditions, as reference data for behavior analysis, which is data that specifies predetermined output conditions for sound effects.

[0264] On the other hand, the data providing processing unit 214 provides the behavior analysis reference data having different output conditions to the information processing system 10 mounted on the vehicle 1 driven by the same driver. Then, the data acquiring unit 212 acquires the behavior data collected based on the respective behavior analysis reference data as a data acquiring process.

[0265] In addition, the data analysis unit 213 calculates an index value of behavior stability based on each behavior data, and sets sound effect output control data for behavior analysis having new output conditions based on the index value calculated for each type of reference data for behavior analysis.

[0266] Then, as sound effect output control processing, the data providing processing unit 214 provides the information processing system 10 of the same driver with sound effect output control data for behavior analysis, which includes data on the new output conditions. That is, the data providing processing unit 214 provides the sound effect output control data for behavior analysis to the information processing system 10, thereby causing the information processing system 10 to control the output of sound effects based on the sound effect output control data for behavior analysis.

[0267] As in the first embodiment, there is no change to the sound effect output control data for behavior analysis having provisional optimized output conditions, so the data providing processing unit 214 may control the output of sound effects in accordance with the sound effect output control data for behavior analysis that has already been provided.

[0268] Also, as in the first embodiment, if there is no change to the sound effect output control data for behavior analysis having provisional optimized output conditions, the data providing processing unit 214 may control the output of sound effects in accordance with the sound effect output control data for behavior analysis that has already been provided to the information processing system 10.

[0269] (Processing in information processing systems) When collecting behavior data based on a plurality of sound effect output control data for behavior analysis having different output conditions, including behavior analysis reference data, the information processing system 10 changes the collection timing and executes sound effect output control based on the sound effect output control data for behavior analysis. Furthermore, when collecting behavior data, the information processing system 10 acquires the behavior data with an ID or name attached thereto for identifying the used sound effect output control data for behavior analysis.

[0270] (When there is insufficient behavior data) If the number of behavior data acquired by the data acquisition process is insufficient, the data analysis unit 213 may control the information processing system 10 to execute a process for acquiring additional behavior data.

[0271] In particular, when behavior data based on a plurality of different sound effect output control conditions is acquired from an individual driver, it is difficult to secure a sufficient number of data in a short time compared to acquiring data from a plurality of drivers. For this reason, if the number of behavior data is insufficient, the driver often cannot accurately identify the optimized sound effect output conditions for stabilizing the behavior of the vehicle 1. As a result, even if driving assistance is provided using sound effects, the behavior of the vehicle 1 cannot be sufficiently stabilized.

[0272] Therefore, when the data analysis unit 213 of this embodiment identifies the provisional output conditions for the sound effect, if the number of data items in the behavior data is insufficient, the data analysis unit 213 may execute a process for acquiring additional behavior data.

[0273] Specifically, when setting the sound effect output control data for behavior analysis, the data analysis unit 213 detects the number of pieces of behavior data for each type of reference data for behavior analysis. Furthermore, the data analysis unit 213 determines whether or not a predetermined numerical condition is satisfied for the number of pieces of behavior data for each type of reference data for dynamic analysis. For example, the data analysis unit 213 determines whether or not the number of pieces of behavior data for each type of reference data for behavior analysis is equal to or greater than a certain number.

[0274] At this time, if the data analysis unit 213 determines that the number of behavior data does not satisfy the numerical condition for at least any type of sound effect output control data for behavior analysis, it instructs the information processing system 10 to additionally collect behavior data of the type of sound effect output control data for behavior analysis that corresponds to the type of sound effect output control data for behavior analysis. Furthermore, for the type of sound effect output control data for behavior analysis that satisfies the above-mentioned numerical condition, the data analysis unit 213 executes setting of sound effect output control data for behavior analysis without additional collection, as described above.

[0275] When an instruction to additionally collect behavior data is given, the information processing system 10 executes additional collection of behavior data for the corresponding type of behavior analysis sound effect output control data.

[0276] On the other hand, if the data analysis unit 213 determines that the number of data items of behavior data does not satisfy the above-mentioned numerical condition for at least any type of behavior analysis sound effect output control data, it may execute a process of correcting the behavior stability obtained from the behavior data that has already been acquired.

[0277] In this case, if each behavior data is labeled based on the type of driving environment, the data analysis unit 213 can correct each behavior data or the behavior stability obtained from each behavior data according to the labeling for the type of behavior analysis sound effect output control data with a small number of data.

[0278] For example, since the behavior stability of the vehicle 1 during rain is often lower than that of the vehicle during fine weather, the data analysis unit 213 corrects the behavior stability value to be higher than that of the behavior data during fine weather.

[0279] [B2.3] Operation of this embodiment (operation of management server) Next, the operation of the sound effect optimization output condition specification process executed by the management server 20 of this embodiment will be described with reference to Fig. 14 and Fig. 15. Fig. 14 and Fig. 15 are flowcharts showing the operation of the sound effect optimization output condition specification process executed by the management server 20 of this embodiment.

[0280] This operation is executed only for one driver (i.e., a specific driver) and the information processing system 10 installed in the vehicle 1 driven by that driver. In this operation, it is assumed that the specific driver has started driving the vehicle 1, and that the information processing system 10 controls the output of a predetermined sound effect when auditory stimulation is to be performed while the vehicle 1 is traveling in a predetermined section.

[0281] First, when the data analysis unit 213 receives an instruction for a sound effect optimization output condition specification process, such as an operation instruction from a specific driver or an instruction from an app (step S301), it sets a predetermined number of reference data for behavior analysis to be provided to the specific driver (step S302).

[0282] Next, the data providing processing unit 214 transmits each set of behavior analysis reference data to the information processing system 10 of the vehicle 1 driven by the specific driver (step S303). Note that the data providing processing unit 214 may transmit the behavior analysis reference data to the information processing system 10 of the vehicle 1 driven by another driver, or may set the information processing system 10 to transmit the behavior analysis reference data in accordance with a rule predetermined by an app or the like.

[0283] Next, the data acquisition unit 212 starts acquiring the behavior data transmitted from the information processing system 10 (step S304). In particular, the data acquisition unit 212 may receive all of the behavior data groups for a predetermined section at once for each behavior analysis reference data, or may receive each behavior data individually.

[0284] Next, the data acquisition unit 104 determines whether or not all of the behavior data after passing through a predetermined section based on each of the behavior analysis reference data has been received (step S305). At this time, if the data acquisition unit 204 determines that all of the behavior data after passing through a predetermined section based on each of the behavior analysis reference data has been received, the data acquisition unit 204 proceeds to the process of step S307. On the other hand, if the data acquisition unit 204 determines that all of the behavior data has not been received, the data acquisition unit 204 waits for a predetermined time (step S306) and executes the process of step S305 again.

[0285] Next, the data acquisition unit 104 determines whether the number of data pieces of the acquired behavior data is the required number of data pieces for each behavior analysis reference data (step S307). At this time, if the data acquisition unit 104 determines that the number of data pieces of the behavior data is equal to or greater than the required number of data pieces, it proceeds to the processing of step S308, and if it determines that the number of data pieces of the behavior data is equal to or less than the required number of data pieces, it proceeds to the processing of step S304.

[0286] The data acquiring unit 104 may simply determine whether the number of acquired behavior data is equal to or greater than the required number of data. Alternatively, the data acquiring unit 104 may select valid behavior data that can be used for stability analysis based on labeling information of the driving environment (i.e., labeling information) or driver characteristic information, and determine whether the number of the selected valid behavior data is equal to or greater than the required number of data. In particular, the data acquiring unit 104 selects behavior data in a special environment, such as behavior data during rainfall or behavior data in an environment with many pedestrians or bicycles, as invalid behavior data.

[0287] Next, based on the acquired behavior data, the data analysis unit 213 calculates an index value indicating the behavior stability of the vehicle 1 for each type of reference data for behavior analysis (i.e., data type), and identifies the data type having the optimal behavior stability index value from among the multiple data types (step S308).

[0288] Next, the data analysis unit 213 determines the sound effect output conditions set in the specific reference data as provisional optimized sound effect output conditions, and determines the sound effect output conditions for analyzing the next behavior stability based on the determined provisional optimized sound effect output conditions (step S309). Note that the data analysis unit 213 determines an output condition that is "1" less than the above-mentioned predetermined number. Specifically, the data analysis unit 213 determines multiple sound effect output conditions excluding the provisional optimized sound effect output conditions.

[0289] Next, the data analysis unit 213 sets new sound effect output control data for behavior analysis that is "1" less than the above-mentioned predetermined number based on each output condition determined in the processing of step S308, including the provisional optimized output condition of the sound effect (step S310).

[0290] Next, the data provision processing unit 214 transmits the set behavior analysis sound effect output control data to each of the information processing systems 10 of the corresponding vehicles 1 (step S311).

[0291] Next, similarly to step S304, the data acquisition unit 212 starts acquiring the behavior data transmitted from each information processing system 10 (step S312).

[0292] Next, the data acquisition unit 104 determines whether or not all of the behavior data after passing through the predetermined section based on each of the behavior analysis reference data has been received (step S313), similar to the process of step S305. If the data acquisition unit 204 determines that all of the behavior data after passing through the predetermined section based on each of the behavior analysis sound effect output control data has been received, the data acquisition unit 204 proceeds to the process of step S314. If the data acquisition unit 204 determines that all of the behavior data has not been received, the data acquisition unit 204 executes the process of step S312 again after a predetermined time has elapsed (step S314).

[0293] Next, the data acquisition unit 104 determines whether the number of data pieces of the acquired behavior data is the required number of data pieces for each behavior analysis reference data (step S315). At this time, if the data acquisition unit 104 determines that the number of data pieces of the behavior data is equal to or greater than the required number of data pieces, it proceeds to the processing of step S316, and if it determines that the number of data pieces of the behavior data is equal to or less than the required number of data pieces, it proceeds to the processing of step S302.

[0294] Next, similarly to step S308, the data analysis unit 213 calculates an index value indicating the behavior stability of the vehicle 1 for each data type based on the acquired behavior data, and identifies a specific data type (step S316).

[0295] Next, the data analysis unit 213 determines whether the index value indicating the behavior stability of the specific data type satisfies a predetermined behavior stabilization condition (step S317). If the data analysis unit 213 determines that the index value of the behavior stability of the specific data type satisfies the behavior stabilization condition, the data analysis unit 213 proceeds to the processing of step S318. If the data analysis unit 213 determines that the index value does not satisfy the behavior stabilization condition, the data analysis unit 213 proceeds to the processing of step S309.

[0296] Next, the data analysis unit 213 specifies the output conditions of the sound effects set in the specific behavior analysis sound effect output control data as the optimized output conditions (step S318), and ends this operation.

[0297] When providing driving assistance based on the auditory stimulation of a specified driver, the data providing processing unit 214 transmits optimized sound effect output control data to the corresponding information processing system 10 for controlling the output of sound effects based on the optimized output conditions identified by the processing of step S318.

[0298] In addition, when the information processing system 10 of a specified driver receives the optimized sound effect output control data transmitted from the management server 20, it plays sound effect data based on the received optimized sound effect output control data while driving in the applicable section, and outputs the specified sound effect inside the vehicle 1.

[0299] [B2.4] Variations This embodiment can be applied to various modifications in the same way as the first embodiment, and therefore the description of each modification will be omitted.

[0300] [C] Other The embodiments of the present disclosure are not limited to those described in the above embodiments, and various modifications are possible. For example, terms cited in the description of the specification or drawings as broadly defined or synonymous terms can be replaced with broadly defined or synonymous terms in other descriptions of the specification or drawings.

[0301] The embodiments of the present disclosure include configurations that are substantially the same as the configurations described in the above embodiments (for example, configurations with the same function, method, and result, or configurations with the same purpose and effect). The embodiments of the present disclosure also include configurations in which non-essential parts of the configurations described in the above embodiments are replaced. The embodiments of the present disclosure also include configurations that achieve the same effects or purposes as the configurations described in the above embodiments. The embodiments of the present disclosure also include configurations in which publicly known technology is added to the configurations described in the above embodiments.

[0302] Although the embodiments of the present disclosure have been described in detail as above, it will be readily apparent to those skilled in the art that many modifications are possible without substantially departing from the novel features and effects of the present invention. Therefore, all such modifications are intended to be included within the scope of the embodiments of the present disclosure. [Explanation of symbols]

[0303] S: Driver assistance network system 1: Vehicle 10: Information Processing Systems 11: Vehicle behavior measurement device 13: Vehicle surroundings detection device 15: Weather information detection device 17: Vehicle position information detection device 19: Sound output device 20: Management Server 40: Vehicle control device 100: Information processing device 104: Data acquisition unit 110: Processing section 111: Communication control unit 112: Input reception processing unit 113: Data processing section 114: Output control section 119: Timer management unit 120: Operation input section 122:Detection unit 140: Storage section 141: Main memory 142: Data storage unit 150: Information storage medium 170: Communications Department 204: Data acquisition unit 210: Processing section 211: Communication control unit 212: Data acquisition unit 213: Data Analysis Department 214: Data provision processing unit 219: Timer management unit 240: Storage section 241: Main memory 242: Data storage unit 243: Driver data storage unit 250: Information storage medium 270: Communications Department

Claims

1. In a driving assistance system that assists a driver who drives a vehicle, one or more processors; and one or more memories communicatively coupled to the one or more processors; the processor: executes a data acquisition process for acquiring data indicating a behavior of the vehicle as behavior data while the vehicle is traveling at least in a predetermined section; a sound effect output control process for outputting a sound effect according to a behavior stability obtained from the behavior data in the predetermined section after the vehicle has passed through the predetermined section, and for executing control to stimulate the sense of hearing of the driver; a driving assistance system that repeatedly executes the data acquisition process and the sound effect output control process while changing the output conditions of the sound effect, and, when the results of the repeatedly executed data acquisition process and the sound effect output control process satisfy preset setting conditions, executes a specification process that specifies the output conditions corresponding to the results as optimal output conditions.

2. the processor: executes an information acquisition process for acquiring driver characteristic information indicating the characteristics of the driver; The driving assistance system according to claim 1 , wherein the identifying process identifies the optimum output condition for a predetermined driver characteristic.

3. the processor: executes an information acquisition process for acquiring information on the driving environment of the vehicle; The driving assistance system according to claim 1 , wherein the specifying process specifies the optimum output condition for a predetermined driving environment.

4. the processor: The driving assistance system according to claim 1 , wherein the output conditions include at least one of conditions regarding output timing, number of times of output, tone, volume, length, and tempo of the sound effect.

5. the processor: When the results of the repeatedly executed data acquisition process and sound effect output control process satisfy a preset condition by the specifying process, the sound effect output control process and the data acquisition process are stopped; executing, as an output condition fixing control process, control for fixing the output condition of the sound effect to the optimal output condition identified when the sound effect output control process and the data acquisition process are stopped, to stimulate the sense of hearing of the driver; 2. The driving assistance system according to claim 1, wherein the behavior data is acquired based on the output condition fixing control process, and the specific process is resumed when the behavior stability obtained from the acquired behavior data satisfies a given special output condition.

6. the processor: The driving assistance system according to claim 5 , wherein when the specific processing is resumed, a setting condition different from the setting condition before the resumption is used.

7. the processor:

2. The driving assistance system according to claim 1, wherein, when the number of behavior data acquired by the data acquisition process is insufficient, control is executed to acquire additional behavior data, or a process is executed to correct behavior stability obtained from already acquired behavior data.

8. In a vehicle equipped with a driving assistance device that assists a driver who drives the vehicle, The driving assistance device executes a data acquisition process for acquiring data indicating a behavior of the vehicle as behavior data while the vehicle is traveling at least in a predetermined section; a sound effect output control process for outputting a sound effect according to a behavior stability obtained from the behavior data in the predetermined section after the vehicle has passed through the predetermined section, and for executing control to stimulate the sense of hearing of the driver; The vehicle repeatedly executes the data acquisition process and the sound effect output control process while changing the output conditions of the sound effect, and when the results of the repeatedly executed data acquisition process and the sound effect output control process satisfy preset setting conditions, executes a specification process to specify the output conditions corresponding to the results as optimal output conditions.

9. A recording medium on which a computer program applied to a driving assistance system that assists a driver who drives a vehicle is recorded, On the computer, executing a data acquisition process for acquiring data indicating a behavior of the vehicle as behavior data while the vehicle is traveling at least in a predetermined section; a sound effect output control process is executed to output a sound effect according to a behavior stability obtained from the behavior data in the predetermined section after the vehicle has passed through the predetermined section, and to execute control to stimulate the hearing of the driver; A recording medium having a computer program recorded thereon, the computer program repeatedly executes the data acquisition process and the sound effect output control process while changing the output conditions of the sound effects, and when the results of the repeatedly executed data acquisition process and the sound effect output control process satisfy preset setting conditions, executes a specific process that specifies the output conditions corresponding to the results as optimal output conditions.

10. A driving assistance method for assisting a driver who drives a vehicle, comprising: The computer executes a data acquisition process for acquiring data indicating a behavior of the vehicle as behavior data while the vehicle is traveling at least in a predetermined section; a sound effect output control process for outputting a sound effect according to a behavior stability obtained from the behavior data in the predetermined section after the vehicle has passed through the predetermined section, and for executing control to stimulate the sense of hearing of the driver; a driving assistance method including: repeatedly executing the data acquisition process and the sound effect output control process while changing the output conditions of the sound effect; and, when the results of the repeatedly executed data acquisition process and the sound effect output control process satisfy predetermined setting conditions, executing a specification process to specify the output conditions corresponding to the results as optimal output conditions.

Images