Driver assistance systems and driver assistance programs
The driver assistance system enhances user engagement and safety by dynamically adjusting character interactions based on intimacy levels, addressing the issue of monotonous expressions in existing systems.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- YUPITERU CORP
- Filing Date
- 2026-01-27
- Publication Date
- 2026-06-09
AI Technical Summary
Existing driver assistance systems fail to maintain a strong emotional connection with drivers, leading to boredom and reduced effectiveness in encouraging safe driving due to monotonous character expressions and gestures.
A driver assistance system that adjusts character expressions and interactions based on intimacy levels, utilizing multiple sensory outputs and dynamic communication modes to enhance user engagement and empathy.
The system maintains a high level of emotional connection with drivers, encouraging safe driving by varying character interactions and providing tailored notifications, thereby preventing boredom and improving driving behavior.
Smart Images

Figure 2026094110000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a driving support system and a driving support program for supporting a driver's driving.
Background Art
[0002] There has been proposed a driving support system that supports a driver's driving by having a character displayed on a display screen communicate with the driver. For example, in Patent Document 1, there has been proposed a driving support system that supports a driver's driving by changing the expression and gesture of a character displayed on a display screen according to the state of the vehicle. In this driving support system, for example, when the driver drives roughly, the expression of the character displayed on the display screen is changed to make the character angry or sad. The driver sees the angry or sad look of the character and becomes aware that they have been driving roughly, and changes their driving method. On the other hand, when the driver drives carefully and gently, the driving support system changes the expression of the character displayed on the display screen to make the character happy or energetic. The driver feels reassured seeing the happy or energetic look of the character and continues to drive safely. Thus, the driving support system described in Patent Document 1 encourages the driver to drive safely by utilizing the emotions of the driver being careful not to make the character unhappy or wanting to please the character.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In order for drivers to feel a strong desire to avoid offending the character or to please them, it is necessary to make the driver strongly empathize with the character. However, in the system described in Patent Document 1, for example, the character's facial expressions are uniformly determined according to the driver's driving style, whether the driver is driving roughly or carefully. As a result, the character's facial expressions and gestures displayed on the screen are monotonous and lack variation, making it easy for drivers to become bored with communicating with the character. Consequently, the state of strong emotional empathy for the character does not last, and eventually, even if the character's facial expressions or gestures change, the driver will feel nothing. As a result, the driver assistance system has the problem of failing to encourage safe driving.
[0005] The object of the present invention is to provide a driver assistance system and a driver assistance program that can encourage drivers to continue safe driving by maintaining a strong emotional connection with the characters. [Means for solving the problem]
[0006] A first aspect of the present invention is a driving assistance system that supports the user's driving by outputting character information, wherein the character communicates with the user and assists the user's driving, and the system determines the expression mode corresponding to the intimacy level by referring to a storage unit that stores information indicating the expression mode of the communication for each level of intimacy level identified based on the driving state of the vehicle, outputs the character information so that the character communicates with the user in the expression mode, and outputs the character information in the expression mode determined based on the intimacy level so that the character's intimacy with the user changes according to the user's driving state.
[0007] According to the first embodiment, the driver assistance system allows the user to recognize living beings such as people and animals as characters by outputting character information to the user. The character information is output from the driver assistance device using various methods that appeal to the user's five senses (sight, hearing, touch, taste, and smell). For example, the output of character information may be performed by displaying an image of the character on a display unit (such as a screen). Alternatively, the output of character information may be performed by outputting the character's voice from an audio output unit (such as a speaker). This enables communication in which the character notifies the user of information.
[0008] In the driver assistance system, the way in which the character communicates changes according to the degree of intimacy between the user and the character. This strengthens the user's emotional connection with the character, making the user feel as if the character is a real person. In order to maintain and further increase the high level of intimacy between the user and the character, the user will readily respond to the character's prompts for safe driving and actively strive to drive safely. In this way, the driver assistance system can prevent the user from becoming bored with communicating with the character by maintaining a high level of emotional connection with the character, and can continuously encourage the user to drive safely.
[0009] In a first embodiment, the system includes a function for detecting the state of the vehicle, and the storage unit stores information indicating the mode of expression of the communication for each level of intimacy and for each state of the vehicle. The storage unit determines the mode of expression corresponding to the level of intimacy and the state of the vehicle, and outputs the character information so that the character communicates with the user in the mode of expression.
[0010] For example, a driver assistance system could identify appropriate notifications based on the vehicle's condition and notify the user via a character. For instance, the system could alert the driver based on their speed and guide them to drive carefully, avoiding sudden steering or braking. This allows the driver assistance system to provide appropriate warnings for optimal safe driving, tailored to the vehicle's condition.
[0011] In the first embodiment, the system has a function to identify the location of the vehicle, and by referring to a storage unit that stores the location information of the traffic monitoring device, the location of the traffic monitoring device is identified, and the character information is output so that information showing the relationship between the identified location of the traffic monitoring device and the location of the vehicle is notified to the user by the character.
[0012] Users can recognize the locations of traffic monitoring devices through communication with a character. Traffic monitoring devices are often installed in areas prone to traffic accidents or in locations where accidents have occurred in the past. Therefore, by notifying users of information regarding the locations of traffic monitoring devices, the driver assistance system can help users recognize accident-prone areas and encourage them to drive especially safely in such locations.
[0013] In the first embodiment, it is preferable to determine whether the vehicle is approaching the traffic monitoring device by receiving radio waves transmitted from the traffic monitoring device, and to output character information so that the user is notified by the character when the vehicle is approaching the traffic monitoring device.
[0014] Through communication with a character, users can recognize the presence of a traffic monitoring device near their vehicle. Traffic monitoring devices are often installed in areas prone to traffic accidents or in locations where accidents have occurred in the past. Therefore, by notifying the user that a traffic monitoring device is near their vehicle, the driver assistance system can help users recognize accident-prone areas and encourage them to drive especially safely in such locations.
[0015] In the first embodiment, the system is equipped with a function to output information to assist the user's driving in a manner other than outputting the character information, and has a character mode for outputting the character information and a non-character mode for not outputting the character information, and the system switches between the character mode and the non-character mode based on the detection of a predetermined switching operation.
[0016] The user can instantly switch between character mode and non-character mode. This feature is particularly useful when the user does not want other users to know that the driver assistance system is operating in character mode. In such cases, the user will want to switch from character mode to non-character mode immediately.
[0017] In the first embodiment, when character information is output by outputting the character's voice from a speaker, the character's voice may be muted based on the detection of a predetermined operation. The user can immediately mute the character's voice. This function is particularly effective when the user does not want other users to hear the character's voice. In such cases, the user wants to mute the character's voice with a simple operation.
[0018] In a first embodiment, the driver assistance system may determine the vehicle's position by receiving radio waves transmitted from a regional navigation satellite, and output character information such that, when it receives radio waves transmitted from the regional navigation satellite, the character notifies the user that it has received radio waves transmitted from the regional navigation satellite.
[0019] For example, if the driver assistance system acquires the regional navigation satellite "Michibiki," it would be good to notify the user via a character that "Michibiki" has been acquired. In this way, the user can understand in detail which satellites are being used by the driver assistance system to determine the vehicle's position. Because the user can learn about the specific workings of the driver assistance system in detail, they can feel more familiar with the system.
[0020] In the first embodiment, the vehicle's position is determined based on at least one of radio waves transmitted from a global navigation satellite and radio waves transmitted from a regional navigation satellite. If the vehicle's position can be determined using at least the radio waves from the regional navigation satellite, the user should be notified in a different manner than when the vehicle's position can be determined without using the radio waves from the regional navigation satellite. The user can clearly recognize at a glance whether the vehicle's position has been determined by receiving radio waves from the regional navigation satellite.
[0021] In the first embodiment, if the intimacy level is less than a first threshold, the character information is output from the first output unit, and if the intimacy level is equal to or greater than the first threshold, the character information is output from the first output unit and a second output unit separate from the first output unit. In the first embodiment, the character information includes image information and audio information, and the image information is output from the first output unit and the audio information is output from the second output unit.
[0022] When the intimacy level is low, the character's image is output, so the user hopes to quickly start an intimate communication with the character by also recognizing another form of expression (such as voice) based on the character information. The driving support system can increase the degree of empathy of the user towards the character by utilizing such user psychology.
[0023] Conversely, the first output unit may be a voice output unit, and the second output unit may be an image output unit. Then, the voice may be output from the first output unit as the character information, and the image may be output from the second output unit as the character information.
[0024] In the first aspect, the character image, which is the character information to be displayed on the display unit, may be made different according to the timing of displaying the character image. For example, a plurality of character images may be prepared for each period. This can prevent the user from getting bored with the character image. Also, since the user will have the desire to see a new character image, the driving support system can effectively induce the user to drive safely by utilizing this emotion. For example, when the user is engaged in dangerous driving or the like, the driving support system may control so that a new character image is not displayed. Thus, the user will always be careful to drive safely.
[0025] In the first aspect, when the intimacy level is less than the second threshold value, the character image is output from the display unit as the character information, and the voice of the character is not output from the voice output unit. When the intimacy level is greater than or equal to the second threshold value, the character image and the voice of the character may be output as the character information.
[0026] When the intimacy level is low, the user cannot recognize the voice of the character, so the user has an expectation of recognizing not only the image of the character but also the voice. By taking advantage of such psychology of the user, the driving support system can increase the degree of empathy of the user towards the character.
[0027] In a first aspect, as the intimacy increases, the character information may be output in such an expression mode that the intimacy of the character with respect to the user becomes greater so that the character tries to communicate with the user. The driving support system can increase the intimacy of the character with respect to the user as the intimacy specified based on the driving state becomes higher. The user feels that the intimacy of the character is gradually increasing, so the familiarity with the character gradually increases and the user strongly empathizes with the character. The user becomes more responsive to the notifications from the character so as not to be disliked by the character. Therefore, the user responds honestly to the encouragement from the character for safe driving and starts to drive safely.
[0028] In a first aspect, the character information may be output so that the character tries to communicate in a different expression mode every time the driving support system is started. For example, the character information may be switched and output every time of startup as if the character were a real living being. As a result, the user feels as if the character were real and strongly empathizes with the character. The user becomes more responsive to the notifications from the character so as not to be disliked by the character. Therefore, the user responds honestly to the encouragement from the character for safe driving and starts to drive safely.
[0029] In the first embodiment, if the driving assistance system is activated in the early morning, the character information should be output so that the character communicates with the user in a sleepy manner. By seeing the character in a sleepy state, the user will come to feel as if the character is a real living creature. Furthermore, the user will feel sorry for waking the character. By causing the user to feel these emotions, the driving assistance system can further increase the degree of the user's empathy for the character.
[0030] In the first embodiment, if the driving assistance system is activated late at night, the character information should be output in a manner that depicts the character going to sleep, thereby communicating with the user. By seeing the character sleeping, the user will come to feel as if the character is a real living being. Furthermore, the user will develop feelings of closeness towards the character. By causing the user to feel these emotions, the driving assistance system can further enhance the degree of the user's empathy for the character.
[0031] In the first embodiment, the voice of the character and the voice of a different character, performed by the person playing the character, are stored in the memory as the expression mode. If the intimacy level is less than the third threshold, the voice of the other character is output as the character information. If the intimacy level is equal to or greater than the third threshold, the voice of the character is output as the character information.
[0032] When a user hears the voice of another character while their intimacy level is below the third threshold, they may feel a sense of relief upon hearing the voice of a different character voiced by a familiar actor, for example, if that character voiced by the same actor. At the same time, they may also want to hear the voice of the system's own character. As their intimacy level increases in this state and they become able to hear the character's voice, their emotional connection to the character increases even further compared to when they heard the character's voice from the beginning.
[0033] In the first embodiment, if the intimacy level is greater than or equal to a fourth threshold (which is greater than the third threshold), the voice of the other character may also be output. When the intimacy level increases, the user can hear both the character's voice and the voice of the other character.
[0034] In the first embodiment, the voice of the character when interacting with the first attitude and the voice of the character when interacting with the second attitude are stored in the memory as the expression modes, and when the intimacy level is less than the fifth threshold, the voice of the character in the first attitude is output as the character information, and when the intimacy level is equal to or greater than the fifth threshold, the voice of the character in the second attitude is output.
[0035] The second attitude should be a contrast to the first attitude, and ideally, it should have elements opposite to the first attitude. In particular, the first attitude should generally have a negative image, and the second attitude should generally have a positive image. In this way, when the level of intimacy exceeds a certain threshold, the attitude will suddenly change, and the gap in that attitude will draw the driver in. As a result, it is possible to create and maintain an even stronger emotional connection with the character in the driver.
[0036] In the first embodiment, the first attitude may be one that is strict with the user, and the second attitude may be one that is affectionate with the user. As intimacy increases, the character's attitude will gradually become more intimate, further increasing the user's emotional connection to the character. The user will respond more readily to notifications from the character in order to avoid being disliked by the character. Consequently, the user will respond more readily to the character's prompts for safe driving and will drive safely.
[0037] In the first embodiment, if the level of intimacy is greater than or equal to the sixth threshold, which is greater than the fifth threshold, the voice of the character that speaks to the user in a strict manner may also be output. When the level of intimacy increases, the user can hear both the voice of the character speaking in a strict manner and the voice of the character speaking in a sweet manner.
[0038] In the first embodiment, when the user performs an operation to set the conditions for outputting the character information, the operation may be accepted only if the intimacy level is equal to or greater than the seventh threshold, and the operation may not be accepted if the intimacy level is less than the seventh threshold. The user will not be able to set the conditions for outputting the character information unless the intimacy level is above a certain level. The user will expect to be able to input conditions when the intimacy level is below a certain level. By making the user wait in this way, the driving assistance system can increase the degree to which the user empathizes with the character.
[0039] In a first embodiment, the driver assistance system operates in either a character mode that outputs the character information or a non-character mode that does not output the character information, and only when operating in character mode, it accepts an operation to set the conditions for outputting the character information via the setting screen. The user can use the driver assistance system by switching between character mode and non-character mode. Furthermore, since the user can set the conditions for outputting character information only when the driver assistance system is operating in character mode, it is possible to prevent the conditions for outputting character information from being accidentally changed when operating in non-character mode.
[0040] In the first embodiment, a setting screen for setting the operating conditions of the driver assistance system is displayed on the display unit, and the setting screen may include a selection operation unit that is selected first when setting the conditions for outputting the character information. The user can clearly recognize at a glance the operation for setting the conditions for outputting the character information.
[0041] In the first embodiment, if the user performs an operation to set the conditions for outputting the character information, and the intimacy level is less than the eighth threshold, the user may be notified that the operation will not be accepted by a voice in a tone different from the character's voice tone. This allows the user to clearly recognize that the setting of the conditions has been rejected.
[0042] In the first embodiment, the user is notified that the operation is not accepted, and the functions of the driver assistance system are introduced to the user. The user can recognize the functions of the driver assistance system and learn how to configure them. Even if the user is not familiar with the functions of the driver assistance system beforehand, they can gradually become familiar with the functions while using the driver assistance system.
[0043] In the first embodiment, a wallpaper operation unit is displayed on the display unit for selecting wallpapers, the number of which can be selected increases over time, and the wallpaper selected by the user via the wallpaper operation unit is displayed on the display unit at least when the driving assistance system is started or when it is in standby mode. The user can select their preferred wallpaper and have it displayed on the display unit. As the number of available wallpapers increases over time, the user can be kept from getting bored by changing the wallpaper even if the driving assistance system is used for a long time.
[0044] In the first embodiment, a playback operation unit is displayed on the display unit for setting the system to output the voice of the character, which has been output from the voice output unit as character information, again at any time. After the system has set the system to output the voice of the character again via the playback operation unit, if the user gives an instruction to output the voice of the character that has already been output, the system will output the voice of the specified character. This allows the voice of the character that has been played back to be listened to repeatedly at any time at a later date.
[0045] In the first embodiment, a clothing operation unit for selecting the clothing of the character, which is indicated by an image of the character displayed on the display unit as character information, is displayed on the display unit, and after the clothing is selected via the clothing operation unit, an image of the character wearing the selected clothing is displayed on the display unit.
[0046] Users will be able to display characters wearing their preferred clothing on the screen. This allows users to switch the character's appearance as they wish, further increasing their emotional connection to the character. Furthermore, the driving assistance system will be able to display the character in various ways, keeping the user engaged.
[0047] In the first embodiment, if the intimacy level is below the ninth threshold, even if the clothing is selected via the clothing operation unit, the display of the image of the character wearing the selected clothing may be prohibited with a predetermined probability. When the intimacy level is low, the user may be rarely rejected even when attempting to change the character's clothing. This encourages the user to increase their intimacy level to ensure they can change the character's clothing. As a result, the user becomes more responsive to the character's notifications and more willing to follow the driver assistance system's guidance for safe driving and drive safely. Furthermore, the driver assistance system can further increase the user's emotional connection to the character by making the character behave as if it were a real living creature.
[0048] In the first embodiment, the background image of the settings screen may be changed based on the user's instructions. The background of the settings screen can be switched to a preferred state. This prevents the display from becoming monotonous and causing the user to become bored.
[0049] In the first embodiment, a mode control unit for selecting either a character mode that outputs the character information or a non-character mode that does not output the character information is displayed on the display unit, and the color of the outer frame of the mode control unit is changed according to the level of familiarity. The user can clearly recognize the mode of expression of character-based communication just by looking at the mode control unit.
[0050] In the first embodiment, an image representing the level of intimacy between the character and the user may be displayed on the display unit. This allows the user to recognize the level of intimacy between the character and the user at a glance.
[0051] In the first embodiment, the initialization operation unit for initializing the operating state is displayed on the display unit, When the operation to initialize the operating state is performed via the initialization operation unit, it is preferable to initialize the user's intimacy level. This allows the user to repeatedly experience the process of the character's intimacy level gradually increasing as the operating state is initialized.
[0052] In the first embodiment, the system includes a storage unit that stores the operating state and setting information other than the operating state. When an initialization operation is input via the initialization operation unit, the operating state is initialized, but the setting information other than the operating state is not initialized. The driving assistance system can initialize the driving state without erasing the setting information set by the user. This saves the user the trouble of repeatedly setting the setting information to the driving assistance system.
[0053] In a first embodiment, location information indicating the position of the vehicle is acquired, the positional relationship between the vehicle and the target is identified based on the map information which associates the location information with the target on the map, and the acquired location information, and the character information is determined and output based on the positional relationship.
[0054] The driver assistance system can identify appropriate notifications based on the relative positions of the vehicle and the target, and notify the user via a character. For example, notifications could include alerting the user when the vehicle approaches areas prone to accidents, such as sharp curves or areas with poor visibility. It could also alert the user when the vehicle approaches an area with traffic monitoring equipment. This allows the driver assistance system to encourage safe driving in dangerous areas. Since users often develop a strong emotional connection with the character, they are likely to respond readily to notifications from the character. Therefore, the driver assistance system can effectively guide the user towards safe driving. For instance, the driver assistance system could vary the character's notifications based on the level of familiarity with the character.
[0055] In the first embodiment, the character information is output so that the character communicates with the user in different representational modes depending on the distance between the vehicle and the object. Through communication with the character, the user can easily and clearly recognize the distance between the vehicle and the object at a glance. For example, when the distance between the vehicle and a place prone to traffic accidents, such as a sharp curve or a place with poor visibility, becomes short, the character may notify the user in different modes depending on the distance. This allows the user to recognize the distance between the vehicle and a dangerous place, and to drive appropriately according to the distance.
[0056] In a first embodiment, the system has a function to detect the behavior of the vehicle, and when the detected behavior satisfies predetermined conditions, it determines and outputs character information based on the behavior. The driver assistance system can identify appropriate notifications based on the vehicle's behavior and notify the user through the character. For example, the notifications may include warnings against sudden steering, sudden braking, or sudden acceleration. This allows the driver assistance system to warn against dangerous driving and encourage calm driving. In particular, since users strongly empathize with the character, it is expected that they will readily respond to the character's notifications. Therefore, the driver assistance system can accurately guide the user to drive safely.
[0057] In a first embodiment, the system may have a function to detect acceleration applied to the vehicle, and the behavior may be determined based on the detected acceleration. The driver assistance system can determine the behavior of the vehicle based on the acceleration applied to the vehicle. For example, the driver assistance system may detect vehicle behavior such as sudden steering, sudden braking, and sudden acceleration by detecting acceleration in the longitudinal and lateral directions.
[0058] In the first embodiment, the character information is output so that the character communicates with the user in different representational modes depending on the magnitude and direction of the acceleration. The driving assistance system can specify the state of the vehicle in detail based on the magnitude and direction of the acceleration. For example, the driving assistance system can identify sudden steering, sudden braking, sudden acceleration, etc., based on the magnitude and direction of the acceleration, and provide notifications to warn the user about these. This allows the user to drive safely by being mindful of not engaging in dangerous driving in response to notifications from the character.
[0059] In the first embodiment, the character information is output in such a way that the character communicates with the user in at least one of the following ways: the character speaks to the user, or the character walks around within the display area of the display unit. This allows the user to feel a sense of familiarity with the character, further increasing the degree of the user's emotional attachment to the character. For example, the character information is output in the manner described above at times other than when output is being performed based on the positional relationship between the vehicle and the object, or when output is being performed when the acceleration meets predetermined conditions. This makes the user feel as if the character is always nearby, further increasing the degree of the user's emotional attachment to the character. For example, the character's phrases can be varied according to the level of familiarity.
[0060] In the first embodiment, if the positional relationship between the object monitoring traffic and the vehicle satisfies a predetermined relationship, the character information may be an image of the character wearing a predetermined outfit. The user can easily and clearly recognize at a glance that the positional relationship between the object monitoring traffic and the vehicle is satisfied by the change in the character's appearance. Since the object monitoring traffic is often installed in places where traffic accidents are likely to occur, the user can accurately recognize places with a high risk of traffic accidents in advance and drive with traffic safety in mind.
[0061] In the first embodiment, the character information may include the output of the character's voice to notify the user of information regarding the object being monitored for traffic. Even if the user is not looking at the driver assistance system, the user can be sure that the position of the object being monitored for traffic and the vehicle satisfy a predetermined relationship through the voice.
[0062] In a first embodiment, the system has a function to detect the vehicle's speed, acquire the speed limit at the vehicle's location, and outputs character information such that the character communicates with the user in a manner that warns them if the detected speed exceeds the acquired speed limit. The user can easily recognize that the vehicle's speed exceeds the speed limit. Because the user has a strong emotional connection to the character, the user is more likely to respond readily to the character's warning and drive safely.
[0063] In a first embodiment, the system has a function to detect the behavior of the vehicle, and when the behavior satisfies predetermined conditions, it outputs character information so that the character communicates in a manner that expresses motion sickness. For example, if a large lateral acceleration of the vehicle is detected, it may be determined that the vehicle is being driven roughly, and character information may be output in a manner that expresses motion sickness. Because the user has a high degree of empathy for the character, the user will feel sorry for the character's motion sickness and will be more inclined to drive carefully. By utilizing these user emotions, the driving assistance system can encourage the user to drive carefully.
[0064] In a first embodiment, the system has a function to detect acceleration applied to the vehicle, and if the acceleration satisfies predetermined conditions for a predetermined period of time or longer, the system outputs character information such that the character communicates with the user in an angry manner. For example, if the acceleration of the vehicle in the longitudinal or lateral directions frequently increases, the system may determine that the vehicle is being driven recklessly and output character information in an angry manner. Because the user has a high degree of emotional attachment to the character, the user will reflect on their actions in response to the character's anger and strive to drive more carefully. By utilizing these emotions of the user, the driving assistance system can encourage the user to drive carefully.
[0065] In the first embodiment, it is preferable to determine whether the user's concentration on driving has decreased, and if it is determined that the user's concentration has decreased, to output the character information so that the character communicates with the user in a manner in which the character speaks to the user. The driving assistance system can alert the user when it determines that the user's concentration on driving has decreased. This allows the user to regain their concentration and drive safely. Since the user has a high degree of emotional attachment to the character, the user will readily respond to the character's alert. For example, the character may communicate with the user in a manner that encourages them to take a break. This allows the user to take a break proactively and thereby reliably regain their concentration.
[0066] In the first embodiment, it is preferable to determine whether the vehicle's driving state is in a state of little change, and if it is determined that the state is in a state of little change, the character information is output so that the character communicates with the user in a manner in which the character speaks to the user. When the vehicle's driving state is in a state of little change, the user may be drowsy while driving. In such cases, the driving assistance system can alleviate the user's drowsiness by alerting the user. This allows the user to resume safe driving. Since the user has a high degree of emotional attachment to the character, the user will readily respond to the character's alerts. For example, the character may communicate with the user in a manner that encourages them to take a break. This allows the user to take a break and reliably regain their concentration.
[0067] In the first embodiment, the system has a function to detect the vehicle's speed, and it is preferable to determine that the vehicle is in the aforementioned state when the vehicle's speed is above a predetermined level and the range of change in the vehicle's driving state is below a predetermined level. The driving assistance system can accurately identify the user's state in a simple manner. This is because when these conditions are met, the user's concentration tends to decrease, and the user is more likely to feel drowsy.
[0068] In the first embodiment, it is preferable to determine that the vehicle is in the aforementioned state when the fluctuations in the vehicle's driving state over a predetermined period of time satisfy predetermined conditions. The driver assistance system can accurately identify the user's state in a simple manner. For example, when a user is driving normally, the driving state fluctuates frequently, so it is preferable to determine that the user is drowsy driving when these fluctuations are small.
[0069] In the first embodiment, location information of the vehicle is acquired, the road on which the vehicle is traveling is identified based on the acquired location information and map information, and if the type of road identified satisfies predetermined conditions, the character information is output so that the character communicates with the user in a manner in which the character speaks.
[0070] For example, a driver assistance system should identify whether the vehicle is traveling on a highway or elevated road. When traveling on such roads, the driving speed tends to be high, and the driving tends to become monotonous with little steering or speed change. In such cases, the driver's concentration tends to decrease, and accidents such as drowsy driving and falling asleep at the wheel are more likely to occur. In response to this, a driver assistance system can prevent traffic accidents by issuing warnings to the user, especially on such roads. Therefore, a driver assistance system can effectively prevent traffic accidents and encourage safe driving.
[0071] In the first embodiment, the vehicle's speed is acquired, and if the acquired speed meets predetermined conditions, the character information is output so that the character communicates with the user in a manner in which the character speaks to the user. When the vehicle is traveling at high speeds, even slight inattention by the user can easily lead to an accident. In response to this, the driver assistance system can warn the user, especially through the character, in such cases, thereby eliminating situations where accidents are likely to occur and preventing accidents from happening in the first place.
[0072] In a first embodiment, the system has a function to detect the acceleration applied to the vehicle, and when the detected acceleration satisfies predetermined conditions, the system outputs character information so that the character communicates with the user in a manner in which the character speaks to the user. For example, the driver assistance system may detect sudden acceleration, sudden braking, sudden steering, etc., of the vehicle from the detected acceleration. If such driving is repeated, the likelihood of the vehicle causing an accident increases. In response to this, the driver assistance system can warn the user, especially through the character, in such cases, thereby preventing the occurrence of an accident.
[0073] In the first embodiment, the character information is output in such a manner that the character communicates by repeatedly speaking at a predetermined interval. Even if the user does not notice the warning in the initial stages of the warning, repeated warnings will eventually lead the user to notice the warning and drive safely. In this way, the driving assistance system can ensure that the user recognizes the warning.
[0074] In the first embodiment, it is preferable that the content of the conversations spoken by the character repeatedly at predetermined intervals be different each time. The driving assistance system can prevent the user from becoming bored with the character by outputting character information so that the character gives warnings in different ways. As a result, the user will continue to respond to the character's warnings and be mindful of safe driving.
[0075] In the first embodiment, when the character speaks repeatedly at a predetermined interval, the volume of the character's voice may be gradually increased as the number of repetitions increases. Since the volume of the character's voice output gradually increases, even if the user does not correct their driving method in the initial stages of the warning, the user will eventually correct their driving method in response to the louder voice. In this way, the driver assistance system can reliably guide the user to drive safely.
[0076] In the first embodiment, location information indicating the position of the vehicle is acquired, and based on the acquired location information and map information, it is determined whether or not the vehicle has crossed a prefectural border. If it is determined that the vehicle has crossed a prefectural border, the character information is output so that the character notifies the user that the vehicle has crossed a prefectural border. The driving assistance system can make the user aware of roughly where the vehicle is currently traveling. By allowing the user to imagine a rough image of the destination, the driving assistance system can prevent the user from losing concentration, falling asleep at the wheel, etc.
[0077] In the first embodiment, coordinate information indicating the vehicle's position is acquired, and based on map information that associates the coordinate information with an object on the map, and the acquired coordinate information, the system determines the prefecture in which the vehicle is traveling and outputs character information so that the character notifies the user of the prefecture in which it is traveling. The driving assistance system can make the user aware of roughly where the vehicle is currently traveling. By allowing the user to imagine a rough image of the destination, the driving assistance system can prevent the user from losing concentration, falling asleep at the wheel, etc.
[0078] In the first embodiment, coordinate information indicating the position of the vehicle is acquired, and based on the map information which associates the coordinate information with an object on the map, and the acquired coordinate information, it is determined whether the distance between the vehicle and a predetermined point is within a predetermined range. If it is determined that the distance between the vehicle and the predetermined point is within a predetermined range, the character information is output to notify the user that the predetermined point is approaching.
[0079] For example, designated locations could include rest areas (PA) and service areas (SA). If the driver assistance system detects a decrease in the user's concentration or drowsiness, it should recommend that the user take a break by stopping at an SA or PA. This allows the driver assistance system to restore the user's concentration and alleviate drowsiness. Alternatively, designated locations could include sharp curves, consecutive curves, and junctions. Such places are prone to accidents due to even slight inattention. When approaching such locations, the driver assistance system should warn the user via a character, thereby suppressing decreased concentration and drowsiness in dangerous areas. This allows the driver assistance system to more effectively prevent traffic accidents.
[0080] In the first embodiment, the character information is output so that the character notifies the user of the distance from the vehicle to the predetermined point. For example, the driving assistance system may notify the user of the distance to the predetermined point specifically, for example, "km away". This allows the driving assistance system to continue to drive safely even before reaching a dangerous place where traffic accidents are likely to occur. In this way, the driving assistance system can eliminate the user's decreased concentration or drowsy driving well in advance of a place where traffic accidents are likely to occur.
[0081] In the first embodiment, the storage unit may use a storage medium that stores data indicating the representation modes when outputting the character information. By obtaining the character information from the storage medium, the representation modes of the character can be changed in various ways. This allows the driver assistance device to provide the user with new representation modes, thereby preventing the user from becoming bored with the character.
[0082] In the first embodiment, the driving state is the frequency with which the user drives the vehicle, and the intimacy level is determined based on the driving frequency. The driver assistance system can determine the intimacy level based on the driver's driving frequency. For example, the driver assistance system may set a higher intimacy level when the driving frequency is high, and a lower intimacy level when the driving frequency is low.
[0083] In the first embodiment, the driving state may be the distance traveled by the vehicle under the user's driving. The driving assistance system can determine the level of familiarity based on the distance traveled. For example, the driving assistance system may set a higher level of familiarity when the distance traveled is long, and a lower level of familiarity when the distance traveled is short.
[0084] The driving assistance program according to the second aspect of the present invention causes a computer to execute each of the functions of the driving assistance system described above. [Brief explanation of the drawing]
[0085] [Figure 1] This is a block diagram showing the electrical configuration of the driver assistance system 4. [Figure 2] This is a table to explain the display modes of the driver assistance system 4. [Figure 3] This figure shows a first example of the screen displayed in radar standby display mode. [Figure 4] This figure shows a second example of the screen displayed in radar standby display mode. [Figure 5] This figure shows an example of the screen displayed in OBD display mode. [Figure 6] This figure shows an example of the screen displayed in MAP display mode - animation mode. [Figure 7] This figure shows an example of the screen displayed in MAP display mode - live-action mode. [Figure 8] This figure shows an example of the screen displayed in MAP display mode - character mode. [Figure 9] This is a schematic diagram showing the information stored on SD card 5. [Figure 10] This is a schematic diagram showing the information stored in RAM44. [Figure 11] This is a flowchart of the main process. [Figure 12] This is a flowchart showing the periodic processing. [Figure 13] This is a flowchart showing the process of identifying the target location. [Figure 14] This is a flowchart showing the process for identifying the operating status. [Figure 15] This flowchart shows the character mode processing. [Figure 16] This figure shows an example of a logo screen displayed based on logo information 213. [Figure 17] This figure shows the first example of a still screen displayed based on still screen information 214. [Figure 18] This figure shows a second example of a static screen displayed based on static screen information 214. [Figure 19] This is a schematic diagram showing startup information 215. [Figure 20] This is a schematic diagram showing the character voice from the startup information 215. [Figure 21] This is a schematic diagram showing character information 2114. [Figure 22] This is a schematic diagram showing the voice information from character information 2114. [Figure 23] This is a schematic diagram showing character information 2124. [Figure 24] This figure shows the character images displayed in alarm display mode. [Figure 25] This figure shows the character images displayed in alarm display mode. [Figure 26] This figure shows the character images displayed in alarm display mode. [Figure 27] This figure shows the character images displayed in alarm display mode. [Figure 28] This figure shows the character images displayed in alarm display mode. [Figure 29] This is a schematic diagram showing the configuration information 23. [Figure 30] This diagram shows the transitions between settings screens. [Figure 31] This is a diagram showing the main menu screen 110. [Figure 32] This is a diagram of the screen settings screen 120. [Figure 33] This is a diagram of the screen selection screen 130. [Figure 34] This is a diagram showing the alarm display settings screen 140. [Figure 35] This is a diagram of the screen settings screen 120. [Figure 36] This is a diagram of the character settings screen 150. [Figure 37] This is a diagram showing the static screen selection screen 160. [Figure 38] This is a diagram of the clothing selection screen 170. [Figure 39] This is a diagram of the voice selection screen 180. [Figure 40] This is a diagram of the system settings screen 190. [Figure 41] This is a diagram of still image 200. [Figure 42] This is a diagram of still image 200. [Modes for carrying out the invention]
[0086] Hereinafter, one embodiment of the present invention will be described with reference to the drawings. These drawings are used to illustrate the technical features that the present invention may adopt. The configuration of the apparatus, flowcharts of various processes, etc., described are not intended to limit the invention to these, but are merely illustrative examples.
[0087] Referring to Figure 1, the overview of the driver assistance system 4 will be explained. The driver assistance system 4 is installed inside the vehicle. The driver assistance system 4 assists the driver by outputting various information. An example of the driver assistance system 4 is a radar detector. The driver assistance system 4 is equipped with a control unit 41 that performs the main control. The control unit 41 consists of a microcontroller equipped with a CPU 42, EEPROM 43, RAM 44, etc. The control unit 41 is also connected to a GPS receiver (GPS module) 45 that receives radio waves from GPS satellites, a microwave receiver (microwave receiving module) 46 that receives microwaves from radar for speed measurement, a wireless receiver (wireless receiving module) 47 that receives UHF band wireless radio waves for traffic enforcement communication, a display unit 48 consisting of a color LCD that displays various information and warning screens, a touch panel 49 provided on the surface of the display unit 48, a lamp 50 that flashes or lights up to provide notification, a speaker 51 that emits warning sounds, a card reader 52 into which an SD card 5 is inserted, an OBD connector 53 for collecting vehicle OBD information, and an acceleration sensor 54 that detects acceleration applied to the driver assistance system 4.
[0088] The control unit 41 creates information to be notified to the driver based on information input from various input devices (GPS receiver 45, microwave receiver 46, wireless receiver 47, touch panel 49, OBD connector 53, acceleration sensor 54), and outputs the information using output devices (display unit 48, lamp 50, speaker 51). These basic configurations are essentially the same as those of conventional devices. The functions of the driver assistance system 4 are realized when the CPU 42 in the control unit 41 executes firmware stored in the EEPROM 43 of the control unit 41. The firmware stored in the EEPROM 43 can be updated with new firmware stored on the SD card 5.
[0089] The main information output from the output device of the driver assistance system 4 to support the driver's driving is warning information to encourage safe driving. Warning information is output in the following cases, for example: The driver assistance system 4 calculates the distance between the location (latitude and longitude) of a target object stored as map information on the SD card 5 and the current location (latitude and longitude) of the vehicle detected by the GPS receiver 45. When the calculated distance falls below a predetermined distance, the output device outputs warning information. Also, for example, the driver assistance system 4 outputs warning information from the output device when the microwave receiver 46 detects a signal corresponding to microwaves in the frequency band emitted from a speed measuring device (a speed measuring device that emits radar waves such as a mobile radar). By outputting warning information, the driver assistance system 4 makes the driver aware of dangerous locations where traffic accidents are likely to occur. In this way, the driver assistance system 4 can encourage safe driving. The above warning information is just one example, and in reality, various other types of warning information are also output to the driver. Details will be described later.
[0090] Figure 2 shows the display modes of the driver assistance system 4. The driver assistance system 4 displays different types of screens on the display unit 48 depending on the set display mode. The driver assistance system 4 has three always-on display modes: radar standby display mode, OBD display mode, and MAP display mode. In radar standby display mode, the display unit 48 can display screens showing the time and speed (see Figure 3), GPS positioning status (see Figure 4), vehicle tilt status, acceleration applied to the vehicle, etc. In OBD display mode, the display unit 48 can display screens showing instantaneous fuel consumption, current fuel consumption, fuel flow rate, vehicle speed, coolant temperature, trip meter, national average fuel consumption, general road average fuel consumption, highway average fuel consumption, engine speed, engine load rate, throttle opening, etc. (see Figure 5). In MAP display mode, the display unit 48 can display a map of the area near the vehicle (see Figures 6 to 8).
[0091] This section describes the warning display mode, which is the display mode when warning information is output. In radar standby display mode and OBD display mode, a ticker indicating the warning information is superimposed on the screen corresponding to the respective constant display mode, and a warning sound is output from speaker 51. In contrast, in MAP display mode, the output method of the warning information can be switched to animation mode, real-life mode (hereinafter collectively referred to as non-character mode), and character mode. As shown in Figure 6, in animation mode, an animation 11 of the target object or speed measuring device is superimposed on the map 10 as warning information, and a warning sound is output from speaker 51. As shown in Figure 7, in real-life mode, a real-life image (REALPHOTO) 12 of the target object or speed measuring device is superimposed on the map 10 as warning information, and a warning sound is output from speaker 51. As shown in Figure 8, in character mode, a character 14 is displayed on the display unit 48 superimposed on the map 10. In addition, the voice of the character 14 is output from speaker 51. The driver is notified of the warning information through the behavior and voice of the character 14.
[0092] The driver assistance system 4 in this embodiment is characterized by its operation in MAP display mode - character mode (within the thick border in Figure 2). When the driver assistance system 4 operates in MAP display mode - character mode, character 14 may be displayed on the display unit 48 even when there is no need to notify the driver of warning information. Furthermore, character 14 behaves as if it were a real person and communicates with the driver by speaking to them. Character 14 also changes its behavior and voice as if its intimacy with the driver is gradually deepening. In this way, the driver assistance system 4 guides the driver to strongly empathize with character 14. In addition, character 14 outputs warning information not only for dangerous places where traffic accidents are likely to occur, but also for dangerous driving, reckless driving, driving without concentration, and drowsy driving. Drivers who have deepened their empathy with character 14 will readily respond to the character's warnings and will actively strive to drive safely. As described above, the driver assistance system 4 can develop and maintain a high level of the driver's empathy for the character 14, thereby preventing the driver from becoming bored with communicating with the character 14 and continuously encouraging the driver to drive safely.
[0093] The above-mentioned display modes (always-on display mode and alarm display mode) are merely examples, and the present invention may operate in other display modes. For example, characters may be displayed on the display unit 48 in radar standby display mode or OBD display mode.
[0094] Refer to Figure 9 for a detailed explanation of the information stored on the SD card 5. The SD card 5 stores output information 21, map information 22, and setting information 23.
[0095] Output information 21 is various types of information output from the output device. Output information 21 includes standby information 211, event information 212, logo information 213, static screen information 214, startup information 215, and setting screen information 216. Event information 212 is information output from the output device to notify the driver of various events when the vehicle status or driving status is determined to be in a predetermined state based on information input from the input device (hereinafter referred to as "event occurrence"). Standby information 211 is information output from the output device when no event has occurred (hereinafter referred to as "standby state"). Logo information 213, static screen information 214, and startup information 215 are the information initially output from the output device when the driver assistance system 4 is started in MAP display mode - character mode. Setting screen information 216 is information of the screen displayed on the display unit 48 when the driver performs a setting input operation on the driver assistance system 4.
[0096] The standby information 211 and event information 212 include image information displayed on the display unit 48 and audio information output from the speaker 51. The standby information 211 and event information 212 include multiple pieces of information depending on the always-on display mode. Specifically, the standby information 211 includes radar standby information 2111 output when operating in radar standby display mode, OBD information 2112 output when operating in OBD display mode, character information 2114 output when operating in MAP display mode - character mode, and non-character information 2115 output when operating in MAP information - non-character mode. The event information 212 includes radar standby information 2121 output when operating in radar standby display mode, OBD information 2122 output when operating in OBD display mode, character information 2124 output when operating in MAP display mode - character mode, and non-character information 2125 output when operating in MAP display mode - non-character mode.
[0097] Map information 22 is information that associates the type of target object, the latitude and longitude indicating the location of the target object, an animation or live image to be displayed on the display unit 48, and sound output from the speaker 51. Target locations include fixed speed measuring devices (including speed measuring devices that emit radar waves (microwaves) like radar and speed measuring devices that do not emit radar waves like loop coils, such as radar speed cameras, H systems, LH systems, and loop coils), speed limit change points, enforcement areas, checkpoint areas, parking violation monitoring areas, N systems, traffic monitoring systems, intersection monitoring points, red light violation prevention systems, police stations, accident-prone areas, car break-in-prone areas, sharp / continuous curves (expressways), branching / merging points (expressways), ETC lane advance notices (expressways), service areas (expressways), parking areas (expressways), parking areas (expressways), highway oases (expressways), smart interchanges (expressways), gas stations within PA / SA (expressways), tunnels (expressways), highway radio reception areas (expressways), prefectural border notices, roadside stations, viewpoint parking areas, etc.
[0098] The setting information 23 is information indicating various operating conditions for the driver assistance system 4. The control unit 41 determines the operating conditions based on the various setting information stored as setting information 23 and performs various processes based on the determined operating conditions. The setting information 23 is backed up to the EEPROM 43 when the power to the driver assistance system 4 is turned off. Also, when a new SD card 5 is inserted into the card reader 52, the setting information backed up to the EEPROM 43 is stored on the SD card 5 as setting information 23.
[0099] Referring to Figure 10, the details of the information stored in RAM 44 will be explained. RAM 44 stores the current date and time 31, vehicle position coordinates 32, mileage 33, intimacy level 34, surrounding information 35, driving status 36, OBD information 37, and event flags 38.
[0100] Current date and time 31 is information indicating the current date and time. Current date and time 31 is determined based on date and time data contained in radio signals from GPS satellites received via GPS receiver 45. Vehicle position coordinates 32 is coordinate information indicating the vehicle's position. Vehicle position coordinates 32 are determined based on radio signals from GPS satellites received via GPS receiver 45. Distance traveled 33 is information indicating the vehicle's distance traveled. Distance traveled 33 is calculated based on the history of changes in vehicle position coordinates 32. Intimacy level 34 will be described later. Surrounding information 35 is information indicating the type of target object in the vicinity of the vehicle, and the distance between the vehicle and the target object. The type of target object and the distance are determined based on map information 22 and vehicle position coordinates 32 stored on the SD card 5. Driving state 36 is information indicating the vehicle's driving state. Driving states include swerving, sudden braking, sudden acceleration, sudden right steering, sudden left steering, inattentive driving, and drowsy driving. OBD information 37 is information obtained from the vehicle via the OBD connector 53. OBD information 37 includes fuel consumption, fuel flow rate, vehicle speed, coolant temperature, engine speed, throttle opening, etc. The event flag 38 is turned ON when an event occurs.
[0101] Referring to Figures 11 to 15, the processing performed in the control unit 41 of the driver assistance system 4 will be described. The main processing starts when the control unit 41 executes the program stored in the EEPROM 43.
[0102] When the main processing starts, the control unit 41 first determines whether it has detected an operation to turn on the power of the driver assistance system 4 (S11). If it does not detect an operation to turn on the power of the driver assistance system 4 (S11: NO), the process returns to S11. If it detects an operation to turn on the power of the driver assistance system 4 (S11: YES), the control unit 41 starts a periodic interrupt process (see Figure 12) which is activated at a predetermined interval (S13).
[0103] Referring to Figure 12, the periodic processing will be explained. When the periodic processing is started in S13 (see Figure 11), the control unit 41 repeatedly executes the periodic processing at a fixed interval. The control unit 41 executes the main processing and the periodic processing in parallel. First, the control unit 41 receives radio signals transmitted from GPS satellites (S31). Based on the date and time data contained in the received radio signals, the control unit 41 identifies the current date and time (S33). The control unit 41 stores the identified current date and time as current date and time 31 (see Figure 10) in the RAM 44 (see Figure 10) (S33). The control unit 41 acquires OBD information from the vehicle via the OBD connector 53 (S35). The control unit 41 stores the acquired OBD information as OBD information 37 (see Figure 10) in the RAM 44 (S35). Next, the control unit 41 executes a process to identify the position of the target object relative to the vehicle (target position identification process, see Figure 13) (S37).
[0104] Referring to Figure 13, the target location identification process will be explained. First, the control unit 41 identifies coordinate information indicating the vehicle's position based on radio signals received from GPS satellites (S51). The control unit 41 stores the identified coordinate information in the RAM 44 as vehicle position coordinates 32 (see Figure 10) (S51). The control unit 41 refers to the map information 22 (see Figure 9) stored on the SD card 5. The control unit 41 determines whether or not there is a target object near the coordinates indicating the vehicle's position identified in S51 (S55). If there is a target object near the vehicle (S55: YES), the control unit 41 associates the type of target object with the distance between the target object and the vehicle and stores it in the RAM 44 as surrounding information 35 (see Figure 10) (S55). The process proceeds to S57. On the other hand, if there is no target object near the coordinates indicating the vehicle's position (S55: NO), the process proceeds to S57.
[0105] Next, the control unit 41 receives a signal via the microwave receiver 46 (see Figure 1) if there is a signal corresponding to microwaves in the frequency band emitted from a speed measuring device that emits radar waves, such as a mobile radar (S57). The control unit 41 also scans the frequencies of enforcement radio, car location radio, digital radio, low-power radio, police station activity radio, police telephone, police activity radio, tow truck radio, helicopter telemetry radio, fire helicopter telemetry radio, fire radio, ambulance radio, highway radio, security radio, etc. (hereinafter, these are collectively referred to as car location radio). Then, if there is a radio signal at the scanned frequency, the control unit 41 receives the signal via the radio receiver 47 (see Figure 1) (S57). The control unit 41 determines whether a signal has been received via the microwave receiver 46 or the radio receiver 47, and whether the reception level of the received signal is above a predetermined level. If the reception level of the received signal is above a predetermined level, the control unit 41 determines that the speed measuring device that output the signal, or the vehicle that outputs the car location radio (hereinafter referred to as a police emergency vehicle), is in the vicinity of the vehicle (S59: YES). The control unit 41 identifies the device that output the signal (speed measuring device or police emergency vehicle) based on the signal frequency. The control unit 41 stores information indicating the identified target as surrounding information 35 in the RAM 44 (S61). The target location identification process ends, and the process returns to the fixed-cycle process (see Figure 12). On the other hand, if the control unit 41 has not received a signal via the microwave receiver 46 or the radio receiver 47, or if the reception level of the received signal is below a predetermined level, it determines that the target that output the signal is not in the vicinity of the vehicle (S59: NO). The target location identification process ends, and the process returns to the fixed-cycle process (see Figure 12).
[0106] As shown in Figure 12, after the target location identification process (S37, see Figure 13) is completed, the control unit 41 calculates the vehicle's mileage based on the history of changes in the vehicle's position coordinates 32 stored in the RAM 44 (S39). The control unit 41 calculates the mileage 33 (see Figure 10) by adding the calculated mileage to the total mileage stored in the EEEPROM 43 (see Figure 1). The control unit 41 stores the calculated mileage 33 in the RAM 44 (S39).
[0107] The control unit 41 determines the intimacy level based on the mileage 33 (S40). Intimacy level is a parameter determined according to the vehicle's mileage. The driver assistance system 4 assumes that the character's intimacy with the driver increases as the vehicle's mileage increases, and expresses this degree of intimacy as intimacy level. Specifically, the intimacy level is determined as follows: If the vehicle's mileage since the first activation of the driver assistance system 4 is 100km, the intimacy level is 0. If the vehicle's mileage with character mode set is 0km or more but less than 1000km, the intimacy level is 1. If the vehicle's mileage with character mode set is 1000km or more but less than 2000km, the intimacy level is 2. If the vehicle's mileage with character mode set is 2000km or more, the intimacy level is 3. The control unit 41 stores the determined intimacy level as intimacy level 34 (see Figure 10) in the RAM 44 (S40).
[0108] Next, the control unit 41 performs a process to identify the vehicle's driving state (driving state identification process, see Figure 14) (S41). The driving state identification process will be explained with reference to Figure 14. First, the control unit 41 acquires the acceleration detected by the acceleration sensor 54 (see Figure 1) and the vehicle speed from the OBD information 37 stored in the RAM 44 in S35 (see Figure 12) (S71). Next, the control unit 41 determines whether the vehicle is in a predetermined driving state based on the acquired acceleration and vehicle speed (S73). Specifically, the control unit 41 determines, based on the acceleration and vehicle speed, whether the vehicle is being driven in one of the following driving states: (a) swerving, (b) sudden braking, (c) sudden acceleration, (d) sudden right steering, (e) sudden left steering, (f) driving with reduced concentration, or (g) drowsy driving. The method of determination is as follows.
[0109] If the following conditions are met within a 15-minute period, the control unit 41 determines that (a) serpentine driving is occurring. The control unit 41 also determines that (b) sudden braking has occurred if the acceleration in the forward direction of the vehicle is 0.3G or more, the acceleration in the rear direction of the vehicle is 0.15G or more, and the acceleration in the left direction of the vehicle is 0.45G or more, 15 or more times. Furthermore, the control unit 41 determines that (f) driving with reduced concentration is occurring if the vehicle speed is 55 km / h or higher and the change in vehicle speed is between 5 km / h and 10 km / h for a predetermined period of time or longer. Also, the control unit 41 determines that (g) driving while drowsy is occurring if the vehicle speed is 55 km / h or higher and the change in vehicle speed is 10 km / h or higher. As described above, the driver assistance system 4 can determine the driving state of the vehicle based on the acceleration applied to the vehicle and the vehicle speed. Furthermore, the driver assistance system 4 can accurately identify the driving state of the vehicle in a simple manner.
[0110] If the control unit 41 determines that the vehicle is being operated in a predetermined operating state, matching any of the above conditions (S73: YES), it stores information indicating the corresponding operating state as operating state 36 (Figure 10) in the RAM 44 (S75). The operating state identification process ends, and the process returns to the fixed-cycle process (see Figure 12). On the other hand, if the control unit 41 determines that none of the above conditions apply (S73: NO), it ends the operating state identification process, and the process returns to the fixed-cycle process (see Figure 12).
[0111] As shown in Figure 12, after the completion of the driving state identification process (S39), the control unit 41 determines in S55 (see Figure 13) and S61 (see Figure 13) whether the peripheral information 35 is stored in the RAM 44, or in S75 (see Figure 14) whether the driving state 36 is stored in the RAM 44. If either is stored in the RAM 44, the control unit 41 determines that an event for notifying the driver has occurred (S43: YES). The control unit 41 turns on the event flag 38 (S45). The periodic processing ends. On the other hand, if neither the peripheral information 35 nor the driving state 36 is stored in the RAM 44 (S43: NO), no event for notifying the driver has occurred, so the control unit 41 turns off the event flag 38 (S47). The periodic processing ends.
[0112] As shown in Figure 11, after starting the periodic processing (see Figure 12) in S13, the control unit 41 refers to the setting information 23 (see Figure 9) stored in the SD card 5 (see Figure 9) and determines the set display mode (S15). If a display mode other than MAP display mode - character mode (see Figure 2) is set as the display mode (S15: NO), the control unit 41 reads the information corresponding to the set display mode from the output information 21 (see Figure 9) on the SD card 5 (see Figure 9) and outputs it from the output device. As a result, the control unit 41 performs the well-known normal operation (S21). The process proceeds to S23. On the other hand, if MAP - character mode is set as the display mode (S15: YES), the control unit 41 executes a process to notify the driver via characters (character mode processing, see Figure 15) (S19).
[0113] Referring to Figure 15, the character mode processing will be explained. The control unit 41 reads the logo information 213 (see Figure 9) stored in the SD card 5 and displays it on the display unit 48 (see Figure 1) (S81). As a result, for example, the logo screen 71 in Figure 16 is displayed on the display unit 48.
[0114] The control unit 41 determines in S83 whether the current date and time and distance traveled have already been determined and stored in the RAM 44 during the periodic processing (see Figure 12) initiated in S13 (see Figure 11). This is because the periodic processing determines the current date and time and distance traveled by receiving radio signals from GPS satellites, and depending on the radio wave environment, it may take some time to determine the current date and time and distance traveled. If the current date and time and distance traveled are not stored in the RAM 44, it means that the current date and time and distance traveled have not yet been determined (S83: NO). In this case, the control unit 41 displays the wallpaper screen 73 with the character 14 lying down on the display unit 48, as shown in Figure 17 (S85), and the process returns to S83.
[0115] In the periodic processing, the current date and time and mileage are determined, and when the current date and time 31 and mileage 33 are stored in the RAM 44 (S83: YES), the control unit 41 reads the still image information 214 (see Figure 9) stored in the SD card 5 and displays it on the display unit 48 (S86). As a result, for example, as shown in Figure 18, a still image 72 showing the character 14 wearing formal attire is displayed on the display unit 48. The still image information 214 contains a total of 12 still images, each different for each month. Each still image reflects the scenery of the season. The control unit 41 refers to the current date and time 31 stored in the RAM 44, selects the still image for the corresponding month from the still image information 214, and displays it on the display unit 48.
[0116] In this way, the driver assistance system 4 prevents the driver from becoming bored with the static screen displayed on the display unit 48 by switching the static screen displayed on the display unit 48 according to the date and time. The driver assistance system 4 also makes the driver want to see new static screens. For example, if the driver engages in dangerous driving, the driver assistance system 4 may be controlled so that a new static screen is not displayed on the display unit 48. This encourages the driver to drive safely in order to display a new static image on the display unit 48. In this way, the driver assistance system 4 can effectively guide the driver toward safe driving.
[0117] After a predetermined time has elapsed since the static screen was displayed on the display unit 48, the control unit 41 reads the startup screen contained in the startup information 215 (see Figure 9) stored on the SD card 5 and displays it on the display unit 48 (S87). The control unit 41 also reads the startup sound contained in the startup information 215 and outputs it from the speaker 51 (S87).
[0118] Refer to Figures 19 and 20 to explain the startup information 215 in detail. Startup information 215 is information output to the output device when the MAP display mode - character mode is started. As shown in Figure 19, startup information 215 includes information for displaying a character image on the display unit 48 (hereinafter referred to as the character image), and information for outputting the character's voice from the speaker 51 (hereinafter referred to as the character voice). The character image and character voice are classified by intimacy level (0-3) and time period (0:00-5:00, 5:00-7:00, 7:00-10:00, 10:00-17:00, 17:00-22:00, 22:00-0:00). The time period indicates the time when the power of the driver assistance system 4 is turned ON. Multiple character images and character voices are prepared for each intimacy level and time period so that the character can communicate with the driver in various forms of expression.
[0119] Figure 20 shows in detail the character voices corresponding to the time period from 7:00 to 10:00. When the intimacy level 34 stored in RAM 44 is 1, the character voice is somewhat distant, such as "Good morning. How are you?", "Now, do your best at work. I'll do my best too," and "Good morning. Drive safely today." The character's manner of speaking to the driver is like meeting for the first time. On the other hand, when the intimacy level 34 is 2, the character voice is more intimate compared to when the intimacy level 34 is 1, such as "Good morning. How are you?", "Every day isn't always fun, but let's do our best," and "Good morning. Drive carefully today." The character's manner of speaking to the driver is like that of a normal friend. Furthermore, when the intimacy level is 34, the character's voice becomes even more intimate compared to when the intimacy level is 1 or 2, with lines like, "Good morning! Hey, I've been waiting for you ever since I woke up!", "Yay! We can be together again today~ I'm so happy!", and "Good morning! You look stylish today? I want some new clothes too~". The character's way of speaking to the driver becomes more casual and friendly.
[0120] In this way, the driver assistance system 4 increases the character's intimacy with the driver in proportion to the intimacy level 34 by outputting more intimate character voices as the intimacy level 34 increases. As the driver senses the character's intimacy gradually increasing, their affection for the character gradually grows, and they empathize more strongly with the character.
[0121] Although not shown in the diagram, the character voices for the time period between 5:00 and 7:00 are compared for each level of intimacy. When intimacy level 34 is 1, the character voices are like, "Good morning~ yawn, excuse me," "Good morning. I'll do my best with the alarms today," and "You're up early. I'm impressed." When intimacy level 34 is 2, the character voices are like, "Huh? Is it morning already?", "Not yet! I'm still sleepy," and "Thanks for getting up early." Furthermore, when intimacy level 34 is 3, the character voices are like, "Good morning~ yawn, sorry," "Yawn, I'm still sleepy. Just one more minute," and "Good morning. I have to do my best with the alarms today. For you." By hearing the character's sleepy voice, the driver comes to feel as if the character is a real living being. In addition, the driver feels sorry for waking the character. The driver assistance system 4 further enhances the degree of empathy for the driver's character by evoking these kinds of emotions in the user.
[0122] As explained above, the character voice is switched according to the time of day, but the character image can also be switched according to the time of day. For example, from 0:00 to 5:00, the character image is associated with a depiction of the character sleeping in bed. By seeing the character sleeping, the driver develops feelings of closeness to the character. The driver assistance system 4 further enhances the degree of empathy the driver has for the character by evoking such feelings in the driver.
[0123] As described above, the driver assistance system 4 switches and outputs character voices depending on the time of day, making the character seem as if it were a real living creature. This makes the driver feel as if the character is real. In this way, the driver assistance system 4 can increase the degree of the driver's emotional connection to the character.
[0124] Note that in the startup information 215 of Figure 19, character voice is not associated with intimacy level: 0. When the intimacy level is 0, the driver assistance system 4 displays the character image on the display unit 48 and does not output character voice from the speaker 51. In this case, the driver recognizes not only the character image but also the character voice, and their expectation of wanting to start intimate communication with the character as soon as possible grows. By utilizing this psychology of the driver, the driver assistance system 4 increases the degree of the driver's emotional connection to the character.
[0125] As shown in Figure 15, after outputting startup information 215 (S87), the control unit 41 reads character information 2114 from the standby information 211 on the SD card 5 and outputs it from the output device (S91). Character information 2114 is information output from the output device when the driver assistance system 4, which operates in MAP display mode - character mode, is in standby mode. Refer to Figures 21 and 22 to explain the details of character information 2114. As shown in Figure 21, character information 2114 includes character images and character voices. Character images and character voices are classified by intimacy level. In Figure 21, "Intimacy Level 1-3" indicates that different character images and character voices are associated with each intimacy level.
[0126] Multiple character images and voices are provided for each expression mode, allowing the character to communicate with the driver in various ways. Specifically, the character information 2114 contains character images and voices corresponding to each of the following expression modes: (1) blinking and lip-syncing, (2) blinking only, (3) walking, and (4) stretching. For example, when the character image corresponding to (1) blinking and lip-syncing is displayed on the display unit 48, the character blinks and moves its mouth as if speaking. Also, when the character image corresponding to (3) walking is displayed on the display unit 48, the character walks freely within the display area of the display unit 48. Also, when the character image corresponding to (4) stretching is displayed on the display unit 48, the character stretches. In addition, the character voice corresponding to each expression mode is output from the speaker 51.
[0127] Figure 22 shows in detail the character voices corresponding to (1) blinking and lip-syncing. When the intimacy level is 34, a somewhat friendly character voice is associated, such as "Do you like driving? I don't dislike your driving." and "Um, thank you for bringing me to your car!" On the other hand, when the intimacy level is 34, a more intimate character voice is associated, such as "Hey, do you like me? I like you too!" and "You look pretty serious when you're driving, hehe." Furthermore, when the intimacy level is 34, an even more intimate character voice is associated, such as "I'm happy every day because you listen to me!" and "You know, I actually want to talk to you more. I want to get to know you better." Note that when character voices are output from speaker 51, one of the multiple character voices associated with intimacy levels 1, 2, and 3 is randomly selected and output. Therefore, even when the intimacy level is the same at 34, a different character voice will be output from speaker 51 each time.
[0128] In this way, the driver assistance system 4 increases the character's intimacy with the driver in proportion to the intimacy level 34 by outputting more intimate character voices as the intimacy level 34 increases. As the driver feels the character's intimacy with them gradually increasing, their sense of familiarity with the character gradually grows, and they empathize more strongly with the character.
[0129] Furthermore, the driver assistance system 4 constantly displays the character on the display unit 48, and even in a standby state where no events occur, it outputs the character's voice from the speaker 51 as if the character were speaking to the driver. In this way, the driver assistance system 4 makes the driver feel as if the character is a real living creature and is always by their side. As the driver develops a sense of closeness to the character, the degree of the driver's emotional connection to the character is further enhanced.
[0130] Furthermore, the driver assistance system 4 prepares multiple character images and character voices, and randomly selects and outputs them from the output device. This prevents the character-based communication from becoming monotonous and prevents the driver from getting bored of communicating with the characters.
[0131] In Figure 21, only the character image is associated with a familiarity level of 0, and no character voice is associated. Therefore, when familiarity level 34 is 0, the character image is displayed on the display unit 48, and no character voice is output from the speaker 51. When familiarity level 34 is low, the driver cannot hear the character voice, so they expect to recognize not only the character image but also the voice. The driver assistance system 4 utilizes this driver psychology to further enhance the degree of the driver's emotional connection to the character.
[0132] As shown in Figure 15, after the character information 2114 corresponding to the standby state is output from the output device in S91, the control unit 41 determines whether it is time to output character information 2124 (see Figure 23, described later) (S93). Character information 2124 is information output to the output device when an event occurs in the driver assistance system 4 operating in MAP display mode - character mode. Details of the determination method and the information to be output will be described later. If the control unit 41 determines that it is time to output character information 2124 (S93: YES), it outputs character information 2124 from the output device (S95), and the process proceeds to S97. On the other hand, if the control unit 41 determines that it is not time to output character information 2124 (S93: NO), the process proceeds to S97.
[0133] The method for determining whether or not to output character information 2124, and the details of the output character information 2124, will be explained with reference to Figure 23. Figure 23 shows the details of character information 2124. Character information 2124 includes a character image and character voice. Multiple character images and character voices are prepared for each expression mode. In Figure 23, character images and voices corresponding to (1) going to sleep, (2) waking up, (3) talking in one's sleep, (4) being warned about speeding, (5) getting carsick, (6) sudden braking, (7) sudden acceleration, (8) sudden steering to the right, (9) sudden steering to the left, (10) getting angry and disappearing if it goes too far, (11) getting mad and returning, (12) dozing off, (13) waking up, (14) losing concentration, (15) drowsy driving, (16) warnings about speed cameras, enforcement, and checkpoints, (17) warnings about radar and car location reception, and (18) other targets are associated with intimacy levels 1-3. Note that, as with character information 2114 (Figure 21), character voices corresponding to intimacy level 0 are not included in character information 2124. Therefore, if the intimacy level 34 is 0, the control unit 41 outputs the character image from the output device, but does not output the character voice from the speaker 51.
[0134] (1) The character information corresponding to going to sleep is output when the driver assistance system 4 is activated between 22:00 and 0:00. When the character image is displayed on the display unit 48, the character goes to sleep one minute after the driver assistance system 4 is activated. When the character goes to sleep, a voice message informing the driver that the character is going to sleep ("Today was fun, wasn't it? Take me for a drive again tomorrow." "I'm going to sleep now. You need to get some sleep too. Goodnight," etc.) is selected according to the intimacy level 34 and output from the speaker 51 as character voice. After the character goes to sleep, the sound of the character breathing is periodically output from the speaker 51 as character voice.
[0135] (2) The character information corresponding to "Wake up" is output when the driver assistance system 4 is activated between 5:00 and 7:00. If the character image is displayed on the display unit 48, the character will wake up one minute after the driver assistance system 4 is activated. When the character wakes up, a voice message informing the driver of their wake-up ("Good morning. Alarm restarting," "Good morning. We can be together again today! I'm so happy!" etc.) is selected according to the intimacy level 34 and output from the speaker 51 as the character's voice.
[0136] (3) Character information corresponding to sleep-talking is randomly output in 5-minute cycles every 10 to 30 minutes while the character is asleep. When the character image is displayed on the display unit 48, the character moves its mouth. In addition, sleep-talking ("The stars are beautiful." "A regular full tank, please." etc.) is selected according to the intimacy level 34, and when the character moves its mouth, it is output as character voice from the speaker 51.
[0137] As described above, the driver assistance system 4 outputs character information in a manner that makes the character appear as if it were a real living creature. The driver will come to feel as if the character is real. In this way, the driver assistance system 4 can increase the degree of the driver's emotional connection to the character.
[0138] (4) Warning about exceeding the speed limit Character information corresponding to this warning is output when the vehicle speed exceeds the speed limit. The vehicle speed is determined based on the OBD information 37 (see Figure 10) stored in RAM 44. The speed limit is determined based on the vehicle position coordinates 32 stored in RAM 44 and the map information 22 stored in SD card 5. For example, when a vehicle is traveling on a highway or elevated road, the vehicle speed is compared with the speed limit on the highway or elevated road plus 10 km / h. Also, for example, when a vehicle is traveling near a speed camera, the vehicle speed is compared with the speed limit of the speed camera plus 10 km / h. When the character image is displayed on the display unit 48, the character notifies the driver of the current vehicle speed and the speed limit and urges them to slow down. Additionally, voice alerts notifying the driver of speeding (such as "Hey! Aren't you going too fast? That's dangerous!" or "Hey, I'm going to start hating people who speed!") are selected according to the intimacy level of 34 and output from speaker 51 as character voices. This allows the driver to easily recognize when the vehicle's speed exceeds the speed limit. Because the driver's emotional connection to the character is strong, the driver will readily respond to the character's alerts and slow down, thereby paying attention to safe driving.
[0139] (5) Character information corresponding to getting carsick is output when the event flag 38 stored in RAM 44 is ON and information indicating erratic driving is stored as the driving state 36. This is because in such cases there is a high possibility that the car is driving on a road with a series of curves. When the character image is displayed on the display unit 48, the character behaves as if they are feeling sick from carsickness. In addition, the character's distressed voice ("Um, ummm, I'm feeling a little sick, sorry," "That's what you're doing driving me like, I'm sick," etc.) is selected according to the intimacy level 34 and output as character voice from the speaker 51. This causes the driver to feel sorry for the character who is carsick and to try to drive more carefully and at a slower speed. In this way, the driving support system 4 can encourage the driver to drive carefully.
[0140] Furthermore, if the character image corresponding to (5) getting carsick is displayed on the display unit 48, the character may rest lying down for 6 hours. In such a case, the driving distance 33 may be modified so that the intimacy level 34 decreases. For example, the driving distance 33 may be reduced by 300 km.
[0141] Character information corresponding to (6) sudden braking, (7) sudden acceleration, (8) sudden right steering, and (9) sudden left steering is output when the event flag 38 stored in RAM 44 is ON and information indicating sudden braking, sudden acceleration, sudden right steering, and sudden left steering is stored as the driving state 36. This is because if the driver drives in such a manner, the vehicle is more likely to cause a traffic accident. When the character image is displayed on the display unit 48, the character loses balance and stumbles in the direction of the detected acceleration. In addition, voice alerts regarding driving behavior (such as sudden braking: "Ah! You almost fell over. I'll be angry if you do that again!", "Are you even looking ahead while driving? Don't look away!", sudden acceleration: "Ouch! I hit my head! Did you see that!", "Sudden acceleration is dangerous! You won't do it again, right?", "Hey, you didn't accidentally mix up the brake and accelerator, did you?", right and left curves: "Turn the steering wheel a little slower—I'm getting dizzy!", "Ah! Nooo! Were you even looking ahead? I thought you were going to fall off!", "I can't believe it! You're such a bad driver!") are selected according to the intimacy level of 34 and output as character voices from speaker 51. Through these alerts, the driver becomes aware of reckless and dangerous driving and strives to drive more carefully. By providing these warnings, the driver assistance system 4 can prevent traffic accidents.
[0142] The character information corresponding to (10) getting angry and disappearing when it goes too far is output when the output of character information corresponding to (4) warning about speeding, (5) motion sickness, (6) sudden braking, (7) sudden acceleration, (8) sudden right steering, and (9) sudden left steering continues for a predetermined number of times within a predetermined time. Alternatively, in (4), if the degree of speeding is very large, for example, if the vehicle speed exceeds the value obtained by adding 30 km / h to the speed limit, it is output. If the character image is displayed on the display unit 48, the character gets angry and disappears from the display unit 48. In addition, voices in which the character vents their anger at the driver ("Don't ignore my warnings," "I told you no! Why would you do that?", "Ugh! Do whatever you want, hmph!" etc.) are selected according to the intimacy level 34 and output from the speaker 51 as character voices. Because the driver's emotional connection to the character is strong, the driver will reflect on the character's anger and strive to drive carefully. In this way, the driver assistance system 4 can encourage careful driving from the driver. In addition, the driver assistance system 4 may modify the mileage 33 so that the intimacy level 34 decreases. For example, the mileage 33 may be reduced by 3000 km.
[0143] (11) The character information corresponding to the character's anger subsides and they return is output 24 hours after the character disappears from the display unit 48 in (10). When the character image is displayed on the display unit 48, the character asks for reconciliation. In addition, a voice message asking for reconciliation ("I'm sorry about earlier... Um, please drive safely next time," "I'm sorry I got so angry yesterday. But I want to be able to go out with peace of mind," "I've come back! If you care about me, please drive safely!" etc.) is selected according to the intimacy level of 34 and output from the speaker 51 as character voice. This further strengthens the driver's emotional connection with the character.
[0144] (12) Character information corresponding to napping is output when the vehicle's forward acceleration is less than 0.05G, the vehicle's rear acceleration is less than 0.1G, and the vehicle's lateral acceleration is less than 0.1G for 10 minutes or more consecutively. When the character image is displayed on the display unit 48, the character is napping. In addition, voices ("You're a good driver. I feel at ease.", "Don't speed while I'm napping.", "I'm going to take a nap, so I'll leave the rest to you." etc.) are selected according to the intimacy level 34 and output from the speaker 51 as character voices. The character is output in a manner that makes it seem as if the character is a real living creature, so the driver will feel as if the character is real. The driver will also feel at ease seeing the character sleeping and will be more inclined to continue driving safely. In this way, the driving support system 4 increases the degree of the driver's empathy for the character and makes it easier for the driver to drive safely.
[0145] (13) Wake up is output when the character is napping as in (12), and the acceleration in the forward direction of the vehicle exceeds 0.1G, the acceleration in the backward direction of the vehicle exceeds 0.2G, and the acceleration in the left-right direction of the vehicle exceeds 0.3G. When the character image is displayed on the display unit 48, the character wakes up from napping. In addition, voices ("Hmm, you're driving so well. It felt like being in a cradle." "Mumble, oh, was I asleep? Sorry." "Oh no, you saw me sleeping? I guess so? How embarrassing." etc.) are selected according to the intimacy level 34 and output from the speaker 51 as character voices. Since the character information is output in a manner that makes the character seem as if it were a real living creature, the driver will come to feel as if the character is real. The driver will also resume safe driving so that the character can fall asleep again peacefully. In this way, the driving support system 4 increases the degree of the driver's empathy for the character and makes it easier for the driver to perform safe driving.
[0146] (14) Decreased concentration, (15) Drowsy driving are output when the event flag 38 stored in RAM 44 is ON, and information indicating decreased concentration or drowsy driving is stored in RAM 44 as driving state 36. When a character image is displayed on the display unit 48, the character alerts the driver and, if there is a rest facility (SA, PA, etc.) near the vehicle, prompts the driver to stop at the rest facility and take a break. Whether or not there is a rest facility near the vehicle is determined based on the vehicle position coordinates 32 stored in RAM 44 and the map information 22 stored in SD card 5. In addition, voice alerts and prompts to take a break ("Watch out! Please concentrate!", "Are you awake?", "There's an SA nearby. Why don't you take a break?" etc.) are selected according to the affinity level 34 and output as character voice from speaker 51. This allows the driver to regain concentration and drive safely. The driver can also recover their concentration by taking an appropriate rest. The driver can also recover from drowsiness and resume safe driving. This makes it possible to prevent traffic accidents caused by decreased concentration or drowsy driving.
[0147] Furthermore, the driver assistance system 4 can accurately identify the driver's condition in a simple manner. This is because, under these conditions, the driver's concentration tends to decrease, and the driver is more likely to become drowsy.
[0148] (16) Character information corresponding to speed cameras, enforcement, and checkpoint warnings is output when the event flag 38 stored in RAM 44 is ON, information indicating radar speed cameras, H systems, LH systems, and loop coils (hereinafter collectively referred to as speed cameras) is stored in RAM 44 as surrounding information 35, and further, information indicating the distance between the speed camera and the vehicle is 2100m, 1100m, and 600m. Alternatively, it is output when the event flag 38 stored in RAM 44 is ON, and information indicating enforcement or a checkpoint is stored as surrounding information 35.
[0149] (17) Character information corresponding to radar and car location reception warnings is output when the event flag 38 stored in RAM 44 is ON and information indicating a speed measuring device or police emergency vehicle is stored in RAM 44 as surrounding information 35.
[0150] The character images corresponding to (16) speed camera, enforcement, checkpoint warnings, or (17) radar, car location reception warnings are displayed on the display unit 48 as follows. As shown in Figures 24 and 25, first, the clothing of character 14 changes from white (Figure 24) to black (Figure 25). This change signifies that character 14 has transformed. The transformed character 14 (see Figure 26) provides the user with information 74 indicating one of the following: speed camera, enforcement, checkpoint, speed measuring device, or police emergency vehicle, as well as the distance 75 between the vehicle and the information, as shown in Figure 27. In addition, voice messages to notify the driver of the displayed content (e.g., "Emergency! Radar speed camera detected 2000 meters ahead," "Close to 1000 meters! It's a radar speed camera," "500 meters left! Don't get photographed!") are selected according to the familiarity level 34 and output from the speaker 51 as character voices.
[0151] As described above, the driver assistance system 4 can recognize when a traffic monitoring target is near the vehicle by receiving a wireless signal transmitted from the target. Traffic monitoring devices are often installed in places where traffic accidents are likely to occur or in places where accidents have occurred in the past. Therefore, by notifying the driver that a traffic monitoring target is near the vehicle, the driver assistance system 4 can make the driver aware of places where traffic accidents are likely to occur and encourage them to drive especially safely in such places.
[0152] Furthermore, the change in Character 14's attire allows drivers to easily and clearly recognize at a glance that the distance between the vehicle and the object being monitored for traffic has decreased. Drivers can accurately identify high-risk areas for traffic accidents in advance and drive with traffic safety in mind.
[0153] Furthermore, since the driver is notified by a character voice when the distance between the vehicle and the object being monitored for traffic is decreasing, the driver assistance system 4 can reliably make the driver aware that the vehicle is approaching a speed camera or similar object, even if the driver is not looking at the display unit 48.
[0154] In addition, as described above, the character 14 displayed on the display unit 48 may change its notification method depending on the target object to be notified to the driver. For example, when a target object is identified by receiving a radio signal, such as a speed measuring device or a police emergency vehicle, a ring-shaped pattern 76 that represents radio waves may be arranged around the character 14 and displayed on the display unit 48, as shown in Figure 28.
[0155] Furthermore, as mentioned above, the speaker 51 may output a character voice (for example, "Transforming") to notify the driver that the character has transformed. This allows the driver to recognize even more reliably that the vehicle is approaching a speed camera or similar device.
[0156] (18) Character information corresponding to other targets is output when the event flag 38 stored in RAM 44 is ON and information indicating prefectural borders, prefectures, service areas, parking areas, sharp curves, continuous curves, junctions, expressways, and elevated roads is stored in RAM 44 as surrounding information 35. When character information is displayed on the display unit 48, the character notifies the driver of the type of target and the distance to the target (e.g., "km away"). In addition, a character voice to notify the driver that the distance from the vehicle to the target is approaching is selected according to the familiarity level 34 and output from the speaker 51.
[0157] The driver assistance system 4 can help the user understand the approximate location of the vehicle by notifying the driver when the vehicle is approaching a prefectural border or by notifying the driver of the prefecture the vehicle is currently traveling through. By allowing the driver to visualize a general area of the destination, the driver assistance system 4 can help prevent loss of concentration and drowsy driving.
[0158] Furthermore, the driver assistance system 4 can encourage the driver to take a break by notifying them when the vehicle is approaching a rest area (PA) or service area (SA). For example, if the driver assistance system 4 detects a decrease in the driver's concentration or drowsiness, it should encourage the driver to stop at an SA or PA and recommend taking a break. This allows the driver assistance system 4 to restore the driver's concentration and alleviate drowsiness. The above notification should ideally be delivered by outputting character information, with a character notifying the driver. This allows the driver assistance system 4 to effectively notify the driver of SAs and PAs.
[0159] Furthermore, the driver assistance system 4 notifies the driver of sharp curves, consecutive curves, junctions, etc., and notifies them of the distance specifically (for example, "km ahead"). This allows the driver to recognize in advance dangerous locations where even a slight lapse in attention could easily lead to an accident. In this way, the driver assistance system 4 can prevent the driver from losing concentration or falling asleep at the wheel in dangerous locations. As a result, the driver assistance system can more reliably prevent traffic accidents.
[0160] Furthermore, whether a vehicle is traveling on a sharp curve, a series of curves, or a junction can be determined based on the acceleration acting on the vehicle. For example, if an acceleration exceeding a predetermined level is instantaneously applied to the vehicle, it can be determined that the vehicle is traveling on a sharp curve. Also, if an acceleration exceeding a predetermined level is continuously applied to the vehicle in the lateral direction, it can be determined that the vehicle is traveling on a series of curves.
[0161] The driver assistance system 4 also notifies the driver when the vehicle is traveling on a highway or elevated road. When traveling on such roads, the vehicle speed tends to be high, and driving tends to become monotonous with little steering or speed change. In such cases, the driver's concentration tends to decrease, making drowsy driving and falling asleep at the wheel more likely. In response to this, the driver assistance system 4 can prevent traffic accidents by providing notifications to the driver, especially on such roads, using character information. Therefore, the driver assistance system 4 can effectively prevent traffic accidents and encourage safe driving. In addition, it can create the impression that there is a passenger in the front seat, thus preventing drowsy driving and falling asleep at the wheel due to decreased concentration, and assisting in regaining consciousness if falling asleep occurs. By creating a character that the driver feels attached to and having that character speak to them, the system aims for an effect that goes beyond mere sound.
[0162] Furthermore, whether a vehicle is traveling on a highway or elevated road can be determined based on its speed. For example, if the vehicle speed is 80 km / h or higher for a specified period of time, it can be determined that the vehicle is traveling on a highway.
[0163] Furthermore, the output of character information according to (1) to (18) above should be repeated at a predetermined interval (for example, every 10 seconds). This ensures that even if the driver does not notice the notification in the initial stages, repeated notifications will eventually lead the driver to notice the notification and drive safely. In this way, the driver assistance system 4 can ensure that the driver recognizes the content of the notification.
[0164] Furthermore, as mentioned above, when character information is repeatedly output, the driver assistance system 4 should output the character information in a way that the character provides notifications in a different manner each time. This prevents the driver from becoming bored with the character information. As a result, the driver will continue to respond to the character's notifications and be more mindful of safe driving.
[0165] Furthermore, when repeatedly outputting character voices from speaker 51, it is preferable to gradually increase the volume of the output character voices. This ensures that even if the driver does not correct their driving behavior in the initial stages of character voice notifications, they will eventually correct their driving behavior in response to the louder volume of the voice. In this way, the driver assistance system 4 can reliably guide the driver to drive safely.
[0166] As shown in Figure 15, the control unit 41 determines whether it has detected a setting operation performed by the driver on the driver assistance system 4 (S97). If the control unit 41 detects that the driver has touched the display unit 48 (Figure 1) in the standby state via the touch panel 49 (see Figure 1), it determines that the driver has performed a setting operation (S97: YES). Based on the setting screen information 216 (see Figure 9) stored in the SD card 5, the control unit 41 displays the setting screen on the display unit 48. The control unit 41 also sequentially switches the setting screen displayed on the display unit 48 according to the content of the setting operation performed by the driver (Figures 31 to 40 (described later)). The setting screens progress as shown in Figure 30. The control unit 41 sets the setting information by storing the setting information set by the setting operation as setting information 23 (see Figure 9) in the SD card 5 (see Figure 9) (S99). The driver assistance system 4 operates according to the driver's settings by the control unit 41 executing processing based on the setting information 23. The process proceeds to S101. On the other hand, if no setting operation by the driver is detected (S97: NO), the process proceeds to S101. The control unit 41 determines whether an operation to turn off the power of the driver assistance system 4 has been detected (S101). If the control unit 41 detects an operation to turn off the power (S101: YES), it terminates the character mode processing and returns to the main processing (Figure 11). On the other hand, if the control unit 41 does not detect an operation to turn off the power (S101: NO), the process returns to S91.
[0167] Referring to Figure 29, the details of the setting information 23 stored on the SD card 5 will be explained. The setting information 23 includes screen setting information 61 and system setting information 67. Screen setting information 61 is the setting information for the screen displayed on the display unit 48. Screen setting information 61 includes static screen information 62, always-on display mode information 63, alarm display mode information 64, and character clothing information 65. System setting information 67 is the setting information other than the screen setting information 61. When the setting process described later is performed by the driver and setting information is input, the control unit 41 stores the input setting information as setting information 23 on the SD card 5. Details of each piece of information will be described later.
[0168] As shown in Figure 30, the setting screen information 216 (see Figure 9) includes a main menu screen 110, a screen setting screen 120, a screen selection screen 130, an alarm display screen 140, a character setting screen 150, a system setting screen 190, and the like. The control unit 41 sequentially switches the screens in response to the driver's operation. This allows the driver to input the desired setting information into the driver assistance system 4.
[0169] When the control unit 41 detects that the driver has touched the display unit 48 in standby mode, it first displays the main menu screen 110 (see Figure 31) on the display unit 48. As shown in Figure 31, the main menu screen 110 is provided with a screen setting selection button 111, a radar menu selection button 112, a system selection button 113, a G sensor calibration selection button 114, and a main screen selection button 115.
[0170] The screen setting selection button 111 is a selection button for changing the screen display settings. The radar menu selection button 112 is a selection button for setting target objects, wireless sensitivity settings, notification settings, etc. The system selection button 113 is a selection button for performing operations such as touch panel calibration, OBD data settings, setting initialization, and registered location deletion. The G sensor calibration selection button 114 is a selection button for performing calibration of the acceleration sensor 54 (see Figure 1). The main screen selection button 115 returns to the main screen when selected. Note that the processing of the control unit 41 when the radar menu selection button 112, system selection button 113, G sensor calibration selection button 114, and main screen selection button 115 are selected is the same as the processing in well-known devices, except for some setting items which will be described later, so the explanation is omitted. The following explanation will focus on the case when the screen setting selection button 111 is selected.
[0171] When the control unit 41 detects that the screen setting selection button 111 has been selected in Figure 31, it displays the screen setting screen 120 (see Figure 32) on the display unit 48. As shown in Figure 32, the screen setting screen 120 is provided with a screen selection button 121, a brightness setting button 122, an alarm display selection button 123, a sub-display selection button 124, a main screen selection button 125, a character setting button 126, and a back button 127.
[0172] The screen selection button 121 is a selection button for determining the always-on display mode (see Figure 2). When the control unit 41 detects that the screen selection button 121 has been selected, it displays the screen selection screen 130 (see Figure 33) on the display unit 48. As shown in Figure 33, the screen selection screen 130 is provided with a MAP screen selection button 131, a radar standby selection button 132, an OBD information selection button 133, a main screen selection button 134, and a back button 135. By selecting any of the selection buttons, the driver can operate the driver assistance system 4 in one of the always-on display modes (see Figure 2) among the MAP display mode (when the MAP screen selection button 131 is selected), radar standby display mode (when the radar standby selection button 132 is selected), or OBD display mode (when the OBD information selection button 133 is selected). The always-on display mode selected by the driver is stored in the SD card 5 as always-on display mode information 63 in the setting information 23.
[0173] As shown in Figure 32, the brightness setting button 122 is a button for adjusting the brightness of the display unit 48. When the brightness setting button 122 is detected to be selected, the control unit 41 displays a screen on the display unit 48 for setting the brightness of the display unit 48. The driver can adjust the brightness of the display unit 48 by performing input operations via the screen. The set information is stored on the SD card 5 as system setting information 67 of the setting information 23.
[0174] The alarm display selection button 123 is a selection button for determining the alarm display mode (see Figure 2). When the control unit 41 detects that the alarm display selection button 123 has been selected, it displays the alarm display setting screen 140 (see Figure 34) on the display unit 48. As shown in Figure 34, the alarm display setting screen 140 displays the animation selection button 141, the character selection button 142, and the live-action selection button 143. Of these, the character selection button 142 has an image of a character's face superimposed on it. By selecting any of these selection buttons, the driver can operate the driver assistance system 4 in one of the following alarm display modes (see Figure 2): character mode (when the character selection button 142 is selected) or non-character mode (animation mode (when the animation selection button 141 is selected) or live-action mode (when the live-action selection button 143 is selected)). Furthermore, because the image of a character's face is superimposed on the character selection button 142, the driver can intuitively recognize the selection button for selecting the character mode. Thus, the ability to intuitively recognize and quickly select the character selection button 142, and instantly switch between character mode and non-character mode, is particularly useful for the driver. This is because the driver may not want others to know that the driver assistance system 4 is operating in character mode, and in such cases, this function allows for an immediate switch from character mode to non-character mode. The warning display mode selected by the driver is stored on the SD card 5 as warning display mode information 64 in the setting information 23.
[0175] Furthermore, the control unit 41 mutes the character voice output from the speaker 51 if the character selection button 142 is repeatedly selected by the driver. The details are as follows: If the control unit 41 detects that the character selection button 142 has been selected once, it outputs the character voice from the speaker 51 as usual. If the control unit 41 detects that the character selection button 142 has been selected twice, it mutes the character voice output from the speaker 51 in the standby state, and outputs the character voice from the speaker 51 as usual when an event occurs. If the control unit 41 detects that the character selection button 142 has been selected three times, it mutes all character voices. In this way, the driver can mute the character voice output from the speaker 51 as needed. This function is particularly effective when the driver does not want others to hear the character voice, because the driver can mute the character voice with a simple operation.
[0176] Furthermore, as described above, the control unit 41 may change the color around the character selection button 142 according to the output status of the character voice. For example, if the character selection button 142 is selected once, the color around the character selection button 142 may be changed to blue. If the character selection button 142 is selected twice, the color around the character selection button 142 may be changed to green. If the character selection button 142 is selected three times, the color around the character selection button 142 may be changed to red.
[0177] Alternatively, the following can be done: The control unit 41 changes the color around the selection button selected by the driver from among the animation selection button 141, character selection button 142, and live-action selection button 143 to a different color from the color around the other selection buttons. Furthermore, if the character selection button 142 is selected, the control unit 41 changes the color around the character selection button 142 according to the intimacy value 34 stored in the RAM 44. Specifically, it is set to red when the intimacy value is 1, yellow when the intimacy value is 2, and green when the intimacy value is 3. This allows the driver to grasp the intimacy value at a glance by looking at the selection button, and thus clearly recognize the manner in which character communication is expressed.
[0178] As shown in Figure 32, the character setting button 126 is a selection button that is selected when setting the representation of the character displayed on the display unit 48. Here, if the intimacy level 34 is 0, the character setting button 126 is represented by an image of a key, as shown in Figure 32. If the control unit 41 detects that the driver has selected the character setting button 126 in this state, it rejects the character setting and returns to the main menu. The driver will not be able to set the character if the intimacy level is low. In such cases, the driver will have high expectations that the character setting will become possible. The driver assistance system 4 increases the degree of the driver's emotional attachment to the character by making the driver impatient in this way.
[0179] Furthermore, when the control unit 41 detects that the character setting button 126 has been selected while it is represented by an image of a key, it outputs the character voice "Entry is denied. If you drive safely, entry will be permitted" from the speaker 51. This allows the driver to clearly understand that the character setting has been denied. In this case, it is preferable to use a tone of voice different from the character's normal speaking style. This allows the driver to understand even more clearly that the character setting has been denied. In this case, it is also preferable to inform the driver of the nuances of the driver assistance system 4. This allows the driver to understand the concept on which the driver assistance system 4 was created.
[0180] Furthermore, in the above-mentioned case, if the control unit 41 outputs a character voice from the speaker 51 that rejects the character setting, it may output a voice at the same time as the notification that the setting is rejected, explaining how the character setting can be made possible. For example, it may output a character voice from the speaker 51 such as, "You can set a character once the driving distance exceeds 100km." This allows the driver to recognize the function of the driver assistance system 4 and learn how to make the character setting possible. Even if the driver is not well aware of the function of the driver assistance system 4 beforehand, they will gradually become aware of the function while using the driver assistance system 4.
[0181] In addition, if the character selection button 142 is not selected on the alarm display setting screen 140 (see Figure 34), the control unit 41 will not set the character to character mode, even if the intimacy level 34 is 1 or higher, because the alarm display mode is not set to character mode. The control unit 4 will display the character setting button 126 with an image of a key, as shown in Figure 32, and will refuse to set the character. The driver can only set the character when the driver assistance system 4 is operating in character mode. Therefore, the driver assistance system 4 can prevent incorrect settings from being made by mistake when the character is set while operating in a non-character mode.
[0182] On the other hand, if the intimacy level 34 stored in RAM 44 is 1 or greater, and the alarm display mode is set to character mode, then, as shown in Figure 35, the selection button for setting the character is represented by an image of the character's face (character setting button 129). By selecting the character setting button 129, the driver can set the character. By assigning an image of the character's face to the selection button, the driver can clearly recognize at a glance which setting button to select in order to set the character.
[0183] When the control unit 41 detects that the character setting button 129 has been selected, it displays the character setting screen 150 (see Figure 36) on the display unit 48. As shown in Figure 36, the character setting screen 150 is provided with a static screen selection button 151, an outfit selection button 152, a background selection button 153, and a voice selection button 154.
[0184] When the control unit 41 detects that the static screen selection button 151 has been selected by the driver, it displays the static screen selection screen 160 (see Figure 37) on the display unit 48. As shown in Figure 37, the static screen selection screen 160 is provided with selection buttons 161, each bearing the name of a static screen that can be displayed on the display unit 48. By selecting one of the selection buttons 161, the driver can choose the static screen that will be displayed on the display unit 48 when the driver assistance system 4 is started (S85, see Figure 15). The static screen selected by the driver is stored on the SD card 5 as static screen information 62 in the setting information 23.
[0185] The control unit 41 may assign all the static screens stored as static screen information 214 on the SD card 5 to the selection button 161 as static screens selectable by the driver, but it is preferable to do so as follows. In S85 of Figure 15, if the driver has not set any static screens, a different static screen is automatically selected each month and displayed on the display unit 48. Here, it is preferable for the driver to be able to set the static screens displayed on the display unit 48 as static screens that can be selected via the static screen selection screen 160. The set static images are stored in the setting information 23. The selection button 161 on the static screen selection screen 160 may only be assigned to static screens set in this way. In this case, the number of selectable static screens increases each month, so a total of 12 static screens can be displayed in a year. In this way, the driver can enjoy the pleasure of gradually increasing the number of displayable static screens. Therefore, even if the driver uses the driver assistance system 4 for a long time, they can continue to enjoy collecting static screens. In this way, the driver assistance system 4 can prevent the driver from getting bored of using the driver assistance system 4.
[0186] When the control unit 41 detects that the clothing selection button 152 (see Figure 36) has been selected by the driver, it displays the clothing selection screen 170 (see Figure 38) on the display unit 48. As shown in Figure 38, the clothing selection screen 170 is provided with selection buttons 171 for selecting the clothing to be worn by the character. The control unit 41 identifies the clothing associated with the selection button 171 selected by the driver and displays the character on the display unit 48 wearing the identified clothing. The information indicating the clothing selected by the driver is stored on the SD card 5 as character clothing information 65 in the setting information 23.
[0187] This allows the driver to display a character wearing their preferred clothing on the display unit 48. Since the driver can switch the character's appearance as they wish, their emotional connection to the character is further enhanced. Furthermore, the driver assistance system 4 can display the character in various ways, keeping the user engaged.
[0188] Furthermore, as described above, if the intimacy level 34 stored in the RAM 44 is 1, the control unit 41 may, with a predetermined probability, refuse to display the character wearing the selected clothing on the display unit 48, even if the clothing has been selected by the driver. This encourages the driver to increase the intimacy level 34 to ensure that the character's clothing is changed. As a result, the driver becomes more responsive to the character's notifications and more willing to follow the guidance for safe driving from the driver assistance system 4 and drive safely. In addition, the driver assistance system 4 can further increase the degree of the driver's emotional connection to the character by making the character behave as if it were a real living creature.
[0189] When the control unit 41 detects that the background selection button 153 (see Figure 36) has been selected by the driver, it displays the background selection screen (not shown) on the display unit 48. The background selection screen is provided with selection buttons for selecting the background color of the character setting screen 150 (see Figure 36), the static screen selection screen 160 (see Figure 37), and the clothing selection screen 170 (see Figure 38). When the control unit 41 detects that the driver has selected a specific color as the background color, it changes the background color of the character setting screen 150, the static screen selection screen 160, and the clothing selection screen 170 according to the selected color. This prevents the display of the character setting screen from becoming monotonous and causing users to become bored.
[0190] Furthermore, as described above, the control unit 41 should be able to change the background image itself, rather than just the background color of the character setting screen 150, the static screen selection screen 160, and the clothing selection screen 170, to a different form. For example, background images such as the character's room, a starry sky, the character after transformation, and a cyber-style image should be provided, and the driver should be able to select one. Also, the background image should only be changeable when operating in character mode.
[0191] When the control unit 41 detects that the driver has selected the voice selection button 154 (see Figure 36), it displays the voice selection screen 180 (see Figure 39) on the display unit 48. As shown in Figure 39, the voice selection screen 180 is provided with selection buttons 181, each containing the content of a character voice that can be output from the speaker 51. When the control unit 41 detects that the driver has selected one of the selection buttons 181, it outputs the selected character voice from the speaker 51. The driver can then hear the desired character voice.
[0192] The control unit 41 may assign all the character voices stored in the SD card 5 as character information 2114, 2124 (see Figure 9) to the selection button 181 as selectable character voices for the driver. For example, the following may be used: When a character voice is output from the speaker 51, the driver may set the outputted character voice as a selectable character voice via the voice selection screen 180. The set character voices may be stored in the setting information 23. The selection button 181 on the voice selection screen 180 may be assigned the content of the character voices set in this way. In this case, the longer the driving assistance system 4 is used, the more character voices will be output from the speaker 51, so the driver can enjoy gradually increasing the number of character voices that can be output. Also, since the character voices are randomly selected and output according to the level of familiarity and the vehicle's condition, it is difficult to hear the same phrase of character voice again once it has been output. In contrast, the driver assistance system 4 allows the driver to set the character voice that has been output as a selectable character voice on the voice selection screen 180, so that the driver can listen to the character voice that has been played repeatedly at any time later on.
[0193] On the other hand, if the system selection button 113 is selected in Figure 31, the control unit 41 displays the system setting screen 190 shown in Figure 40 on the display unit 48. Among the selection screens provided on the system setting screen 190, the selection button unique to the present invention is the reset button 191. The reset button 191 is used to reset the mileage 33 and intimacy level 34 stored in the RAM 44. When the reset button 191 is selected, the control unit 41 resets the mileage and intimacy level by storing 0 in the mileage 33 and 0 in the intimacy level 34 stored in the RAM 44. The driving support system 4 then operates with an intimacy level of 0. This allows the driver to repeatedly experience the process of the character's intimacy towards the driver gradually increasing from the beginning by initializing the intimacy level.
[0194] In the above case, even if the mileage 33 and intimacy level 34 are reset, the setting information 23 stored on the SD card 5 is not reset. Therefore, the information of various settings made by the driver to the driver assistance system 4 is maintained. Furthermore, for example, if the driver sets a selectable static screen on the static screen selection screen 160, or sets a character voice that can be output on the voice selection screen 180, this setting information is not reset by selecting the reset button 191. Therefore, even if the reset button 191 is selected and the mileage 33 and intimacy level 34 are reset, the driver can continue to select a desired static screen from a large number of static screens and display it on the display unit 48. Furthermore, even if the reset button 191 is selected and the intimacy level is reset, the driver can continue to select a desired character voice from a large number of character voices and output it from the speaker 51. In this way, the driver assistance system 4 can initialize the intimacy level without erasing the set setting information. This saves the user the trouble of repeatedly setting the setting information to the driver assistance system 4.
[0195] By resetting the intimacy level, the driver can restart the intimacy level from 0, while retaining the previously set still images and character voices. By resetting the relationship with the character multiple times, it becomes possible to obtain still images and character voices that were previously unavailable. For example, if you drive 1100km in one go after purchasing the driver assistance system 4, your intimacy level will drop to 2. As a result, you will no longer be able to obtain the character voices at intimacy level 1. Resetting the intimacy level 34 in such cases can avoid this problem. It also has the added benefit of allowing you to reconnect with the character on an emotional level.
[0196] Once the setting process is completed as described above (S99, see Figure 15), and the operation to turn off the power of the driver assistance system 4 is detected (S101: YES, see Figure 15), the control unit 41 stores the setting information 23 stored in the SD card 5, and the mileage 33 and intimacy level 34 stored in the RAM 44, in the EEPROM 43, as shown in Figure 11 (S23). This backs up the information. The main process ends. The mileage stored in the EEPROM 43 will be referenced when the mileage 33 is calculated (S39, see Figure 12) the next time the power of the driver assistance system 4 is turned ON. Also, when a new SD card 5 is inserted into the card reader 52, the setting information 23 stored in the EEPROM 43 will be stored in the SD card 5. This allows the driver to continue using the setting information that was set once.
[0197] As explained above, the driver assistance system 4 allows the driver to recognize a character by outputting character information (character image, character voice). The driver assistance system 4 changes the way the character communicates with the driver according to the degree of the character's intimacy with the driver, thereby strengthening the driver's emotional connection with the character and making the user feel as if the character is a real person. The driver will respond readily to the character's prompts for safe driving in order to maintain and further increase the character's intimacy with the driver. The driver will also respond more readily to notifications from the character in order to avoid being disliked by the character. In this state, the driver assistance system 4 can easily guide the driver to actively drive safely by prompting them to drive safely. Furthermore, the driver assistance system 4 outputs diverse and varied character information in order to maintain a high level of the driver's emotional connection with the character. In this way, the driver assistance system 4 can prevent the driver from becoming bored with communication with the character and can continuously encourage the driver to drive safely.
[0198] Furthermore, the driver assistance system 4 can appropriately determine the information to notify the driver based on the vehicle's status (sudden braking, sudden acceleration, sudden steering, etc.) and the positional relationship between the vehicle and the target object, and can deliver warnings and encourage safe driving to the driver via the character. In this way, the driver assistance system 4 can determine the optimal information to prevent traffic accidents and notify the driver via the character, depending on the situation.
[0199] Furthermore, the driver assistance system 4 can identify appropriate notifications based on the vehicle's driving status and notify the user through the character. This allows the driver assistance system 4 to warn against dangerous driving and encourage calm driving. In particular, since drivers strongly empathize with the character, it is expected that they will readily respond to the character's notifications. Therefore, the driver assistance system 4 can accurately guide the driver to drive safely.
[0200] Furthermore, the driver assistance system can determine the vehicle's state in detail based on the magnitude and direction of acceleration. This allows the driver to drive safely by being mindful of avoiding dangerous driving behaviors in response to notifications from the character.
[0201] It should be noted that the present invention is not limited to the embodiments described above, and various modifications are possible. The driver assistance system 4 may receive radio signals transmitted from GPS (Global Navigation) satellites as well as radio signals transmitted from regional navigation satellites. The driver assistance system 4 may then identify coordinate information indicating the vehicle's position based on both radio signals. This allows the driver assistance system 4 to identify the coordinate information indicating the vehicle's position in detail. Furthermore, when radio waves are received from regional navigation satellites, information indicating that radio signals transmitted from regional navigation satellites have been received may be displayed on the display unit 48. The notification that radio signals transmitted from regional navigation satellites have been received may be conveyed via a character displayed on the display unit 48. In this way, the driver can understand in detail which satellites are being used by the driver assistance system 4 to determine the vehicle's position. The driver can also understand in detail the specific movements of the driver assistance system 4, thereby further increasing their familiarity with the driver assistance system 4.
[0202] On the other hand, separate from notifications via characters, it would be good to display an icon on the display unit 48 indicating, for example, that a radio signal has been received from a regional navigation satellite. Alternatively, the driver could be notified that a radio signal has been received from a regional navigation satellite by switching the icon indicating that a radio signal transmitted from a GPS satellite has been received to a different form. The driver can then clearly recognize at a glance whether the vehicle's position has been determined by receiving a radio signal transmitted from a regional navigation satellite. It is preferable that the regional navigation satellite be "Michibiki".
[0203] As described above, when the intimacy level is 0, the driver assistance system 4 displays the character image on the display unit 48 and does not output the character voice from the speaker 51. In contrast, the driver assistance system 4 may store the character voice of a character other than the character shown by the character image (hereinafter referred to as "this character") (hereinafter referred to as "another character voice") as character information 2114 and 2124 corresponding to intimacy level 0 on the SD card 5. Then, when the intimacy level is 0, the driver assistance system 4 may output the other character voice from the speaker 51. For example, the other character voice may be the voice of a character familiar to the person (voice actor, etc.) who performs the character voice of this character (hereinafter referred to as "this character voice").
[0204] In such cases, the driver, upon hearing the voice of a different character, feels relieved and at the same time desires to hear the voice of the main character. When the intimacy level reaches 1 or higher and the main character's voice becomes available, the driver's emotional connection to the character increases even further compared to when the main character's voice was heard from the beginning. In particular, if the voice actor for the main character is publicly known, fans of that voice actor expect to hear the voice of a different character rather than the main character's voice. For example, when a driver purchases a new driver assistance system 4, the intimacy level is 0, so the voice of a different character is output, thus fulfilling that expectation and creating an opportunity for the driver to strongly empathize with the character. Then, when the intimacy level reaches 1 or higher, the main character's voice becomes available for the first time. As a result, fans of that voice actor can hear a new character voice, enjoying two different voices from that voice actor in one product. This can create a strong emotional connection to the character in the driver. Furthermore, if this mechanism is not disclosed to the driver, it can surprise them and make them want to increase the intimacy level.
[0205] Furthermore, as mentioned above, when the intimacy level reaches 2 or higher, it is preferable to allow the driver to switch between the main character's voice and the voice of the other character according to their settings. When the voice of the other character is selected, the driver assistance system 4 should communicate with the driver by outputting the voice of the other character from speaker 51 instead of the main character's voice. This allows the driver to hear both the main character's voice and the voice of the other character when the intimacy level is high. In particular, it is preferable to insert phrases from the other character's voice into phrases from the main character's voice, as if the main character were acting as the other character. This makes the main character behave as if they are imitating the other character. The main character can then create the impression that the driver has taken an interest in the other character. In this way, the driver and the main character can feel that they have shared a common interest in the other character, which helps maintain a stronger emotional connection with the character. This state is also preferable when the intimacy level is n or higher. By setting the intimacy level n to a level where monotony occurs or before it occurs, monotony can be prevented, and the driver can be given a fresh impression.
[0206] As described above, the character images and voices were defined so that the character's intimacy with the driver would gradually deepen as the level of intimacy increased, and the character's communication with the driver would reflect this. However, the character's manner of expression may differ significantly depending on whether the level of intimacy is 0 or 1, or 3 or 4. For example, if the level of intimacy is 0 or 1, the character should treat the driver with a strict attitude, while if the level of intimacy is 2 or 3, the character should treat the driver with a gentle attitude. In this way, when the level of intimacy reaches 2 or higher, the attitude will suddenly change, and the driver will be drawn to this gap in attitude. As a result, a stronger emotional connection with the character by the driver can be created and maintained.
[0207] Furthermore, as mentioned above, when the intimacy level reaches 2 or higher, it would be good to allow the character's attitude towards the driver to be switched according to the driver's settings. For example, the driver assistance system 4 should be configured so that even when the intimacy level reaches 2 or higher, the character continues to treat the driver with a strict attitude. This allows the driver to experience both a strict attitude and a more affectionate attitude as the intimacy level increases.
[0208] When the driver assistance system 4 is started, a static screen may be displayed on the display unit 48 that shows a level of intimacy with the character towards the driver. Intimacy may be determined based on driving distance or closeness. For example, as shown in the static images 200 in Figures 41 and 42, the character's intimacy may be indicated by the number of hair ornaments 201 on the character. For example, if the character's intimacy with the driver is high, as shown in Figure 41, a large number of hair ornaments 201 may be displayed on the display unit 48 to indicate that the character's intimacy with the driver is high. On the other hand, if the character's intimacy with the driver is low, as shown in Figure 42, a small number of hair ornaments 201 may be displayed on the display unit 48 to indicate that the character's intimacy with the driver is low. This allows the driver to recognize the character's intimacy at a glance.
[0209] The number of hair ornaments 201 displayed on the display unit 48 may be increased by one for every 100km increase in driving distance. Furthermore, if the driver repeatedly engages in dangerous driving, specifically if the driver is notified by the character of driving such as sharp turns, sudden acceleration, sudden left or right steering, or speeding, the number of hair ornaments 201 displayed on the display unit 48 may be decreased by one, and the driving distance may be decreased by 100km at the same time.
[0210] As described above, the driver assistance system 4 determined the level of intimacy based on the distance traveled, but the level of intimacy may also be determined by parameters other than the distance traveled.
[0211] In the above description, intimacy levels were set to 0-3, but the present invention is not limited to this. The startup information 215, character information 2214, and character information 2124 may each be based on intimacy levels determined by different criteria. For example, the startup information 215 may be based on intimacy levels 1-0 to 1-3. The character information 2114 may be based on intimacy levels 2-0 to 2-3. The character information 2124 may be based on intimacy levels 3-0 to 3-3. Here, intimacy levels 1-0 to 1-3, 2-0 to 2-3, and 3-0 to 3-3 may be determined by different criteria based on the distance traveled.
[0212] The driver assistance system 4 targets a core group of users known as anime otaku, and aims to deepen the user's attachment to the character by creating a "young but caring wife-like character" when driving on highways and elevated roads, while also preventing drowsy driving and reduced awareness.
[0213] If the driver assistance system 4 receives positive feedback from anime fans, it will be expanded to include casual anime fans and general users to make it more versatile. The casual anime fan group refers to users who were interested in anime when they were younger, watch anime with their families, and have no problem watching late-night anime. For example, younger generations are likely to have less resistance to anime watched by core anime fans. This is because the amount of anime content broadcast late at night is enormous, and young people who live a nocturnal lifestyle are likely to have watched several of these shows as a matter of course. General users, such as salespeople who frequently travel on highways, often purchase the cheapest radar detectors available, but this is mainly due to concerns about license suspension due to speeding. On the other hand, a decrease in concentration is a major enemy for drivers who drive for long periods, and some people try to restore their concentration by talking (speaking and listening) using hands-free phones. By providing drivers who frequently use such highways with a device that allows them to hear and speak (including agreement and interjections), we can help prevent a decline in concentration while driving and potentially offer products that are more interesting and have higher added value.
[0214] When expanding to the aforementioned user base, it is essential to differentiate between the core audience and the rest. The following methods can be used for differentiation: • We will sell models with limited quantities of printed materials, audio, etc. • Ensure that it is not possible to obtain anything other than the limited edition model. • We will distribute audio and image files owned by a limited number of users, such as web members. However, we will only provide a very small portion of them, not all of them. Depending on the restrictions on voice actors, it might be acceptable to sell the audio separately as anime voices and non-anime voices. This would increase the premium value of the limited edition models. Sales channels will be restricted for core customers, while general sales channels will be considered for other customers.
[0215] The specific devices covered under Driver Assistance System 4 are as follows: • Car navigation system (with map) • Dashcam (without a map) • Radar detector (does not carry a map) • Radar detector (with map) • Other in-vehicle devices connected via OBD connector, or equipped with map information or GPS functionality.
[0216] The conditions for operating in a mode that outputs character information to the user are as follows: (1) In voice-activated mode (roads registered on the map), it is best to consider a road as a highway or elevated road if it is traveling at 55 km / h for 2 minutes or more. Also, (2) In voice-activated mode (roads that are registered on the map but may have been changed to new roads, the user does not have a map, roads not registered on the map, etc.), it is best to consider a road as a highway or elevated road if it is traveling at 55 km / h for 5 minutes or more.
[0217] In all cases, it is best to identify the vehicle speed information by referring to the OBD data or GPS data. (1) In voice prompt mode, it is best to set it to always provide voice prompts during acceleration, deceleration, and changes in direction. It is also good to have the driver memorize the phrases used for acceleration, deceleration, and changes in direction. This will help the driver understand the situation if they fall asleep or become disoriented while driving, as they will hear a familiar voice and phrases. In some cases, it is also good to set other modes to change the criteria for voice prompts.
[0218] The device to be attached should perform the following functions: 1. Acceleration • Significant increase in fuel injection amount based on OBD data, resulting in a rapid increase in speed. • Acceleration G measurement using a gyro sensor • Rapid increase in speed due to GPS data In these cases, it's best to output sounds like "fast, let's go, whoooo," etc.
[0219] 2. Deceleration • Fuel injection cut-off time (e.g., 2 seconds or more) and rapid decrease in speed based on OBD data. • Measurement of deceleration G using a gyro sensor • Rapid decrease in speed based on GPS data In these cases, it would be good to output voice prompts such as "Fuel cut, speed decreasing, brakes, etc."
[0220] 3. Measurement using left and right gyro sensors In this case, it would be good to output voice messages such as "We're turning right (left), we're still turning, the curve is long, etc."
[0221] To enhance driver concentration through comfort, the dialogue should be positive and create a favorable impression whenever possible. Avoid negative comments such as "bad," "bad," or anything else that might upset the driver, or warnings that the vehicle is dangerous. Instead, focus on providing feedback on acceleration, deceleration, and lateral changes. The reason for avoiding negative expressions like "dangerous" is that it is difficult for the system to logically calculate such situations, although this rule does not apply if the system can logically calculate future dangerous situations.
[0222] 4. Contact the prefectures currently involved in the process at the prefectural border. It is helpful to give the driver a general idea of the route to their destination by calling out to them or recognizing their approximate location. This can help prevent the driver from driving with reduced awareness or falling asleep at the wheel.
[0223] 5. Near parking areas and service areas It is a good idea to call out to the driver a certain distance before the destination. By calling out to the driver or announcing a place where they can take a break, you can encourage them to take a break and prevent them from driving with reduced awareness or falling asleep at the wheel.
[0224] 6. Call out before sharp curves / series of curves. It is a good idea to speak to the driver a certain distance before the target. By speaking to them or announcing that there is a change in driving, you can make them more alert and prevent them from driving with reduced awareness or falling asleep at the wheel.
[0225] 7. Call out before the branching / merging point. It is a good idea to speak to the driver a certain distance before the target. By speaking to them or announcing that there is a change in driving, you can make them more alert and prevent them from driving with reduced awareness or falling asleep at the wheel.
[0226] Even if conditions 8.1-7 are not met, it is a good idea to check in with them regularly. For example, every two minutes would be appropriate. It is a good idea to speak to the driver using voices that evoke images related to the scenery of the highway, lines that sound like they would be spoken by a passenger, relatable content (that makes the driver want to nod in agreement), and surprising content (that makes the driver want to make a witty remark). Also, to prevent a decrease in concentration due to driving alone, it is a good idea to have the driver speak to them using interesting lines from anime characters. [Explanation of symbols]
[0227] 4. Driver assistance systems 5 SD cards 48 Display section 51 speakers 41 Control Unit 54 Accelerometer
Claims
1. A driver assistance system that assists the driver in driving, It comprises a display unit and a control unit, When the control unit identifies a target by receiving a wireless signal, it arranges a ring-shaped pattern resembling radio waves around the character and displays it on the display unit. A driver assistance system characterized by the following features.
2. Equipped with additional speakers, The control unit outputs a character voice from the speaker to notify the driver that the character has transformed. The driver assistance system according to claim 1, characterized by the following:
3. The aforementioned character voice includes the phrase "Henshin" (transformation). The driver assistance system according to claim 2, characterized by the following:
4. The aforementioned targets include speed measuring devices and police emergency vehicles. A driving assistance system according to any one of claims 1 to 3, characterized by the above.
5. Equipped with an additional microwave receiver, The control unit outputs alarm information when the microwave receiver detects a signal corresponding to a microwave in the frequency band emitted from the speed measuring device. A driver assistance system according to any one of claims 1 to 4, characterized by the above.
6. The control unit will cause the character to disappear from the display unit if the output of character information corresponding to a sudden left turn continues for a predetermined number of times within a predetermined time, or if the degree of speeding is very large in a speeding warning. A driver assistance system according to any one of claims 1 to 5, characterized by the above.
7. In the case of a very large degree of speeding, the vehicle speed must be greater than the speed limit plus 30 km / h. The driving assistance system according to claim 6, characterized by the following:
8. The control unit includes a function to make the character disappear from the display unit, and to display the character information on the display unit after a predetermined time has elapsed since the character disappeared from the display unit. A driving assistance system according to claim 6 or 7, characterized by the following:
9. A program for a computer to implement the functions of the driver assistance system described in any one of claims 1 to 8.