Electronic device and program or the like

Abstract

To improve, for example, the functionality of a system that uses an electronic device used in a vehicle by proposing a mechanism that differs from the conventional one.SOLUTION: A system 1 includes an electronic device 10 used in a vehicle 40. The electronic device 10 comprises: a state detection unit for detecting whether the vehicle 40 is in a predetermined stopped state; and a phrase processing unit for executing a phrase process for outputting a voice of a predetermined phrase to a user. The phrase processing unit executes a predetermined first phrase process if the vehicle 40 is in a predetermined first stopped state and suppresses the execution of the first phrase process if the vehicle 40 is in a predetermined second stopped state.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an electronic device, a program, and the like. [Background technology]

[0002] Patent Document 1 discloses a system that displays a character and outputs information that contributes to the user's safe driving. Patent Document 1 discloses that the intimacy between the user and the character is improved based on information on the vehicle's mileage, and the character's voice is output based on the intimacy. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-169873 A Summary of the Invention [Problem to be solved by the invention]

[0004] One of the objects of the present invention is to improve the functionality of electronic devices used in vehicles, for example, by proposing a mechanism different from the conventional one.

[0005] The purpose of the present invention is not limited to this, and the applicant intends to obtain rights for configurations that aim to obtain effects from parts of the configurations disclosed in this specification and drawings, etc., by filing a divisional application, amendment, etc. For example, this specification discloses a problem in which the part described as "can be" in this specification is read as "the problem is to be". The problems are described as being independent, and the applicant intends to obtain rights for the configurations for solving each problem separately by filing a divisional application, amendment, etc. Even if the problems are implicitly understood from the description in the specification, the applicant intends to include part of the configurations described in this specification in the scope of the patent claim by amendment or divisional application. In addition, the applicant has disclosed a configuration that solves a problem that combines these independent problems, and intends to obtain rights for it. [Means for solving the problem]

[0006] (1) It is desirable to provide an electronic device for use in a vehicle, the electronic device having a state detection unit that detects that the vehicle is in a predetermined stopped state, and a phrase processing unit that executes phrase processing to output a predetermined phrase to a user, wherein the phrase processing unit executes a predetermined first phrase processing when the vehicle is in a predetermined first stopped state, and suppresses execution of the first phrase processing when the vehicle is in a predetermined second stopped state.

[0007] In this way, a user of an electronic device that is used in a vehicle and executes phrase processing to output a predetermined voice phrase to the user can be exposed to the first phrase processing or the opportunity for exposure to the first phrase processing can be reduced depending on the stopped state of the vehicle. In this way, the first phrase processing can be prevented from affecting the safe use of the vehicle by the user.

[0008] The electronic device used in the vehicle may be, for example, a detector such as a radar detector or a laser detector, but may also be a navigation device, a drive recorder, or other in-vehicle device. The electronic device used in the vehicle may be an electronic device that is retrofitted to the vehicle.

[0009] The first phrase processing may be a phrase processing that is relatively long from start to end. Such a first phrase processing may include a phrase processing that outputs a voice of a phrase that means a question to the user. Such a first phrase processing is particularly preferably a dialogue processing that recognizes a response from the user to a question to the user and further outputs a voice of a phrase in response to the response. Alternatively, the first phrase processing may be a phrase processing that outputs a voice of a phrase of a predetermined length or more to the user.

[0010] The first stopped state may be a stopped state suitable for executing the first phrase processing. The second stopped state may be a stopped state unsuitable for executing the first phrase processing. The first stopped state may be a stopped state in which sufficient time is ensured to complete the first phrase processing, particularly when the vehicle is stopped in a parking lot (i.e., parked). The second stopped state may be a stopped state in which sufficient time is not ensured or is difficult to ensure to complete the first phrase processing, particularly when the vehicle is waiting at a traffic light. The second stopped state may be specified as a state in which the vehicle is stopped and is not in the first stopped state. Alternatively, the first stopped state may be specified as a state in which the vehicle is stopped and is not in the second stopped state.

[0011] (2) The first phrase processing may be an interactive processing including a process of outputting a voice of a phrase meaning a question to the user, and a process of recognizing a response from the user and further outputting a voice of a phrase in response to the response.

[0012] In this way, the user can access the dialogue processing when the vehicle is in an appropriate stopped state. The dialogue processing requires the active action of the user to respond to questions, which makes the user more conscious of the dialogue processing. Since the execution of the dialogue processing is suppressed in the second stopped state, the dialogue processing can be executed while taking into consideration the safe use of the vehicle by the user.

[0013] (3) The phrase processing unit further executes a second phrase processing, which comprises a process of outputting a predetermined phrase to the user, and when the vehicle is in the second stopped state, suppresses execution of the first phrase processing, but may execute the second phrase processing without suppressing it.

[0014] In this way, even if the execution of the first phrase processing, which is a dialogue processing, is suppressed, the execution of the second phrase processing consisting of a processing for outputting a voice of a predetermined phrase to the user is not suppressed, so that the user can have many opportunities to come into contact with the phrase processing while taking into consideration the safe use of the vehicle by the user. The second phrase processing is based on the idea that if the second phrase processing is a phrase processing that does not include a processing for recognizing a response from the user and further outputting a voice of a phrase in response to the response, the user is less conscious of the second phrase processing than the first phrase processing, and it is easier to ensure safe driving by the user. It is particularly good to use the second phrase processing as a phrase processing that involves one-sided speech to the user.

[0015] (4) The second stopped state may be a state in which the vehicle is waiting for a traffic light.

[0016] In this way, the user is less likely to encounter the first phrase processing when the vehicle is waiting at a traffic light, which makes it easier to use the vehicle safely. When the vehicle is waiting at a traffic light, the user may be forced to start the vehicle immediately after the start of the first phrase processing, and in that case, it may be difficult to complete the first phrase processing, which takes time from start to finish. For example, the user may be forced to start the vehicle in the middle of the dialogue processing, which may result in the dialogue processing being interrupted midway. The possibility of such a situation occurring can be reduced.

[0017] (5) The vehicle may include a position information acquisition unit that acquires position information of the vehicle based on the results of positioning by a global navigation satellite system, and a display processing unit that performs processing to display the position of the vehicle on a road on a map by correcting the position information based on a map matching function, and the state detection unit may detect that the vehicle is waiting at a traffic light when the vehicle is stopped and the position information has not been corrected by the map matching function.

[0018] In this way, it is possible to easily detect whether the vehicle is waiting at a traffic light by utilizing the map matching function, which displays the vehicle's position on a road on a map by correcting the location information measured by a global navigation satellite system.

[0019] (6) The vehicle navigation system may have a connection unit to which an external in-vehicle device is connected and a linking processing unit that realizes functions linked with the in-vehicle device, and the phrase processing unit may execute or suppress execution of a third phrase processing having content related to the in-vehicle device depending on the connection record of the in-vehicle device to the connection unit.

[0020] In this way, the user can access a third phrase process that discusses topics related to external electronic devices connected to the electronic device, and the timing of execution of this third phrase process can be customized to be appropriate depending on the past connection history of the in-vehicle device.

[0021] (7) The phrase processing unit may be configured not to execute the third phrase processing if the in-vehicle device has been connected to the connection unit at least once.

[0022] In this way, when a user already owns an in-vehicle device and is using it by connecting it to an electronic device, the execution of the third phrase processing having a content related to the in-vehicle device is suppressed, so that appropriate phrase processing can be executed for the user. In particular, when the phrase processing is related to an explanation of the in-vehicle device or a promotion to purchase the in-vehicle device, such as an advertisement for the in-vehicle device, the execution of phrase processing that is unnecessary for the user can be suppressed.

[0023] (8) Preferably, suppressing the execution of the first phrase processing means not executing the first phrase processing.

[0024] In this way, the first phrase process is not executed when the vehicle is in the second stopped state, which contributes to safer use of the vehicle by the user.

[0025] (9) The vehicle may include a location information acquisition unit that acquires location information of the vehicle based on the results of positioning by a global navigation satellite system, and a geographical range identification unit that sequentially identifies the geographical range in which the vehicle is located from among multiple geographical ranges divided into predetermined units based on the location information, and the phrase processing unit may execute a fourth phrase processing regarding the current location of the vehicle when the vehicle is in a traveling state and the geographical range in which the vehicle is located has changed and then the vehicle has traveled a predetermined distance within the same geographical range.

[0026] In this way, the user can access the fourth phrase processing related to the vehicle's current location, which is executed when it is determined based on the location information that the vehicle is traveling in a predetermined geographical range, while the user is actually traveling in that geographical range. In the global navigation satellite system and other types of positioning technology, the location information obtained by positioning may contain an error (i.e., a positioning error), but it is possible to reduce the possibility that the fourth phrase processing related to the vehicle's current location is executed at an incorrect timing due to the positioning error or the like. The geographical range is preferably a prefecture in particular, but may be a geographical range divided into other units such as a city, ward, town, or village. The fourth phrase processing related to the current location may be a process of outputting a voice of a phrase related to the geographical range to which the current location belongs, such as a local phrase.

[0027] (10) The predetermined travel within the same geographical area may be the vehicle traveling a predetermined distance within the same geographical area.

[0028] In this way, the user can access the fourth phrase process related to the vehicle's current location when the vehicle is currently traveling within the corresponding geographical range. Even if a positioning error exists, if the vehicle has traveled a predetermined distance within the same geographical range, it is highly likely that the vehicle is currently traveling within that geographical range.

[0029] (11) A display processing unit that performs processing to display the position of the vehicle on a road on a map by correcting the position information based on a map matching function, and the phrase processing unit may determine that the vehicle is in the driving state when the vehicle is traveling at a predetermined speed or faster and the position information has been corrected using the map matching function.

[0030] In this way, by utilizing the map matching function, it is possible to simply determine whether the vehicle is traveling within a predetermined geographical range.

[0031] (12) The vehicle may have an alarm processing unit that issues an alarm according to a positional relationship between the vehicle and a specified object while the vehicle is traveling, and if the phrase processing unit determines that the specified traveling has occurred within the same geographical range while the alarm processing is being executed while the vehicle is traveling, it may execute the fourth phrase processing after the alarm processing is executed.

[0032] In this way, when it is determined that the vehicle is traveling within the same geographical area, and a notification is being made according to the positional relationship between the vehicle and a predetermined object, the user can prioritize understanding the content of the notification, but can also access the fourth phrase processing after the notification has ended.

[0033] This is based on the idea of ​​giving a priority to the notification according to the positional relationship between the vehicle and a predetermined object over the fourth phrase processing. The condition for making the notification may be, for example, that the vehicle has a predetermined proximity relationship with the predetermined target object. The notification processing may be a processing for notifying the user that the vehicle has the proximity relationship. The notification processing may particularly include a processing for issuing an alarm to the user who is using the vehicle. The alarm processing may particularly be a processing for issuing an alarm when the vehicle has a predetermined proximity relationship with a speed control point that regulates the vehicle speed.

[0034] (13) The phrase processing includes a performance in which a specified character speaks, and includes a calculation unit that calculates a parameter indicating a relationship between the user and the character, and an indicator display processing unit that performs processing to display an indicator indicating the speed of the vehicle, wherein the calculation unit calculates the parameter based on the relationship between the speed of the vehicle and the speed limit of the road on which the vehicle is traveling, and the indicator display processing unit changes the display mode of the indicator depending on the effect that the speed of the vehicle has on the parameter when the speed of the vehicle exceeds the speed limit.

[0035] In this way, the user can see by the indicator whether the vehicle speed exceeds the speed limit, and can also understand the effect that exceeding the speed limit will have on the parameter indicating the relationship between the user and the character. In particular, when the speed limit is exceeded by a predetermined speed and a parameter is calculated that indicates a worsening of the relationship between the user and the character, by making this fact visually understandable, the user can be more strongly encouraged to use the vehicle safely.

[0036] (14) The indicator display processing unit changes a display mode of the indicator depending on whether or not to change the parameter in a direction that worsens a relationship between the user and a predetermined character, based on a relationship between a speed of the vehicle and a speed limit of a road on which the vehicle is traveling. It is good.

[0037] In this way, when a parameter in a direction in which the relationship between the user and the character deteriorates is calculated based on the relationship between the vehicle speed and the speed limit of the road on which the vehicle is traveling, this fact can be visually grasped, so that the user can be more strongly encouraged to drive safely. In particular, when a parameter in a direction in which the relationship between the user and the character deteriorates when the speed limit is exceeded by a predetermined speed is calculated, the user can be encouraged to refrain from driving the vehicle at a speed significantly exceeding the speed limit.

[0038] (15) The indicator display processing unit may change the position pointed to by the indicator in accordance with the speed of the vehicle, and may change the display mode of the indicator by changing the color of the indicator.

[0039] In this way, the user can determine the vehicle's speed from the position indicated by the indicator, and can easily determine from the change in color of the indicator the impact that exceeding the speed limit will have on the parameters indicating the relationship between the user and the character.

[0040] (16) Phrases used in the phrase processing are classified into one of a plurality of categories depending on the content of the phrase, and the phrase processing unit may select phrases belonging to a predetermined first category more frequently than it selects phrases belonging to a predetermined second category.

[0041] In this way, the frequency of selection in phrase processing can be changed according to the content of the phrase used in phrase processing. By keeping the frequency of selection of a particular phrase selected in phrase processing low, it is possible to reduce the possibility that the voice of that particular phrase will be unpleasant to the ears of the user.

[0042] (17) The first category may include more short phrases or have a larger number of phrases than the second category.

[0043] In this way, subcategories in which short phrases are more likely to be selected or in which the same phrase is less likely to be selected multiple times are preferentially selected, thereby reducing the possibility that the sound of a particular phrase will be unpleasant to the user.

[0044] (18) The vehicle may have a function of communicating with an external terminal device, and may transmit information that changes depending on the vehicle's usage status to the terminal device.

[0045] In this way, the user can check the information that changes depending on the usage status of the vehicle using a terminal device external to the electronic device, which is particularly preferably a portable terminal device such as a smartphone or a tablet computer.

[0046] (19) The phrase processing may include a performance in which a specified character speaks, and may have a calculation unit that calculates parameters indicating a relationship between the user and the character, and the parameters may be included as information that changes depending on the usage status of the vehicle.

[0047] In this way, the user can use the terminal device to check the parameters indicating the relationship between the user and the character, which are used in phrase processing by the electronic device.

[0048] (20) It is preferable that a program is provided to a computer for realizing the functions of any of the electronic devices described above.

[0049] In this way, a user of an electronic device that is placed in a vehicle and executes phrase processing to output a predetermined voice phrase to the user can be exposed to the first phrase processing or the opportunity for exposure to the first phrase processing can be reduced depending on the stopped state of the vehicle. In this way, the first phrase processing can be prevented from affecting the safe use of the vehicle by the user.

[0050] The inventions shown in (1) to (20) above can be arbitrarily combined. For example, it is preferable to add at least a part of the configuration of at least one of the inventions after (2) to all or a part of the configuration of the invention shown in (1). In particular, it is preferable to add at least a part of the configuration of at least one of the inventions after (2) to the invention shown in (1). In addition, it is also possible to extract any configuration from the inventions shown in (1) to (20) and combine the extracted configurations. The applicant of this application intends to obtain rights to the inventions including these configurations. In addition, even if there is a description such as "in the case of" or "when", it is not intended to describe the configuration as being limited to that case or time. These are examples of better configurations, and the applicant intends to obtain rights to configurations other than these cases or times. In addition, the parts described in order are not limited to this order. Configurations in which some parts have been deleted or the order has been changed are also disclosed, and the applicant intends to obtain rights. Effect of the Invention

[0051] According to the present invention, by proposing a mechanism different from the conventional one, it is possible to improve the functionality of a system that utilizes electronic devices used in a vehicle, for example.

[0052] The effect of the invention of the present application is not limited to this, and the effect achieved from the configuration disclosed in the specification and drawings, etc. is also disclosed, and there is an intention to obtain rights to the configuration achieving said effect through divisional applications, amendments, etc. For example, in this specification, the part that states "can..." is a description that clearly indicates the effect achieved, and there are parts that show the effect even without the description "can...". Also, there are effects that can be understood from the configuration even without such a description. [Brief description of the drawings]

[0053] [Figure 1] FIG. 1 is a diagram illustrating an overview of an electronic device according to an embodiment of the present invention. [Diagram 2] FIG. 11 is a diagram showing an example of notification information according to the embodiment. [Diagram 3] FIG. 2 is a diagram illustrating a configuration of a system according to the embodiment. [Figure 4] FIG. 2 is a block diagram showing an electrical configuration of the electronic device according to the embodiment. [Diagram 5] 13 is a diagram showing a configuration of a phrase management table according to the embodiment. FIG. [Figure 6] FIG. 2 is a block diagram showing an electrical configuration of a terminal device according to the embodiment. [Figure 7] 10 is a flowchart showing a process related to a notification function according to the embodiment. [Figure 8] 13 is a flowchart showing a process flow for an indicator value / intimacy calculation function according to the embodiment. [Figure 9] 13 is a diagram showing the relationship between the excess speed, the distance subtracted per second, and the estimated time until the traveling speed reaches 0 km when the starting traveling distance is 100 km according to the embodiment. FIG. [Figure 10] 13 is a diagram showing the reduction in running distance depending on the number of falls of Ray according to the embodiment. FIG. [Figure 11] 13 is a diagram showing the relationship between the connection status of the optional device according to the embodiment and a coefficient by which the rate of increase or efficiency of the indicator is multiplied. FIG. [Figure 12] A figure showing the relationship between the power-off time, the attenuation rate of distance x, and the remaining indicator level when the accessory power is next turned on in the case where the indicator value is positive when the accessory power is turned off in the same embodiment. [Figure 13] 13 is a diagram showing the relationship between the mileage when the accessory power supply is turned off and the indicator value when the accessory power supply is turned on according to the embodiment; FIG. [Figure 14] 13 is a flowchart showing a process related to a G sensor processing function according to the embodiment. [Figure 15] 5 is an explanatory diagram of G sensor sensitivity according to the embodiment. FIG. [Figure 16] 11 is an explanatory diagram of a condition for generating a G sensor event according to the embodiment. FIG. [Figure 17]13 is a flowchart showing a process related to a phrase processing function according to the embodiment. [Figure 18] 13 is a flowchart showing a process related to a phrase processing function according to the embodiment. [Figure 19] 13 is a flowchart showing a process related to a phrase processing function according to the embodiment. [Figure 20] 13 is a flowchart showing a process related to a phrase processing function according to the embodiment. [Figure 21] 11 is a diagram illustrating a method for determining an utterance interval according to the embodiment. FIG. [Figure 22] 13A to 13C are diagrams showing phrases output in processing related to the phrase processing function according to the embodiment. [Figure 23] 13 is a flowchart showing phrase processing related to the prefectural border phrase speaking function according to the embodiment. [Figure 24] 13 is a diagram illustrating a specific example of phrase processing related to the prefectural border phrase speaking function according to the embodiment. FIG. [Diagram 25] 13 is a diagram illustrating a specific example of phrase processing related to the prefectural border phrase speaking function according to the embodiment. FIG. [Figure 26] 13 is a diagram illustrating a specific example of phrase processing related to the prefectural border phrase speaking function according to the embodiment. FIG. [Figure 27] 13 is a diagram illustrating a specific example of phrase processing related to the prefectural border phrase speaking function according to the embodiment. FIG. [Figure 28] 10 is a flowchart showing an indicator display process related to a speed indicator display function according to the embodiment; [Figure 29] 11A to 11C are diagrams illustrating a process related to a speed indicator display function according to the embodiment. [Diagram 30] 11A to 11C are diagrams illustrating a process related to a speed indicator display function according to the embodiment. [Diagram 31] 11A to 11C are diagrams illustrating a process related to a speed indicator display function according to the embodiment. [Diagram 32] 11A to 11C are diagrams illustrating a process related to a speed indicator display function according to the embodiment. [Diagram 33] 13 is a flowchart showing phrase processing according to the embodiment. [Diagram 34] 11 is a sequence diagram showing a process related to the initial setting of a link function according to the embodiment. FIG. [Diagram 35] 11 is a sequence diagram showing processing related to data linking of the linking function according to the embodiment. FIG. [Diagram 36] 11A and 11B are diagrams showing examples of screens displayed on the terminal device according to the embodiment. [Figure 37] 11A and 11B are diagrams illustrating another form of the electronic device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0054] Hereinafter, the embodiments will be described in detail with reference to the drawings. The embodiments shown below are examples of the embodiments of the present invention, and the present invention is not limited to these embodiments. In the following description, the labeling using the numerical values ​​1, 2, ... is for identifying each element, and does not determine the number of elements. In the drawings referred to in this embodiment, the same parts or parts having similar functions are given the same or similar symbols (symbols with A, B, etc. added after the numbers), and repeated explanations may be omitted. In addition, in each drawing referred to in the following description, the scale may be different from the actual scale in order to make each member, each area, etc. recognizable. Hereinafter, the system of the present invention will be described by taking as an example a case where the system is an electronic device used in a vehicle and includes an electronic device that functions as a detector that detects and notifies speed control points.

[0055] [1. Overview of Electronic Device 10] FIG. 1 is a diagram for explaining an overview of an electronic device 10 according to a first embodiment of the present invention. The electronic device 10 is an electronic device used in a vehicle, and provides various information to a driver and other users. The electronic device 10 is an in-vehicle device having a function of a so-called radar / laser detector, and has a function of providing information that contributes to safe driving by the driver. The electronic device 10 may be, for example, a device that is purchased by a user separately from the vehicle 40 and later installed on the vehicle 40 (also called an aftermarket product). The vehicle 40 may be, for example, an internal combustion engine vehicle having an engine as a drive source, a hybrid vehicle having an engine and a driving motor as drive sources, an electric vehicle having a driving motor as a drive source, or the like. The vehicle 40 may be a four-wheeled vehicle, but is not limited to a four-wheeled vehicle, and may be, for example, a two-wheeled vehicle such as a motorcycle, or a large transport vehicle having four or more wheels.

[0056] Moreover, the electronic device 10 has a function that allows the user to have pseudo-communication with the character through dialogue. Furthermore, the electronic device 10 has a function that allows the user to improve the relationship between the user and the character and increase the intimacy level by driving safely, so that the relationship can become more intimate. The electronic device 10 has a function that outputs various information to the user according to the relationship between the user and the character. The electronic device 10 may be configured so that the user can select either a mode in which "Kirishima Rei" is displayed as a character (e.g., Rei mode) or a mode in which this character is not displayed (e.g., normal mode). The configuration related to the character described below is a configuration related to the former mode. The appearance of such a character in the electronic device 10 can attract the interest and attention of the user, which can contribute to the provision of attractive products and the improvement of awareness of safe driving. The appearance of such a character in the electronic device 10 also contributes to the business operators who manufacture and sell the electronic device 10 and to the improvement of the name recognition of the character. The character "Kirishima Rei" may be referred to as "Rei" below. "Kirishima Rei" is one of the mascot characters of Yupiteru Corporation, a company that manufactures and sells electronic devices such as electronic device 10, and is one of the characters that symbolize Yupiteru Corporation.

[0057] The normal screen SC01 shown in FIG. 1 is an example of an image displayed on the electronic device 10 in a normal state. The normal screen SC01 includes, as display elements, a map 300, a vehicle icon I, a character 200, an indicator image 210, and an intimacy image 220. The map 300 is a map of the surroundings of the current position of the vehicle. In a normal state, the map 300 is displayed as a multi-colored (color) image. The vehicle icon I is an icon that is placed at the current position of the vehicle and superimposed on the map 300. The character 200 is displayed superimposed on the map 300, and is displayed in 3D animation so that the user can get a three-dimensional feeling. Here, the character 200 is displayed in the appearance of the character 200A. The electronic device 10 has a function of allowing the user to obtain the costume and other accessories of the character 200 as items, and has a function of displaying the character 200 wearing the acquired costume and accessories. It should be noted that the objects displayed in the 3D animation are not limited to characters, but may be display elements such as objects exemplified by icons and maps.

[0058] The indicator image 210 is an image that shows a value (hereinafter referred to as the "indicator value") indicating the mood of the character (i.e., Ray). The indicator value changes depending on the user's driving, and is a value that indicates how Ray is currently feeling. The calculation method will be described in detail later, but the indicator value also serves as an indicator of the user's safe driving. It is preferable that the indicator image 210 is displayed at all times to encourage the user to be conscious of safe driving.

[0059] The indicator image 210 is an image that resembles a heart. For example, when the indicator value is "0", the inside of the indicator image 210 is not filled in and is transparent, and the area of ​​the map 300 in the background can be seen. When the indicator value is "+0.5", the indicator image 210 is an image in which the lower half of the inside of the heart is filled in and the other half is not filled in and is transparent. The larger the indicator value is, the larger the area that is filled in, and when it is "+1.0", the entire inside of the heart is filled in. When the indicator value L is "-0.5", the indicator image 210 is an image in which half of the heart is displayed and the other half is hidden and is transparent. The smaller the indicator value is, the larger the area that is hidden, and when it is "-1.0", it is preferable that the entire heart or most of it is hidden. The indicator image 210 may be an image other than an image that resembles a heart, for example, an image of a bar graph or other graph.

[0060] The intimacy image 220 is an image showing the intimacy between the user and the character. Here, the intimacy image 220 is an image with a numerical value indicating the level of the user arranged inside a circular area. This level means the intimacy. The intimacy image 220 may be displayed in other forms. The intimacy is an example of a parameter indicating the quality of the relationship between the user and the character. The higher the intimacy, the better the relationship between the user and the character, and the lower the intimacy, the worse the relationship between the user and the character (i.e., the worsened relationship). In addition to this, the normal screen SC01 also includes information such as an icon indicating the presence of a target arranged on the map 300 (for example, an icon indicating a police station) and the current vehicle speed (here, 0 km / h).

[0061] The normal screen as described above is a screen different from a notification screen described later, and can be said to be an example of a standby screen or a home screen displayed in a standby state of the electronic device 10. The electronic device 10 may be configured so that the user can set the normal screen to any screen (for example, a screen that displays a background image).

[0062] 2 is an example of an image displayed on the electronic device 10 when the vehicle is in a predetermined proximity relationship with a predetermined target (i.e., when a notification is issued). The target is a so-called POI (Point of Interest), and is typically a target on the road that a user should pay attention to.

[0063] The notification screen SC02 includes, as display elements, a map 300, a vehicle icon I, a character 200, an indicator image 210, and an intimacy image 220. The map 300 is a map of the surroundings of the current position of the vehicle, and is particularly preferable if it is displayed in a color different from that of the map 300 on the normal screen, since it makes it easier for the user to recognize that a notification has been made. The map 300 is displayed mainly in two colors, for example, with roads in green and other areas in black. In FIG. 2, the character 200 is displayed in the appearance of the character 200B. The character 200B represents the appearance of the character 200A after transformation, and has a different hairstyle and clothes from the character 200A. When the notification screen notifies the presence of a predetermined object to be warned, such as a speed control point, the transformed character 200B is displayed. The indicator image 210 and the intimacy image 220 have already been described.

[0064] The notification screen SC02 may further include notification information 230 as a display element. The notification information 230 is information indicating that the vehicle is in a predetermined proximity relationship with a target. The notification information 230 may be displayed, for example, by a window superimposed on the map 300. In the example of FIG. 2, the notification information 230 indicates a display in which the vehicle is in a predetermined proximity relationship with a laser-type speed camera (an example of a speed measurement device). Here, the notification information 230 includes information on the type of speed measurement device that the vehicle is approaching and the distance to that speed measurement device. The content of the notification information 230 changes depending on the type of speed measurement device, the distance to that speed measurement device, and other factors.

[0065] [2. System 1 Configuration] <2-1. Overall configuration of System 1> Fig. 3 is a diagram showing the configuration of the system 1. Fig. 3(A) is a diagram showing the overall configuration of the system 1. Fig. 3(B) is a diagram showing an example of the external appearance of the electronic device 10. The electronic device 10 is broadly divided into a main body unit 101 and a fixed unit 102. Fig. 3(B) shows a photograph of the external appearance of the electronic device 10.

[0066] The system 1 includes an electronic device 10 and a terminal device 60. The electronic device 10 and the terminal device 60 communicate with each other via a communication line NW. The communication line NW includes Wi-Fi (registered trademark). When both are in the cabin of a vehicle 40, the electronic device 10 and the terminal device 60 can communicate with each other wirelessly. The standard of the communication line NW is not particularly limited, and includes, for example, a wireless communication LAN of a standard other than Wi-Fi (registered trademark) and a public communication line of a standard such as LTE, 4G, 5G, or the like. The communication path between the electronic device 10 and the communication line NW and the communication path between the terminal device 60 and the communication line NW are preferably wireless communication paths, but may include a wired communication path.

[0067] In this embodiment, the electronic device 10 and the terminal device 60 are used by the same user U. The user U is a user of the vehicle 40, for example, a driver who drives the vehicle 40. The terminal device 60 is a smartphone in this embodiment, but may be a communication terminal other than a smartphone. For example, the terminal device 60 may be a mobile terminal device such as a tablet terminal, a feature phone, or a wearable terminal. In this embodiment, the system 1 includes one electronic device 10 and one terminal device 60, but may include multiple of either one.

[0068] <2-2. Configuration of Electronic Device 10> The electronic device 10 has a notification function of outputting information for notifying a user that the electronic device 10 is in a predetermined proximity relationship with the speed measurement device as a target. The speed measurement device is used to measure the speed of the vehicle 40 and enforce the speed of the vehicle 40. The speed measurement device 30 shown in FIG. 3(A) is a laser type speed measurement device. The electronic device 10 receives laser light as a speed measurement signal emitted by the speed measurement device 30 and notifies the presence of the speed measurement device 30. The speed measurement device 30 is installed at a speed enforcement point where the speed of the vehicle is enforced. The speed enforcement point is determined taking into consideration the driving conditions of the vehicle (e.g., whether the vehicle is likely to speed up) and the occurrence conditions of traffic accidents (e.g., points where a large number of accidents occur). Examples of speed enforcement points include expressways, straight roads, curves, and points beyond curves among routes (roads) on which the vehicle runs. The speed measurement signal is a signal for speed measurement emitted by a speed enforcement device, and may be called a measurement wave for speed enforcement. The appearance of the speed measuring device 30 shown in Fig. 3(A) is one example, and the speed measuring device 30 may have a different appearance. The laser light is a pulse laser having a specific wavelength and a specific pulse width. The specific wavelength belongs to the infrared light region, for example, and is any of 850 nm, 905 nm, 950 nm, and 1900 nm. The pulse width is, for example, approximately 20 ns or approximately 15 ns. The pulse interval is, for example, approximately 80 ms. The "approximately" may be within a specified range that can be regarded as being the same as a reference value or substantially the same as that value.

[0069] As shown in FIGS. 3A and 3B, the electronic device 10 (main body 101) is, for example, a monitor-type device having a substantially rectangular parallelepiped shape. The electronic device 10 is disposed in the passenger compartment of the vehicle 40. The electronic device 10 is installed on the dashboard 41 using, for example, double-sided tape. The housing of the electronic device 10 is formed of resin or other materials. The main body 101 of the electronic device 10 has an opening on its front side. The electronic device 10 has a display unit 13 for displaying an image at the position of the opening, and a touch sensor 191 superimposed on the display area of ​​the display unit 13. The light receiving unit 12 for receiving laser light from the speed measuring device 30 is provided on the rear side of the main body 101. The fixing unit 102 of the electronic device 10 is provided under the main body 101 and is a fixing member for fixing the main body 101 to a predetermined location. The fixing unit 102 is also called a bracket, and functions as a base for the electronic device 10.

[0070] As shown in FIG. 3A, the speed measurement device 30 includes a speed measurement unit 31, an image capture unit 32, and a strobe 33. The speed measurement unit 31 measures the speed of the vehicle, for example, by a laser scanning method. Specifically, the speed measurement unit 31 emits a laser light Lout, and when the laser light Lout reaches the vehicle 40 and is reflected, receives the reflected light Lref. The speed measurement unit 31 measures the distance to the vehicle 40 based on the time required from emitting the laser light Lout to receiving the reflected light Lref. The speed measurement unit 31 repeatedly measures the distance to the vehicle 40, and measures the speed of the vehicle 40 based on the moving distance of the vehicle 40 per unit time. The speed measurement unit 31 emits the laser light Lout within a sector-shaped range T with a central angle of angle θ, for example, while changing the direction in a counterclockwise direction. The emission direction of the laser light Lout is, for example, approximately horizontal. The speed measurement unit 31 emits the laser light to a mirror rotating at a constant speed, for example. The laser light reflected by the mirror and emitted from the light emitting window is the laser light Lout.

[0071] The photographing unit 32 photographs the target vehicle when the speed measured by the speed measurement unit 31 is equal to or greater than a threshold value. The photographing unit 32 is used to photograph a vehicle that has violated the speed limit. The strobe 33 emits light when photographed by the photographing unit 32. The photographing unit 32 may photograph based on light in the infrared region so that it can photograph even at night. In this case, the strobe 33 may emit light having energy in the infrared region. The speed measurement device 30 may have a function of transmitting data related to speed enforcement, such as the measured speed and the photographed image, to an external computer via a communication unit (not shown).

[0072] FIG. 4 is a block diagram showing an electrical configuration of the electronic device 10. The control unit 11 controls each unit of the electronic device 10. The control unit 11 is an example of a first control unit. The control unit 11 is, for example, a computer including an arithmetic processing circuit and a memory. The arithmetic processing circuit includes, for example, a central processing unit (CPU), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other arithmetic processing circuits. The memory includes, for example, a random access memory (RAM) or other volatile memory. The arithmetic processing circuit performs various controls by temporarily reading data into the memory and performing arithmetic processing. The data includes programs for the control unit 11 to execute each function and data for work. The control unit 11 also includes a clock unit that measures time. The clock unit is, for example, a real-time clock. Each function executed by the control unit 11 may be realized by one or more hardware elements, one or more software elements, or a combination of these.

[0073] The light receiving unit 12 is an example of a receiving unit that receives (in other words, receives) laser light. The light receiving unit 12 receives light incident through a window provided on the back side of the electronic device 10, and outputs a signal corresponding to the received light to the control unit 11. The window may be provided with an optical member such as a visible light cut filter or a lens. The signal output by the light receiving unit 12 changes, for example, according to the amount of light received by the light receiving unit 12. The light receiving unit 12 includes, for example, a photodiode as a light receiving element, but may also be a phototransistor or other light receiving element. The light receiving unit 12 has sensitivity at least in the infrared light region. The light receiving unit 12 may include an A / D conversion circuit or the like that converts an analog signal from the light receiving element into a digital signal.

[0074] The display unit 13 displays an image. The display unit 13 is, for example, a 3.2-inch color TFT liquid crystal display. The liquid crystal display is, for example, of an IPS (In Plane Switching) type. The display unit 13 may be an organic EL (Electro Luminescence) display or a display device of another type.

[0075] The audio output unit 14 outputs audio. The audio output unit 14 has, for example, an audio processing circuit and a speaker. The audio output unit 14 may have a configuration for outputting audio via an external device connected by wire or wirelessly. An example of the external device is a speaker device (so-called car audio) that is installed as standard in the vehicle 40. When a wireless connection is used, for example, Bluetooth (registered trademark) may be used.

[0076] The radar receiver 15 is an example of a receiver that receives radar waves as speed measurement signals from a radar-compatible speed measurement device. Radar waves include certain microwaves, stealth waves that emit radio waves only at the moment a certain stealth enforcement device measures, normal radar waves, new radar waves compatible with K-band and X-band z (e.g., MSSS compatible), and cancellation notifications. The radar receiver 15 has, for example, an antenna and a receiving circuit.

[0077] The radio receiving unit 16 receives a radio signal of a predetermined frequency. Examples of the radio signal include radio signals belonging to frequencies of traffic enforcement radio, car location radio, digital radio, special low-power radio, jurisdictional radio, police telephone, police activity radio, tow truck radio, helicopter radio, firefighting helicopter radio, firefighting radio, emergency radio, highway radio, police radio, etc. The reception of a radio signal by the radio receiving unit 16 is also an indicator that the vehicle 40 is in a predetermined proximity relationship with a speed enforcement point. The radio receiving unit 16 has, for example, an antenna and a receiving circuit.

[0078] The position information acquisition unit 17 acquires position information indicating the position of the vehicle 40 (more specifically, the current position). The position of the vehicle 40 can be regarded as the position of the electronic device 10 arranged in the vehicle 40 and the positions of the user U and other people (passengers) riding in the vehicle 40. The position information acquisition unit 17 acquires the position information of the vehicle 40 based on the result of positioning by a global navigation satellite system (GNSS: Global Navigation Satellite System). In this embodiment, the position information acquisition unit 17 may acquire the position information (latitude information and longitude information) of the electronic device 10 based on a signal from a GPS (Global Positioning System), which is one of the GNSS. The position information acquisition unit 17 may also use Michibiki as a Quasi-Zenith Satellite System (QZSS). The position information acquisition unit 17 may acquire the position information of the vehicle 40 from a positioning unit that performs positioning by a global navigation satellite system mounted on the vehicle 40.

[0079] The communication unit 18 communicates with an external device via a communication line NW. In this embodiment, the external device is a terminal device 60. The communication unit 18 wirelessly communicates with the external device, for example, by Wi-Fi (registered trademark), Bluetooth (registered trademark), or other wireless LAN (Local Area Network) communication or short-range wireless communication. The external device is, for example, a smartphone, a tablet computer, or other communication terminal in the vehicle 40. The communication unit 18 may further communicate via a public communication line such as the Internet.

[0080] The input unit 19 accepts information input from a user. The input unit 19 has a touch sensor 191 and a microphone 192. The touch sensor 191 accepts input of a user's operation. The touch sensor 191 detects a position touched by the user. The touch sensor 191 is, for example, a capacitive type or other type. The microphone 192 picks up sound and generates a sound signal indicating the picked up sound. The microphone 192 is, for example, a condenser microphone or other microphone. The input unit 19 may also include physical buttons such as a volume adjustment button and a task button.

[0081] The sensor unit 20 has various sensors. The sensor unit 20 has, for example, an acceleration sensor, a gyro sensor, an air pressure sensor, a temperature sensor, a humidity sensor, and an illuminance sensor. The acceleration sensor is, for example, a three-axis acceleration sensor that detects the acceleration of the vehicle in the forward / backward, left / right, and up / down directions. The gyro sensor is a sensor that detects the inclination of the electronic device 10. The acceleration sensor and the gyro sensor may be used to estimate the position of the vehicle 40 by autonomous navigation when a signal from a GNSS satellite cannot be received. The acceleration sensor and the gyro sensor are also used for processing a predetermined event such as a fall event, which will be described later. The air pressure sensor measures air pressure. The air pressure sensor is used, for example, to detect an elevation difference and determine whether the road is a highway or an ordinary road. The temperature sensor detects temperature. The humidity sensor detects humidity. The illuminance sensor is a sensor that detects illuminance indicating the brightness inside the vehicle cabin, which is the periphery of the electronic device 10. The illuminance sensor is used to adjust the brightness of the display of the display unit 13.

[0082] The mounting unit 21 is a mounting unit in which an external storage medium is mounted. The external storage medium is, for example, a memory card (for example, a microSD card). In this case, the mounting unit 21 is a memory card slot.

[0083] The power supply control unit 22 controls the supply of power to each unit of the electronic device 10. The power supply control unit 22 has, for example, a power switch and a power supply control circuit. The power supply control unit 22 supplies the power supplied from the vehicle 40 side via the connection unit 24 to each unit of the electronic device 10. In this embodiment, the power supply control unit 22 receives power from an accessory power supply (ACC) connected via the connection unit 24 and controls the supply of the power to each unit of the electronic device 10. The power supply on the vehicle 40 side is not limited to the accessory power supply, and may be, for example, a constant power supply (+B). As the power supply, a power supply other than the power supply on the vehicle 40 side, such as a mobile battery, may be used. The power supply control unit 22 has, for example, a power switch and a power supply control circuit. The power supply control unit 22 may further have a battery (for example, a secondary battery or a button battery) or an electric double layer capacitor as a power storage means.

[0084] The light emitting unit 23 emits light in various colors and includes, for example, a light emitting diode.

[0085] The connection unit 24 is connected to an external in-vehicle device (for example, an optional device). The connection unit 24 has, for example, a terminal. For example, a cable that connects to an OBD-II ("II" is a Roman numeral meaning "2") connector mounted on the vehicle 40 may be connected to the connection unit 24. The OBD-II connector is also called a fault diagnosis connector, is connected to the vehicle's ECU, and outputs various vehicle information. The vehicle information includes information regarding the usage status of the vehicle 40. The usage status of the vehicle 40 includes the running status of the vehicle 40. The running status of the vehicle 40 is information regarding the running status of the vehicle 40, and may include, for example, information on the running speed of the vehicle 40. Without being limited thereto, the running status of the vehicle 40 may include information regarding the status of the vehicle, such as information on the injection time, the intake air amount, and the remaining fuel.

[0086] The in-vehicle device connected to the connection unit 24 is a detection device 50 that detects the state of the user. The detection device 50 may be, for example, a DMS (Driver Monitoring System), and may capture an image of the driver of the vehicle 40, and when a specific user state, exemplified by distracted driving and drowsy driving, is detected, output information indicating the detection result to the electronic device 10. The detection device 50 may, for example, detect the direction of the user's face and line of sight based on an image of the driver, and when it detects that the user is distracted or drowsy driving, issue an alarm.

[0087] The on-vehicle device connected to the connection unit 24 is a detection device 55 that detects obstacles around the vehicle 40. Such a detection device 55 is used, for example, for vehicle detection for a forward vehicle collision warning system (FCWS). When there is a possibility of rear-ending a vehicle ahead, the detection device 55 outputs information about the possibility to the electronic device 10. The warning may be issued by a display, sound, light emission, or other method that can be perceived by the driver. The warning may be issued by the electronic device 10, but the detection device 50 or the detection device 55 may also issue the warning. When multiple on-vehicle devices are connected to the connection unit 24, a predetermined option device (adapter) may be used. The on-vehicle device is not limited to the detection devices 50 and 55, and may be on-vehicle devices such as a rear vehicle collision warning system (RCWS) or a drive recorder. It is particularly preferable that the on-vehicle device exhibits a function that contributes to safe driving by the user.

[0088] The storage unit 25 stores data. The storage unit 25 may include a non-volatile memory. The storage unit 25 may include, for example, a flash memory, an EEPROM (Electrically Erasable Programmable Read-Only Memory), or other storage device. The storage unit 25 may include, for example, an optical recording medium, a magnetic recording medium, and a semiconductor recording medium, or other recording medium. The data stored in the storage unit 25 may be stored in cloud computing or other external storage means as appropriate.

[0089] The control unit 11 reads out software from the storage unit 25 into a memory and executes the software. The storage unit 25 stores software for the control unit 11 to perform various controls. The software includes an OS (Operating System) 251 and a program 252 that runs on the OS 251. The OS 251 is, for example, Android (registered trademark), but may be another OS. The program 252 includes programs (for example, application programs) for implementing various functions of the control unit 11, which will be described later. The program 252 may further include a game engine. For example, the game engine may be Unity (Unity3D), which is a game engine with an integrated development environment (IDE). The control unit 11 executes the program 252 to perform a process of adding motion to character model data, and has a function of playing a moving image of a character (for example, the character 200) by 3D animation, in other words, a function of playing a moving image of a 3D character. The program 252 includes a program (voice recognition engine) for executing a voice recognition function. In this embodiment, the voice recognition function is realized by a function of the control unit 11, but may be realized by an external device such as a server device connected via a communication line NW.

[0090] The display data 253 includes data showing an image to be displayed on the display unit 13. The data of the image to be displayed on the display unit 13 may include various data for display, such as schematic diagrams or photographs. The data stored in the storage unit 25 may include data stored at a stage before the product shipment of the electronic device 10, as well as data imported after the product shipment via an external storage medium or the communication unit 18. The data imported after the product shipment includes updated information on information (location information such as longitude and latitude, type information, etc.) of a new target to be notified.

[0091] The display data 253 may include, for example, map data. The map data is data for displaying a map on the display unit 13, and includes, in addition to normal map data such as a road network, information on objects to be warned about and other landmarks, traffic regulation information, and the like. The traffic regulation information also includes information on speed limits set for roads (routes) included in the map. Objects to be warned about include traffic landmarks that require caution. The objects to be alerted include, for example, locations of accidents caused by drowsy driving, speed enforcement devices (laser type, radar type, loop coil type, H system, LH system, photocell type, mobile type, etc.), speed limit change points, enforcement areas, checkpoints, parking monitoring areas, N systems, traffic monitoring systems, intersection monitoring points, signal ignoring prevention systems, police stations, expressway traffic police units, accident-prone areas, areas with high incidence of vehicle theft, sharp / continuous curves (expressway), branching / merging points (expressway), advance ETC lane guidance (expressway), service areas (expressway), parking areas (expressway), highway oases (expressway), smart interchanges (expressway), long / continuous tunnels on expressways, highway radio receiving areas (expressway), roadside stations, view point parking, parking lots, public toilets, gas stations in PAs / SAs (expressway), tunnels (expressway), prefectural border announcements, roadside stations, etc. The storage unit 25 stores information on the type of object, location information indicating the location of the object, and information to be output regarding the notification / alarm of the object (for example, image data to be displayed on the display unit 13 and audio data) in association with each other. The map data of this embodiment is configured such that address information of each point is associated with latitude and longitude information of the point.

[0092] The storage unit 25 further stores intimacy data 254, setting data 255, and phrase management data 256. The intimacy data 254 is data for specifying the indicator value and intimacy described above. The setting data 255 includes data for specifying the contents set by the user for the electronic device 10.

[0093] The phrase management data 256 is data for managing the contents of phrases uttered by the voice of a character. The voice of a character may be a voice in which the contents of a phrase are spoken in the character's voice. The voice data representing the voice of a character may be stored in the storage unit 25 as pre-recorded audio data, for example. Alternatively, the electronic device 10 may use a voice synthesis technique to convert text data into the voice of a character.

[0094] Fig. 5 is a diagram showing an example of the configuration of phrase management data 256. As shown in Fig. 5, the phrase management data 256 associates "phrase ID", "category", "subcategory", "anime 1", "anime 2", "phrase", and "gallery classification". In this embodiment, the phrase management data 256 is data in a table format, and data stored in each of the fields of "category", "subcategory", "anime 1", "anime 2", "phrase", and "gallery classification" may be expressed in the format of text data (character strings), for example.

[0095] "Phrase ID" is identification information that identifies a phrase. "Category" indicates the category (classification) to which the phrase indicated by the phrase ID belongs. "Subcategory" indicates a category (sub-classification) that is a further subdivision of a category. In this embodiment, to make the content easier to understand, categories and subcategories may be represented by sentences that explain the type of corresponding phrase or the situation in which the phrase is used. For example, the category "POI warning" indicates an warning related to a POI (point of interest), and its subcategory "policy area" indicates a POI warning that occurs when there is a specified proximity relationship with a police area, which is an area where speed enforcement is carried out.

[0096] "Animation 1" and "Animation 2" indicate animations that are displayed when a phrase is output by the voice of a character. In the phrase management data 256, information that identifies the animation to be displayed is stored in each of the fields "Animation 1" and "Animation 2". In this way, it is possible to define, for each phrase, the motion (movement) of the character when the voice of the phrase is output. In the "Animation 1" and "Animation 2" fields, there are cases where animation information is stored in the "Animation 1" field and "Animation 2" is blank, and cases where animation information is stored in both the "Animation 1" and "Animation 2" fields. In the former case, only the animation specified by the information of "Animation 1" is displayed. In the latter case, the animation specified by the information of "Animation 1" is displayed, and then the animation specified by the information of "Animation 2" is displayed. This makes it possible to display two animations in succession while the voice of one phrase is being output. By using different facial expressions of the character expressed by the two animations, it is possible to express two facial expressions while the voice of the character of one phrase is being output. Note that three or more animations may be associated with one phrase.

[0097] A "phrase" refers to the content of a phrase. In this embodiment, a phrase may be formed of a human-understandable sentence (or a character string), and the syntax, length, and the like are not particularly important.

[0098] The relationship between the timing of outputting the voice of a character and the timing of displaying the animation of that character may be preset, for example, for each category, subcategory, animation, or phrase. In addition, in the phrase management data 256, when a plurality of phrases are associated with the same category and subcategory, unless otherwise specified, one of the phrases selected randomly (in other words, selected by lottery) may be selected and output by the voice of the character. Although random selection can provide more enjoyment to the user, it is not limited to random selection, and selection may be made according to a predetermined rule, such as selection in a predetermined order.

[0099] [3. Electrical configuration of terminal device 60] FIG. 6 is a block diagram showing an electrical configuration of the terminal device 60. The control unit 61 includes a computer having a CPU, a ROM, and a RAM (an example of a second control unit). The CPU reads out a program stored in the ROM or the storage unit 65 into the RAM and executes it to control each unit of the terminal device 60. The audio input / output unit 62 includes a microphone and a speaker, and realizes a function related to audio input / output in the terminal device 60. The communication unit 63 includes, for example, a wireless communication circuit and an antenna, and is an interface for connecting to a communication line NW. The UI (User Interface) unit 64 includes, for example, a touch panel unit, and accepts operations from a user and notifies information by displaying an image. The storage unit 65 includes, for example, an EEPROM, and stores an OS 651 and a program 652 that runs on the OS 651 as a program executed by the control unit 61. The program 652 may include an application program for communicating with the electronic device 10 to realize various functions. The program 652 may also include, for example, a game engine. The game engine may be Unity (Unity3D), which is a game engine with a built-in IDE, similar to the electronic device 10. The control unit 61 executes the program 252 to perform processing to add motion to character model data and play back a moving image of the character using 3D animation, in other words, a function to play back a moving image of a 3D character. The terminal device 60 may be created by partially reusing a Unity project developed for the electronic device 10.

[0100] The photographing unit 66 photographs and generates image data showing the photographed image. The photographing unit 66 is, for example, a camera having an image sensor exemplified by a CMOS and a CCD, and a lens. The terminal device 60 may be configured to be able to connect an external photographing device.

[0101] [4. Functions of 10 electronic devices] The electronic device 10 executes each function described below. The control unit 11 of the electronic device 10 executes a function of outputting character information according to the usage status of the vehicle 40. The character information includes at least the voice of the character, and further includes an image (animation) of the character in this embodiment. Therefore, the process of outputting the character information may include a process of outputting the voice of the phrase by the voice of the character, and further includes a process of outputting an image of the character in this embodiment.

[0102] In the electronic device 10, the control unit 11 executes the program 252 to thereby perform the following functions.

[0103] <4-1: Notification function> The notification function of the electronic device 10 is a function in which the control unit 11 notifies the user of information using the light receiving unit 12, the radar receiving unit 15, the wireless receiving unit 16, the location information acquiring unit 17, etc. Such a control unit 11 functions as a notification processing unit. The notification function may include, for example, a function of notifying information about a target called a POI (Point of interest). Notification by the notification function includes notification by displaying a character, but may be performed using any of a display on the display unit 13, a sound output by the sound output unit 14, a predetermined light emission by the light emitting unit 23, and other methods that can be perceived by a person. The notification function may, for example, execute the functions described below.

[0104] (Laser warning function) The control unit 11 executes a laser warning function. Specifically, the control unit 11 performs warning control to issue a warning when it is determined that the control unit 11 has received a laser light for speed measurement from a speed measurement device compatible with the laser method, using the light receiving unit 12. The laser light compatible with the laser method is a pulse laser having a specific wavelength of light and a specific pulse width. The specific wavelength belongs to, for example, the infrared light region, and the wavelength is, for example, 850 nm, 905 nm, 950 nm, or 1900 nm. The pulse width is, for example, approximately 20 ns or approximately 15 ns. The pulse interval is, for example, approximately 80 ms. The term "approximately" may be within a specific range that can be regarded as being the same as a reference value or substantially the same as that value. For example, when the control unit 11 determines that laser light corresponding to a laser method has been received, it causes the display unit 13 to display a schematic diagram or photograph of a speed measuring device corresponding to the laser method stored in the memory unit 25, and reads out the audio data stored in the memory unit 25 and outputs an audio message saying "Laser light has been received. Watch your speed" from the audio output unit 14.

[0105] (Radar warning function) The control unit 11 executes a radar warning function. Specifically, the control unit 11 performs warning control to issue a warning when it is determined that a radar wave from a speed measuring device has been received by the radar receiving unit 15. For example, when it is determined that a radar wave for speed measurement has been received, the control unit 11 causes the display unit 13 to display a schematic diagram or a photo of a speed measuring device corresponding to a radar method stored in the storage unit 25, and also reads out the voice data stored in the storage unit 25 and outputs a voice message such as "This is radar. Watch your speed" from the voice output unit 14.

[0106] (Wireless alarm function) The control unit 11 executes a wireless warning function. Specifically, when the control unit 11 determines that a wireless signal of a predetermined frequency has been received by the wireless receiving unit 16, the control unit 11 performs warning control to issue a warning. The control unit 11 scans frequencies corresponding to the various wireless signals described above. When the control unit 11 determines that a wireless signal has been received at the scanned frequency, the control unit 11 displays on the display unit 13 a schematic diagram or a photograph indicating that a wireless signal corresponding to the frequency stored in the storage unit 25 for each wireless type has been received, and reads out audio data stored in the storage unit 25 for each wireless type, and outputs audio indicating the type of the wireless signal from the audio output unit 14. For example, when the control unit 11 receives a traffic enforcement signal, it outputs an audio message such as "This is a traffic enforcement signal. Watch your speed."

[0107] (Position alarm function) The control unit 11 executes a position warning function (generally called a GPS warning). Specifically, the control unit 11 performs warning control to issue a warning based on the position information of the target stored in the storage unit 25 and the position information acquired by the position information acquisition unit 17. For example, the control unit 11 calculates the distance between the position information of the target and the position information of the electronic device 10, and performs warning control when the calculated distance becomes a predetermined approach distance. For example, while traveling on a highway, the control unit 11 performs warning control when the target is approached to within 2 km, and also performs warning control when it is determined that the target is 1 km, 500 m, just before, or has passed. For example, regarding a speed control point in a tunnel, the control unit 11 performs warning control when the target is approached to within 2 km while traveling on a highway, and also performs warning control when it is determined that the target is 1 km or 500 m. The control unit 11 displays a warning screen on the display unit 13, and outputs sounds such as sound effects, background music, and voice messages from the audio output unit 14.

[0108] Targets that can be subject to alarm control by the location alarm function include speed enforcement points, as well as speed trap areas, mobile speed camera areas, tailgating enforcement areas, stop enforcement areas, intersection enforcement areas, other enforcement areas, seat belt check areas, drunk driving check areas, mobile phone check areas, other checkpoints, intersection monitoring points, traffic light ignoring prevention systems, highway traffic police, N systems, traffic monitoring systems, police stations, accident-prone areas, service areas, parking areas, highway oases, long / continuous highway tunnels, highway radio receiving areas, roadside stations, view point parking, parking lots, public toilets, etc.

[0109] The control unit 11 may operate only the notification function set by the user among the above-mentioned multiple notification functions. Furthermore, a priority may be set for each of the multiple notification functions or for each of the targets to be notified, either at the design stage of the electronic device 10 or by user setting. In this case, the control unit 11 may give priority to issuing a notification with a high priority, for example, making a notification with a high priority more noticeable than a notification with a low priority, or, when a notification with a low priority and a notification with a high priority compete with each other, only the notification with the high priority may be issued.

[0110] (Operation flow of the alarm function) FIG. 7 is a flowchart showing a process related to the notification function. First, the control unit 11 causes the display unit 13 to display a normal screen (step S11). The normal screen is an image as described with reference to FIG. 1. Next, the control unit 11 determines whether or not a notification condition is satisfied (step S12). The notification condition is, for example, as described above, and is determined in advance according to the target, and in this embodiment, the condition is that the vehicle has a predetermined proximity relationship with the target.

[0111] If the determination in step S12 is "NO", the control unit 11 causes the display unit 13 to display the normal screen (step S13). Since there is no information to be notified, the control unit 11 causes the normal screen to be displayed as is.

[0112] When the control unit 11 determines that the notification condition is satisfied (step S13; YES), it performs notification processing (step S14). The notification processing includes processing for outputting character information in addition to displaying a predetermined notification screen on the display unit 13. The display of the notification screen includes, for example, information identifying a target object and information on the distance to the target object. The processing for outputting character information may include outputting a phrase related to the notification processing in the voice of the character and displaying an image of the character.

[0113] The control unit 11 may output character information based on the phrase management data 256. In the notification process, the control unit 11 may select a phrase belonging to, for example, "safe driving support", "notification / information", or "alarm". Here, the "category" indicates a classification of notifications. The "subcategory" indicates a more detailed classification of the notification indicated by the "category". For example, the category "POI warning" indicates a warning regarding a POI (point of interest), and the "policy area" indicates a warning when there is a predetermined proximity relationship with a police area, which is an area where speed enforcement is carried out, among the POI warnings. In this way, the control unit 11 may select a phrase associated with the "category" and "subcategory" in a situation indicated by the "category" and "subcategory".

[0114] Also, for example, when the speed of the vehicle 40 exceeds the legal speed limit, the control unit 11 outputs a speeding phrase, which is a phrase indicating that the vehicle is speeding, by the voice of the character when the speed limit is 20 km / h or more every five minutes. Furthermore, when the control unit 11 detects a speed limit of 20 km / h or more five consecutive times every five minutes, it is preferable that the control unit 11 executes a process of causing the character to run away from home.

[0115] The control unit 11 does not change the warning (display or sound) issued by the notification function depending on the intimacy level or the indicator value. This is because the warning by the notification function is intended to contribute to the user's safe driving, rather than to attract the interest of the user's character. Without being limited to this, the control unit 11 may have a function to change the content of the notification by the notification function depending on the intimacy level or the indicator value. If the warning by the notification function is changed depending on the intimacy level, it is expected to have an effect of encouraging the user to take action in the direction of increasing the intimacy level.

[0116] After performing the process of step S13 or S14, the control unit 11 judges whether the accessory power is turned off (step S15). If the judgment in step S15 is "NO", the control unit 11 returns the process to step S12. If the judgment in step S15 is "YES", the control unit 11 ends the process of FIG.

[0117] <4-2. Indicator value and intimacy calculation function> The indicator value / intimacy degree calculation function is a function that performs processing to calculate the indicator value and the intimacy degree based on the usage status of the vehicle 40. The control unit 11 functions as a calculation unit that calculates the indicator value and the intimacy degree.

[0118] FIG. 8 is a flowchart showing the flow of processing related to the indicator value / intimacy calculation function. First, the control unit 11 calculates the indicator value (indicator initial value) when the accessory power is turned on (i.e., when ACC is ON) (step S21). The indicator value when the electronic device 10 is used for the first time is "0". On the other hand, if the electronic device 10 was used when the vehicle 40 was driven the previous time, the indicator value calculated in step S21 may not be "0". This is because, as will be described in detail later, the indicator value when the accessory power is turned on is the value inherited from the indicator value when the previous drive ended (when the accessory power was off). Here, a case will be described where the indicator value is "0" when the electronic device 10 is used for the first time.

[0119] Next, the control unit 11 acquires vehicle information via the connection unit 24 (step S22). Next, the control unit 11 determines whether or not a predetermined travel unit has been traveled (step S23). In this embodiment, the predetermined travel unit is a unit of a predetermined travel distance, and may be 1 km. The control unit 11 may determine whether or not the predetermined travel distance has been traveled based on the vehicle information. The travel unit may be specified by an element other than distance, and may be, for example, a unit of a predetermined travel time. The control unit 11 determines "NO" in step S23 until the predetermined travel unit has been traveled. The control unit 11 may periodically acquire vehicle information and make the determination in step S23.

[0120] When it is determined in step S23 that a predetermined driving unit has been traveled (step S23; YES), the control unit 11 calculates an indicator value L for the current driving unit (step S24). The indicator value is an example of a first parameter. The indicator value has an initial value (standard value) of "0", a maximum value of "+1", and a minimum value of "-1". The indicator value is calculated in increments of "0.1", for example. The indicator value L is calculated by the calculation of the following formula (1).

number

[0121] In formula (1), x is the distance traveled by the vehicle 40 during the current trip. In addition, x is counted in units of 10 m, and if the vehicle's travel distance is 1 km (1000 m), "100" is substituted for x. The maximum value of x may be set to, for example, 100 km.

[0122] In formula (1), Sf is a likability coefficient. The likability coefficient Sf is a coefficient that is an index of the likability of the character to the user. The likability coefficient Sf has a larger value as the likability is higher, and a smaller value as the likability is lower. The likability coefficient Sf changes depending on the usage situation of the vehicle 40, and is changed, for example, by the result of dialogue processing in the phrase processing function described later. The dialogue processing is a process of outputting a voice of a question phrase that is a phrase to ask the user, recognizing the user's response to this question phrase (i.e., an answer), and further outputting a voice of a phrase in response to the response. The voice is the voice of the character. The likability coefficient Sf may further change depending on a stop sign violation. The standard value of the likability coefficient Sf is "1.0".

[0123] In formula (1), Sv indicates a speeding penalty point that indicates a penalty point due to speeding. The standard value of the speeding penalty point Sv is "0", and it is a parameter for subtracting a value corresponding to the excess speed Vover from the travel distance x every second when the vehicle 40 exceeds the legal speed limit. The speeding penalty point Sv is calculated by the following formula (2).

number

[0124] 9 is a diagram showing the relationship between the excess speed, the distance subtracted per second, and the estimated time until the traveled distance of vehicle 40 becomes 0 km when the traveled distance (starting traveled distance) is 100 km. The speed of vehicle 40 is a speed calculated from the position information acquired by position information acquisition unit 17, but when connection unit 24 is connected to an OBD-II connector, it is preferable to use a speed calculated based on the vehicle information acquired from vehicle 40.

[0125] In formula (1), Sd indicates the dangerous driving penalty points that indicate the penalty points due to dangerous driving. The standard value of the dangerous driving penalty points Sd is "0", and it is a parameter for subtracting a value corresponding to the number of falls Nr of Ray from the distance traveled x every second. The dangerous driving penalty points Sd are calculated using the following formula (3). Sd=sin(rad(Nr×9)×1000) ···(3)

[0126] The number of falls Nr of Ray will be described in detail in the section <4-3. G-sensor processing function>. When the acceleration sensor value exceeds a predetermined G threshold due to an impact or sudden steering on the vehicle 40, Ray falls over. The dangerous driving penalty points Sd act in the direction of decreasing the indicator value L, assuming that the user is driving dangerously (i.e., driving contrary to safe driving) as the number of falls of Ray increases. When Ray falls over, a maximum of 10 km is subtracted from the current mileage x. The number of falls Nr is accumulated from when the accessory power is turned on to when it is turned off. In addition, the number of falls Nr is held for 30 minutes immediately after a fall, and if Ray does not fall over during this time, one fall is reset. If Ray falls over before 30 minutes have passed, the number of falls Nr is added and the indicator value L is further reduced. The amount of reduction in the mileage x due to the number of falls Nr is shown in FIG. 10, for example.

[0127] The control unit 11 may determine that Ray has carsickness after the tenth fall, and when Ray has become carsick, may hide Ray from the display unit 13 (i.e., erase the display). The control unit 11 may also temporarily stop counting the mileage x until Ray returns from his carsick state to his normal state. The control unit 11 may determine the time until Ray returns from his carsick state to his normal state by selecting, for example, one hour, two hours, three hours, or six hours. When Ray returns from his carsick state to his normal state, the control unit 11 may reset the number of falls Nr to "0", but may resume the indicator value L (mileage x) from the value before he became carsick. The control unit 11 may reset the number of falls Nr to "0" by turning off the accessory power.

[0128] Returning to formula (1), the explanation will be given. In formula (1), Sp indicates the stop sign violation penalty points, which indicate the points deducted due to a stop sign violation. The standard value of the stop sign violation penalty points Sp is "0", and it is a parameter for subtracting a value according to the number of times Pa that the vehicle 40 has violated a stop sign from the travel distance x for each violation. The stop sign violation penalty points Sp are calculated using the following formula (4). Sp = Pa × 1000 (4)

[0129] In formula (1), τs is a safe driving time constant. The safe driving time constant τs has a smaller value when the user is more conscious of safe driving, and acts in the direction in which the indicator value is more likely to increase. The safe driving time constant τs is a time constant multiplied by the G-sensor difficulty coefficient Gs and the adjustment parameter Lx. Details will be explained in section <4-3. G-sensor processing function>, but Gs is a difficulty parameter based on the G-sensor sensitivity. Gs increases when the G-sensor sensitivity is increased, and decreases when the G-sensor sensitivity is decreased. Details of the G-sensor sensitivity will be explained in section [C: G-sensor processing], but the difficulty parameter satisfies the relationship of the G-sensor difficulty coefficient Gs = (5 / G-sensor sensitivity) x (3 / 5). For G-sensor sensitivities "Lv.1" to "Lv.5", the G-sensor difficulty coefficient Gs varies between "3.0" and "0.6". The G-sensor sensitivity specifies how easily Ray falls, and can also be said to be a value indicating the difficulty of the game.

[0130] Lx is a fixed value, which is 3000. For example, when Gs=3 and a favorability coefficient Sf, which will be described later, is 1, τs=3000, and the travel distance of the vehicle 40 from when the accessory power is turned on to when it is turned off is 30 km, the indicator value L is determined to increase from 0% to 63%.

[0131] Furthermore, the control unit 11 changes the rate of increase or decrease of the indicator value depending on whether the detection device 50 or the detection device 55 is connected to the connection unit 24 as the in-vehicle device. For example, the control unit 11 multiplies the decrease value and increase value of the indicator by a coefficient according to the relationship between the connection status of the in-vehicle device shown in Fig. 11 and the coefficient to be multiplied by the rate of increase or efficiency of the indicator.

[0132] Returning to FIG. After calculating the indicator value L in step S24, the control unit 11 calculates the intimacy S based on the indicator values ​​calculated up to that point (step S25). The intimacy S is an example of a second parameter. The intimacy S is a value that changes in increments of "1", with an initial value of "0", a minimum value of "0", and a maximum value of "999". In step S25, the control unit 11 accumulates the indicator values ​​of the driving units up to that point to determine the intimacy S. The intimacy S is calculated by the calculation of the following formula (5). S = S + L × Cf (5)

[0133] In formula (5), the intimacy level S on the left side is the intimacy level calculated in the current step S25. The intimacy level S on the right side is the intimacy level at the current time point, that is, the intimacy level at the time point before the current intimacy level is calculated. L is the indicator value L calculated in the previous step S24. Cf is a correction coefficient. The correction coefficient Cf is a value that determines how much the intimacy level S at the current time point is changed according to the indicator value L calculated this time.

[0134] Next, the control unit 11 judges whether the accessory power supply has been turned off (step S26). If the user is using the vehicle 40, the control unit 11 judges "NO" in step S26 and returns the process to step S22. In this way, while the vehicle 40 is being used (driving), the control unit 11 calculates the indicator value L and the intimacy degree S every time the vehicle 40 is driven a predetermined driving unit. If the user stops using the vehicle 40 by parking the vehicle 40 or returning home and judges in step S26 that the accessory power supply has been turned off, the control unit 11 stores the time (date and time) when the accessory power supply has been turned off in the storage unit 25 (step S27). Then, the control unit 11 ends the process of FIG. 8.

[0135] The next time the accessory power is turned on, the control unit 11 also performs the process described in FIG. 8. However, in this case, the control unit 11 reduces the indicator value when the accessory power is turned on next time (when ACC is ON) according to the length of the power OFF time, which is the time during which the accessory power was turned off. FIG. 12 is a diagram showing the relationship between the power OFF time, the attenuation rate of the distance x, and the indicator remaining amount (when traveling 100 km) when the accessory power is turned on next time, when the indicator value when the accessory power is turned off is positive. As shown in FIG. 12, the longer the power OFF time, the larger the attenuation rate of the distance x and the smaller the indicator value. The indicator value thus reduced is referred to as the "indicator remaining amount" in FIG. 12. However, if the power OFF time is one month or more, the indicator value returns to the initial value. Note that if the indicator value when the accessory power is turned off is negative, it is maintained until the accessory power is turned on next time, regardless of the power OFF time.

[0136] A specific process that the control unit 11 performs the next time the accessory is powered on will be described. The control unit 11 converts the stored indicator value when the accessory power is turned off into a distance the next time the accessory power is turned on, and substitutes the calculated value for the traveled distance x to set the initial value of the indicator value. At this time, the control unit 11 initializes parameters such as the number of falls Nr once. The control unit 11 may convert the distance the next time the accessory power is turned on by calculating the following formula (6).

[0137]

number

[0138] The relationship between the travel distance x when the accessory power is turned off and the indicator value when the accessory power is turned on is as shown in FIG.

[0139] The indicator value is decreased according to the power OFF time, because the time when the user does not use the vehicle 40 can be regarded as the time when Ray is left alone, and the longer this time, the worse the relationship changes, reproducing an actual interpersonal relationship. In this way, compared to the case where the indicator value and the intimacy degree are reset to zero, the user can feel that the interpersonal relationship between the user and the character continues for a long period of time. Also, consideration is given to prevent the indicator value from decreasing unintentionally by the user. Note that if the length of the period during which the user has suspended use of the vehicle 40 is equal to or shorter than a predetermined time, the indicator value may not be decreased, and various modifications are possible regarding the relationship between the length of the period during which the user has suspended use of the vehicle 40 and the change in the indicator value.

[0140] In this manner, in the electronic device 10, when safe driving is performed, the indicator value L and the intimacy level S change in an upward direction, and when undesirable driving such as a traffic violation or reckless driving that is not a traffic violation is performed, the indicator value L and the intimacy level S change in a downward direction. Therefore, for a user who wishes to increase intimacy with Ray, such changes in the indicator value L and the intimacy level S motivate the user to drive safely. In particular, if a violation occurs when the indicator (mileage) is small, the amount of decrease in the indicator value is large. Therefore, by continuously maintaining the indicator at a high value, the intimacy level can be efficiently increased.

[0141] As described above, the control unit 11 calculates the indicator value based on the usage status of the vehicle 40 each time the vehicle 40 travels a predetermined travel unit, and further calculates the intimacy level based on the indicator calculated up to the present time. The indicator value L increases according to the travel distance. It increases if safe driving is continued, and decreases if dangerous driving is performed. This motivates the user to drive safely.

[0142] <4-3.G sensor processing function> The G sensor processing function is a process that detects G (shock) acting on the vehicle 40 and performs processing accordingly.

[0143] Fig. 14 is a flowchart showing a process related to the G sensor processing function. The control unit 11 repeatedly executes the process of Fig. 28 while the power supply of the electronic device 10 is on (for example, while the power supply of an accessory is on).

[0144] The control unit 11 judges whether to set the G-sensor sensitivity (step S31). If the judgment in step S31 is "YES", the control unit 11 sets the G-sensor sensitivity (step S32). The control unit 11 may write the set G-sensor sensitivity to the setting data 255.

[0145] FIG. 15 is an explanatory diagram of G-sensor sensitivity. G-sensor sensitivity is divided into a plurality of stages, and in this embodiment, it is divided into five stages, "Lv.1" to "Lv.5". A G-threshold is set for each of the G-sensor sensitivities "Lv.1" to "Lv.5". The G-threshold includes a threshold for acceleration in the forward / rearward direction and a threshold for acceleration in the left / right direction. The higher the level of G-sensor sensitivity, the lower the G-threshold. Therefore, the higher the G-sensor sensitivity, the easier it is to detect the occurrence of a large impact even with a smaller acceleration.

[0146] Returning to FIG. If the result of the determination in step S31 is "NO," or if the G sensor threshold value is set in step S32, the control unit 11 starts the G detection process (step S33). The G detection process is a process for detecting a predetermined G (impact). In the G detection process, the control unit 11 acquires acceleration in each of the forward, backward, left, and right directions, and compares it with the G threshold value corresponding to each direction. Then, the control unit 11 determines whether to generate a G sensor event (step S34). The control unit 11 determines whether to generate a G sensor event based on the conditions shown in FIG. 15, and generates a G sensor event if the conditions are met (step S35).

[0147] The G sensor event in step S35 will be described with reference to FIG. In the case of a G-sensor event, the control unit 11 may also output character information based on the phrase management data 256 in response to the generated event, and may further update the gallery acquisition status data 257.

[0148] For example, the control unit 11 generates a fall (right) event when the relationship of 0.2G≦sensor value≦G threshold is satisfied for the right direction. In this case, the control unit 11 causes the display unit 13 to display an animation showing Ray falling to the right. The control unit 11 generates a fall (left) event when the relationship of 0.2G≦sensor value≦G threshold is satisfied for the left direction. In this case, the control unit 11 causes the display unit 13 to display an animation showing Ray falling to the left. The control unit 11 generates a fall (front) event when the relationship of G threshold≦G sensor value is satisfied for the forward direction. In this case, the control unit 11 causes the display unit 13 to display an animation showing Ray falling forward. For the fall (front) event, the control unit 11 may generate a screen cracking effect with a predetermined probability (randomly). The control unit 11 generates a fall (back) event when the relationship of G threshold≦G sensor value is satisfied for the backward direction. In this case, the control unit 11 causes the display unit 13 to display an animation showing Ray falling backward. When the relationship of G threshold value≦G sensor value is satisfied for the right direction, the control unit 11 generates a steering (right) event. In this case, the control unit 11 causes the display unit 13 to display an animation showing that right steering has been performed. When the relationship of G threshold value≦G sensor value is satisfied for the left direction, the control unit 11 generates a steering (left) event. In this case, the control unit 11 causes the display unit 13 to display an animation showing that left steering has been performed. The larger the value of the G sensor sensitivity, the more likely Ray will fall when steering / braking suddenly (i.e., the difficulty of the game will increase), but the indicator value will be more likely to increase when driving safely continues.

[0149] Returning to FIG. Next, the control unit 11 counts up the number of falls by "1" and stores it in the storage unit 25 (step S36). Then, the control unit 11 ends the processing in Fig. 14. If the determination in step S34 is "NO", the control unit 11 also ends the processing in Fig. 14.

[0150] <4-4. Phrase processing function> The phrase processing function is a function that performs phrase processing, which is a process of outputting a predetermined phrase to the user of the vehicle 40. The phrase processing is a function that includes speech to the user, more specifically, a function that includes a process in which a character speaks to the user. The phrase processing function includes a "tweet processing" that is an example of the second phrase processing, and a "dialogue processing" that is an example of the first phrase processing.

[0151] The tweet process is a speech process that outputs a voice of a predetermined phrase to the user. In this embodiment, the tweet process is a process in which a character displayed on the display unit 13 unilaterally speaks to the user in a manner similar to a tweet (as if talking to itself). The tweet process includes a speech from the electronic device 10 by outputting the voice of the character, but does not include a process of recognizing a response from the user to the speech or further speaking in response to the response.

[0152] The dialogue processing is a process for simulating a dialogue between a user and a character through voice. In this embodiment, the dialogue processing is a process for realizing a dialogue between a character displayed on the display unit 13 and the user (i.e., realizing a pseudo dialogue). The dialogue processing is a process for allowing the user to feel as if he or she is actually having a dialogue with the character. The dialogue processing includes a process for speaking to the user by outputting the voice of the character, and a process for recognizing a response from the user to the speech, and further speaking to the user by outputting the voice of the character. In this embodiment, a case will be described in which the dialogue processing is a dialogue processing in which the character speaks to the user, but the dialogue processing in which the user speaks to the character may also be a dialogue processing in which the user speaks to the character.

[0153] 17, 18, 19, and 20 are flowcharts showing the processing related to the phrase processing function. The control unit 11 repeatedly executes the processing of Figs. 17 to 20 while the power of the electronic device 10 is on (for example, while an accessory power is on). The control unit 11 may determine whether or not to perform utterance related to the phrase processing function based on the intimacy level S. For example, the control unit 11 may perform phrase processing related to the phrase processing function when the intimacy level S is equal to or higher than a threshold value, but may not perform the phrase processing when the intimacy level S is less than the threshold value. In this way, phrase processing related to the phrase processing function can be performed on the condition that the intimacy level S indicates that the relationship between the user and the character is relatively good.

[0154] The control unit 11 determines the speech interval based on the current indicator value (step S41). The speech interval may be the interval at which Ray speaks by phrase processing (either tweet processing or dialogue processing) and the interval at which processing is performed to output the voice of a phrase by either tweet processing or dialogue processing. For example, the control unit 11 may calculate the speech interval (excluding warnings and POIs) by the calculation of the following formula (7). In this way, the speech interval varies depending on the indicator value. That is, by keeping the indicator value high (continuing safe driving), the interval at which Ray speaks becomes shorter and the frequency of speaking increases. Speech interval = 5 + rand(25 - (indicator value x 10 + 100) / 10) (7)

[0155] FIG. 21 is a diagram for explaining a method of determining an utterance interval. In FIG. 21, the horizontal axis corresponds to the latest indicator value at the current time, and the vertical axis corresponds to the utterance interval [minutes]. As shown in FIG. 21, a lower limit and an upper limit of the utterance interval are specified for each indicator value. The control unit 11 randomly determines the utterance interval from the range between the lower limit and the upper limit of the utterance interval corresponding to the latest indicator value at the current time. It is preferable that the probability of each time between the lower limit and the upper limit of the utterance interval being selected is equal, but this is not necessary. The lower limit is 5 minutes regardless of the indicator value. The upper limit is set so that it becomes smaller as the indicator value increases. For example, when the indicator value is "-1.00", the upper limit is "30 minutes", and when the indicator value is "1.00", the upper limit is "10 minutes", and the lower limit changes linearly so that it becomes shorter as the indicator value increases. Therefore, the larger the indicator value, the higher the possibility that the utterance interval will be shorter. This is done in order to give the user the impression that Ray is more proactively talking to the user when Ray is in a good mood as understood from the indicator value. This allows the user to intuitively understand whether the relationship with the character is good or bad, and can arouse interest in the character. Note that the lower limit may be set to be smaller as the indicator value increases.

[0156] When the speech interval is determined, the control unit 11 judges whether the determined speech timing has arrived (step S42). After determining the speech interval, the control unit 11 judges whether the speech interval has elapsed. If it is determined in step S42 that it is not the speech timing, the control unit 11 waits.

[0157] When it is determined that the utterance timing has arrived (step S42; YES), the control unit 11 determines whether the vehicle 40 is in a stopped state (step S43). The stopped state may be a state in which the vehicle 40 is actually stopped or a state in which the vehicle 40 is considered to be stopped. For example, the stopped state may be a state in which the speed of the vehicle 40 is equal to or lower than a predetermined speed. This is because, when the speed of the vehicle is measured using a GNSS signal (for example, a GPS signal) from which position information is acquired, a speed greater than "0" may be indicated due to a positioning error even though the vehicle 40 is actually stopped. The predetermined speed may be, for example, 7 km / h, but may be another speed such as 10 km / h. The control unit 11 may also refer to the position information of the vehicle 40, and may determine the stopped state of the vehicle 40 when the vehicle 40 is in a position where it is considered to be stopped, such as a stop point. The stopped state may be grasped by the fact that the vehicle 40 is not in a running state. The vehicle 40 being in a running state may be a state in which the vehicle 40 can be regarded as being in a running state, for example, the speed of the vehicle 40 being equal to or higher than a predetermined speed (for example, equal to or higher than 7 km / h).

[0158] When the control unit 11 determines that the vehicle is not stopped but is moving (step S43, NO), it selects one phrase by lottery from among phrases in the tweet process that are phrases that mean monologue (hereinafter referred to as "soliloquy phrases") (step S44). As monologue phrases, there are phrases included in records with the category "soliloquy" in the phrase management data 256. The control unit 11 outputs character information based on the selected monologue phrase (step S45). This process of outputting character information may include outputting the monologue phrase in the voice of the character and displaying an image of the character.

[0159] When the control unit 11 determines that the vehicle is stopped (step S43; YES), it determines whether or not dialogue processing has already been performed on the same day (step S46). In this embodiment, in order to prevent an increase in dialogue processing opportunities, the number of times is limited to a predetermined number of times per day. Therefore, when the control unit 11 determines that dialogue processing has already been performed on the same day (step S46; YES), it selects one of the monologue phrases by lottery and outputs character information based on the selected phrase (steps S44, S45).

[0160] If the control unit 11 determines that the dialogue processing has not been performed yet on the same day (step S46; NO), it selects one phrase by lottery from the phrases that identify the contents of the dialogue processing and the monologue phrases (step S47). Next, the control unit 11 determines whether the selected phrase is a phrase that identifies the contents of the dialogue processing (step S48).

[0161] If the control unit 11 determines that the selected phrase is not a phrase that specifies the content of the utterance in the dialogue processing (step S48; NO), the selected phrase is a monologue phrase. The control unit 11 proceeds to steps S44 and S45, and outputs character information based on the selected phrase.

[0162] On the other hand, when the control unit 11 determines that the selected phrase is a phrase that specifies the content of the utterance in the dialogue processing (step S48; YES), it performs a detection process to detect whether the vehicle 40 is in a waiting state at a traffic light (step S49). The detection process of the waiting state at a traffic light will be described in detail later.

[0163] When the control unit 11 determines based on the detection process that the vehicle 40 is not waiting for a traffic light (step S49; NO), in this embodiment, when the control unit 11 determines that the vehicle 40 is stopped and not waiting for a traffic light, it performs dialogue processing (step S50). A state in which the vehicle is stopped and not waiting for a traffic light is an example of a first stopped state, which is an example of a stopped state in which sufficient time is secured to complete the dialogue processing. An example of such a stopped state is a state in which the vehicle 40 is stopped (i.e., parked) in a parking lot.

[0164] On the other hand, when the control unit 11 determines that the vehicle 40 is waiting for a traffic light (step S49; YES), in this embodiment, when it determines that the vehicle 40 is stopped and waiting for a traffic light, it ends the processing in Fig. 17 without performing the dialogue processing. The waiting for a traffic light state is an example of a second stopped state, and is an example of a stopped state in which sufficient time cannot be secured or is difficult to secure for completing the dialogue processing.

[0165] The number of dialogue processes per day does not have to be limited, in which case the process of step S46 may be skipped and the process may proceed to step S47. Also, if the number of dialogue processes per day is limited to a predetermined number of times, which is equal to or greater than two, dialogue processes may be performed until the predetermined number of times is reached, and after that, speech may be performed using the monologue speech function.

[0166] In this embodiment, when the control unit 11 determines that the vehicle 40 is in a stopped state and is waiting for a traffic light (an example of a second stopped state), the control unit 11 does not execute the dialogue process even when it is determined that it is the timing to execute the dialogue process. In this way, the user can be less likely to encounter the execution of the dialogue process when the vehicle 40 is waiting for a traffic light. In the dialogue process, the character speaks, the user responds to the speech, and the character speaks to the response. In this way, the dialogue process may be somewhat long from start to finish and may involve a somewhat long exchange. When such a somewhat long exchange is involved, the user may be in a situation where he or she must start the vehicle 40 in the middle of the dialogue process. In order to reduce the possibility of such a situation, the control unit 11 does not execute the dialogue process when the vehicle 40 is waiting for a traffic light even if the vehicle is in a stopped state.

[0167] In addition, in this embodiment, when the vehicle 40 is waiting for a traffic light, the control unit 11 does not execute dialogue processing, but executes tweet processing. It is possible to ensure that the user has many opportunities to come into contact with phrase processing while taking into consideration the safe use of the vehicle by the user. As a result, it is possible to prevent the user from getting bored and to attract the user's interest. In addition, since the user does not need to respond to tweet processing, the awareness of tweet processing is less likely to be active than awareness of dialogue processing, and it is based on the idea that even if tweet processing is executed, it is easier to ensure safe driving by the user.

[0168] Furthermore, in this embodiment, when the vehicle 40 is in a traveling state, the control unit 11 does not execute dialogue processing, but executes tweet processing. In this way, dialogue processing involving a user's response is not executed when the vehicle 40 is in a traveling state, and the user's distraction by dialogue processing while driving is suppressed, and consideration is given to the user's safe driving, while a process of outputting a voice spoken, for example, by a character talking to itself, is executed when the vehicle is in a traveling state, so that the user does not get bored and the user's interest can be attracted.

[0169] (4-4-1. Detection process) The detection process of step S49 will now be described. The control unit 11 is an example of a state detection unit that detects a state where the vehicle is waiting for a traffic light. As a premise, the control unit 11 functions as a display processing unit that performs processing to display the vehicle position on the road in the map by correcting the position information acquired by the position information acquisition unit 17 based on the map matching function. The display of the map described in Figs. 1 and 2 is based on the function of this display processing unit. The map matching function is also adopted in known car navigation systems, and is a function that performs processing to correct the running position of the vehicle on the road in the map data using the position information acquired by the position information acquisition unit 17 and the map data stored in the map data. In this way, even if the position information of the position information acquisition unit 17 includes a positioning error, the vehicle position can be prevented from deviating from the road in the map. In the map matching function, when it is determined from the history of the position information acquired by the position information acquisition unit 17 that the vehicle 40 is estimated to be on a specific road, the position of the vehicle is corrected so that it is located on that road. Therefore, when the vehicle 40 is in a stopped state and the correction of the position information by the map matching function is not performed (which may be called a fail state or an ineffective state), it is detected that the vehicle is waiting for a traffic light. In this way, the map matching function that is also used in many car navigation systems can be utilized to easily detect the state of waiting at a traffic light.

[0170] The detection process may be performed in other ways as long as it detects that the vehicle is waiting for a traffic light. For example, the control unit 11 may obtain an image of the area in front of the vehicle 40 using an on-board camera, and determine whether the vehicle is waiting for a traffic light based on the obtained image. For example, the control unit 11 may perform image recognition processing on the image from the on-board camera, and determine that the vehicle is waiting for a traffic light when it recognizes an image representing a red light in a stopped state.

[0171] (4-4-2. Dialogue processing) The interactive processing in step S51 will now be described in detail. The control unit 11 first selects a Q&A start phrase from the phrase management data 256 (step S61). For example, the control unit 11 selects a phrase from a record including the category "Q&A start" based on the phrase management data 256. The Q&A start phrase indicates the voice of the character uttered at the start of dialogue processing, and is a phrase for making the user aware that a question by dialogue processing will start and for asking the user whether or not it is OK to start a question. The Q&A start phrase is a phrase indicating whether Ray is OK to start talking. The Q&A start phrase includes phrases such as "Do you have time now?". The control unit 11 outputs character information based on the selected Q&A start phrase (step S62). The character information includes outputting the voice of the character uttering the Q&A start phrase and displaying an image of the character. Then, the control unit 11 waits in a state where voice recognition for recognizing a response from the user to the Q&A start phrase has been performed.

[0172] Next, the control unit 11 determines whether the vehicle 40 is in a moving state (e.g., is no longer in a stopped state) (step S63). That is, the control unit 11 determines whether the vehicle is in a moving state while waiting for a response from the user to the Q&A start phrase. If the control unit 11 determines that the vehicle is in a moving state (step S63; YES), the process proceeds to step S65. If the control unit 11 determines "NO" in step S63, the process proceeds to step S64.

[0173] The control unit 11 judges whether or not a response from the user has been recognized (step S64). The response here means that the user has given some kind of response, and it does not matter, for example, what the response is, or whether or not the response content has been recognized. Step S64 is a step for judging whether or not a voice has been recognized, regardless of whether a response included in a voice recognition dictionary has been recognized. The control unit 11 may start voice recognition when the output of the voice of the character is finished, but may also perform voice recognition during output or before output. The response indicates some kind of reaction or reply to the voice of the character, and here, it is judged whether or not the voice of the user has been recognized. The control unit 11 may perform a predetermined filter process on the sound signal from the microphone 192 before performing voice recognition. The filter process in this case may be, for example, a filter process that passes the frequency band of the human voice and cuts the frequency band below that (for example, below 200 Hz).

[0174] When the control unit 11 determines in step S64 that it has not yet recognized a response from the user (step S64; NO), it determines whether a predetermined waiting time has elapsed (step S65). The predetermined waiting time is preferably determined in advance, and is, for example, three minutes. When the control unit 11 determines that the predetermined waiting time has not elapsed (step S65; NO), it returns the process to step S64 and continues waiting. When the control unit 11 determines that the predetermined waiting time has elapsed (step S65; YES), it proceeds to step S67.

[0175] When the control unit 11 determines that a response from the user has been recognized within the waiting time (step S64; YES), it determines whether the user's response is positive (step S66). Whether the response is positive indicates that the response is a positive response to the character's utterance. An example of a response that positively responds to a character's utterance is a response that indicates agreement or conformity with the character's utterance, such as a favorability response that is a response that the character has a favorability rating for. In addition, an example of a response that positively responds to a character's utterance is a response that is semantically a reply to a question phrase uttered by the character. In this way, it is sufficient that the response is one that is desired by the electronic device 10 in the dialogue with the character. Here, a response that indicates approval of the start of dialogue processing in response to a question using a Q&A start phrase, such as "Sure," is an example of a positive response.

[0176] If the control unit 11 determines that the answer is affirmative (step S66), the control unit 11 advances the process to step S69. If the control unit 11 determines that the answer is not affirmative, the control unit 11 advances the process to step S67. On the other hand, a response to a question using a Q&A start phrase such as "Not now" that does not approve of the start of dialogue processing is an example of a negative response. In addition to this, if the content of the response cannot be determined to be affirmative, for example, if the content of the response is unclear, the response is also determined to be "NO" in step S66.

[0177] If the control unit 11 judges "NO" in step S63, if the control unit 11 judges "YES" in step S65, or if the control unit 11 judges "NO" in step S66, the control unit 11 selects a phrase for Q&A interruption / start from the phrase management data 256 (step S67). For example, the control unit 11 selects a phrase from records including the category "Q&A" and the category "Q&A interruption / user refusal" in the phrase management data 256. In step S67, the control unit 11 selects one of the following phrases from the records of the subcategory "Q&A interruption / start" if the control unit 11 judges "NO" in step S63, from the records of the subcategory "Q&A interruption / silence" if the control unit 11 judges "YES" in step S65, or from the records of the subcategory "Q&A interruption / user refusal" if the control unit 11 judges "NO" in step S66. That is, the phrase to be selected differs depending on the reason for interrupting the Q&A in the dialogue processing.

[0178] The control unit 11 outputs character information based on the selected Q&A interruption / start phrase (step S68). This process of outputting character information may include outputting the Q&A interruption / start phrase in the character's voice and displaying an image of the character. Then, the control unit 11 ends the dialogue process. When the dialogue process is ended in this way, the control unit 11 may be configured not to execute the next dialogue process until a predetermined time, for example, 10 minutes, has elapsed.

[0179] The reason why the dialogue processing is terminated when the vehicle 40 is in a traveling state is to contribute to the user's safe driving by not performing the dialogue processing while the vehicle 40 is traveling if the dialogue processing is started because the vehicle 40 is in a stopped state but is traveling before the dialogue processing is completed. For example, if the vehicle 40 is in a traveling state after the character speaks but before recognizing the user's response, the control unit 11 may stop the dialogue processing. In this way, even if the dialogue processing is in the middle of the dialogue processing, the dialogue processing is stopped when the vehicle is in a traveling state, so that the user's safe driving can be taken into consideration.

[0180] If the answer is "YES" in step S66, the control unit 11 continues the dialogue processing. The control unit 11 selects one of the question phrases from the phrase management data 256 (step S69). The question phrase is a phrase indicating a question (prompting) of the user in the dialogue processing. In step S69, the control unit 11 may select a question phrase that has never been selected before. This is to prevent the user from becoming bored by being asked the same question multiple times, for example.

[0181] The control unit 11 outputs character information based on the selected question phrase (step S70). The process of outputting the character information may include outputting the question phrase in the voice of the character and displaying an image of the character. The control unit 11 then waits while performing voice recognition to recognize a response from the user to the question phrase.

[0182] Next, the control unit 11 judges whether or not a response from the user has been recognized (step S71). The response here means that the user has made some kind of response, and does not matter, for example, what the response is, or whether or not the response content has been recognized. This is the same as step S64.

[0183] When the control unit 11 determines that it has recognized a response from the user (step S71; YES), it determines whether the response from the user is positive (step S72). When the control unit 11 determines that the response is positive (step S72; YES), it selects a response phrase from the phrase management data 256 and outputs character information (step S73). This process of outputting character information may include outputting the response phrase in the voice of the character and displaying an image of the character. The response phrase has content in response to the user's positive response.

[0184] Then, the control unit 11 performs a first dialogue result process (step S74). The first dialogue result process may be a process that is performed according to the result of the dialogue process, and may include, for example, at least one of increasing the indicator value L (for example, the indicator value is set to the maximum value "+1.0", which means that there is no limit on the continuing distance) and obtaining a designated item. As a process for increasing the indicator value L, the control unit 11 may increase the favorability coefficient Sf, for example, by increasing it to "10" for only 10 minutes. Then, the control unit 11 ends the dialogue process.

[0185] If the determination in step S71 is "NO", the control unit 11 advances the process to step S75 in FIG. 19. If the control unit 11 determines that a predetermined time has elapsed without a response from the user, the control unit 11 advances the process to step S75. Here, the absence of a response from the user indicates that the user has been silent. The predetermined time may be, for example, 30 seconds. Next, the control unit 11 determines whether the user has asked to repeat the predetermined number of times (step S75). Here, the predetermined number of times is three times. If the control unit 11 determines that the user has not asked to repeat the predetermined number of times (step S75; NO), the control unit 11 selects a repeat phrase based on the phrase management data 256 (step S76). The repeat phrase here is a phrase to be asked to repeat when the user is silent. Then, the control unit 11 outputs character information based on the selected repeat phrase (step S77). This process of outputting character information may include outputting the repeat phrase in the voice of the character and displaying an image of the character. Then, the control unit 11. The process returns to step S71.

[0186] When the determination in step S72 in Fig. 18 is "NO", the control unit 11 advances the process to step S78 in Fig. 20. If the response from the user is recognized but not positive, the response may be negative or the response may not be recognized (misrecognition).

[0187] Next, the control unit 11 judges whether the response from the user is negative (step S78). Whether the response is negative indicates that it is a response that denies the character's utterance. For example, there is a response that denies, agrees with, or does not agree with the character's utterance. There is also a response that is a response to a question phrase uttered by the character, and a response that is a response but does not have a favorable impression of the character. If it is judged that the response is negative (step S78; YES), the control unit 11 selects a response phrase from the phrase management data 256 and outputs character information (step S79). This process of outputting the character information may include outputting the response phrase in the character's voice and displaying an image of the character. The response phrase has content in response to the user's negative response.

[0188] Next, the control unit 11 performs a second dialogue result process (step S80). The second dialogue result process may be a process performed according to the result of the dialogue process, and may include, for example, at least one of a decrease in the indicator value L and the acquisition of a designated item. The process for decreasing the indicator value L may be to lower the favorability coefficient Sf, for example, to "0.8" for 10 minutes. Here, since the user has responded, the favorability coefficient Sf is set higher than in the case of ignoring, which will be described later, but lower than in the case of a positive response or the standard value. Then, the control unit 11 ends the dialogue process.

[0189] When the control unit 11 determines that the response from the user is not negative (step S78; NO), it is determined that the recognition is erroneous, and proceeds to step S76. The control unit 11 determines whether the user has asked the user to repeat the speech a predetermined number of times (three times in this embodiment) (step S81). When the control unit 11 determines that the user has not asked the user to repeat the speech a predetermined number of times (step S81; NO), it selects a repeat phrase (step S82). The repeat phrase here is a phrase to be asked to repeat when the recognition is erroneous. For example, in an environment such as inside the vehicle 40, the result of the voice recognition may be erroneous due to the influence of various noises. This may be the case when the voice recognition fails or when the response is recognized with words (different words) that are not appropriate. When such an erroneous recognition occurs, the control unit 11 outputs character information based on the selected repeat phrase (step S83). The process of outputting the character information may include outputting the repeat phrase in the voice of the character and displaying an image of the character. Then, the control unit 11 returns the process to step S71.

[0190] The control unit 11 is configured to repeat the process a predetermined number of times, and if the total number of repeats in cases of silence and incorrect recognition reaches a predetermined number (three times), but the user's response cannot be determined as either affirmative or negative, the control unit 11 ends the dialogue process.

[0191] When the control unit 11 determines that the user's response was not recognized and the user has asked three times to repeat the request in step S75 of FIG. 19 (step S75; YES), the control unit 11 determines whether the user was silent all three times (step S84). When the control unit 11 determines that the user was silent all three times (step S84; YES), the control unit 11 selects a three-times ignore phrase from the phrase management data 256 (step S85) and outputs character information (step S86). The three-times ignore phrase is a response phrase when the user is silent three times. The process of outputting the character information may include outputting the three-times ignore phrase in the voice of the character and displaying an image of the character. For example, the three-times ignore phrase may be a phrase expressing anger or sulking, so that the character's feelings can be conveyed to the user.

[0192] Then, the control unit 11 performs a third dialogue result process (step S87). The third dialogue result process is a process that is performed according to the result of the dialogue process, and may be, for example, a process of not increasing the indicator value L for a predetermined time (for example, 15 minutes). Alternatively, the third dialogue result process may include a process of decreasing the indicator value L. The process of decreasing the indicator value L may be to lower the likability coefficient Sf, for example, to 0.2 for 10 minutes. Then, the control unit 11 ends the dialogue process.

[0193] If the control unit 11 determines in step S84 that the three times were not all silent (step S84; NO), it selects a silent phrase from the phrase management data 256 (step S88) and outputs character information (step S89). The silent phrase is a response phrase when the final silence occurs. The process of outputting this character information may include outputting the silent phrase in the character's voice and displaying an image of the character.

[0194] Then, the control unit 11 ends the dialogue processing. Unlike the case where there are three silences, the control unit 11 does not perform dialogue result processing to decrease the indicator value L. This is because the cause of the erroneous recognition may be the condition inside the vehicle 40 or the electronic device 10. Instead, the control unit 11 may perform the third dialogue result processing after suppressing the amount of decrease.

[0195] If the determination in step S81 of FIG. 20 is "YES," the control unit 11 selects an incorrectly recognized phrase from the phrase management data 256 (step S90) and outputs character information (step S91). The incorrectly recognized phrase is a response phrase when the user's response cannot be correctly recognized. The process of outputting this character information may include outputting the incorrectly recognized phrase in the character's voice and displaying an image of the character. Then, the control unit 11 ends the dialogue process. Note that although the control unit 11 was unable to determine whether the user's response was positive or negative, it does not perform dialogue result processing that would decrease the indicator value L because the user has made some kind of response.

[0196] The control unit 11 may be configured to vary the occurrence rate of asking to repeat according to the intimacy level, so that the higher the intimacy level, the higher the probability of asking to repeat. In this way, the better the relationship between the user and the character, the higher the probability that the character will make an utterance that prompts the user to respond, so that the user can be given the feeling that he or she is close to the character. The reason for not asking to repeat all the time is that if the user were to ask to repeat every time, the user would not be given the wrong impression that there is a malfunction in the electronic device 10.

[0197] In addition to the above, other conditions for ending the dialogue process may include when the screen transitions to the settings screen, when the screen transitions to Ray's room, when the character becomes invisible (normal mode / asleep / car sickness / running away from home, etc.), when an alarm is issued by the notification function, etc.

[0198] In the present embodiment, the dialogue process follows a sequence of a character speaking, a user responding, and another character speaking again; however, the dialogue process may also be performed in which the character speaking and the user responding go back and forth two or more times.

[0199] (4-4-3. Phrase processing related to in-vehicle devices) The control unit 11 functions as a linking processing unit that realizes a function linked with the detection devices 50, 55 that are in-vehicle devices connected to the connection unit 24. The control unit 11 may execute or suppress a phrase process having a topic related to the detection devices 50, 55 according to the connection record of the detection devices 50, 55 to the connection unit 24. In this way, the user can be exposed to a phrase process (an example of a third phrase process) having a topic related to the in-vehicle device connected to the electronic device 10, and the phrase process can be customized according to the user's connection record of the in-vehicle device. This phrase process may be either the tweet process or the dialogue process described above.

[0200] In particular, the control unit 11 may be configured not to execute phrase processing having a topic related to a specific in-vehicle device if the specific in-vehicle device has been connected to the connection unit 24 at least once. In this manner, if the user already owns a specific in-vehicle device and is using it by connecting it to the electronic device 10, it is possible to execute appropriate phrase processing for the user by not executing phrase processing having a topic related to the in-vehicle device. In particular, when the phrase processing is an explanation about the in-vehicle device, such as an advertisement for the in-vehicle device, or a content related to purchasing promotion for the in-vehicle device, it is possible to not execute phrase processing that is not necessary for the user.

[0201] FIG. 22 is a diagram showing phrases output in processing related to the phrase processing function. For example, the control unit 11 may perform phrase processing based on the phrase management data 256 shown in FIG. 22. If an in-vehicle device (e.g., OBD, FCW, ADP (adapter), DMS) shown in a subcategory in FIG. 22 has been connected even once, the control unit 11 may not select a phrase associated with this subcategory. In this way, for example, the control unit 11 can prevent the character from speaking a phrase corresponding to an optional item (one example of an in-vehicle device) when the optional item is connected even once. Also, when an optional item is connected, if there is a phrase to be output for the optional item, the control unit 11 may release all phrases for the optional item. The flag indicating whether the optional item is connected or not may be released by initializing the electronic device 10.

[0202] (4-4-4: Prefectural border phrase processing function) The prefectural border phrase processing function is a function that performs a predetermined phrase processing (fourth phrase processing) when the vehicle 40 travels across a border between prefectures (hereinafter referred to as a "prefectural border"), which is an example of a predetermined geographical range. As described above, the map data is configured such that address information is associated with latitude information and longitude information of each point. The control unit 11 sequentially identifies the prefecture to which the current location belongs while the vehicle 40 is traveling, based on the map data and the position information acquired by the position information acquisition unit 17. Such a control unit 11 functions as a geographical range identification unit.

[0203] FIG. 23 is a flowchart showing phrase processing related to the prefectural border phrase processing function. The control unit 11 identifies the vehicle speed (vehicle speed) of the vehicle 40 (step S101). The control unit 11 may identify the vehicle speed of the vehicle 40 based on, for example, vehicle information input via the connection unit 24. Next, the control unit 11 determines whether the vehicle 40 is in a running state (step S102). As described above, the vehicle 40 being in a running state may be a state in which the vehicle 40 can be considered to be in a running state, for example, the speed of the vehicle 40 may be equal to or higher than a predetermined speed (for example, 7 km / h or higher). The method of determining the running state may be the same as that of step S42, but may be different. When it is determined that the vehicle 40 is not in a running state (step S102; NO), the control unit 11 ends the processing of FIG. 23.

[0204] When it is determined in step S102 that the vehicle is in a traveling state (step S102; YES), the control unit 11 determines whether the position information acquired by the position information acquisition unit 17 is valid, that is, has been corrected by the map matching function (step S103). When it is determined that the position information is not valid (i.e., a Fail state) (step S103; NO), the control unit 11 ends the processing in Fig. 23. The invalid state may be specified as a state in which the vehicle is not on a road, or a state in which the position information is not corrected based on the map matching function.

[0205] As described above, in the map matching function, when it is determined from the history of the position information acquired by the position information acquisition unit 17 that the vehicle 40 is estimated to be on a specific road, the vehicle position is corrected so that it is located on that road. Therefore, when the vehicle 40 is in a traveling state and the position information is corrected by the map matching function, the map matching function is in an active state. When this map matching function is in an active state, it can be determined that the electronic device 10 has crossed the prefectural border by being mounted on the vehicle 40 and passing through the road, rather than crossing the prefectural border by other means such as an airplane.

[0206] If the result of step S103 is "YES", that is, if the map matching function is determined to be valid, the control unit 11 determines whether the prefecture of the address of the current location has changed (step S104). The valid state may be specified as a state in which the vehicle is on a road and the position information has been corrected based on the map matching function. If the control unit 11 determines that the prefecture of the address of the current location has not changed based on the map data and the position information (step S104; NO), the control unit 11 ends the processing of FIG.

[0207] When the control unit 11 determines that the prefecture of the address of the current location has changed (step S104; YES), it determines the mileage from when the prefecture of the address of the current location has changed (step S105). The control unit 11 may determine the mileage based on the vehicle information acquired from the connection unit 24, or may determine the mileage based on the location information acquired by the location information acquisition unit 17.

[0208] Next, the control unit 11 determines whether the prefecture of the address of the current location has changed (step S106). If it is determined that the prefecture of the address of the current location has changed (step S106; YES), the control unit 11 ends the process of FIG.

[0209] When the control unit 11 determines that the prefecture of the address of the current location has not changed, it determines whether the travel distance since the prefecture of the address of the current location has changed has reached a predetermined distance (step S107). The predetermined distance is a threshold value for the travel distance, and may be a distance sufficient to determine that the vehicle 40 has crossed a prefectural border and is traveling within the same prefecture after crossing the border. The predetermined distance may be a distance that takes into account the influence of positioning errors and indicates that the vehicle 40 is likely to be traveling across a prefectural border even with the influence. The predetermined distance is set to 30 m here, but this is a distance that the inventors considered to be appropriate for determining that the vehicle 40 is traveling within the same prefecture, and is determined in advance assuming a travel distance when traveling at a speed of 100 km / h for about 1 second. However, the predetermined distance is not limited to 30 m, and may be a distance less than 30 m or greater than 30 m.

[0210] When the control unit 11 determines that the distance traveled since the prefecture of the address of the current location has changed has not reached the predetermined distance (step S107; NO), it determines whether the prefecture of the address of the current location has changed (step S108). When the control unit 11 determines that the prefecture of the address of the current location has changed (step S108; YES), it ends the processing of FIG. 23. When the control unit 11 determines that the prefecture of the address of the current location has not changed (step S108; NO), Return to step S105. The control unit 11 repeats steps S105 to S108 (step S108: NO) to sequentially determine the travel distance within the same prefecture after crossing the prefectural border.

[0211] When the control unit 11 determines that the distance traveled since the prefecture of the current address has changed has reached a predetermined distance (step S107; YES), it determines whether a predetermined warning process is in progress (step S109). The warning process is as described above. When the control unit 11 determines that warning process is in progress (step S109; YES), it waits until the warning process is completed. Note that the predetermined warning process may be all warning processes or may be only a part of the warning process. It may also be a notification process other than the warning process, or may be a notification process that is understood to be a warning or the like.

[0212] When it is determined that the warning process is not in progress (step S109; NO), the control unit 11 outputs character information using a prefectural border phrase (step S110) based on the phrase management data 256. In the process of outputting character information using a prefectural border phrase, the control unit 11 may, for example, select a phrase that belongs to "prefectural border" and is associated with the prefecture of the current location, and execute a phrase process (fourth phrase process) that outputs the voice of that phrase.

[0213] As shown in Fig. 24, when the vehicle 40 moves from one prefecture to another, if the movement is likely, the control unit 11 executes phrase processing for the current location after the movement. Note that this is true not only when the vehicle moves across prefectures, but also when the vehicle moves between prefectures.

[0214] According to the process of FIG. 23, the control unit 11 operates as follows. For example, as shown in FIG. 25(A), when moving from Miyazaki prefecture to Kagoshima prefecture and an alarm process is not in progress ("NO" in step S109), the control unit 11 may promptly output character information that utters the prefectural border phrase "Kagoshima ken~n" after traveling a predetermined distance after moving to Kagoshima prefecture (step S110).

[0215] For example, as shown in Fig. 25(B), when the vehicle crosses a prefectural border but GPS is lost, the map matching function is not enabled during the period when GPS is lost. In this case, when GPS loss is resolved and the map matching function becomes enabled, the control unit 11 may output character information using a prefectural border phrase. Here, when the vehicle moves from Miyazaki prefecture to Kumamoto prefecture, the control unit 11 may output character information uttering the prefectural border phrase "Kumamoto ken~n" as soon as GPS loss is resolved (step S110).

[0216] For example, as shown in FIG. 26(A), when the vehicle crosses prefectural borders such as Tochigi, Saitama, and Gunma in a short period of time, if the distance traveled in each prefecture reaches a predetermined distance ("YES" in step S107 in each prefecture), the control unit 11 outputs character information using a prefectural border phrase corresponding to each prefecture (step S110).

[0217] For example, as shown in FIG. 26(B), when the vehicle moves from Saitama prefecture to Gunma prefecture in a short period of time but moves back to Saitama prefecture before reaching a predetermined distance ("NO" in step S107->"YES" in step S108), the control unit 11 does not output character information using a prefectural border phrase corresponding to Gunma prefecture. For example, when the vehicle is traveling near the prefectural border but is recognized as having crossed the prefectural border due to a positioning error, the possibility of erroneously outputting character information using the prefectural border phrase can be reduced. In addition, it is possible to prevent the prefectural border phrase corresponding to Gunma prefecture from being output after the vehicle 40 returns to Saitama prefecture.

[0218] For example, as shown in Fig. 26(C), if the user moves from Tochigi prefecture to Gunma prefecture and then to Saitama prefecture in a short period of time, or if the user moves from Gunma prefecture to Saitama prefecture before reaching a predetermined distance ("NO" in step S107 -> "YES" in step S108), the control unit 11 does not output character information using the prefecture border phrase corresponding to Gunma prefecture. This prevents the output of character information using the prefecture border phrase corresponding to Gunma prefecture when the user has already moved to Saitama prefecture, and can reduce the occurrence of discrepancies between the prefecture border phrase and the current prefecture.

[0219] For example, as shown in Fig. 27, when the vehicle has traveled across the border between Miyazaki Prefecture and Kagoshima Prefecture but is undergoing warning processing (shown as "warning in progress" in Fig. 27) ("YES" in step S109), the control unit 11 outputs character information using a prefectural border phrase corresponding to Kagoshima Prefecture (step S110) after warning processing ends ("NO" in step S109). In this way, when it is determined that the vehicle is traveling within the same prefecture, even if a warning is being issued according to the positional relationship between the vehicle and a specified object, the warning can be given priority and a phrase related to the vehicle's current location can be output after the warning has ended.

[0220] Conventionally, when a POI (point of interest) is placed at the position of a prefectural border on a map and it is determined that a vehicle has passed through the prefectural border based on the POI, the prefectural border conquering count can be obtained. In this embodiment, the above map data is used, so a different prefectural conquering count can be obtained. In the conventional method of using POI, the prefectural border conquering count may not be counted even if the vehicle crosses a prefectural border on a road other than an expressway or a major road. However, in this embodiment, the above map data is used, so that crossing a prefectural border on a road other than an expressway or a major road can be counted, and the prefectural border conquering count can be obtained.

[0221] In steps S105 to S107, it is determined whether the distance traveled within the same prefecture has reached a predetermined distance, but an index other than the distance traveled may be used as long as it is an index for grasping the certainty that the vehicle is traveling within the same prefecture. For example, it may be determined that the travel time has reached a predetermined time. In addition, although travel within the same prefecture is determined as the same geographical range here, travel within a geographical range divided into other units such as a city, ward, town, or village may also be determined. In either case, in step S110, a process of outputting a phrase related to the current location that belongs to the geographical range after movement may be performed.

[0222] <4-5. Function to display other characters> The control unit 11 has a function to display characters other than Kirishima Rei as characters. The control unit 11 has a function to display, for example, "Chibi Rei", a character that represents Rei as a child. For example, when the intimacy level is equal to or higher than a threshold, the control unit 11 may select the display of Chibi Rei, and when selected, may display Chibi Rei instead of Rei. Even when Chibi Rei is displayed, the control unit 11 performs the same functions as when Rei is displayed, but the control unit 11 may perform different processing, for example, by using different phrases to output character information for Rei and Chibi Rei, or by changing the image of the character to be displayed to Chibi Rei. Furthermore, the control unit 11 may display another character when a predetermined condition is met in a mode (Rei mode) in which Rei or Chibi Rei is displayed. The predetermined condition is when neither Rei nor Chibi Rei is displayed, such as when Rei or Chibi Rei gets car sick and leaves the room, or when they run away from home. The character displayed in this case may be, for example, a mascot character of Yupiteru Corporation, such as "Aoi Chacha".

[0223] <4-6: Speed ​​indicator display function> The speed indicator display function is a function that performs an indicator display process that displays the speed of the vehicle 40 using an indicator. The control unit 11 functions as an indicator display processing unit. This indicator displays the current speed limit and information that serves as a guide for speeding on a map, and is characterized in that the display mode changes based on the relationship with the speed limit and the relationship with the indicator value. In the following, the indicator that displays the speed is referred to as a "speed indicator", but may also be referred to as a speed meter or the like. The speed range that the speed indicator of this embodiment corresponds to may be, for example, 0 km to 180 km / h. This speed indicator is a bar-shaped indicator that displays the vehicle speed, and further displays a bar at a position that indicates the speed limit.

[0224] FIG. 28 is a flowchart showing an indicator display process related to the speed indicator display function. The control unit 11 determines the type of road on which the vehicle 40 is traveling (step S121). Here, the control unit 11 determines whether the vehicle 40 is traveling on an expressway (step S122). The control unit 11 may determine whether the vehicle 40 is traveling on an expressway based on the air pressure sensor of the sensor unit 20, or may determine whether the vehicle is traveling on an expressway based on the position information acquired by the position information acquisition unit 17. If it is determined that the vehicle is not traveling on an expressway (step S122; NO), the control unit 11 ends the processing of FIG.

[0225] When it is determined that the vehicle is traveling on an expressway (step S122; YES), the control unit 11 determines whether the speed limit at the current location is known (step S123). The control unit 11 may determine whether the speed limit at the current location is known based on whether the speed limit at the current location can be acquired based on map data. When it is determined that the speed limit at the current location is not known (step S123; NO), the control unit 11 ends the process of FIG.

[0226] When it is determined that the speed limit at the current location is known (step S123; YES), the control unit 11 determines whether the speed limit has changed (step S124). A change in the speed limit may include not only a change in the value of the speed limit, but also a change from an unknown state to a known state.

[0227] If the control unit 11 determines that the speed limit has changed (step S124; YES), it causes the display unit 13 to display the speed limit (step S125). As shown in Fig. 29, the control unit 11 may determine whether the speed limit has changed based on the POI, and if so, display the changed speed limit. For example, as shown in Fig. 30(B), the control unit 11 may display the speed limit (the number "80" is displayed in a circle in Fig. 30(B)) together with the character string "Speed ​​limit change point."

[0228] If the control unit 11 has caused the display unit 13 to display the speed limit in step S125, or if it has determined in step S124 that the speed limit has not changed (step S124; NO), the control unit 11 proceeds to the process in step S126. Next, the control unit 11 determines whether the speed of the vehicle 40 is equal to or less than the speed limit (step S126).

[0229] When the control unit 11 determines in step S126 that the speed of the vehicle 40 is equal to or lower than the speed limit (step S126; YES), the control unit 11 causes the display unit 13 to display the speed indicator in the first display mode (step S128). FIG. 30(A) is a diagram showing the speed indicator M1 in the first display mode. As shown in FIG. 30(A), the speed indicator M1 in the first display mode is a bar-shaped speed indicator that indicates the position of the speed limit and the position of the current speed of the vehicle 40, and displays the color of the bar in blue (an example of the first color). As shown in FIG. 31(A), when the speed is equal to or lower than the speed limit (here, 80 km or less), the control unit 11 may display the part indicating the current speed (a part occupying a predetermined range from the bottom end upward) in blue and display the background in gray. Then, the control unit 11 returns to the process of step S121.

[0230] When the control unit 11 determines in step S127 that the speed of the vehicle 40 exceeds the speed limit (step S127; NO), it determines whether the speed of the vehicle 40 is equal to or lower than the speed limit plus a predetermined speed Va (speed limit + Va) (step S128). When the control unit 11 determines in step S128 that the speed of the vehicle 40 is equal to or lower than the speed limit + predetermined speed Va (step S128; YES), it causes the display unit 13 to display the speed indicator in the second display mode (step S129). FIG. 30(B) is a diagram showing the speed indicator M2 in the second display mode. As shown in FIG. 30(B), the speed indicator M2 in the second display mode is a bar-shaped speed indicator that indicates the position of the speed limit and the position of the current speed of the vehicle 40, and in addition, displays the color of the bar in yellow (an example of the second color). 31(B), when the speed is equal to or greater than the speed limit (here, 80 km or greater) and is equal to or less than the speed limit plus a predetermined speed Va, the control unit 11 may display the portion indicating the current speed in yellow and display the background in gray. Then, the control unit 11 returns to the process of step S121.

[0231] The predetermined speed Va may be, for example, 20 km, and may be a speed at which the speed of the vehicle 40 exceeds the speed limit but is lower than the speed at which the indicator value becomes a negative value, in other words, a speed at which the indicator value does not become a negative value. A speed at which the indicator value becomes a negative value is a speed that tends to deteriorate the parameter indicating the relationship between the user and the character 200. In this way, the user can understand that the speed of the vehicle 40 exceeds the speed limit but is not so excessive that the relationship between the user and the character 200 becomes worse.

[0232] If the speed of the vehicle 40 exceeds the speed limit plus the predetermined speed Va in step S128 (step S128; NO), the control unit 11 causes the display unit 13 to display the speed indicator in the third display mode (step S130). FIG. 30(C) is a diagram showing the speed indicator M3 in the third display mode. As shown in FIG. 30(C), the speed indicator M3 in the third display mode is a bar-shaped speed indicator that indicates the position of the speed limit and the position of the current speed of the vehicle 40, and also displays the color of the bar in red (an example of the third color). As shown in FIG. 31(C), when the speed is equal to or higher than the speed limit (here, 80 km or higher) and exceeds the speed limit plus the predetermined speed Va, the control unit 11 may display the part indicating the current speed in red and display the background in gray. Then, the control unit 11 returns to the processing of step S121. s

[0233] The predetermined speed Va is, for example, 20 km, and is the speed at which the speed of the vehicle 40 exceeds the speed limit and the indicator value becomes a negative value. The speed at which the indicator value becomes a negative value is the speed that will worsen the relationship between the user and the character 200. In this way, the user can understand that the speed of the vehicle 40 exceeds the speed limit and that the exceedance will worsen the relationship between the user and the character 200. In addition to knowing the speed limit, the user can understand that if the speed is faster than the current speed, the relationship with the character will also deteriorate, and this makes it easier for the user to be more motivated to drive at a slower speed.

[0234] For example, when the vehicle speed is 90km / h or more and exceeds the speed limit by 20km / h, the control unit 11 executes the process of step S130. However, when the speed limit is less than 80km / h, the control unit 11 displays the speed limit on the speed indicator as the actual speed limit, which is less than 80km / h, while fixing the speed limit used for selecting the first to third display modes and calculating the indicator value at 80km / h. This is to prevent the indicator value from dropping unexpectedly when driving on expressways where the speed limit is 80km, such as the Shuto Expressway.

[0235] In addition, when the control unit 11 displays a notification screen as described in Fig. 2, for example, when switching from a normal screen to a notification screen, it is particularly preferable to hide the speed indicator. When switching from a normal screen to a notification screen, the control unit 11 displays an animation of Ray transforming, but this is to prevent the animation from overlapping with the speed indicator and improve the visibility of the animation.

[0236] Also, the screen displaying the speed indicator does not have to be limited to the normal screen or the notification screen. The control unit 11 of the electronic device 10 may have a function of displaying an OBD screen displaying information acquired from the OBD-II connector when the connection unit 24 and the OBD-II connector mounted on the vehicle 40 are connected via a cable. Figs. 32(A) to (C) are examples of OBD screens. It is preferable that the user can set which OBD screen of Figs. 32(A) to (C) is to be displayed. In each OBD screen, the information acquired from the OBD-II connector is displayed in the left area, and an image of a weapon resembling a gun is displayed in the right area. This weapon resembling a gun is sometimes carried by Ray, for example, when Ray is wearing a combat suit. In Figs. 32(A) to (C), a speed indicator based on vehicle information is also displayed. The control unit 11 may also display this speed indicator in the manner described in Figs. 28 to 31. FIG. 32(A) shows a speed indicator like a circular meter, but the processing of the speed indicator display function in this section can be applied to any indicator or meter of any shape or configuration that displays speed.

[0237] <4-7. Weighting the occurrence rate of specific phrases> The appearance rate of a particular phrase may be weighted. Conventionally, the appearance rate of a phrase is basically random, but since the same phrases are often reproduced depending on the user's life rhythm and driving route, such as the start-up phrase that is generated when the electronic device 10 is started, or POIs, the appearance frequency of characteristic phrases increases, and this may be unpleasant to the user.

[0238] Therefore, the control unit 11 designates the subcategory of phrases that are to appear with high frequency as a "subcategory (high lottery frequency)" and sets the appearance rate different from other subcategories.

[0239] FIG. 33A is a flow chart showing the phrase processing of this section. The control unit 11 randomly selects whether to play a phrase of "Subcategory (high selection frequency)" (step S131). This selection may be performed by a selection with a predetermined probability of winning. The probability of winning may be, for example, 80%, but may be another probability such as 70%. If the control unit 11 judges "YES" in step S131, the control unit 11 randomly acquires any phrase belonging to "Subcategory (high selection frequency)" (step S132). Then, the control unit 11 outputs character information based on the acquired frame. On the other hand, if the control unit 11 judges "NO" in step S131, the control unit 11 randomly acquires any phrase from among all subcategories including the subcategory of "Subcategory (high selection frequency)" and other subcategories, or from among the other subcategories (step S133). Then, the control unit 11 outputs character information based on the acquired frame.

[0240] As a subcategory of "subcategory (high selection frequency)", the subcategory shown in FIG. 33(B) is particularly preferable. Although not included in the example of FIG. 33(B), "activation phrase" may be further included as a subcategory of "subcategory (high selection frequency)". The subcategory shown in FIG. 33(B) is preferably a subcategory to which relatively short phrases belong, or a subcategory having a predetermined number or more of prepared phrases. On the other hand, if a subcategory to which relatively long phrases belong, or a subcategory having less than a predetermined number of prepared phrases has a high selection frequency, the phrases may be unpleasant to the user, but this can be prevented.

[0241] The phrase processing that weights the occurrence rate of such a specific phrase can be understood as processing in which the phrase is classified into one of a plurality of categories according to the content of the phrase, and the phrase processing unit selects a phrase belonging to a predetermined first category more frequently than a phrase belonging to a predetermined second category.

[0242] [5. Linkage Function Between Electronic Device 10 and Terminal Device 60] The link function is a function that is realized by linking the electronic device 10 and the terminal device 60. In this embodiment, as the link function, not only the electronic device 10 but also the terminal device 60 can check information that changes according to the usage status of the vehicle 40 managed by the electronic device 10. For example, the information that changes according to the usage status of the vehicle 40 may include intimacy, item acquisition status, phrase acquisition status, etc. In this way, the user can check, using the terminal device, parameters that indicate the relationship between the user and the character and are used for phrase processing of the electronic device.

[0243] 36(A) shows a top screen displayed on the terminal device 60 based on the program 652. The control unit 61 causes the UI unit 64 to display the top screen. In the game engine in the program 652, the Unity Project used by the terminal device 60 may be one created by copying the Unity Project for the electronic device 10, for example. The top screen displays an image of a character 700 representing Fuji Ray, who is the same character as the character 200. In this example, the character 700 is displayed as a character 700A wearing the same outfit as the character 200A. The background of the character 700 displayed on the UI unit 64 is black, which is different from the background on the display unit 13 of the electronic device 10.

[0244] In the following, a case will be described in which the electronic device 10 cooperates with one terminal device 60. In the case where a terminal device is replaced with a new one, the electronic device 10 is made to stop cooperation with the old terminal device and is allowed to cooperate with the new terminal device.

[0245] (Initial settings (processing at first connection)) FIG. 34 is a sequence diagram showing a process related to the initial setting of the link function. The control unit 11 of the electronic device 10 first accepts an operation of a pairing start button (step S201). The control unit 11 may display a predetermined pairing start button on the display unit 13 and accept a touch operation on the pairing start button. Then, the control unit 11 waits for communication. The control unit 61 in the terminal device 60 accepts an operation of the pairing start button (step S202). The control unit 11 may display a predetermined pairing start button on the UI unit 64 and accept a touch operation on the pairing start button. When the control unit 61 in the terminal device 60 accepts the operation of the pairing start button, it transmits an IP address assigned to the terminal device 60 using the communication unit 63 (step S203). The IP address may be transmitted by broadcast.

[0246] When the control unit 11 in the electronic device 10 receives the IP address using the communication unit 18, it confirms with the user whether or not a connection to the device having this IP address is possible. For example, the control unit 11 may display a soft button for selecting whether or not to connect, together with the IP address, on the display unit 13. When the control unit 11 receives an operation by the user to permit the connection, it permits the connection by communication with the terminal device 60 (step S204). This starts communication (e.g., TCP communication) between the terminal device 60 and the electronic device 10 (step S205).

[0247] The control unit 11 connects to the terminal device 60 through communication based on the IP address of the terminal device 60, and transmits identification information for identifying the terminal device itself (hereinafter referred to as "device identification information") to the terminal device 60 using the communication unit 18 (step S206). The device identification information may be, for example, a UUID (Universally Unique Identifier), but may be any information that can uniquely identify the electronic device 10.

[0248] In the terminal device 60, when the control unit 61 receives the device identification information using the communication unit 63, the control unit 61 stores the received device identification information in the storage unit 65 (step SS207).

[0249] (When data is linked) FIG. 35 is a sequence diagram showing processing related to data linking of the linking function. The control unit 11 of the electronic device 10 first accepts an operation of a connection start button (step S211). The control unit 11 may display a predetermined connection start button on the display unit 13 and accept a touch operation on the connection start button. Then, the control unit 11 waits for communication. In the terminal device 60, the control unit 61 uses the UI unit 64 to confirm with the user whether or not data linkage with the electronic device 10 is to be performed (step S212). When the control unit 11 determines that data linkage is to be performed by the user's operation (step S213; YES), it transmits the IP address and the device identification information stored in step S207 using the communication unit 63 (step S214). When the control unit 11 receives the IP address and the device identification information in the electronic device 10, it checks whether the device identification information is that of its own device (step S215). When the control unit 11 confirms that the device identification information is that of its own device (step S215; YES), it permits a connection for communication with the terminal device 60 and starts communication with the terminal device 60 (steps S216, S217).

[0250] When communication between the electronic device 10 and the terminal device 60 is started, the control unit 11 transmits the situation data managed by the electronic device 10 to the terminal device 60 using the communication unit 18 (step 218). The situation data includes information that changes according to the usage status of the vehicle 40 collected by the electronic device 10, and may include, for example, the user level (i.e., intimacy level), the number of times an automatic speed camera has been passed, the distance traveled, the record of acquiring items, the record of visiting PAs, SAs, and roadside stations, and the number of prefectures conquered, but may also include other information.

[0251] In the terminal device 60, when the control unit 61 receives the situation data using the communication unit 63, the control unit 61 stores the situation data in the storage unit 65, thereby updating the situation data in the terminal device 60 (step S220). The control unit 61 displays a status screen that displays a status based on the situation data stored in the storage unit 65 (step S221). FIG. 36(B) is an example of the status screen. On this status screen, a window 710 that displays the user's level (intimacy) and score is displayed. The score may be calculated based on the situation data, for example.

[0252] (Share function) The sharing function is a function that ranks statuses specified based on situation data such as user level and mileage, and enables them to be shared between users. A server (not shown) may automatically collect user information via the terminal device 60 (e.g., via a smartphone), rank the user information in the server, and automatically distribute the information. Specifically, the server collects information on the current status from each terminal device 60. For this purpose, the terminal device 60 manually sends the status information to the server, and then sends the status information in response to an operation on the UI unit 64, for example. The server performs a ranking process based on the status information received from the terminal device 60, etc. After ranking the user information, the server distributes the information indicating the ranking to the terminal device 60 (e.g., a smartphone), or updates the website so that the information can be viewed on a specific website. The ranking may be configured to display, for example, information on the top 100 users for each item, or the contents of the status.

[0253] The ranking should include at least some of the following items, and preferably all of them. SA stands for service area, PA for parking area, and HO for highway oasis.

[0254] Total mileage -Average distance traveled per day ·level Number of prefectural borders conquered Number of prefectures conquered Number of phrases Number of items acquired Kirishima Rei (Normal) / Number of costumes for Chibi Rei Number of times passing through an speed camera Number of stops at SA / PA / HO / roadside station - The number of days since the electronic device 10 was first turned on -G sensor response times The number of times the character has run away from home due to the character running away process

[0255] [6. Explanation of matters related to SDGs] The introduction of System 1 is expected to contribute to several of the Sustainable Development Goals (SDGs) as follows:

[0256] (SDG11: Sustainable Cities and Communities) According to the electronic device 10 of the embodiment described above, it is possible to detect a vehicle speed measurement device and notify the user using character information. The user can be motivated to drive safely by knowing the presence of the vehicle speed measurement device, and the use of character information can further pique the user's interest. Doing so can also contribute to realizing urban development where people can continue to live safely and securely on roads and in the surrounding areas.

[0257] [7. Modifications] The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit and scope of the present invention. In addition, the following modified examples may be combined as appropriate.

[0258] The control unit 11 does not execute dialogue processing when the vehicle 40 is stopped and waiting for a traffic light. Alternatively, the control unit 11 may execute dialogue processing even when the vehicle 40 is stopped and waiting for a traffic light, but suppress the execution of the dialogue processing. To suppress the execution, for example, some dialogue processing may not be executed. For example, the control unit 11 may not execute dialogue processing in which a phrase is longer than a predetermined length or dialogue processing in which the number of exchanges is large (the number of round trips is greater than a predetermined number) when the vehicle is waiting for a traffic light, but may execute other dialogue processing even when the vehicle is waiting for a traffic light. To suppress the execution, the frequency of execution may be reduced. This is because even in this case, the frequency of the dialogue processing being terminated when the state of waiting for a traffic light ends in the middle of the dialogue processing is reduced.

[0259] The control unit 11 may treat the phrase processing that is suppressed when the vehicle is stopped and waiting at a traffic light as a phrase processing other than a dialogue processing. For example, even if the phrase is a tweet processing that is longer than a predetermined length, the control unit 11 may suppress the execution of the tweet processing when the vehicle is stopped and waiting at a traffic light.

[0260] The control unit 11 is an example of a state detection unit that detects the state in which the vehicle 40 is waiting for a traffic light, but may also function as a state detection unit that detects a parking state in which the vehicle 40 is parked. For example, the control unit 11 may detect that the vehicle 40 is in a parked state when the vehicle 40 is in a location with a parking lot such as an SA, PA, HO, roadside station, home, or workplace and is in a stopped state based on the location information acquired by the location information acquisition unit 17. When the control unit 11 detects that the vehicle 40 is in a parked state, it is preferable to execute the dialogue processing without suppressing its execution. The parked state in this case is an example of a first stopped state.

[0261] The second stopped state may be specified as a state in which the vehicle is stopped and is not in the first stopped state, or the first stopped state may be specified as a state in which the vehicle is stopped and is not in the second stopped state.

[0262] In the above-described embodiment, the phrase processing is a process of outputting the voice of a phrase by the voice of a character, but it may be a process of outputting the voice of a phrase in a manner not associated with a character. Also, the electronic device 10 may perform the phrase processing without displaying (outputting) an image of a character.

[0263] The electronic device 10 has a function of receiving a police wave and a function of notifying in response to the reception of the police wave, but these functions may be installed in different electronic devices. In the configuration shown in FIG. 37(A) which is an example of this aspect, the first electronic device 103 has a function of receiving a police wave and a function of outputting a signal corresponding to the reception result to the outside. The first electronic device 103 is also called an antenna unit. The second electronic device 101A has a function of acquiring a signal output from the first electronic device 103 and notifying in response to the reception of the police wave by the first electronic device 103 based on this signal. The first electronic device 103 and the second electronic device 101A are connected, for example, by a wired communication path (for example, the cable 104 shown in FIG. 37(A)), but may be connected by a wireless communication path. The notification does not have to include, for example, notification by at least one of a display, a sound, and a light. In the configuration shown in FIG. 37(B), which is an example of this aspect, the electronic device 101B does not have a display unit. The electronic device 101B outputs sound from a sound output hole 105 provided on the front side, or emits light from a light emitting unit 106 to notify the user. The electronic device may be installed at a position other than on the dashboard, such as the windshield of the vehicle (for example, near the upper end of the windshield), or the vehicle's rearview mirror or the ceiling of the vehicle cabin. In the configuration shown in FIG. 37(C), which is an example of this aspect, the electronic device 101B is fixed to the windshield by using a mounting member 107 instead of the fixing unit 102. The mounting member 107 is formed, for example, by using a metal plate-like member. The electronic device may be configured to be fixed to any one of a plurality of possible installation positions selected by the user.

[0264] The configurations and operations described in the above-mentioned embodiments may be partially omitted or modified. In addition, various modifications are possible with respect to the specific display contents, parameters, and specific processing methods (e.g., calculation formulas and the format of data to be handled).

[0265] The above-mentioned dialogue processing, tweet processing, and other functions installed in the electronic device 10 may be installed in electronic devices other than the electronic devices used in vehicles. The electronic devices may be, for example, electronic devices arranged in homes, offices, and other facilities for monitoring and crime prevention purposes. The electronic devices may be robot-type devices having an appearance imitating a person, an animal, or a virtual creature. The electronic devices may be electronic devices that can be carried by a user, such as a smartphone or a tablet computer. In addition, even in electronic devices other than the electronic devices used in vehicles, it is possible to implement the above-mentioned embodiment by replacing the part that represents the running of the vehicle with the movement of the user, or by replacing the period from when the accessory power is turned off to when it is turned on next time with a period when the user did not use the electronic device (for example, a period when the application was not running, or a period when the power of the electronic device was turned off). The electronic devices other than the electronic devices used in vehicles may be, for example, small signage-type display devices installed in homes, etc.

[0266] The electronic device used in the vehicle may be, for example, a detector such as a radar detector or a laser detector, but may also be a navigation device, a drive recorder, or other in-vehicle device.

[0267] In the above-described embodiment, the configuration of transmission may be read as a configuration of output. The output may be an output other than transmission, for example, an output by recording (storage) or printing. The functions of the control unit 11 and the control unit 61 may be realized by one or more hardware resources, one or more software resources, or a combination of these. For functions realized by software resources, a program for realizing the function may be distributed via the Internet or other networks.

[0268] Each function described in the above embodiment may be realized by one or more hardware elements, one or more software elements, or a combination of these. Furthermore, each function may be realized by one device that is physically or logically coupled, or by two or more devices that are physically or logically separated.

[0269] The storage medium storing the program described in the above embodiment is not limited to the one described in the above embodiment, and may be any storage medium readable by a computer. Examples of the computer-readable storage medium include storage media of various storage methods such as semiconductor storage media, optical storage media, and magnetic storage media. Examples of the computer-readable storage medium include storage media built into a device that realizes a function based on a program, storage media external to the device, storage media of a server connected to the device via an electric communication line (e.g., wired and / or wireless), and other storage media.

[0270] The computer that realizes the functions based on the programs described in the above-mentioned embodiments is not limited to the computer of the device described in the above-mentioned embodiments. The functions may be realized by other computers depending on the purpose, use, nature, etc. of the functions. For example, the functions realized by the viewer program of the imaging device may be realized by a computer program of a personal computer that plays back images captured by the imaging device, a smartphone, a tablet computer, or other devices, as appropriate. In addition, the functions based on the programs described in the above-mentioned embodiments may be realized by diverting them to a device other than the device described in the above-mentioned embodiments, for example, by a computer for more general-purpose use. The programs described in the above-mentioned embodiments may be executed by, for example, a program executed by a personal computer (for example, PC software), a program executed by a smartphone (for example, a smartphone app), or a computer of another information processing terminal. Alternatively, the computer that realizes the functions based on the programs may be a computer used in a device for a specific purpose, such as a home device or a commercial device.

[0271] Furthermore, functions described as being implemented by an application program may be implemented by an operating system, middleware, firmware, or other programs other than application programs.

[0272] Furthermore, the notification or announcement of specified information is not limited to being made explicitly as long as the user is able to recognize the notification or announcement, but may also be made implicitly (i.e., without explicitly notifying or announcing the specified information).

[0273] In addition, in the portion where it is explained that A may be, for example, a1, a2..., and an, A may be specified as including one or more of a1, a2..., and an, but it is also possible to specify A as not including one or more of a1, a2..., and an. Therefore, it is also possible to specify A by excluding at least some of the listed elements, such as "A (excluding a1)" or "A (excluding a1 and a2)."

[0274] In a section that describes A having B and B having C, A may have C. In a section that describes processing as performing B after A and C after B, A may have C. In a section that describes processing as being performed after a conditional judgment, the disclosure also discloses the processing to be performed for that processing part that does not require a conditional judgment, and we intend to obtain rights for these as well. In a section that describes P having Q, an intervening object or intervening processing may be provided between P and Q. We intend to obtain rights for these as well by divisional application or amendment.

[0275] The scope of the present invention is not limited to the configurations explicitly described in the specification, but includes combinations of various aspects of the present invention disclosed in this specification. The configurations of the present invention that are to be patented are specified in the attached claims, but it is our intention to include configurations disclosed in this specification in the claims in the future, even if they are not currently specified in the claims.

[0276] The present invention is not limited to the configuration described in the above-mentioned embodiment. The components of each of the above-mentioned embodiments and modifications may be arbitrarily selected and combined. Any components of each of the embodiments and modifications may be arbitrarily combined with any components described in the means for solving the invention or any components that embody any components described in the means for solving the invention. We intend to acquire rights to these as well through amendments to this application or divisional applications. Even if there is a description such as "in the case of" or "when", this is not intended to describe a configuration that is limited to that case or time. We also disclose configurations that are not in these cases or times, and we intend to acquire rights. Furthermore, the parts described in order are not limited to this order. We also disclose configurations in which some parts are deleted or the order is changed, and we intend to acquire rights.

[0277] In addition, we intend to obtain rights to the overall design or partial design by converting to a design registration application. The drawings depict the entire device in solid lines, but they include not only the overall design but also partial designs claimed for a part of the device. For example, some parts of the device may be partial designs, and the drawings include some parts of the device as partial designs regardless of the parts. A part of the device may be a part of the device, or a part of that part. We intend to obtain rights to the overall design as well as partial designs in which any part of the solid line part of the drawing is shown as a broken line part. In addition, the modules, parts, and components inside the device's casing, all of which are shown in the drawings, are subject to trade independently, and we intend to obtain rights to them by converting to a design registration application in the same way. [Explanation of symbols]

[0278] 1: System 10:Electronic equipment 11: Control section 12: Light receiving part 13: Display section 14: Audio output section 15: Radar receiver 16: Wireless receiver 17: Location information acquisition section 18: Communications Department 19: Input section 20: Sensor section 21: Mounting part 22: Power supply control unit 23: Light emitting part 24: Connection part 25: Storage section 30: Speed ​​measuring device 31: Speed ​​measurement section 32: Photography Department 33: Strobe 40: Vehicle 41: Dashboard 50:Detection device 55:Detection device 60: Terminal device 61: Control section 62: Audio input / output section 63: Communications Department 64:UI section 65: Storage section 66: Photography Department 101: Main body 101A: Second electronic device 101B:Electronic equipment 102:Fixed part 103: First electronic device 104: Cable 105: Sound emission hole 106: Light emitting part 107: Mounting material 191: Touch sensor 192: Microphone 200: Character 200A: Character 200B: Character 210: Indicator image 218: Step 220: Intimacy image 230: Information 252: Program 253: Display data 254: Intimacy data 255: Configuration data 256: Phrase management data 257: Gallery acquisition status data 300: Map 652: Program 700: Character 700A: Character

Claims

1. An electronic device for use in a vehicle, A state detection unit that detects whether the vehicle is in a predetermined stopped state; a phrase processing unit that executes a phrase process for outputting a predetermined phrase to a user; having The phrase processing unit includes: When the vehicle is in a predetermined first stopped state, a predetermined first phrase process is executed; When the vehicle is in a predetermined second stopped state, execution of the first phrase process is suppressed. electronic equipment.

2. The first phrase processing is a dialogue processing including a process of outputting a voice of a phrase meaning a question to the user, and a process of recognizing a response from the user and further outputting a voice of a phrase in response to the response.

2. The electronic device according to claim 1.

3. the phrase processing unit further executes a second phrase process that includes a process of outputting a voice of a predetermined phrase to the user; When the vehicle is in the second stopped state, execution of the first phrase process is suppressed, but execution of the second phrase process is executed without being suppressed.

3. The electronic device according to claim 2.

4. The second stopped state includes a state in which the vehicle is waiting for a traffic light.

4. The electronic device according to claim 3.

5. a position information acquisition unit that acquires position information of the vehicle based on a result of positioning by a global navigation satellite system; a display processing unit that performs processing to display the position of the vehicle on a road on a map by correcting the position information based on a map matching function; having The state detection unit is detecting that the vehicle is waiting at a traffic light when the vehicle is stopped and the position information is not corrected by the map matching function; 5. The electronic device according to claim 4.

6. a connection section to which an external in-vehicle device is connected; a link processing unit for implementing a function linked with the in-vehicle device; having The phrase processing unit includes: executing or suppressing a third phrase process having a content related to the in-vehicle device according to a connection record of the in-vehicle device to the connection unit; 6. The electronic device according to claim 5.

7. The phrase processing unit includes: if the in-vehicle device has been connected to the connection unit at least once, execution of the third phrase process is suppressed.

7. The electronic device according to claim 6.

8. suppressing the execution of the first phrase processing means not executing the first phrase processing.

8. The electronic device according to claim 7.

9. a position information acquisition unit that acquires position information of the vehicle based on a result of positioning by a global navigation satellite system; a geographical area specifying unit that sequentially specifies a geographical area in which the vehicle is located among a plurality of geographical areas divided into predetermined units based on the location information; The phrase processing unit includes: execute a fourth phrase process related to the current location of the vehicle when the vehicle is in a traveling state and has traveled a predetermined distance within the same geographical range after the geographical range in which the vehicle exists has changed; The electronic device according to claim 1 .

10. The predetermined travel within the same geographical area means that the vehicle has traveled a predetermined distance within the same geographical area.

10. The electronic device according to claim 9.

11. a display processing unit that performs processing to display the position of the vehicle on a road on a map by correcting the position information based on a map matching function; having The phrase processing unit determines that the vehicle is in the traveling state when the vehicle is traveling at a predetermined speed or faster and the position information is being corrected by the map matching function. The electronic device according to claim 10.

12. a notification processing unit that issues a notification according to a positional relationship between the vehicle and a predetermined object while the vehicle is traveling; The phrase processing unit includes: when it is determined that the vehicle has traveled within the same geographical area during the execution of the notification process while the vehicle is traveling, the fourth phrase process is executed after the notification process is executed. The electronic device according to claim 11.

13. The phrase processing includes a performance in which a predetermined character speaks, A calculation unit that calculates a parameter indicating a relationship between the user and the character; an indicator display processing unit that performs processing to display an indicator that displays the speed of the vehicle; having The calculation unit calculates the parameter based on a relationship between a speed of the vehicle and a speed limit of a road on which the vehicle travels; The indicator display processing unit is when the speed of the vehicle exceeds a speed limit, changing a display mode of the indicator according to an effect of the speed of the vehicle on the parameter; 10. The electronic device according to claim 9.

14. The indicator display processing unit is changing a display mode of the indicator depending on whether or not to change the parameter in a direction that worsens a relationship between the user and a predetermined character, based on a relationship between a speed of the vehicle and a speed limit of a road on which the vehicle is traveling; 14. The electronic device according to claim 13.

15. The indicator display processing unit is a position indicated by the indicator is changed in accordance with the speed of the vehicle, and a display mode of the indicator is changed so as to change a color of the indicator.

14. The electronic device according to claim 13.

16. A phrase used in the phrase processing is classified into one of a plurality of categories according to the content of the phrase, The phrase processing unit includes: Selecting a phrase belonging to a first predetermined category more frequently than selecting a phrase belonging to a second predetermined category; 10. The electronic device according to claim 9.

17. The first category includes more short phrases or has a larger number of phrases than the second category.

17. The electronic device according to claim 16.

18. Equipped with a function for communicating with external terminal devices, Transmitting information that changes depending on the usage status of the vehicle to the terminal device; 10. The electronic device according to claim 9.

19. The phrase processing includes a performance in which a predetermined character speaks, a calculation unit that calculates a parameter indicating a relationship between the user and the character, The information that changes depending on the usage status of the vehicle includes the parameters.

20. The electronic device of claim 18.

20. On the computer, A program for implementing the functions of the electronic device according to any one of claims 1 to 8.

Images