System, program, and the like
The system addresses the challenge of maintaining user engagement and safe driving by dynamically adjusting information output based on vehicle usage and interaction, enhancing user engagement through adaptive character interaction.
Patent Information
- Application Number
- JP2025169068
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-06-30
- Filing Date
- 2025-10-07
- Publication Date
- 2026-01-08
AI Technical Summary
Existing systems fail to effectively attract user attention and maintain engagement while ensuring safe driving by providing dynamic and interactive information based on vehicle usage and user interaction.
A system with an acquisition unit, interaction processing unit, and output processing unit that adjusts information output based on vehicle usage status and user interaction, including dialogue processing when the vehicle is stopped or below a certain speed, and calculates a parameter for the relationship with a character based on usage status and dialogue, allowing for dynamic information output and interaction.
Enhances user engagement by providing interactive and dynamic information that adapts to the relationship with a character, ensuring user attention is maintained without distracting from safe driving.
Smart Images

Figure 2026002869000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a system, a program, and the like. [Background technology]
[0002] Patent Document 1 discloses a system that displays a character and outputs information that contributes to the user's safe driving. Patent Document 1 discloses that the intimacy between the user and the character is improved based on information about the vehicle's mileage, and the character's voice is output based on the intimacy. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-169873 Summary of the Invention [Problem to be solved by the invention]
[0004] One of the objects of the present invention is to provide a technology with improved functionality compared to conventional technology, for example, to provide a technology for outputting information that will attract more attention from users.
[0005] The purpose of the present invention is not limited to this, and the applicant intends to obtain rights for configurations that aim to achieve the effects achieved by the components disclosed in the specification and drawings, etc., through divisional applications, amendments, etc. For example, the specification discloses problems in which the phrase "can be" is read as "the problem is to...". Each problem is described as an independent problem, and the applicant intends to obtain rights for configurations that solve each problem separately through divisional applications, amendments, etc. Even if the problem is implicitly understood from the description in the specification, the applicant intends to include part of the configuration described in the specification in the scope of the patent claim through amendments or divisional applications. The applicant also discloses configurations that solve problems that combine these independent problems, and the applicant intends to obtain rights for them. [Means for solving the problem]
[0006] (1) A system is provided that has an acquisition unit that acquires vehicle usage status, an interaction processing unit that performs interaction processing with a user while the vehicle is in use, and an output processing unit that performs processing to output information to the user based on the usage status and the interaction processing.
[0007] In this way, users using the vehicle can enjoy the interaction, and the user's interest can be attracted by outputting to the user information that changes depending on the results of the interaction processing in addition to the vehicle usage status.
[0008] (2) The dialogue processing unit may perform the dialogue processing when the vehicle is stopped.
[0009] In this way, the dialogue processing is performed when the vehicle is stopped, which prevents the user from being distracted by the dialogue processing while driving, and allows the user using the vehicle to enjoy the dialogue while taking into consideration the user's safe driving.
[0010] (3) The dialogue processing unit may perform the dialogue processing when the traveling speed of the vehicle is equal to or lower than a predetermined speed.
[0011] In this way, dialogue processing is performed when the vehicle's traveling speed is below a predetermined speed, such as when the vehicle is stopped, thereby preventing the user from being distracted while driving by dialogue processing when the vehicle's traveling speed is above the predetermined speed, and providing the user with the enjoyment of dialogue while taking into consideration the user's safe driving.
[0012] (4) The dialogue processing unit may include a process of speaking to the user and a process of recognizing the user's response to the utterance, and the output processing unit may perform a process of outputting information to the user in accordance with the recognized response.
[0013] In this way, the information output to the user changes depending on the user's response in the dialogue, making it possible to attract the user's interest in the dialogue and output information to the user that changes depending on the results of the dialogue.
[0014] (5) The dialogue processing is a process of reproducing a dialogue between the user and a specified character, and has a calculation unit that calculates a parameter indicating the quality of the relationship between the user and the character based on the vehicle usage status and the dialogue processing, and the output processing unit performs a process of outputting information to the user based on the parameter.
[0015] In this way, a parameter indicating the quality of the relationship between the user and the character changes based on the vehicle usage status and the dialogue between the character and the user while using the vehicle, and the information output to the user changes based on that parameter, so that a variety of information that changes depending on the relationship between the user and the character can be output to the user.
[0016] (6) The usage status may include a period during which the user has stopped using the vehicle, and the calculation unit may change the parameter depending on the period.
[0017] In this way, even if the use of the vehicle is discontinued, the parameters are not reset, so the relationship with the character can be carried over the next time the vehicle is used, and since the parameters change depending on the period for which the character has been left unattended, an actual interpersonal relationship can be reproduced in terms of the quality of the relationship between the user and the character.
[0018] (7) The usage status may include the length of the period from when the accessory power of the vehicle is turned off to when the accessory power is next turned on, and the calculation unit may change the parameter depending on the length.
[0019] In this way, even if the use of the vehicle is discontinued, the parameters are not reset, so the relationship with the character can be carried over the next time the vehicle is used, and since the parameters change depending on the period for which the character has been left unattended, an actual interpersonal relationship can be reproduced in terms of the quality of the relationship between the user and the character.
[0020] (8) The dialogue processor may increase the frequency of the utterance when the parameter indicates a good relationship.
[0021] In this way, the better the relationship between the user and the character, the more the user will be given the impression that the character will actively talk to the user, allowing the user to intuitively understand whether the relationship with the character is good or bad, and attracting the user's interest in interacting with the character.
[0022] (9) If the dialogue processor is unable to recognize the response, it may utter an utterance to the user requesting that they ask again based on the parameter.
[0023] The interior of a vehicle may be noisy due to engine noise and other sounds, and the situation may differ depending on the vehicle. In this way, by having the character speak according to the parameters to prompt the user to repeat the question, the user can intuitively understand whether their relationship with the character is good or bad, and this can arouse interest in the character.
[0024] (10) When the dialogue processor is unable to recognize the response, the closer the parameter indicates the closer the relationship, the more likely it is that it will make an utterance indicating that it will ask the user to repeat the question.
[0025] In this way, the better the relationship between the user and the character, the higher the probability that the character will make an utterance that prompts a response, which gives the user the feeling that they are becoming closer to the character.
[0026] (11) The dialogue processing unit may select one of a phrase belonging to a first group and a phrase belonging to a second group, make the utterance based on the selected phrase, and vary the probability of selecting a phrase from the first group and the second group depending on the parameter.
[0027] In this way, it is possible to reduce overlapping of phrases in the characters' speech, while changing the phrases spoken to the user depending on the relationship with the character.
[0028] (12) When the user uses a predetermined item, the calculation unit may calculate the parameter by reducing the influence of a direction that worsens the relationship or increasing the influence of a direction that improves the relationship.
[0029] In this way, the items have an effect on the user's relationship with the characters, giving the user the feeling that they are playing a game.
[0030] (13) The dialogue processor may make the utterance so as to give the user the impression that the character is riding in the vehicle.
[0031] This allows the user to feel as if they are riding in the vehicle together with the character, and gives the user a sense of immersion in the virtual world in which the character exists.
[0032] (14) The vehicle may have a notification processing unit that notifies the user when the vehicle is in a predetermined proximity to a predetermined target, and the dialogue processing unit may make the speech related to the notification processing unit.
[0033] In this way, the user can be made aware of the notification processing unit, which notifies the user when the vehicle is in a predetermined proximity to a predetermined target, through dialogue with the character. For example, the user can deepen their understanding of the function of the notification processing unit.
[0034] (15) The dialogue processor may utter the utterances related to vehicle driving.
[0035] In this way, the user can be made aware of vehicle driving through dialogue with the character, for example, the user can be made aware of safe driving.
[0036] (16) The dialogue processing unit may utter the utterance with content related to a user's response in the dialogue processing.
[0037] In this way, the user can be made aware of the content of the user's response in the dialogue processing through dialogue with the character. For example, the user can be made more aware of the content of the response to the character's utterance.
[0038] (17) If the vehicle enters a moving state after the utterance but before the response is recognized, the dialogue processor may stop the dialogue processing.
[0039] In this way, even if the dialogue processing is in progress, the dialogue processing is stopped when the vehicle starts moving, so that consideration can be given to the user's safe driving.
[0040] (18) The output processing unit may perform, as the output processing, a speech output process that outputs to the user a speech having a content different from that of the dialogue processing.
[0041] In this way, the speech that changes depending on the results of the dialogue processing as well as the vehicle usage status can be output with content different from that of the dialogue processing, which prevents the user from getting bored while driving the vehicle and can attract the user's attention.
[0042] (19) The dialogue processing unit may not perform the dialogue processing when the vehicle is in a moving state, and the output processing unit may perform the speech output processing when the vehicle is in a moving state.
[0043] In this way, interactive processing that requires a user's response is not performed when the vehicle is in motion, while taking into consideration the user's safe driving, and speech output processing that outputs speech, such as a character talking to itself, is performed when the vehicle is in motion, thereby preventing the user from getting bored while driving the vehicle and attracting the user's attention.
[0044] (20) The output processing unit may be configured to increase the frequency of the speech output process when the parameter indicates a better relationship.
[0045] In this way, the better the relationship between the user and the character, the more the user will be given the impression that the character will actively talk to the user, allowing the user to intuitively understand whether the relationship with the character is good or bad and attracting the user's interest in the character's speech.
[0046] (21) The output processing unit may select one of the phrases belonging to the third group and the phrases belonging to the fourth group, perform the speech output processing based on the selected phrase, and vary the probability of selecting a phrase from the third group and the fourth group depending on the parameter.
[0047] In this way, it is possible to reduce overlapping of phrases in the characters' speech, while changing the phrases spoken to the user depending on the relationship with the character.
[0048] (22) The output processing unit may output speech related to vehicle driving in the speech output process.
[0049] In this way, the user can be made aware of vehicle driving through dialogue with the character, for example, the user can be made aware of safe driving.
[0050] (23) As the output process, the output processing unit may output information regarding a predetermined night drive function when it recognizes a predetermined voice indicating a call from the user to the character during a predetermined time period at night.
[0051] In this way, when a predetermined call is made to the character at night, it is possible to give the player the feeling of enjoying a night drive with the character.
[0052] (24) The calculation unit may calculate a first parameter based on the usage status and the dialogue processing each time the vehicle travels a predetermined distance, and may calculate a second parameter indicating the quality of the relationship between the user and the character based on the first parameter calculated up to the present time.
[0053] In this way, the state of dialogue and vehicle use for each predetermined driving period can be determined, and a parameter indicating the quality of the relationship between the user and the character can be calculated.
[0054] (25) The calculation unit may calculate the first parameter for each driving unit using a first coefficient that improves the relationship and a second coefficient that worsens the relationship.
[0055] In this way, each time the vehicle travels a predetermined distance, the factors that improve the relationship between the user and the character and the factors that improve the relationship between the user and the character can be determined, and a parameter indicating the quality of the relationship between the user and the character can be calculated.
[0056] (26) Factors that improve the relationship may include the user giving a favorable response to the utterance in the dialogue processing, and factors that worsen the relationship may include the user giving an unfavorable response to the utterance in the dialogue processing or ignoring the utterance. It would be good to do so.
[0057] In this way, the content of the user's response to the character's utterance in the dialogue processing can be made to act in a direction that improves or worsens the relationship between the user and the character.
[0058] (27) The vehicle may have a registration unit that registers location information of the user's home or destination, and the output processing unit may perform the output process by outputting a predetermined voice of the character when the vehicle's location information and the user's home or destination location information are in a predetermined positional relationship.
[0059] In this way, it is possible to output the voice of a character according to the relationship between the user's home or commute location and the user's location. For example, when the user returns home, it is possible to output the voice of a character praising the user, and when the user arrives at the workplace, it is possible to output the voice of a character encouraging the user's work.
[0060] (28) The vehicle may have a notification processing unit that notifies the user when the vehicle is in a predetermined proximity to a predetermined target.
[0061] In this way, when the vehicle is in a predetermined proximity to a predetermined target, the user can be notified of this.
[0062] (29) When a condition for acquiring a predetermined item is met, the output processing unit may perform a process for allowing the user to acquire the item.
[0063] In this way, the user can obtain items according to the interactive processing with the user and the usage status of the vehicle, and the game-like nature of the game can attract the user's interest.
[0064] (30) The dialogue processing is a process of reproducing a dialogue between the user and a specified character, and has a calculation unit that calculates a parameter indicating the quality of the relationship between the user and the character based on the usage status and the dialogue processing, the output processing unit performs a process of outputting the information based on the parameter, the item includes a first item that changes the ease of change of the parameter indicating the quality of the relationship between the user and the character, and the calculation unit changes the calculation method of the parameter based on whether the first item has been used.
[0065] In this way, the user can acquire a first item that changes the ease of change of a parameter indicating the quality of the relationship with the character depending on the interactive processing and the vehicle usage status, and the game-like nature of the game can attract the user's interest.
[0066] (31) In the process of speaking to the user, the dialogue processing unit selects one of a plurality of speech contents and speaks the selected speech content, and in the process of recognizing the user's response, recognizes the response by comparing the user's response content with dictionary data corresponding to the selected speech content, and individual dictionary data may be prepared for each of the plurality of speech contents.
[0067] In this way, even if the number of types of utterances that can be made by a character in dialogue processing is increased, when recognizing a user's response, the recognition is based on dictionary data corresponding to the utterance content that was actually selected, thereby shortening the processing time for recognizing the user's response and suppressing delays in subsequent processing. For example, after recognizing a user's response, when further utterances are made or information is output in response to that response, the user is less likely to get the impression that the system is responding slowly.
[0068] (32) The dictionary data includes character information specifying a combination of affirmative or negative modifiers and predicates included in the response content, and the dialogue processing unit determines whether the user's response content is affirmative or negative with respect to the selected utterance content based on the combination of affirmative or negative modifiers and predicates extracted from the user's response content and the combination of negative modifiers and predicates specified by the character information included in the dictionary data corresponding to the selected utterance content.
[0069] In this way, various responses from the user are possible in the dialogue processing, but parts of the user's response that are irrelevant to the system's judgment of whether the content of the utterance is positive or negative (for example, the subject or modifiers that are not necessary for the judgment) are not used in the judgment, and the judgment is made based on a combination of affirmative or negative modifiers and predicates extracted from the content of the user's response.This shortens the processing time for recognizing the user's response, suppresses delays in subsequent processing, and improves the accuracy of the judgment.
[0070] (33) The device may have a main body portion and a fixing portion for fixing the main body portion to a predetermined position on the vehicle, and the main body portion may have a recess formed on its outer surface and an attachment portion formed inside the recess to which the fixing portion is attached.
[0071] This allows the range over which the attitude of the main body part fixed to the fixing part can be changed to be wider, making it easier to fix the main body part in a predetermined position on the vehicle in the attitude desired by the user.
[0072] (34) The main body may have a light receiving unit that receives laser light from the speed measuring device and a power storage unit that is located below the light receiving unit, and the main body may have a back surface that is inclined so that the thickness in the front-to-back direction gradually increases from top to bottom.
[0073] In this way, the configuration of the light receiving unit that receives laser light from the vehicle measuring device can be appropriately set, while the relatively large storage unit can be stored in a position below the light receiving unit, thereby ensuring the aesthetic appearance of the main body.
[0074] (35) It is preferable that the device has a microphone into which the user's voice is input, a microphone hole leading to the microphone, and a dummy microphone hole different from the microphone hole.
[0075] This prevents a foreign object from being inserted into the microphone hole for detecting the user's voice, which can cause the foreign object to become stuck in the microphone hole or damage the microphone.
[0076] (36) It is preferable to provide a program for causing a computer to function as any of the above systems.
[0077] In this way, the user can be entertained by the dialogue while using the vehicle, and a variety of information that changes depending on the results of the dialogue processing in addition to the vehicle usage status can be provided to the user. For example, information that attracts the user's attention and raises the user's awareness regarding vehicle usage can be output.
[0078] The inventions described in (1) to (36) above can be arbitrarily combined. For example, it is desirable to combine all or part of the invention described in (1) with at least part of the structure of at least one of the inventions described in (2) and subsequent paragraphs. In particular, it is desirable to combine the invention described in (1) with at least part of the structure of at least one of the inventions described in (2) and subsequent paragraphs. Furthermore, it is also possible to extract any structure from the inventions described in (1) to (36) and combine the extracted structures. The applicant of this application intends to obtain rights to inventions including these structures. Furthermore, even if a description is made of "in the case of..." or "when...," it is not intended to describe a structure limited to that case or time. These are merely examples of better structures, and the applicant intends to obtain rights to structures other than these cases or times. Furthermore, any descriptions that specify an order are not limited to this order. The applicant also discloses structures in which some parts are deleted or the order is changed, and the applicant intends to obtain rights to such structures. [Effects of the Invention]
[0079] According to the present invention, it is possible to provide a technology with improved functionality compared to the prior art, for example, a technology for outputting information that will attract the user's attention more.
[0080] The effects of the present invention are not limited to these, and effects achieved by the components disclosed in the specification and drawings, etc. are also disclosed, and the applicant intends to obtain rights to the components that achieve these effects through divisional applications, amendments, etc. For example, in this specification, the phrase "can..." clearly states the effect achieved, and there are parts that demonstrate the effect even without the phrase "can...". Furthermore, there are effects that can be understood from the configuration even without such a description. [Brief explanation of the drawings]
[0081] [Figure 1] 1 is a diagram illustrating an overview of an electronic device according to an embodiment of the present invention. [Figure 2] FIG. 2 is a diagram illustrating a configuration of an electronic device according to the embodiment. [Figure 3] FIG. 2 is a block diagram showing the electrical configuration of the electronic device according to the embodiment. [Figure 4] 10 is a flowchart showing a process related to a warning function according to the embodiment; [Figure 5] 10 is an example of a warning screen according to the embodiment. [Figure 6A] 10A and 10B are diagrams illustrating character effects relating to the alarm function according to the embodiment. [Figure 6B] 10A and 10B are diagrams illustrating character effects relating to the alarm function according to the embodiment. [Figure 6C] 10A and 10B are diagrams illustrating character effects relating to the alarm function according to the embodiment. [Figure 7] 10 is a flowchart showing the flow of processing related to an indicator value / intimacy calculation function according to the embodiment. [Figure 8] 10 is a diagram illustrating the relationship between an excess speed, a safe driving coefficient, and a attenuation amount of the safe driving coefficient according to the embodiment. FIG. [Figure 9] 10 is a diagram illustrating the relationship between the number of falls of Ray, the safe driving coefficient, and the attenuation amount of the safe driving coefficient according to the embodiment. FIG. [Figure 10]10 is a graph showing the results of a simulation of the relationship between the indicator value, the degree of intimacy, and a traffic violation according to the embodiment. [Figure 11] 10 is a flowchart showing a process related to a G sensor processing function according to the embodiment. [Figure 12] 10 is an example of an image displaying Ray's room according to the embodiment. [Figure 13] 5 is an explanatory diagram of G sensor sensitivity according to the embodiment. FIG. [Figure 14] 10A and 10B are diagrams illustrating conditions for generating a G-sensor event according to the embodiment. [Figure 15] 10A to 10C are diagrams illustrating character effects relating to a G sensor event according to the embodiment. [Figure 16] 10 is a flowchart showing a process related to a dialogue processing function according to the embodiment; [Figure 17] 10 is a flowchart showing a process related to a dialogue processing function according to the embodiment; [Figure 18] 10 is a flowchart showing a process related to a dialogue processing function according to the embodiment; [Figure 19] 10A and 10B are diagrams illustrating a method for determining an utterance interval according to the embodiment. [Figure 20] 10A and 10B are diagrams illustrating a phrase selection method according to the embodiment. [Figure 21A] FIG. 2 is a diagram illustrating the contents of a dialogue processing function according to the embodiment. [Figure 21B] FIG. 2 is a diagram illustrating the contents of a dialogue processing function according to the embodiment. [Figure 21C] FIG. 2 is a diagram illustrating the contents of a dialogue processing function according to the embodiment. [Figure 21D] FIG. 2 is a diagram illustrating the contents of a dialogue processing function according to the embodiment. [Figure 22A] 10A and 10B are diagrams illustrating character presentations related to the dialogue processing function according to the embodiment. [Figure 22B] 10A and 10B are diagrams illustrating character presentations related to the dialogue processing function according to the embodiment. [Figure 22C]10A and 10B are diagrams illustrating character presentations related to the dialogue processing function according to the embodiment. [Figure 22D] 10A and 10B are diagrams illustrating character presentations related to the dialogue processing function according to the embodiment. [Figure 22E] 10A and 10B are diagrams illustrating character presentations related to the dialogue processing function according to the embodiment. [Figure 22F] 10A and 10B are diagrams illustrating character presentations related to the dialogue processing function according to the embodiment. [Figure 22G] 10A and 10B are diagrams illustrating character presentations related to the dialogue processing function according to the embodiment. [Figure 22H] 10A and 10B are diagrams illustrating character presentations related to the dialogue processing function according to the embodiment. [Figure 22I] 10A and 10B are diagrams illustrating character presentations related to the dialogue processing function according to the embodiment. [Figure 22J] 10A and 10B are diagrams illustrating character presentations related to the dialogue processing function according to the embodiment. [Figure 22K] 10A and 10B are diagrams illustrating character presentations related to the dialogue processing function according to the embodiment. [Figure 23] 10 is an example of an image displaying Ray's room according to the embodiment. [Figure 24] 10 is a diagram illustrating the probability of activating the night drive function according to the embodiment. FIG. [Figure 25] FIG. 10 is a diagram illustrating a night drive function according to the embodiment. [Figure 26] 10A and 10B are diagrams illustrating character effects related to the night drive function according to the embodiment. [Figure 27] 10A and 10B are diagrams illustrating an item function according to the embodiment. [Figure 28] 10 is a diagram illustrating the procedure for acquiring items at SAs, PAs, HOs, and roadside stations according to the embodiment. FIG. [Figure 29] 10A and 10B are diagrams illustrating character effects related to an item function according to the embodiment. [Figure 30] FIG. 10 is a diagram showing an example of a normal screen when Chibi Rei is displayed according to the embodiment. [Figure 31A] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 31B] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 31C] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 31D] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 31E] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 31F] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 31G] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 31H] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 31I] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 31J] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 31K] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 31L] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 31M] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 31N] 10A and 10B are diagrams illustrating character effects related to the Chibi Ray display function according to the embodiment. [Figure 32] 10A and 10B are diagrams illustrating character effects related to the job support function according to the embodiment. [Figure 33]10A and 10B are diagrams illustrating character effects related to the temperature phrase function according to the embodiment. [Figure 34A] 10A and 10B are diagrams illustrating character effects relating to the monologue phrase utterance function according to the embodiment. [Figure 34B] 10A and 10B are diagrams illustrating character effects relating to the monologue phrase utterance function according to the embodiment. [Figure 34C] 10A and 10B are diagrams illustrating character effects relating to the monologue phrase utterance function according to the embodiment. [Figure 34D] 10A and 10B are diagrams illustrating character effects relating to the monologue phrase utterance function according to the embodiment. [Figure 34E] 10A and 10B are diagrams illustrating character effects relating to the monologue phrase utterance function according to the embodiment. [Figure 34F] 10A and 10B are diagrams illustrating character effects relating to the monologue phrase utterance function according to the embodiment. [Figure 34G] 10A and 10B are diagrams illustrating character effects relating to the monologue phrase utterance function according to the embodiment. [Figure 35] 10 is a flowchart showing execution timings of a dialogue processing function and a monologue phrase utterance function according to the embodiment; [Figure 36A] 10 is an example of an image displaying Ray's room according to the embodiment. [Figure 36B] 10 is an example of an image displaying Ray's room according to the embodiment. [Figure 36C] 10 is an example of a menu screen according to the embodiment. [Figure 37A] 10A and 10B are diagrams illustrating character effects relating to the functions of Ray's room according to the embodiment. FIG. [Figure 37B] 10A and 10B are diagrams illustrating character effects relating to the functions of Ray's room according to the embodiment. FIG. [Figure 37C] 10A and 10B are diagrams illustrating character effects relating to the functions of Ray's room according to the embodiment. FIG. [Figure 38A]10A to 10C are diagrams illustrating the content (motion) of animation related to a ray according to the embodiment. [Figure 38B] 10A to 10C are diagrams illustrating the content (motion) of animation related to a ray according to the embodiment. [Figure 38C] 10A to 10C are diagrams illustrating the content (motion) of animation related to a ray according to the embodiment. [Figure 38D] 10A to 10C are diagrams illustrating the content (motion) of animation related to a ray according to the embodiment. [Figure 38E] 10A to 10C are diagrams illustrating the content (motion) of animation related to a ray according to the embodiment. [Figure 38F] 10A and 10B are diagrams illustrating the content (motion) of an animation related to Chibi Rei according to the embodiment. [Figure 38G] 10A and 10B are diagrams illustrating the content (motion) of an animation related to Chibi Rei according to the embodiment. [Figure 38H] 10A and 10B are diagrams illustrating the content (motion) of an animation related to Chibi Rei according to the embodiment. [Figure 38I] 10A and 10B are diagrams illustrating the content (motion) of an animation related to Chibi Rei according to the embodiment. [Figure 38J] 10A and 10B are diagrams illustrating the content (motion) of an animation related to Chibi Rei according to the embodiment. [Figure 39] FIG. 2 is a diagram showing an external configuration of the electronic device according to the embodiment. [Figure 40] FIG. 2 is a diagram showing an external configuration of the electronic device according to the embodiment. [Figure 41] 6A and 6B are views of the electronic device according to the embodiment; [Figure 42] 3A and 3B are diagrams illustrating an external configuration of a fixing part according to the embodiment. [Figure 43] FIG. 2 is a diagram showing the internal configuration of the electronic device according to the embodiment as viewed from the front side. [Figure 44] FIG. 2 is a diagram showing the internal configuration of the electronic device according to the embodiment as viewed from the front side. [Figure 45]FIG. 2 is a diagram showing the internal configuration of the electronic device according to the embodiment as viewed from the rear side. [Figure 46] FIG. 10 is a diagram showing a display form of an indicator value according to a modified example of the present invention. [Figure 47] FIG. 10 is a diagram showing a screen display according to a modified example of the present invention. [Figure 48] 10A and 10B are diagrams illustrating an example of dictionary data used in a process for recognizing a user's response in a dialogue process according to a modified example of the present invention. [Figure 49] 10A and 10B are diagrams illustrating an example of dictionary data used in the process of recognizing a user's response in the dialogue process according to a modified example of the present invention. [Figure 50] 10A and 10B are diagrams illustrating an example of dictionary data used in a process for recognizing a user's response in a dialogue process according to a modified example of the present invention. [Figure 51] FIG. 10 is a diagram illustrating an example of an OBD screen according to a modified example of the present invention. [Figure 52] 10A and 10B are diagrams illustrating information displayed on an OBD screen according to a modified example of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0082] The following embodiments will be described in detail with reference to the drawings. The embodiments described below are examples of embodiments of the present disclosure, and the present disclosure is not limited to these embodiments. In the following description, labeling using numbers such as "1," "2," etc., is intended to identify each element and does not define the number of elements. In the drawings referred to in the present embodiment, identical parts or parts having similar functions are designated by the same or similar symbols (symbols consisting of a number followed by A, B, etc.), and repeated description of such parts may be omitted. In addition, in the drawings referred to in the following description, the scale may be different from the actual scale to ensure that each component, area, etc. is recognizable. The following describes a case in which the system of the present invention is applied to a system mounted on a vehicle and detects speed enforcement devices. The vehicle is preferably a four-wheeled automobile, but may also be, for example, a two-wheeled vehicle such as a motorcycle or a large transport vehicle with four or more wheels. The vehicle 40 is, for example, an internal combustion engine vehicle having an engine as a drive source, a hybrid vehicle having an engine and a traction motor as drive sources, or an electric vehicle having a traction motor as a drive source.
[0083] [1. Overview of Electronic Device 10] FIG. 1 is a diagram illustrating an overview of an electronic device 10 according to an embodiment of the present invention. The electronic device 10 is installed in a vehicle and provides various types of information to a driver or other users. The electronic device 10 has a function as a so-called radar / laser detector and provides information that contributes to safe driving by the driver. The electronic device 10 also has a function that allows a user to engage in pseudo-communication through dialogue with a character. Furthermore, the electronic device 10 has a function that allows the user to increase the intimacy between the user and the character and develop a more intimate relationship by driving safely. The electronic device 10 has a function that outputs various information to the user depending on the relationship between the user and the character. It is preferable that the electronic device 10 be configured so that the user can select (switch) between a mode in which a character is displayed (e.g., ray mode) and a mode in which a character is not displayed (e.g., normal mode). In this case, the character-related configuration described below is a configuration related to the former mode.
[0084] A normal screen IMG1 shown in FIG. 1(A) is an example of an image displayed on the electronic device 10 under normal circumstances. The normal screen IMG1 includes, as display elements, a map 300, a host vehicle icon I, a character 200, an indicator image 210, and an intimacy image 220. The map 300 is a map of the area surrounding the current location of the vehicle. Under normal circumstances, the map 300 is displayed as a map 300A, which is a multicolor image. The host vehicle icon I is an icon placed at the current location of the vehicle, overlaid on the map 300. The character 200 is a female character named Kirishima Rei (hereinafter referred to as "Rei"), and is displayed overlaid on the map 300. The character 200 is displayed in 3D animation, giving the user a sense of depth. Here, the character 200 is displayed with the appearance of the character 200A. The user can acquire the costumes and accessories of the character 200 as items and display the character 200 wearing those designs and accessories. Note that the items displayed in the 3D animation are not limited to characters, and may be display elements such as object images exemplified by icons or maps.
[0085] The indicator image 210 is an image that shows a value indicating Ray's mood (hereinafter referred to as the "indicator value"). Here, the indicator image 210 is displayed in the form of a bar graph, but it may be displayed in other forms. The indicator value is a value that indicates how Ray is currently feeling depending on the user's driving. The indicator value also serves as an indicator of the user's safe driving. The indicator image 210 is normally displayed at all times to encourage the user to be conscious of safe driving.
[0086] The intimacy image 220 is an image that indicates the intimacy between the user and Ray. Here, the intimacy image 220 displays the intimacy using a circular meter and a number indicating the user's level placed inside the meter. The intimacy may be displayed in other forms. The intimacy is an example of a parameter that indicates the quality of the relationship between the user and the character. A higher intimacy indicates a better relationship between the user and the character, and a lower intimacy indicates a worse relationship (i.e., a worsening relationship) between the user and the character. In addition to this, the normal screen IMG1 also includes information such as an icon indicating the presence of a target placed on the map 300 (for example, an icon with the letter "H" in a circle indicating an H-system speed camera) and the current vehicle speed (here, 60 km / h).
[0087] The normal screen described above is a screen different from the alarm screen described later, and can be considered an example of a standby screen or home screen displayed in the standby state of the electronic device 10. The normal screen may be configured so that the user can set it to any screen (for example, a screen that displays a background image).
[0088] 1B is an example of an image displayed on the electronic device 10 when the vehicle is in a predetermined proximity relationship with a predetermined target (i.e., when an alert is issued). The target is a so-called POI (Point of Interest), and is typically a target that a user on a road should pay attention to.
[0089] The warning screen IMG2 includes, as display elements, a map 300, a vehicle icon I, a character 200, an indicator image 210, an intimacy image 220, and notification information 230. The map 300 is a map of the area around the vehicle's current location, and is displayed as map 300B here. The map 300B is displayed using a color different from that of the map 300A. The map 300B is displayed using two colors, for example, with roads in green and other areas in black. The vehicle icon I overlaps with the notification information 230 in FIG. 1(B), but is an icon placed at the vehicle's current location on the map 300B. The character 200 is displayed in the appearance of the character 200B. The character 200B represents the transformed appearance of the character 200A, and has a different hairstyle, decoration (for example, cat-like ears), and costume from the character 200A. The indicator image 210 and the intimacy image 220 are as already described.
[0090] The notification information 230 is information indicating a notification (more specifically, an alarm) that the vehicle is in a predetermined proximity relationship with a target. The notification information 230 is displayed in a window overlaid on the map 300B. In the example of FIG. 1(B), the notification information 230 shows a display when the vehicle is in a predetermined proximity relationship with an H-system speed camera (an example of a speed measurement device). Here, the notification information 230 includes information on the type of speed measurement device the vehicle is approaching and the distance to that speed measurement device. The content of the notification information 230 changes depending on the type of speed measurement device, the distance to that speed measurement device, and other factors. Next, the electronic device 10 will be described in detail.
[0091] FIG. 2 is a diagram showing the external configuration of the electronic device 10. The electronic device 10 has an alarm function that outputs information to notify a user that the electronic device 10 is in a predetermined proximity to a speed measurement device as a target. A speed measurement device is used to measure the speed of a vehicle 40 and enforce the speed of the vehicle 40. The speed measurement device 30 shown in FIG. 2(A) is a laser-type speed measurement device. The electronic device 10 receives laser light as a speed measurement signal emitted by the speed measurement device 30 and notifies the presence of the speed measurement device 30. The speed measurement device 30 is installed at a speed enforcement point where vehicle speed is enforced. Speed enforcement points are determined taking into consideration the vehicle's driving conditions (e.g., whether vehicles are likely to speed) and the occurrence of traffic accidents (e.g., points with a high number of accidents). Examples of speed enforcement points include expressways, straight roads, curves, and points beyond curves on routes (roads) on which vehicles travel. The speed measurement signal is a signal for measuring speed emitted by a speed enforcement device, and may also be called a speed enforcement measurement wave. The appearance of the speed measurement device 30 shown in FIG. 2(A) is one example, and a different appearance may also be used. The laser light is a pulse laser with a specific wavelength and a predetermined pulse width. The specific wavelength belongs to the infrared light region, for example, and is any of 850 nm, 905 nm, 950 nm, and 1900 nm. The pulse width is, for example, approximately 20 ns or approximately 15 ns. The pulse interval is, for example, approximately 80 ms. The term "approximately" may be used to mean a value that is the same as a reference value or within a predetermined range that can be considered to be substantially the same as that value.
[0092] As shown in FIGS. 2A and 2B, the electronic device 10 is, for example, a monitor-type device having a substantially rectangular parallelepiped shape. The electronic device 10 is installed in the passenger compartment of a vehicle 40. The electronic device 10 is attached to a dashboard 41 using, for example, double-sided tape. The housing of the electronic device 10 is made of resin or other materials. The electronic device 10 is broadly divided into a main body 101 and a fixed part 102. The main body 101 has an opening on its front side. The electronic device 10 has a display 13 for displaying an image at the opening and a touch sensor 191 superimposed on the display area of the display 13. The light receiving part 12 for receiving laser light from the speed measurement device 30 is provided on the back side of the main body 101. The fixed part 102 is provided below the main body 101 and is a fixing member for fixing the main body 101 in a predetermined location. The fixed part 102 is also called a bracket and functions as a base for the electronic device 10.
[0093] As shown in FIG. 2A, the speed measurement device 30 includes a speed measurement unit 31, an imaging unit 32, and a strobe 33. The speed measurement unit 31 measures the speed of the vehicle, for example, by a laser scanning method. Specifically, the speed measurement unit 31 emits a laser beam Lout, and when the laser beam Lout reaches the vehicle 40 and is reflected, receives the reflected light Lref. The speed measurement unit 31 measures the distance to the vehicle 40 based on the time required from emitting the laser beam Lout to receiving the reflected light Lref. The speed measurement unit 31 repeatedly measures the distance to the vehicle 40 and measures the speed of the vehicle 40 based on the distance traveled by the vehicle 40 per unit time. The speed measurement unit 31 emits the laser beam Lout within a sector-shaped range T with a central angle θ, changing its direction, for example, counterclockwise. The emission direction of the laser beam Lout is, for example, approximately horizontal. The speed measurement unit 31 emits the laser beam, for example, toward a mirror rotating at a constant speed. The laser light reflected by the mirror and emitted from the light emitting window is the laser light Lout.
[0094] The imaging unit 32 captures an image of the target vehicle when the speed measured by the speed measurement unit 31 is equal to or greater than a threshold. The imaging unit 32 is used to capture an image of a vehicle that has violated the speeding rule. The strobe 33 emits light when an image is captured by the imaging unit 32. The imaging unit 32 may capture images based on light in the infrared region so that images can be captured even at night. In this case, the strobe 33 may emit light having energy in the infrared region. The speed measurement device 30 may have a function to transmit data related to speed enforcement, such as the measured speed and captured images, to an external computer via a communication unit (not shown).
[0095] FIG. 3 is a block diagram showing the electrical configuration of the electronic device 10. The control unit 11 controls each unit of the electronic device 10. The control unit 11 is, for example, a computer including an arithmetic processing circuit and a memory. The arithmetic processing circuit includes, for example, a central processing unit (CPU), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other arithmetic processing circuits. The memory includes, for example, a random access memory (RAM) or other volatile memory. The arithmetic processing circuit performs various controls by temporarily reading data into the memory and performing arithmetic processing. The data includes programs for the control unit 11 to execute each function and working data. The control unit 11 also includes a clock unit that measures time. The clock unit is, for example, a real-time clock. Each function of the control unit 11, which will be described later, may be realized by one or more hardware elements, one or more software elements, or a combination thereof.
[0096] The light receiving unit 12 is an example of a receiving unit that receives (receives) laser light. The light receiving unit 12 receives light incident through a window provided on the back side of the electronic device 10 and outputs a signal corresponding to the received light to the control unit 11. The window may be provided with an optical member such as a visible light cut filter or a lens. The signal output by the light receiving unit 12 changes, for example, depending on the amount of light received by the light receiving unit 12. The light receiving unit 12 includes, for example, a photodiode as a light receiving element, but may also be a phototransistor or other light receiving element. The light receiving unit 12 is sensitive at least in the infrared light region. The light receiving unit 12 may also include an A / D conversion circuit or the like that converts an analog signal from the light receiving element into a digital signal.
[0097] The display unit 13 displays an image. The display unit 13 is, for example, a 3.2-inch color TFT liquid crystal display. The liquid crystal display is, for example, an IPS (In Plane Switching) type. The display unit 13 may also be an organic EL (Electro Luminescence) display or a display device of another type.
[0098] The audio output unit 14 outputs audio and includes, for example, an audio processing circuit and a speaker.
[0099] The radar receiver 15 is an example of a receiver that receives radar waves as speed measurement signals from a radar-compatible speed enforcement device. Radar waves include certain microwaves, stealth waves that are emitted only at the moment a certain stealth enforcement device measures, normal radar waves, new radar waves compatible with K-band and X-band, and cancellation notifications. The radar receiver 15 includes, for example, an antenna and a receiving circuit.
[0100] The radio receiver 16 receives radio signals of a predetermined frequency. Examples of radio signals include those belonging to frequencies for traffic enforcement radio, car location radio, digital radio, special low-power radio, local authority radio, police telephone, police activity radio, tow truck radio, helicopter radio, firefighting helicopter radio, firefighting radio, emergency radio, highway radio, and police radio. Receipt of a radio signal by the radio receiver 16 also serves as an indicator that the vehicle 40 is in a predetermined proximity to a speed enforcement point. The radio receiver 16 includes, for example, an antenna and a receiving circuit.
[0101] The location information acquisition unit 17 acquires location information indicating the location of the electronic device 10 (more specifically, the current location). The location of the electronic device 10 can be considered to be the same as the location of the vehicle 40 in which the electronic device 10 is installed and the location of the driver and other people (occupants) riding in the vehicle 40. The location information acquisition unit 17 may acquire location information (latitude information and longitude information) of the electronic device 10 based on, for example, a signal from a Global Positioning System (GPS), which is one of the Global Navigation Satellite Systems (GNSS). The location information acquisition unit 17 may also use Michibiki as a Quasi-Zenith Satellite System (QZSS). The location information acquisition unit 17 may acquire location information based on signals from base station devices for 4G, 5G communication, or other purposes.
[0102] The communication unit 18 communicates with an external device. The communication unit 18 communicates wirelessly with the external device, for example, by Wi-Fi (registered trademark), Bluetooth (registered trademark), or other wireless LAN (Local Area Network) communication or short-range wireless communication. The external device is, for example, a smartphone, a tablet computer, or other communication terminal within the vehicle 40. The communication unit 18 may also communicate via a public communication line such as the Internet.
[0103] The input unit 19 accepts information input from the user. The input unit 19 has a touch sensor 191 and a microphone 192. The touch sensor 191 accepts input of user operations. The touch sensor 191 detects the position touched by the user. The touch sensor 191 is, for example, a capacitive type or other type. The microphone 192 picks up sound and generates a sound signal indicating the picked up sound. The microphone 192 is, for example, a condenser microphone or other microphone. The input unit 19 may also be provided with physical buttons such as a volume adjustment button and an operation button.
[0104] The sensor unit 20 includes various sensors. The sensor unit 20 includes, for example, an acceleration sensor, a gyro sensor, a barometric pressure sensor, a temperature sensor, a humidity sensor, and an illuminance sensor. The acceleration sensor is, for example, a three-axis acceleration sensor that detects the vehicle's acceleration in the front-to-back, left-to-right, and up-to-down directions. The gyro sensor is a sensor that detects the tilt of the electronic device 10. The acceleration sensor and gyro sensor may be used to estimate the position of the vehicle 40 using autonomous navigation when signals from GNSS satellites cannot be received. The acceleration sensor and gyro sensor are also used for processing predetermined events such as a rollover event, which will be described later. The barometric pressure sensor measures barometric pressure. The barometric pressure sensor is used, for example, to detect elevation differences and determine whether the vehicle is on a highway or an ordinary road. The temperature sensor detects temperature. The humidity sensor detects humidity. The illuminance sensor is a sensor that detects illuminance, which indicates the brightness inside the vehicle cabin, which is the area around the electronic device 10. The illuminance sensor is used to adjust the display brightness of the display unit 13.
[0105] The mounting unit 21 is a mounting unit into which an external storage medium is mounted. The external storage medium is, for example, a memory card (for example, a microSD card). In this case, the mounting unit 21 is a memory card slot.
[0106] The power supply unit 22 supplies power received from a power source to each unit within the electronic device 10. The power supply unit 22 includes, for example, a power switch and a power supply control circuit. The power supply unit 22 may further include a battery (for example, a secondary battery or a button battery) or an electric double layer capacitor as a power storage means.
[0107] The light emitting unit 23 emits light in various colors and includes, for example, a light emitting diode.
[0108] The terminal unit 24 is a terminal for connecting an external device (e.g., an optional device). The terminal unit 24 is connected to a cigarette lighter socket of the vehicle 40 via a cigarette lighter plug cord, for example, to receive power. A cable that connects to an OBD-II connector mounted on the vehicle 40 is also connected to the terminal unit 24. The OBD-II connector is also called a fault diagnosis connector, and is connected to the vehicle's ECU to output various vehicle information. The vehicle information includes information related to the usage status of the vehicle 40. The usage status of the vehicle 40 includes the driving status of the vehicle 40. The driving status of the vehicle 40 is information related to the driving status of the vehicle 40, and may include, for example, information about the driving speed of the vehicle 40. However, the driving status of the vehicle 40 may also include information related to the vehicle status, such as injection time, intake air amount, and remaining fuel.
[0109] An external device connected to the terminal unit 24 is a detection device 50 that detects the state of the user. The detection device 50 captures an image of the driver of the vehicle 40, and when it detects a predetermined state of the user, such as looking away or falling asleep at the wheel, it outputs information indicating the detection result to the electronic device 10. For example, the detection device 50 detects the direction of the user's face and line of sight based on the captured image of the driver, and when it detects that the user is looking away or falling asleep at the wheel, it issues an alarm.
[0110] An external device connected to the terminal unit 24 is a detection device 60 that detects obstacles around the vehicle 40. Such a detection device 60 is used, for example, for vehicle detection for a forward vehicle collision warning system (FCWS). When there is a possibility of a rear-end collision with a vehicle ahead, the detection device 60 outputs information regarding the possibility to the electronic device 10. The warning may be issued by a display, sound, light, or other means that can be perceived by the driver. The warning may be issued by the electronic device 10, or the detection device 50 or 60 may issue the warning. When multiple external devices are connected to the terminal unit 24, a predetermined optional device (adapter) may be used. The external device is not limited to the detection devices 50 and 60, but may be an external device such as a rear-end vehicle collision warning system or a drive recorder. It is more preferable that the external device exhibits a function that contributes to safe driving by the user.
[0111] The storage unit 25 stores data. The control unit 11 reads programs from the storage unit 25 into memory and executes them. The storage unit 25 stores programs for the control unit 11 to perform various controls. The programs include an OS (Operating System) 251 and an application program (hereinafter referred to as an "application") 252 that runs on the OS 251. The OS 251 is, for example, Android (registered trademark), but may be another OS. The application 252 is an application program for implementing various functions of the control unit 11, which will be described later. The application 252 also functions as, for example, Unity (Unity3D), a game engine with a built-in IDE (Integrated Development Environment). The control unit 11 can display 3D animation by executing the application 252. The storage unit 25 may also store a program for performing voice recognition (a voice recognition engine), other necessary programs, dictionary data for voice recognition, and other data. In this embodiment, the voice recognition function is implemented by the control unit 11, but it may also be implemented by an external device, such as a server device, connected via a communication line.
[0112] The display data 253 includes data representing an image to be displayed on the display unit 13. The display data 253 includes animation data for displaying 3D animation using a game engine. The image data to be displayed on the display unit 13 may also include various other data for display, such as schematic diagrams or photographs. The data stored in the storage unit 25 may include data stored before the electronic device 10 is shipped, as well as data imported after the product is shipped via an external storage medium, the communication unit 18, or the like. The data imported after the product is shipped includes updated information on new alarm targets (location information such as longitude and latitude, type information, etc.).
[0113] The storage unit 25 also stores intimacy data 254, setting data 255, phrase data 256, and item data 257. The intimacy data 254 is data specifying an indicator value and intimacy. The setting data 255 stores data of operation settings set by a user for the electronic device 10. The phrase data 256 is data (here, text data) specifying a phrase to be uttered by the electronic device 10 in dialogue processing between the electronic device 10 and the user. The voice uttered based on the phrase data is an example of the voice of a character displayed by the electronic device 10. The item data 257 includes data such as items to be acquired by the user of the electronic device 10 and conditions for acquiring the items. Details of each of these data will be described later.
[0114] The memory unit 25 also stores map data. The map data is information for displaying a map on the display unit 13, and includes not only normal map data such as road networks, but also information on objects to be warned about and other landmarks, traffic rule information, etc. The traffic rule information also includes information on speed limits set for roads (routes) included in the map. Objects to be warned about include traffic landmarks that require caution. The objects of the alarm include, for example, locations of drowsy driving accidents, speed enforcement devices (laser type, radar type, loop coil type, H system, LH system, photocell type, mobile type, etc.), speed limit switching points, enforcement areas, checkpoints, parking ban monitoring areas, N system, traffic monitoring systems, intersection monitoring points, red light ignorance prevention systems, police stations, expressway traffic police, accident-prone areas, areas with high rates of vehicle theft, sharp / continuous curves (expressways), branching / merging points (expressways), ETC lane advance guidance (expressways), service areas (expressways), parking areas (expressways), highway oases (expressways), smart interchanges (expressways), long / continuous tunnels on expressways, highway radio reception areas (expressways), roadside stations, view point parking, parking lots, public toilets in PAs / SAs, gas stations (expressways), tunnels (expressways), prefectural border announcements, roadside stations, etc. The memory unit 25 stores information on the type of object to be warned about, location information indicating the location of the object to be warned about, and information to be output regarding the warning about the object to be warned about (for example, image data to be displayed on the display unit 13 and audio data) in association with each other.
[0115] The storage unit 25 includes a non-volatile memory. The storage unit 25 includes, for example, a flash memory, an EEPROM (Electrically Erasable Programmable Read-Only Memory), or other storage devices. The storage unit 25 may include, for example, an optical recording medium, a magnetic recording medium, a semiconductor recording medium, or other recording media. The data stored in the storage unit 25 may be stored in cloud computing or other external storage means as appropriate.
[0116] Under the above configuration, when the accessory power supply of the vehicle 40 is turned on, the control unit 11 performs the processes related to each function described below. When the accessory power supply is turned on, the control unit 11 performs the startup process of the electronic device 10. In the startup process, the control unit 11 reads out and executes various programs including the OS 251 and the application 252 from the storage unit 25. Then, by executing the application 252, the control unit 11 mainly realizes the "alarm function", the "indicator value / intimacy calculation function", the "G-sensor processing function", the "dialog processing function", the "night drive function", the "item function", the "mini Ray display function", the "work support function", the "temperature phrase function", the "drowsiness / napping function", the "special effect function of alarm (at transformation)", the "status display function", the "muttering phrase voice function", and the "Ray's room display function".
[0117] The "alarm function" is an example of a function related to the notification processing unit. The "indicator value / intimacy calculation function" is an example of a function related to the calculation unit. The "dialog processing function" is an example of a function related to the dialog processing unit. The "G-sensor processing function", the "night drive function", the "item function", the "mini Ray display function", the "work support function", the "temperature phrase function", the "drowsiness / napping function", the "special effect function of alarm (at transformation)", the "status display function", the "muttering phrase voice function", and the "Ray's room display function" are examples of functions related to the output processing unit. The functions related to the output processing unit output information that can be recognized by the user based on the dialog processing and the usage status of the vehicle 40. Such information includes, for example, character information related to the character. The character information includes attributes related to the character such as indicators and intimacy in addition to the appearance (appearance and clothing) of the character. The character information output includes the image of the character and the voice of the character.
[0118] <A: Alarm Function> The alarm function is a function that performs an alarm process to issue an alarm (in this embodiment, an alarm) when the vehicle 40 is in a predetermined proximity to a predetermined target. The alarm function in this embodiment is a function that issues an alarm using the light receiving unit 12, the radar receiving unit 15, the wireless receiving unit 16, and the position information acquiring unit 17. The control unit 11 functions as an alarm processing unit.
[0119] 4 is a flowchart showing processing related to the alarm function. When the control unit 11 determines that the accessory power supply is turned on (i.e., when ACC is ON) (step S51; YES), it causes the display unit 13 to display a normal screen (step S52). The normal screen is the image as described with reference to FIG. 1(A). Next, the control unit 11 determines whether the vehicle 40 has a predetermined proximity relationship with a predetermined target (step S53). Here, the predetermined proximity relationship refers to a relationship in which the vehicle is close to the target within a predetermined distance, and more preferably refers to a relationship in which a target exists in the traveling direction or on the path of the vehicle, and the vehicle is close to the target within a predetermined distance.
[0120] If the determination in step S53 is "NO", the control unit 11 causes the display unit 13 to display the normal screen (step S54). If the normal screen is already being displayed, the control unit 11 causes the normal screen to continue to be displayed.
[0121] When the control unit 11 determines that there is a predetermined proximity relationship with a predetermined target (step S53; YES), it displays a warning screen (step S55). Displaying the warning screen is an example of processing to output a warning to the user. The warning screen is, for example, a screen on which information specifying the target, the distance to the target, and the character 200 are arranged.
[0122] The processing of steps S53 and S55 will be described in detail. The radar warning function is a function that issues a warning when radar waves are received using the radar receiver 15. The laser warning function is a function that issues a warning when laser light from the speed measurement device 30 is received using the light receiver 12. The wireless warning function, performed using the wireless receiver 16, is a function that issues a warning when a wireless signal of a predetermined frequency is received using the wireless receiver 16. The position warning function (generally also referred to as a GPS warning) that is performed using the position information acquisition unit 17 is a function that issues a warning based on the position information of the object to be warned stored in the memory unit 25 and the position information acquired by the position information acquisition unit 17. For example, the position warning function calculates the distance between the position information of the object to be warned and the position information of the electronic device 10, and issues a warning when the calculated distance reaches a predetermined approach distance. For example, the position warning function issues a warning when the target is within 2 km while traveling on a highway, and also issues a warning when the target is determined to be 1 km, 500 m, immediately before, or passed. The location warning function will alert you to speed enforcement points inside tunnels when you are driving on a highway and when the vehicle is within 2 km of the target, and will also sound an alert when the vehicle is determined to be 1 km or 500 m away from the target.
[0123] The alarm function at least issues an alarm by displaying the character 200, but may also be implemented using a display on the display unit 13, output of an alarm sound (e.g., sound effects, background music, character voice, or other sounds) by the audio output unit 14, predetermined light emission by the light-emitting unit 23, or other human-perceptible methods. An example of an alarm screen corresponding to an H-system type speed camera is shown in FIG. 5(A). An example of an alarm screen corresponding to the laser alarm function is shown in FIG. 5(B). An example of an alarm screen corresponding to a loop coil type speed camera is shown in FIG. 5(C). An example of an alarm screen corresponding to a policing area is shown in FIG. 5(D). The alarm may be set to a higher level the closer the vehicle 40 is to the object to be warned. In addition to the above, the alarm function may also issue an alarm related to the destination or other predetermined locations. The control unit 11 does not change the alarm (display or sound) issued in relation to the alarm function depending on the intimacy level or indicator value, but may change it depending on the intimacy level or indicator value at that time. The latter is desirable in that it attracts the user's attention and encourages use of the electronic device 10.
[0124] (Character presentation related to alarm function) Here, the character effects relating to the alarm function will be described. The character effects relating to the alarm function may be performed in the process of step S53 (for example, effects other than those relating to the alarm function) or in the process of step S55 (for example, effects relating to the alarm function). Figures 6A, 6B, and 6C are diagrams explaining the content of these effects. In Figures 6A, 6B, and 6C and other drawings described later, the character effects can be explained by "subcategory," "animation," "intimacy," and "phrase." Data (for example, data in a table format) specifying the character effects shown in Figures 6A, 6B, and 6C and other drawings described later may be stored in storage unit 25.
[0125] "Subcategory" refers to the category (classification) to which the character's performance belongs. For example, in Figures 6A, 6B, and 6C, the row corresponding to the subcategory "Accident-prone area" specifies the character's performance executed in the accident-prone area. In this way, the corresponding character's performance is executed under the circumstances indicated by the subcategory. Note that although it is called a "subcategory" here, the higher-level category indicates, for example, a function realized by the control unit 11 (here, an alarm function) or a classification of functions belonging to that function.
[0126] "Animation" specifies the character animation displayed in the character presentation. The character strings (such as "ID001", "ID002", etc.) in the animation column identify the animation, and two or more subcategories with the same character string will be presented with the same animation, while two or more subcategories with different character strings will be presented with different animations. The relationship between character strings and animations is explained in section [2. About animation]. If the animation column is blank or shows "-", no animation will be used.
[0127] "Intimacy" specifies the intimacy level that is the condition for a character's performance. If the intimacy column is blank or shows "-", no intimacy conditions are set, and the corresponding performance will be performed regardless of the current intimacy level. "Intimacy 1", "Intimacy 2", and "Intimacy 3" correspond to "Low Intimacy", "Medium Intimacy", and "High Intimacy", respectively, with the former indicating a lower intimacy level and the latter indicating a higher intimacy level.
[0128] A "phrase" is a phrase uttered during character performance. During character performance, the character's voice containing this phrase is output. A phrase is an example of a human-understandable sentence (character string), and is not particularly limited by syntax or length.
[0129] The relationship between the display timing of the animation and the output timing of the phrase may be adjusted in advance for each subcategory, each animation, or each phrase. When multiple effects are associated with the same subcategory, unless otherwise specified, any one effect randomly selected (or selected by lottery) is performed. By making a random selection, it is possible to give pleasure to the user, but the selection is not limited to random selection, and a selection according to a predetermined rule such as selecting in a predetermined order may be made.
[0130] To explain an example of the character effect related to the warning function, in the character effect for the subcategory "Accident-Prone Area", the control unit 11 causes the display unit 13 to display the animation specified by "ID001", and outputs the voice of the character of the phrase "Accident-Prone Area, Please Drive Safely" using the voice output unit 14. The effect by the character related to the warning function is performed regardless of the intimacy. This is because the warning by the warning function has a strong aspect of contributing to the safe driving of the user rather than attracting the interest and attention of the user's character. On the other hand, if the warning by the warning function is changed according to the intimacy, an effect of prompting the user to take actions in the direction of increasing the intimacy can be expected.
[0131] Returning to FIG. 4 for explanation. When the process of step S54 or S55 is performed, the control unit 11 determines whether the accessory power is turned off (step S56). If it is determined "NO" in step S56, the control unit 11 returns the process to step S53. If it is determined "YES" in step S56, the control unit 11 ends the process of FIG. 4.
[0132] <B: Indicator Value and Intimacy Calculation Function> The indicator value and intimacy calculation function is a function of calculating an indicator value and intimacy based on the usage status of the vehicle 40 and the dialogue process (in this embodiment, the result of the dialogue process). The control unit 11 functions as an acquisition unit and a calculation unit.
[0133] FIG. 7 is a flowchart showing the flow of processing related to the indicator value / intimacy calculation function. First, the control unit 11 calculates the indicator value Pd (hereinafter referred to as the "indicator initial value") when the accessory power is turned on (i.e., during ACCON) (step S1). The indicator initial value Pd is "0" when the electronic device 10 is used for the first time. On the other hand, if the electronic device 10 was used when the vehicle 40 was last driven, the indicator value may not be "0". As will be described in detail later, this is because the indicator initial value Pd when the accessory power is turned on is the value inherited from the indicator value at the end of the last drive (when the accessory power was off). Here, we will explain the case where the electronic device 10 is used for the first time and the indicator initial value Pd is "0".
[0134] Next, the control unit 11 acquires vehicle information via the terminal unit 24 (step S2). Next, the control unit 11 determines whether or not a predetermined driving unit has been traveled (step S3). In this embodiment, the predetermined driving unit is a predetermined unit of driving distance, which may be 1 km. The control unit 11 may determine whether or not the predetermined driving distance has been traveled based on the vehicle information. The driving unit may be specified by an element other than distance, and may be, for example, a predetermined unit of driving time. The control unit 11 determines "NO" in step S3 until the predetermined driving unit has been traveled. The control unit 11 may periodically acquire vehicle information and make the determination in step S3.
[0135] If it is determined in step S3 that the predetermined travel unit has been traveled (step S3; YES), the control unit 11 calculates an indicator value L for the current travel unit (step S4). The indicator value is an example of a first parameter. The indicator value has an initial value (standard value) of "0", a maximum value of "+1", and a minimum value of "-1". The indicator value is calculated in increments of "0.1", for example. The indicator value L is calculated using the following equation (1).
number
[0136] In formula (1), Pd is the indicator initial value mentioned above. x is the vehicle's travel distance for this trip. x is counted in 10-meter increments, so if the vehicle's travel distance is 1 km (1000 m), "100" is substituted for x.
[0137] In equation (1), Sv is the safe driving coefficient for speeding, which varies between "0" and "1.0." The safe driving coefficient Sv is "1.0" when there is no speeding, and approaches "0" as the degree of speeding increases. The safe driving coefficient Sv is calculated by the following equation (2). Vover is the maximum speeding limit for the current driving unit, and more specifically, is the maximum value obtained by subtracting the speed limit from the vehicle speed. The speed of the vehicle 40 is calculated from the position information acquired by the position information acquisition unit 17, but when the terminal unit 24 is connected to an OBD-II connector, it is preferable to use a speed calculated based on the vehicle information acquired from the vehicle 40.
number
[0138] FIG. 8 is a diagram illustrating the relationship between the speed limit Vover [km / h], the safe driving coefficient Sv, and the attenuation amount of the safe driving coefficient Sv. FIG. 8(A) shows a representative example of these relationships in numerical form. FIG. 8(B) shows a graph of the relationship between the speed limit Vover [km / h] and the safe driving coefficient Sv. In this embodiment, Equation (2) is set to act in a direction that significantly reduces the indicator value when the speed limit Vover exceeds 20 km / h.
[0139] In equation (1), Sd is a safe driving coefficient that depends on the number of times Ray falls, and is a coefficient that varies between "0" and "1.0." The number of times Ray falls will be explained in detail in the section [C: G-sensor processing]. Ray falls when the acceleration sensor value exceeds a predetermined G-threshold due to an impact or sudden steering of the vehicle 40. Sd is a safe driving coefficient determined by the number of times Ray falls. The safe driving coefficient Sd acts in the direction of decreasing the indicator value L as the number of times Ray falls increases, indicating that the user is driving dangerously (i.e., driving unsafely). The safe driving coefficient Sd is calculated using the following equation (3). Sd = cos(rad(number of falls of Ray × 9)) (3)
[0140] FIG. 9 is a diagram illustrating the relationship between Ray's number of falls, the safe driving coefficient Sd, and the attenuation of the safe driving coefficient Sd. FIG. 9(A) shows a representative example of these relationships in numerical form. FIG. 9(B) shows a graph of the relationship between the number of falls [times] and the safe driving coefficient Sd. Ray's number of falls is specified within the range of "0 times" to "10 times," and the display unit 13 shows how Ray became carsick after the 10th fall. Furthermore, if any of the following three conditions is met, the number of falls is cleared to "0." - When a specified time has passed without Ray falling (for example, 30 minutes). - When Ray recovers from car sickness (after a specified time has passed or when using a specific item). If the answer is correct in the dialogue process (i.e., if the favorable response is given. More details will be given later.)
[0141] The control unit 11 may determine that Ray has carsickness after the tenth fall, and when Ray has become carsick, may hide Ray from the display unit 13 (i.e., erase the display). The control unit 11 may also temporarily stop counting the mileage x until Ray returns from his carsick state to a normal state. The control unit 11 may determine the time it takes for Ray to return from his carsick state to a normal state by selecting, for example, one hour, two hours, three hours, or six hours. When Ray returns from his carsick state to a normal state, the control unit 11 may reset the number of falls to "0", but may resume counting the indicator value L (mileage x) from the value before Ray became carsick. The control unit 11 may reset the number of falls to "0" by turning off the accessory power.
[0142] Returning to equation (1), the explanation will be given. In equation (1), Sp is the safe driving coefficient for stop sign violations. The safe driving coefficient Sp is calculated by subtracting (minus) the distance traveled x according to the number of stop sign violations. When the accessory power is turned off, the safe driving coefficient Sp is cleared to "0". The safe driving coefficient Sp is calculated using the following equation (4). In this case, the value of x is reduced by 3 km for each stop sign violation. Sp = Number of stop signs × 300 (4)
[0143] In formula (1), Df is the deduction coefficient. The deduction coefficient Df is a coefficient multiplied by the deduction element that is contrary to safe driving, that is, a coefficient used in a function that determines the amount of reduction in the indicator value when the user commits an act that is contrary to safe driving. Specifically, it is a coefficient that determines the amount of reduction in the indicator value for speeding and the number of times Ray falls. The deduction coefficient D f is, for example, 1.5.
[0144] In equation (1), τs is the safe driving time constant. The safe driving time constant τs takes a smaller value as the user tries to drive safely, and acts in the direction that makes it easier for the indicator value to increase. The safe driving time constant τs is calculated using the following equation (5). τs=(Lx×Gs) / (Sd×Sf) ···(5)
[0145] In equation (5), Lx is an adjustment parameter. Although Lx=3000, when an external device is connected as an optional device to the terminal unit 24 (i.e., when the optional device is connected), the following value is subtracted from Lx as a bonus. When the optional device is connected, the safe operation time constant τs, which reduces the adjustment parameter, also decreases, making it easier for the indicator value to increase. If an OBD adapter is connected to the OBD-II connector, "100" If the detection device 50 or 60 is connected, "100"
[0146] In equation (5), Gs is a difficulty parameter determined by G-sensor sensitivity. G-sensor sensitivity will be explained in detail in section [C: G-sensor processing], but the difficulty parameter satisfies the relationship Gs = (5 / G-sensor sensitivity) x (3 / 5). For G-sensor sensitivities of "Level 1" to "Level 5," the difficulty parameter Gs varies between "3.0" and "0.6." G-sensor sensitivity determines how easily Ray falls, and can also be considered a value that indicates the difficulty of the game.
[0147] In formula (5), Sf is the likability coefficient. The likability coefficient Sf is a coefficient that indicates the likability of the character 200 to the user. The likability coefficient Sf has a larger value as the likability is higher, and a smaller value as the likability is lower. The likability coefficient Sf changes at least through dialogue processing. The likability coefficient Sf changes depending on the results of dialogue processing including a question phrase, which is a phrase that the character asks the user, and the user's response (i.e., answer) to this question phrase. The likability coefficient Sf also changes depending on the stop sign violation. The likability coefficient Sf changes within a range of "0.5" to "2.0". The standard value of the likability coefficient Sf is "1.0".
[0148] Returning to FIG. After calculating the indicator value L in step S4, the control unit 11 calculates the intimacy S based on the indicator values calculated up to that point (step S5). The intimacy S is an example of a second parameter. The intimacy S is a value that changes in increments of 1, with an initial value of "0", a minimum value of "0", and a maximum value of "999". In step S5, the control unit 11 adds up the indicator values for the driving units so far to obtain the intimacy S. The intimacy S is calculated by the following equation (6). S = S + (l + Cf) (6)
[0149] In equation (6), the intimacy level S on the left side is the intimacy level calculated in step S5. The intimacy level S on the right side is the intimacy level at the current time, that is, the intimacy level at the time before the current intimacy level is calculated. L is the indicator value calculated in step S4 immediately before. Cf is a correction coefficient. The correction coefficient Cf is a value that determines how much the current intimacy level is changed depending on the indicator value L calculated this time. The correction coefficient Cf is, for example, 0.2413, assuming that the intimacy level S is "999" after driving 30 km smoothly in one trip and one year has passed.
[0150] Next, the control unit 11 determines whether the accessory power supply has been turned off (step S6). If the user is using the vehicle 40, the control unit 11 determines "NO" in step S6 and returns the process to step S2. In this way, while the vehicle 40 is being used (traveled), the control unit 11 calculates the indicator value L and the intimacy degree S each time the vehicle 40 travels a predetermined travel unit. If the user stops using the vehicle 40 by parking the vehicle 40 or returning home and determines in step S6 that the accessory power supply has been turned off, the control unit 11 stores the time (date and time) when the accessory power supply was turned off in the storage unit 25 (step S7). Then, the control unit 11 ends the process of FIG. 7.
[0151] The next time the accessory power is turned on, the control unit 11 also performs the processing described in FIG. 7. However, in this case, the control unit 11 may calculate an indicator initial value Pd other than "0" depending on the indicator value L when the accessory power was previously turned off. As shown in equation (1), when using the accessory for the second time or later, the indicator initial value Pd is added when calculating the indicator value L. In this way, the indicator value from the previous time the accessory power was turned off can be carried over. The indicator initial value Pd is a value obtained by applying an indicator decay function to the indicator value when the accessory power was turned off after the previous driving ended. Specifically, the control unit 11 calculates the indicator initial value Pd by the calculation of the following equation (7).
[0152]
number
[0153] In equation (7), Poff is the indicator value when the accessory power was last turned off. τ is an adjustment parameter, e.g., τ=48. τ represents the time (in hours) until the indicator value decays to 37% of the value when the accessory power was last turned off. T represents the length of time during which the user has stopped using the vehicle 40, and in this embodiment, it is the time elapsed from when the accessory power was last turned off until the next time the accessory power was turned on (i.e., the ACCOFF time). The last time the accessory power was last turned off may be identified by the time stored in step S7. As shown in equation (7), as the ACCOFF time increases, the indicator initial value Pd gradually approaches the initial value 0. Therefore, the indicator initial value Pd calculated in step S1 decreases depending on the length of time the accessory power was off. Since the indicator value L can be a negative value, if the accessory power was off for a long period of time, the intimacy level S may decrease. This is done to reproduce an actual interpersonal relationship in which the time the user does not use the vehicle 40 can be considered the time Ray is left alone, and the longer this time is, the worse the relationship becomes. In this way, compared to resetting the indicator value and intimacy to zero, it is possible to create a sense that the interpersonal relationship between the user and the character continues over a long period of time. Note that if the length of the period during which the user has suspended use of the vehicle 40 is equal to or shorter than a predetermined time, the indicator initial value Pd may not decrease, and various modifications are possible regarding the relationship between the length of the period during which the user has suspended use of the vehicle 40 and the change in the indicator initial value Pd.
[0154] Figure 10 is a graph showing the results of simulating the relationship between the indicator value, intimacy, and traffic violations. The graph in Figure 10(A) has the horizontal axis corresponding to the driving distance [×10 m], and the vertical axis corresponding to the indicator value [%]. The graph in Figure 10(B) has the horizontal axis corresponding to the driving distance [×10 m], and the vertical axis corresponding to the speed exceeding [km / h], the number of falls [times], and the number of stop violations [times], respectively. As shown in Figure 10(A), overall, the intimacy tends to increase according to the driving distance x of the vehicle 40, and the state where Ray becomes happy or the relationship between Ray and the user becomes intimate is reproduced. On the other hand, as shown in Figure 10(B), for sections where the number and degree of traffic violations such as speed exceeding, number of falls, and stop violations are large, it can be seen that the indicator value L decreases and the increase in intimacy S is dulled, or the indicator value L becomes a negative value and the intimacy S decreases. Thus, when safe driving is performed, the indicator value L and intimacy S change in an upward direction, and when undesirable driving such as traffic violations or rough driving that is not a traffic violation is performed, the indicator value L and intimacy S change in a downward direction. Therefore, users who want to increase the intimacy with Ray can use the changes in such indicator values L and intimacy S as a motivation to pay attention to safe driving.
[0155] As described above, each time the vehicle 40 travels a predetermined driving unit, the control unit 11 calculates an indicator value based on the dialogue process and the usage status of the vehicle, and further calculates the intimacy based on the indicators calculated up to the current point. Also, the value of the indicator L increases according to the driving distance. It increases when safe driving is continued and decreases due to dangerous driving. Therefore, it serves as a motivation for the user to pay attention to safe driving.
[0156] <C: G-sensor processing function> The G-sensor processing function is a process that detects the G (impact) acting on the vehicle 40 and performs corresponding processing. The control unit 11 functions as an output processing unit.
[0157] 11 is a flowchart showing processing related to the G sensor processing function. The control unit 11 repeatedly executes the processing in FIG. 11 while the power supply of the electronic device 10 is on (for example, while the power supply of an accessory is on).
[0158] The control unit 11 determines whether to set the G-sensor sensitivity (step S11). If the determination in step S11 is "YES", the control unit 11 sets the G-sensor sensitivity (step S12). The control unit 11 may write the set G-sensor sensitivity to the setting data 255.
[0159] The G-sensor sensitivity can be set, for example, via a predetermined image showing Ray's room. FIG. 12 is an example of a room screen IMG3 that displays Ray's room. The user can set the G-sensor sensitivity by selecting a button B1 on the room screen that has the character string "G-sensor" shown in FIG. 12 attached thereto. The control unit 11 may set the G-sensor sensitivity based on an operation received via the touch sensor 191.
[0160] FIG. 13 is an explanatory diagram of G-sensor sensitivity. G-sensor sensitivity is divided into multiple levels, and in this embodiment, it is divided into five levels, "Lv.1" to "Lv.5." A G-threshold value is set for each of the G-sensor sensitivities "Lv.1" to "Lv.5." The G-threshold value includes a threshold value for acceleration in the forward / backward direction and a threshold value for acceleration in the left / right direction. The higher the level of G-sensor sensitivity, the lower the G-threshold value. Therefore, the higher the G-sensor sensitivity, the more likely it is that a large impact will be detected even with a smaller acceleration.
[0161] Returning to FIG. If the determination in step S11 is "NO" or if the G sensor threshold value is set in step S12, the control unit 11 starts the G detection process (step S13). The G detection process is a process for detecting a predetermined G (impact). In the G detection process, the control unit 11 acquires acceleration in each of the forward, backward, left, and right directions and compares it with whether it is equal to or greater than the G threshold value corresponding to each direction. Then, the control unit 11 determines whether to generate a G sensor event (step S14). The control unit 11 determines whether to generate a G sensor event based on the conditions shown in FIG. 14, and generates a G sensor event if the conditions are met (step S15).
[0162] The G-sensor event will be described with reference to FIG. For example, the control unit 11 generates a fall (right) event when the relationship 0.2 G≦sensor value≦G threshold is satisfied for the right direction. In this case, the control unit 11 causes the display unit 13 to display an animation showing Ray falling to the right. The control unit 11 generates a fall (left) event when the relationship 0.2 G≦sensor value≦G threshold is satisfied for the left direction. In this case, the control unit 11 causes the display unit 13 to display an animation showing Ray falling to the left. The control unit 11 generates a fall (forward) event when the relationship G threshold≦G sensor value is satisfied for the forward direction. In this case, the control unit 11 causes the display unit 13 to display an animation showing Ray falling forward. For the fall (forward) event, the control unit 11 may generate a screen cracking effect with a predetermined probability (randomly). The control unit 11 generates a fall (backward) event when the relationship G threshold≦G sensor value is satisfied for the backward direction. In this case, the control unit 11 causes the display unit 13 to display an animation showing Ray falling backward. When the relationship of G threshold value≦G sensor value is satisfied for the right direction, the control unit 11 generates a steering (right) event. In this case, the control unit 11 causes the display unit 13 to display an animation indicating that steering has been performed to the right. When the relationship of G threshold value≦G sensor value is satisfied for the left direction, the control unit 11 generates a steering (left) event. In this case, the control unit 11 causes the display unit 13 to display an animation indicating that steering has been performed to the left. The larger the G sensor sensitivity value, the more likely Ray will fall when steering / braking suddenly (i.e., the difficulty of the game increases), but the indicator value is more likely to increase when driving safely.
[0163] (Character effects related to G-sensor events) Here, the character performance related to the G-sensor event will be described. FIG. 15 is a diagram for explaining this performance content. In FIG. 15, the subcategory means the category (classification) to which the performance belongs. For example, in FIG. 15, the row corresponding to the subcategory "Exit due to car sickness" specifies the character performance to be executed when Lei is in a car-sick state. For example, an example of the character performance related to the G-sensor event will be described. In the character performance in "Exit due to car sickness", the control unit 11 causes the display unit 13 to display the animation specified by "RDLeiN013", and outputs the voice of the character of the phrase "Ugh, I can't do it anymore. I'm going to take a break." using the voice output unit 14. The character performance related to the G-sensor event is performed regardless of the intimacy. This is because the alarm by the alarm function has a strong aspect that it contributes to the safe driving of the user rather than attracting the interest and attention of the user's character. On the other hand, if the performance by the character related to the G-sensor event changes depending on the intimacy, an effect of prompting the user to take actions for safe driving can be expected.
[0164] Returning to FIG. 11 for explanation. Next, the control unit 11 increments the number of falls by "1" and stores it in the storage unit 25 (step S16). Then, the control unit 11 ends the process of FIG. 11. Even when it is determined "NO" in step S14, the control unit 11 ends the process of FIG. 11.
[0165] <D: Dialogue processing function> The dialogue processing function is a function for conducting a dialogue with the user through voice. In this embodiment, the dialogue processing function is a process for reproducing a dialogue between the user and a character displayed on the display unit 13 (i.e., realizing a pseudo-dialogue). Such a dialogue processing function is a function that allows the user to feel as if they are having an actual dialogue with the character. The dialogue includes at least an utterance from the electronic device 10 by outputting the voice of the character, and an utterance indicating a response from the user to the content of the utterance. Below, a case will be described in which the dialogue processing function realizes dialogue processing in which the character speaks to the user, but dialogue processing in which the user speaks to the character may also be realized.
[0166] Figures 16, 17, and 18 are flowcharts showing processing related to the dialogue processing function. The control unit 11 repeatedly executes the processing of Figures 16, 17, and 18 while the power of the electronic device 10 is on (for example, while the power of an accessory is on). The control unit 11 functions as a dialogue processing unit.
[0167] The control unit 11 first determines whether the intimacy level S is equal to or greater than a threshold (step S21). This threshold is the minimum intimacy level at which Ray appears and engages in a dialogue with the user. The threshold intimacy level may be a threshold value belonging to "low intimacy level," e.g., "+1." In this embodiment, intimacy levels of "0" to "333" may be classified as "low intimacy level" (i.e., intimacy level 1), "334" to "666" as "medium intimacy level" (i.e., intimacy level 2), and "667" to "999" as "high intimacy level" (i.e., intimacy level 3). If the determination in step S21 is "NO," the control unit 11 terminates the processing of FIG. 16. This is because the dialogue processing function is not activated because the intimacy level S is less than the threshold. Note that the processing in step S21 may be omitted, allowing dialogue regardless of the intimacy level.
[0168] If the determination in step S21 is "YES," the control unit 11 determines whether the vehicle 40 is in a stopped state (step S22). The stopped state refers to a state in which the vehicle 40 is currently stopped or is considered to be stopped. The stopped state may be, for example, a state in which the speed of the vehicle 40 is equal to or less than a predetermined speed. This is because, when the vehicle speed is measured using a GNSS signal (e.g., a GPS signal) from which position information is acquired, a speed greater than "0" may be indicated due to positioning errors even when the vehicle 40 is actually stopped. The predetermined speed may be, for example, 7 km / h, but may also be another speed such as 10 km / h. The control unit 11 may also refer to the position information of the vehicle 40, and may determine the stopped state of the vehicle 40 when the vehicle 40 is located at a position where it is considered to be stopped, such as a stop sign.
[0169] If the determination in step S22 is "NO," the control unit 11 ends the processing in Fig. 16. This is to prevent dialogue when the vehicle 40 is moving, that is, when the vehicle is not stopped. This is to contribute to safe driving by not performing dialogue processing when the vehicle 40 is moving (that is, when the vehicle is in a moving state) and performing dialogue processing when the vehicle 40 is in a stopped state.
[0170] If the determination in step S22 is "YES," the control unit 11 determines whether the speech interval has been determined (step S23). If no dialogue has taken place since the vehicle 40 started traveling, the speech interval has not been determined, and therefore the control unit 11 determines "NO" in step S23. If the determination in step S23 is "NO," the control unit 11 determines the speech interval based on the latest indicator value at the current time point (step S24). The control unit 11 calculates the speech interval (excluding warnings and POIs) by calculating the following equation (8). In this way, the speech interval varies depending on the indicator value. In other words, by keeping the indicator value high (continuing safe driving), the interval at which Ray speaks becomes shorter, and the frequency of speech increases. Speech interval = 5 + rand(25 - (indicator value x 10 + 100) / 10) (8)
[0171] FIG. 19 is a diagram illustrating a method for determining the speech interval. In FIG. 19, the horizontal axis corresponds to the latest indicator value at the current time, and the vertical axis corresponds to the speech interval [minutes]. As shown in FIG. 19, a lower limit and an upper limit of the speech interval are defined for each indicator value. The control unit 11 randomly determines the speech interval from the range between the lower limit and the upper limit of the speech interval corresponding to the latest indicator value at the current time. It is preferable that the probability of selecting each time between the lower limit and the upper limit of the speech interval be equal, but this is not necessary. The lower limit is 5 minutes regardless of the indicator value. The upper limit is set to decrease as the indicator value increases. For example, when the indicator value is "-1.00," the upper limit is "30 minutes," and when the indicator value is "1.00," the upper limit is "10 minutes." The lower limit linearly changes so that it decreases as the indicator value increases. Therefore, the larger the indicator value, the more likely the speech interval will be shortened. This is done so that the better Ray's mood, as determined from the indicator value, gives the user the impression that Ray is actively talking to the user. This allows the user to intuitively understand whether their relationship with the character is good or bad, and can attract interest in the character. Note that the lower limit may also be set to be smaller as the indicator value increases.
[0172] If the speech interval has been determined (step S23; YES, or after the processing of step S24), the control unit 11 determines whether it is time to speak (step S25). After determining the speech interval, the control unit 11 determines whether the speech interval has elapsed. If it is determined in step S25 that it is not time to speak, the control unit 11 returns the process to step S21.
[0173] When the control unit 11 determines in step S25 that it is time to speak (step S25; YES), it selects (by lottery) a phrase (question phrase) to be used for speaking from the phrase data 256 (step S26). When the control unit 11 determines that the vehicle 40 is stopped and that the determined speech interval has elapsed, it executes the process of step S26. In this way, the phrase to be used varies depending on the intimacy level by lottery every time the speech interval elapses. Note that the phrases used here are phrases (which are generated randomly) excluding events such as alarms and POIs, and the probability of speaking each phrase varies as follows:
[0174] FIG. 20 is a diagram illustrating a method for selecting a phrase. As shown in FIG. 20(A), phrases are registered in phrase data 256 so as to belong to one of groups G1, G2, and G3. Group G1 corresponds to "intimacy: low," group G2 corresponds to "intimacy: medium," and group G3 corresponds to "intimacy: high." Group G1 stores many phrases that give a relatively unfriendly impression, while groups G2 and G3 store many phrases that strongly express intimacy toward the user, in that order. Note that any one of groups G1, G2, and G3 is an example of a first group, and any of the others is an example of a second group.
[0175] The control unit 11 selects a phrase by selecting a group and then selecting a phrase from the selected group. The control unit 11 selects a group by calculating the following basic formula (8). The control unit 11 selects a phrase by randomly drawing from the phrases in the group.
[0176]
number
[0177] Regardless of whether the intimacy level is low, medium, or high, groups G1, G2, and G3 are all available for selection, but the probability of each group being selected varies depending on the intimacy level. The selection probability of each group determined by equation (9) can be expressed as shown in Figures 20(B) and 20(C). As shown in Figures 20(B) and 20(C), when the intimacy level is low, the selection probability is highest in the order of groups G1, G2, and G3. When the intimacy level is medium, the selection probability is still highest in the order of groups G1, G2, and G3, but the selection probability of groups G2 and G3 increases as the intimacy level increases. When the intimacy level is high, the selection probability is still highest in the order of groups G3, G2, and G1, but the selection probability of group G3 increases as the intimacy level increases. The selection probability of group G2 remains roughly constant regardless of the intimacy level. The selection probability of group G1 decreases as the intimacy level increases. By making all groups G1, G2, and G3 available for selection regardless of intimacy, phrase duplication is minimized even with repeated use and usage of the electronic device 10, and utterances can be changed according to intimacy. Furthermore, if the difference in the selection probability between groups G1, G2, and G3 is extremely large, selection of a specific group is likely to be biased, and phrase duplication is likely to occur. Therefore, the difference is prevented from becoming too large. In this way, phrase duplication in the character's utterances can be reduced, while phrases uttered to the user can be changed according to the relationship with the character. A phrase is selected based on whether a question phrase has not occurred in the dialogue processing during the same day, and a question phrase can be used a maximum of once per day.
[0178] Next, the control unit 11 uses the selected phrase to output the character's voice indicating the character's utterance from the voice output unit 14 (step S27).
[0179] Next, the control unit 11 determines whether a response from the user to the voice output to the character in step S27 has been recognized (step S28). The control unit 11 may start voice recognition when the character's voice output has ended, or may perform voice recognition during or before the output. The response indicates some kind of reaction or reply to the character's voice, and in this case, it determines whether the user's voice has been recognized. The control unit 11 may perform a predetermined filter process on the sound signal from the microphone 192 before performing voice recognition. In this case, the filter process may, for example, be a filter process that passes the frequency band of the human voice and cuts off frequency bands below that (for example, 200 Hz or below).
[0180] If the determination in step S28 is "YES," the control unit 11 determines whether there is any further phrase to be output as the character's voice (step S29). This is because the dialogue may end with the character's utterance and the user's response, or the character may make further utterances. If the determination in step S29 is "YES," the control unit 11 outputs a character voice indicating the character's utterance from the voice output unit 14 (step S30). Next, the control unit 11 determines whether a response from the user to the character voice output in step S30 has been recognized (step S31). Step S31 may be processed in the same manner as step S29.
[0181] If the determination in step S29 is "NO" or if the determination in step S31 is "YES," the control unit 11 determines whether the user's response is affirmative (step S32). Whether the response is affirmative indicates that the response is a response that affirms the character's utterance. A response that affirms the character's utterance is, for example, a response that indicates agreement or sympathy with the character's utterance, and is a favorability response that is a response that the character likes. Another response that affirms the character's utterance is a response that semantically replies to a question phrase uttered by the character. In this way, it is sufficient that the response is one that is desired by the electronic device 10 in the dialogue with the character. If the determination in step S32 is "YES," the control unit 11 increases the favorability coefficient Sf to the maximum value of "2.0" (step S33). Then, the control unit 11 ends the processing of FIG. 16.
[0182] If the determination in step S28 or S31 is "NO," the control unit 11 reduces the favorability coefficient Sf to "0.5" (step S34). Then, the control unit 11 ends the processing of FIG. 16. If the response is not recognized, it is assumed here that the user has ignored the character's utterance, and the favorability coefficient Sf is reduced. For example, if the control unit 11 does not recognize a response from the user within a predetermined time (e.g., 5 seconds) from the time the character's voice output ends, the control unit 11 may determine "NO" in step S28 or S31.
[0183] If the determination in step S32 is "NO," the control unit 11 determines whether the user's response is negative (step S35 in FIG. 17). Whether the response is negative indicates that the response denies the character's utterance. For example, there are responses that deny, agree with, or do not agree with the character's utterance. There are also responses that are replies to a question phrase uttered by the character, and responses that are replies but do not have a favorable impression of the character. If the determination in step S35 is "YES," the control unit 11 decreases the favorable impression coefficient Sf to "0.8" (step S36). Then, the control unit 11 ends the processing in FIG. 17. Here, because the user is responding, the favorable impression coefficient Sf is higher than in the case of ignoring, but is lower than in the case of a positive response or the standard value. In this way, if the user "ignores" the character's utterance, it is preferable to make the negative indicator value L larger than in the case of "denying" the character's utterance.
[0184] If the determination in step S35 is "NO," the control unit 11 determines whether to ask the user to repeat (step S37). In an environment such as inside the vehicle 40, various noises may cause the voice recognition result to be erroneous. This may be because the voice recognition failed or because the response was recognized using inappropriate words (different words). When such an erroneous recognition occurs, the control unit 11, under predetermined conditions, causes Ray to output a voice of the character to "ask again" to the user, such as "Say it again."
[0185] For example, the "listen again" function may have the following specifications: -You can ask each question phrase to be repeated a maximum of once. The occurrence rate of repeating the request varies depending on the intimacy level, and the higher the intimacy level, the higher the chance of repeating the request.
[0186] The probability of asking again is determined, for example, by calculating the following formula: probability of asking again y = intimacy / 999 × 0.3 + 0.1. In this case, the relationship between intimacy and the rate of asking again is "10%" when intimacy is "0" and "40%" when intimacy is "999". In this way, the better the relationship between the user and the character, the higher the probability that the character will make an utterance prompting the user to respond, which gives the user a sense of becoming closer to the character. One reason for not always asking again is that asking again every time would prevent the user from misunderstanding that there is a malfunction in the electronic device 10.
[0187] If the control unit 11 determines not to ask the user to repeat the utterance (step S37; NO), it sets the liking coefficient Sf to the standard value of "1.0" (step S38). In this way, when it cannot be determined whether the user has a positive, negative, or ignored the character's utterance, the control unit 11 sets the liking coefficient Sf to the standard value of "1.0" so that the indicator value L and, in turn, the intimacy level S (in other words, the evaluation) do not change. However, the control unit 11 treats this as having been a dialogue process, and determines a new speech interval to perform the next dialogue process. Then, the control unit 11 ends the processing of FIG. 17.
[0188] When the control unit 11 determines that the user should ask again (step S38; YES), the control unit 11 utters the asking again (step S39). This utterance should be such that the user can understand the intention of the asking again, such as "What did you say?" Then, the control unit 11 determines whether or not it has recognized a response from the user to the asking again utterance (step S28). The subsequent processing is as already described.
[0189] Once the favorability coefficient Sf is changed, it remains valid until the vehicle 40 has traveled a predetermined distance, such as 15 km. Once the favorability coefficient Sf is changed, it may remain valid until a predetermined time, such as 10 minutes, has elapsed. The duration of the favorability coefficient Sf after being changed is not limited to these. The favorability coefficient Sf is then cancelled and returns to the standard value of "1.0". The conditions for cancellation may differ depending on the type of response.
[0190] FIG. 18 is a flowchart showing the flow of processing performed by the control unit 11 in parallel with the processing shown in FIGS. 16 and 17. After outputting the character's voice, the control unit 11 determines whether the vehicle has been moving before recognizing the response (step S41). If the determination in step S41 is "YES," the control unit 11 sets the favorability coefficient Sf to the standard value of "1.0" (step S42) and terminates the dialogue processing described in FIGS. 16 and 17 (step S43). This is to contribute to the user's safe driving by not performing dialogue processing while the vehicle 40 is moving if the dialogue processing is started because the vehicle 40 is stopped but the vehicle 40 is moving before the dialogue processing is completed. For example, the control unit 11 may stop the dialogue processing if the vehicle 40 starts moving after the character speaks but before recognizing the user's response. In this way, the dialogue processing is stopped if the vehicle starts moving even if the dialogue processing is in progress, thereby taking into consideration the user's safe driving.
[0191] (Direction related to interactive processing functions) Here, the presentation related to the dialogue processing function will be explained. The dialogue processing includes realizing a pseudo dialogue between the user and the character using voice, and presenting the character. FIGS. 21A to 21C are diagrams illustrating an example of a specific flow of the dialogue processing. FIGS. 22A to 22K are diagrams illustrating the content of the character presentation related to the dialogue processing. A subcategory refers to the category (classification) to which the presentation belongs, and in this case refers to the category to which the question phrase uttered in the dialogue processing (the phrase selected in step S26) belongs. A subcategory can also be said to be a topic or a theme of the dialogue content. For example, in FIG. 22A, the row corresponding to the subcategory "N: 2D Characters" ("N:" can be ignored; the same applies to other drawings) specifies dialogue processing of content related to 2D characters (i.e., 2D characters).
[0192] Lines with a common subcategory specify the content and effects that can be uttered by a character in a single dialogue process. Among the lines with a common subcategory, lines corresponding to phrases ending in "?" correspond to question phrases, and other lines corresponding to phrases not ending in "?" correspond to phrases that are uttered when the user gives a positive response or phrases that are uttered when the user gives a negative response. However, lines corresponding to the subcategory "N: Misrecognition" specify the effects that will be produced if the user asks again. Lines corresponding to the subcategory "N: Silence" specify the effects that will be produced if the user does not respond (in other words, if the user responds silently or ignores the question).
[0193] Here, the specific contents of the dialogue processing will be explained. (A: Dialogue processing that is completed with one round trip between the character's utterance and the user's response) For example, suppose that the control unit 11 selects in step S26 a phrase (question phrase) belonging to the subcategory "N: 2D Characters," which is "For a character like me, it's more painful to be forgotten than to be hated... You won't forget me, right?" In this case, in the process of step S27, the control unit 11 outputs the voice of the character saying the selected question phrase, "For a character like me, it's more painful to be forgotten than to be hated... You won't forget me, right?" via the voice output unit 14, and displays the animation identified by "RDLeiN 034" on the display unit 13. Next, in step S28, the control unit 11 determines whether or not a response from the user has been recognized. If a response from the user has been recognized (step S28; YES), the control unit 11 proceeds to the process of step S29. The dialogue process here is completed once the user's response is recognized, so the control unit 11 determines "NO" in step S29.
[0194] Next, the control unit 11 determines whether the user's response is positive (step S32). For example, suppose the user responds with "I won't forget." This response means that the user has positively interpreted the character's utterance. In this sense, such a positive response can be considered a favorability response that increases the favorability rating (in FIG. 21A, "◯" is indicated in the favorability rating response column). The control unit 11 determines "YES" in step S32. In this case, the control unit 11 proceeds to the processing of step S33, but in addition to the processing of setting the favorability rating coefficient Sf to "2.0," it also performs character performance. Here, the control unit 11 outputs the character's voice, "Just hearing you say that is enough to satisfy me, but I'm sorry for being so greedy. I hope you won't forget me even when you get a girlfriend," via the voice output unit 14, and also displays the animation identified by "ID032" on the display unit 13. On the other hand, suppose the user responds with "I'll forget." This response means that the content of the character's utterance was interpreted negatively. In this case, the control unit 11 determines "NO" in step S32 and then "YES" in step S35, and proceeds to the processing of step S35. In addition to the processing of setting the favorability coefficient Sf to "0.8", the control unit 11 also performs character performance. Here, the control unit 11 outputs the voice of the character saying the reply phrase "Oh, yeah, it's fine, you can forget about me. You'll come to see me eventually anyway" via the voice output unit 14, and also displays the animation identified by "ID064" on the display unit 13.
[0195] If the control unit 11 does not recognize a response from the user in step S28 (step S28; NO), the control unit 11 determines "NO" in step S28 and proceeds to the process of step S34. In addition to the process of setting the favorability coefficient Sf to "0.5," the control unit 11 performs a character performance. Here, the control unit 11 performs a performance according to one of the rows belonging to the subcategory "Silent" shown in FIG. 22K. Here, the control unit 11 performs a different performance depending on the current intimacy level. For example, when the intimacy level is "low," the control unit 11 performs a performance according to one of the rows with an intimacy level of "1." For example, the control unit 11 outputs a voice of the character saying the phrase "I'm sorry. I don't understand what you're saying" via the audio output unit 14, and displays an animation identified by "ID052" on the display unit 13. For example, when the intimacy level is "medium" (intimacy level 2), the control unit 11 outputs the character's voice saying the phrase "Hey, won't you answer me?" via the voice output unit 14, and displays the animation specified by "ID052" on the display unit 13. When the intimacy level is "high" (intimacy level 3), the control unit 11 outputs the character's voice saying the phrase "It's not like you to not answer me." via the voice output unit 14, and displays the animation specified by "ID052" on the display unit 13. In this way, when the user ignores the character, the character's performance differs depending on the intimacy level; when the intimacy level is low, the character appears cold, and when the intimacy level is high, the character appears to care about the user. This allows the user to feel as if they are having a conversation with a character that actually exists.
[0196] When the control unit 11 recognizes a response from the user and the response is neither positive nor negative, the control unit 11 determines in step S37 whether to ask the user to repeat the question. If the determination in step S37 is "YES," the control unit 11 utters a repeat utterance in the process of step S39. Here, the control unit 11 performs a performance according to any of the rows belonging to the subcategory "misrecognition" shown in FIG. 22F. Here, the control unit 11 performs a performance that differs depending on the current level of intimacy. For example, the control unit 11 performs a performance according to any of the rows in which the intimacy level is "low" or "1." For example, the control unit 11 outputs a voice of the character saying the phrase "I'm sorry. What did you say?" via the audio output unit 14 and displays an animation identified by "ID056" on the display unit 13. For example, when the intimacy level is "medium," the control unit 11 outputs a voice of the character saying the phrase "Hmm, what? What did you say?" via the audio output unit 14 and displays an animation identified by "ID027" on the display unit 13. For example, when the intimacy level is "High," the control unit 11 outputs the character's voice saying the phrase "That's not the answer I expected," via the voice output unit 14, and displays the animation identified by "ID043" on the display unit 13. In this way, even when repeating a question, the character's presentation differs depending on the intimacy level; a low intimacy level gives the character a cold impression, while a higher intimacy level makes the character appear more concerned about the user. This gives the user the feeling that they are conversing with a character that actually exists.
[0197] (B: In the case of dialogue processing in which the character speaks and the user responds twice) For example, suppose that the control unit 11 selects in step S26 a question phrase "Hey, don't you think it's about time we turned you into an anime?", which is a question phrase belonging to the subcategory "N: About animation." In this case, in the process of step S27, the control unit 11 outputs the voice of a character saying the selected question phrase "Hey, don't you think it's about time we turned you into an anime?" via the voice output unit 14, and displays the animation specified by "RDLeiN 034" on the display unit 13. Next, in step S28, the control unit 11 determines whether or not it has recognized a response from the user. If it has recognized a response from the user (step S28; YES), the control unit 11 proceeds to the process of step S29. In this dialogue process, the control unit 11 determines "YES" in step S29 and proceeds to the process of step S30.
[0198] The process of step S30 varies depending on the response from the user. For example, if the user's response is an affirmative response such as "I think so," "That's right," or "I think so" (Response 1-1 shown in FIG. 21B), the control unit 11 outputs, in the voice of the character, a question phrase corresponding to the affirmative response, such as "After all, if it's going to be made into an anime, it'll be a battle story, right?" On the other hand, if the user's response is a negative response such as "That's not true" or "I don't think so" (Response 1-2 shown in FIG. 21B), the control unit 11 outputs, in the voice of the character, a question phrase corresponding to the negative response, such as "Well, then, what do you think is better? A novel? Or a game?"
[0199] Next, the control unit 11 determines whether the user's response to the second question phrase uttered in the process of step S30 is affirmative (step S32). For example, suppose the user responds affirmatively (response 1-1) to the question phrase uttered after the first response 1-1, "After all, if it's going to be made into an anime, it'll be a battle story, right?", such as "That's right" or "I think so." Since this response is a favorability response, the control unit 11 determines "YES" in step S32. In this case, the control unit 11 proceeds to the process of step S33, but in addition to setting the favorability coefficient Sf to "2.0," it also performs character performance. Here, the control unit 11 outputs the character's voice saying the reply phrase "This story is about being caught up in an interplanetary space war... Just thinking about it makes it fun. You're excited too, aren't you?" via the audio output unit 14, and also displays the animation identified by "ID032" on the display unit 13. On the other hand, if the user gives a negative response (Response 1-2) such as "That's not true" or "I don't think so," the control unit 11 determines "NO" in step S32 and then "YES" in step S35, and in the process of step S35, in addition to processing to set the favorability coefficient Sf to "0.8," it also performs character performance. Here, the control unit 11 outputs the voice of the character saying the reply phrase "Oh? You prefer romance stories? But I don't think they suit you," via the voice output unit 14, and also causes the display unit 13 to display the animation identified by "ID056."
[0200] For example, suppose the user replies "Games" (Response 2-1) to the question phrase "Well, then, what do you think is better? Novels? Or games?" uttered after the first Response 1-2. Since this is not a favorability response, the control unit 11 determines "NO" in Step S32 and "YES" in Step S35, and in addition to setting the favorability coefficient Sf to "0.8" in the process of Step S36, performs character performance. Here, the control unit 11 outputs the character's voice saying the reply phrase "You think a character development game is good, don't you? It's obvious by now." via the voice output unit 14, and also displays the animation identified by "ID032" on the display unit 13. Suppose the user replies "Novels" (Response 2-2). Since this is not a favorability response, the control unit 11 determines "NO" in step S32 and then "YES" in step S35, and in the process of step S36, in addition to processing to set the favorability coefficient Sf to "0.8", it also performs character performance. Here, the control unit 11 outputs the voice of the character saying the reply phrase "In novels, my voice can't be heard" via the voice output unit 14, and also displays the animation identified by "ID041" on the display unit 13.
[0201] Although not described in this embodiment, dialogue processing may be performed in which the character's speech and the user's response go back and forth three or more times, and the processing in this case can be understood from the explanation of the two-way dialogue processing described above.
[0202] In this way, for each subcategory, the number of times the character's utterance goes back and forth with the user's response varies, but there is only one favorability rating answer. However, depending on the subcategory, there may be multiple favorability ratings answers. Note that the processing when the user's response is not recognized in step S31 (step S31; NO), when the user's response is not recognized, or when the user asks to repeat is as already explained.
[0203] (C: Contents of the dialogue) The content (topic) of the dialogue processing may be anything, but with reference to FIGS. 22A to 22K, examples include the following.
[0204] (C-1) For example, in the dialogue processing, the control unit 11 may utter utterances that give the user the impression that Ray is riding in the vehicle 40 (for example, the impression that the user is driving with Ray). Such dialogue processing may include, for example, subcategories such as "N: About driving," "N: About Ray's strategy," "N: About having Ray in the car 1," "N: About having Ray in the car 2," "N: Shall we take a detour?", "N: Waiting for you to come and see me," "N: About responding to conversations," "N: Feeling someone's gaze," and "N: About making someone carsick." This allows the user to feel as if they are riding in the vehicle with the character, and provides a sense of immersion in the virtual world in which the character exists.
[0205] (C-2) In the dialogue processing, the control unit 11 may, for example, utter content related to functions of the electronic device 10, such as an alarm function (alarm processing unit) or an item function. Such dialogue processing may include, for example, subcategories such as "N: About items," "N: Alarms and chatting," "N: About alarms," "N: About catchphrases (to warn)," and "N: About making someone car sick." In this way, the user can be made aware of the functions of the electronic device 10 through dialogue with the character. For example, the user can deepen their understanding of the functions of the electronic device 10, such as an alarm function (alarm processing unit) or an item function.
[0206] (C-3) The control unit 11 may, for example, make a statement about the content related to the driving of the vehicle (e.g., things to pay attention to during driving or things that may occur during driving) in the dialogue process. Such a dialogue process has, for example, subcategories such as "N: Are you concentrating on driving?", "N: Driving tips", "N: Are you taking a detour?", "N: About the merging point", "N: About parking prohibition", etc. By doing so, it is possible to make the user aware of the content related to the driving of the vehicle through the dialogue with the character. For example, it is possible to make the user aware of paying attention to safe driving.
[0207] (C-4) The control unit 11 may, for example, make a statement about the content related to the user's response in the dialogue process. Such a dialogue process has, for example, a subcategory such as "N: About the reply in the conversation". By doing so, it is possible to make the user aware of the content related to the user's response in the dialogue process through the dialogue with the character. For example, it becomes easier for the user to have the awareness of responding to the character's statement.
[0208] (C-5) There is also a dialogue process for other content shown in FIGS. 22A to 22K. For example, the control unit 11 may make a statement about the content related to animation or games (e.g., the content related to the virtual world where Ray exists). Such a dialogue process has, for example, subcategories such as "N: About animation", "N: About games", "About Tel's hair texture" (Tel is a virtual character that is Ray's pet), etc. The control unit 11 may also make a statement about the content related to the user's attributes such as the user's hobbies and the attributes of Ray. Such a dialogue process has, for example, subcategories such as "N: Do you cry in anime?", "N: Tough phrases", "N: Gap", "N: About sports", etc. Also, the tone of the character's voice and the content of the phrases should reflect the assumed personality of the character. For example, it is advisable to reflect a strong personality.
[0209] <E: Night Drive Function> The night drive function (night drive mode) executed by the control unit 11 will be described. The control unit 11 functions as an output processing unit. The night drive mode is a function that operates during a predetermined time period at night (for example, 10:00 PM to 5:00 AM). The characters represent virtual people, and are presented as sleeping during the nighttime hours. Therefore, the control unit 11 varies the output content of information about the characters depending on the time period. The daytime hours are designated as normal operating hours in which the characters are awake and make various announcements, and the nighttime hours are designated as abnormal (standby) operating hours in which the characters are asleep and do not engage in any major activities (talk in their sleep). For example, the control unit 11 may disable at least some of the functions realized by displaying the character 200, such as the "alarm function," "indicator value / intimacy calculation function," "G sensor processing function," "dialogue processing function," and the "item function" described below, during the nighttime hours.
[0210] In this case, for example, if the driver mainly drives at night, simply outputting character information indicating a sleeping state, such as talking in his sleep, may lack interest. Therefore, the electronic device 10 activates a night drive function based on the intimacy level, even at night. When the night drive function is activated, it is preferable to activate at least some of the functions realized by displaying the character 200, such as an "alarm function," an "indicator value / intimacy level calculation function," a "G sensor processing function," a "dialogue processing function," and an "item function" (described later). This increases the game's appeal, as the function operates at night at least once every few times.
[0211] The condition for starting the night drive function is, for example, when Ray's room shown in FIG. 12 is displayed, and the vehicle 40 is parked at night, the user performs a predetermined action of touching the sleeping Ray displayed on the display unit 13 twice. The double touch represents a light tapping motion, such as "poke poke" or "knock knock" to wake up a sleeping person. Alternatively, the predetermined action of the user may be speaking to Ray using specific words (e.g., voice recognition of words for the night drive function, such as "Wake up Ray" or "Let's go for a drive"). The night drive lottery is limited to one entry per sleep (i.e., one entry per nighttime slot) or up to three entries (i.e., three entries per nighttime slot). If the entry is successful, the control unit 11 activates the night drive function. In this way, calling out to the character at night can give the user the feeling of enjoying a night drive with the character.
[0212] The screen displaying the sleeping Ray displayed on the display unit 13 during the nighttime hours described above may be the screen shown in Fig. 23. Fig. 23 is a diagram showing a room screen IMG30 displayed during the nighttime hours. On the room screen, a character image showing Ray sleeping and soft buttons corresponding to each of a plurality of menus are arranged. Each menu will be described later.
[0213] The probability Nd that the night drive function will be activated for the user's actions described above varies depending on the indicator value L and the intimacy level S. For example, this probability Nd satisfies the relationship of the following equation (10). This is shown in graph form in FIG. 24. Nd = (indicator value L × intimacy S) / 1400 However, if Nd<0, it is set to 0. (10)
[0214] Thus, the higher the indicator value and the higher the intimacy level, the higher the probability Nd that the night drive function will be activated. The control unit 11 causes the display unit 13 to display an image that is different from the normal image when the night drive function is activated. For example, a character operating with the night drive function may be wearing dressed-up clothing for night drives, as shown in FIG. 25. Furthermore, when the night drive function is activated, the control unit 11 may output phrases exclusive to the night drive function as the character's voice at the start and end of the night drive function.
[0215] Furthermore, if Ray is carsick or has run away from home, he can use an item to release the condition, and then use an item to wake him up from drowsiness to activate the night drive function. While the night drive function is running, the control unit 11 issues a warning about the alarm function without transforming Ray. The phrases are as already explained. Furthermore, during the night hours, the night drive function continues regardless of whether the engine of the vehicle 40 is on or off.
[0216] The conditions under which the night drive function is activated may be as follows. - It must be during the evening hours (between 10:00 PM and 5:00 AM). The vehicle 40 is stopped. -Indicator value L is greater than "0". Intimacy S must be "1" or higher. -Perform the user's specified actions as described above. Win the Night Drive feature lottery.
[0217] The conditions for ending the night drive function are the end of the night time period (when the time reaches 5:00), when switching to normal mode, or when Ray becomes carsick, runs away from home, or switches back to normal mode. The control unit 11 ends the night drive function if Ray becomes carsick, runs away from home, or switches back to normal mode while the night drive function is running.
[0218] (Character effects related to the night drive function) Here, the presentation of characters related to the night drive function will be described. FIG. 26 is a diagram for explaining this presentation content. In FIG. 26, the subcategory means the category (classification) to which the presentation belongs. For example, in FIG. 26, the row corresponding to the subcategory "Night Drive NG" specifies the presentation when the lottery for the night drive function fails. The row corresponding to the subcategory "When Night Ray Appears" specifies the presentation when the night drive function is activated and the character operating with the night drive function is displayed (appears). The row corresponding to the subcategory "Night Drive OK" specifies the presentation when the lottery for the night drive function wins. The row corresponding to the subcategory "End of Night Drive" specifies the presentation when the night drive function is ended. The presentation by the characters related to the night drive function is performed regardless of the intimacy, but if it is made to change according to the intimacy, an effect that the user takes actions in the direction of increasing the intimacy can be expected.
[0219] <F: Item Function> The item function is a function for the user to obtain an item or use an item. The control unit 11 functions as an output processing unit that outputs information related to the item. In FIG. 27(A), the item name, the effect when the item is used, the usage conditions, the number of uses, the maximum stock number, and the duration / distance of the effect of the item are shown. In FIG. 27(B), the acquisition conditions of the item, the probability of acquisition, and the item that can be acquired under those conditions are shown. In FIG. 27, "Star Hair Ornament" and "Lucky Potion" are treated as rare items, and the others are treated as normal items that are not rare items.
[0220] When the item acquisition conditions shown in FIG. 27(B) are met, the control unit 11 performs a process of allowing the user to acquire the item with a predetermined probability. The process of allowing the user to acquire the item may include a process of writing that information to the item data 257. Furthermore, when the user uses an item owned by the user, the control unit 11 exerts an effect corresponding to the item, as shown in FIG. 27(A). For example, the item "Lucky Potion" (an example of a first item) has the effect of resetting the number of falls, which is a demerit factor for the indicator value, and making the indicator value more likely to increase (the favorability coefficient reaches its maximum value). As described above, the effect of the "Lucky Potion" lasts for the time it takes to travel 15 km, and the user can own up to five of them. Note that if the item is used before its effect expires, the duration of the effect is increased. In this way, when the user uses a predetermined item, the control unit 11 calculates the indicator value L so as to reduce the effect of decreasing the indicator value L or the intimacy level S, or to increase the effect of improving the intimacy level S. In this way, the user can feel as if he or she is playing a game in terms of building relationships with the characters.
[0221] In FIG. 27(A), "car sick" refers to the behavior of a character who has fallen over more than 10 times. The character recovers from the sickness after a predetermined time has passed (for example, 1, 2, 3, or 6 hours, randomly selected) since the last fall, and the number of falls is cleared. "Sleeping" refers to the behavior of a character who is sleeping at night. "Running away from home" refers to the behavior of a character who has run away from home, and is a behavior that occurs as a result of traffic violations or undesirable driving, such as speeding between 20 km / h and 30 km / h three consecutive times, speeding by 30 km / h or more, or exceeding the speed limit (25 km / h or more) five or more times.
[0222] FIG. 28 is a diagram for explaining the procedure for acquiring items at SAs (service areas), PAs (parking areas), HOs (highway oases), and roadside stations.
[0223] First, when the vehicle 40 has a predetermined proximity relationship with an SA, PA, HO, or roadside station (here, when the vehicle has stopped at that location), the control unit 11 outputs a POI phrase, which is a phrase indicating this, from the audio output unit 14 (step S101). Here, the control unit 11 may determine that the vehicle 40 has a predetermined proximity relationship when the vehicle 40 is stopped at any of these locations. When the indicator value is equal to or greater than a threshold value of 0.2, the control unit 11 starts a lottery to determine whether or not to allow the user to acquire an item (step S102), and when the indicator value is less than the threshold value of 0.2, the control unit 11 determines that the user will not be allowed to acquire an item and ends the lottery without doing anything (step S103). The item lottery in step S102 is a lottery to determine whether or not the user will be allowed to acquire some item. The item lottery is designed to be won with a predetermined probability.
[0224] If the item lottery is won, the control unit 11 next starts a lottery for a rare item (step S104). The rare item lottery in step S104 is a lottery to determine whether the user will acquire a rare item. The rare item lottery is won with a predetermined probability. If the rare item lottery is won, the control unit 11 causes an item confirmation phrase to be uttered (spoken) (step S105). That is, the control unit 11 outputs, by the voice of the character, a phrase indicating that the rare item lottery has been won, which the character is to utter. The item confirmation phrase is, for example, a phrase such as "Yay, maybe I got a rare item" or "I won a rare item!" Then, the control unit 11 causes an item acquisition phrase to be uttered. That is, the control unit 11 outputs, by the voice of the character, a phrase including the acquired rare item, which the character is to utter (step S106). The item acquisition phrase is, for example, a phrase such as "I got a lucky potion!"
[0225] If the user loses the item lottery in step S104, the control unit 11 causes the character to utter an item suggesting phrase (step S107). That is, the control unit 11 outputs, in the voice of the character, a phrase that suggests that although the user lost the rare item lottery, the location is a location where a rare item can be obtained. Examples of the item suggesting phrase include, "Doesn't it feel like something is hidden here?" and "It looks like there's a rare item here." Then, the control unit 11 causes the user to obtain the item. That is, the control unit 11 causes the user to obtain a normal item that is not a rare item (step S108).
[0226] If the user loses the lottery to acquire an item in step S102, the control unit 11 causes the character to utter an item suggesting phrase (step S109). That is, the control unit 11 outputs, in the voice of the character, a phrase to be uttered by the character suggesting that although the user lost the lottery to acquire an item, the location is a location where the item can be acquired. An example of the item suggesting phrase is the phrase "It looks like there's an item here." In this case, the control unit 11 does not cause the user to acquire any item (step S110).
[0227] Here, the character effects related to the item functions will be described. FIG. 29 is a diagram for explaining this effect content. In FIG. 29, the subcategory means the category (classification) of the effect. For example, the row corresponding to the subcategory "Use for Hangover" in FIG. 29 specifies the character effects executed when the item "Hangover Potion" is used. For example, in the character effects of "Use for Hangover", the voice of the character with the phrase "Don't drive too recklessly, okay." may be uttered. The character effects related to the item functions are performed regardless of the intimacy. This is because the character effects related to the item functions are strongly related to, for example, the user's rough driving and contribute to the user's safe driving. However, if the character effects related to the item functions are made to change according to the intimacy, an effect that the user takes actions in the direction of increasing the intimacy can be expected.
[0228] The electronic device 10 (control unit 11) may further execute the following functions.
[0229] <G: Chibi Ray Display Function> Instead of Ray, the character 200 may be displayed as "Chibi Ray," a character that represents Ray as a child. The control unit 11 functions as an output processing unit. For example, when the intimacy level is equal to or higher than a threshold, the control unit 11 may make it possible to select the display of Chibi Ray, and when selected, display Chibi Ray instead of Ray. FIG. 30 is a diagram showing an example of a screen displaying Chibi Ray. The normal screen IMG4 shown in FIG. 30 is an example of an image displayed on the electronic device 10 during normal operation. The normal screen IMG4 includes, as display elements, a map 300 (300C), a host vehicle icon I, the character 200C, an indicator image 210, and an intimacy level image 220. The map 300 (300C), the host vehicle icon I, the indicator image 210, and the intimacy level image 220 are as described with reference to FIG. 1(A). The character 200C is a female character named Chibi Ray that is displayed superimposed on the map 300. Character 200C is displayed in 3D animation, giving the user a sense of depth. Map 300C is displayed in colors different from those of maps 300A and 300B, such as pink and red, which give the user a cute impression. While the above-mentioned functions are executed even while Chibi-Rei is displayed, control unit 11 may differentiate between Ray and Chibi-Rei by, for example, uttering different phrases in dialogue processing or by displaying a Chibi-Rei character image.
[0230] Here, the character effects related to the Chibi Ray display function will be described. FIGS. 31A to 31N are diagrams for explaining a part of this effect content. In the Chibi Ray display function, the same effects as when Ray is displayed are performed, but the animations and phrases to be displayed are different. Also, the activation conditions for the character effects may be different. FIG. 31A is a diagram showing the effects related to the alarm function and the G-sensor event. FIGS. 31B to 31N are diagrams showing the effects related to the dialogue processing function. The subcategories are common to the case of Ray, but the animations and phrases are different. Also, effects of subcategories different from the case of Ray are included. Here, Chibi Ray as a second character different from Ray has been described, but the electronic device 10 may have a function of displaying another character, or may display characters after the third character.
[0231] <H: Work Support Function> The work support function randomly voices a work support phrase when the user's home and workplace are registered in the electronic device 10. The control unit 11 functions as a registration unit that registers location information of the user's home or commute destination. The control unit 11 then outputs a voice of a predetermined character when a predetermined condition is met, in a case where the location information of the vehicle 40 and the location information of the user's home or commute destination have a predetermined positional relationship. For example, when the electronic device 10 is turned on within a 1-kilometer radius of the home and the electronic device enters within a 200-meter radius of the workplace, the control unit 11 outputs a work support phrase by voice of the character with a predetermined probability. The control unit 11 may output a work support phrase by voice of the character with a predetermined probability when the electronic device 10 is turned on within a 1-kilometer radius of the workplace and six hours have passed since the user arrived at the workplace, or when the electronic device enters within a 200-meter radius of the home. When the electronic device 10 is activated at the workplace, the voice is not voiced until six hours have passed since the user arrived, taking into account travel during lunch breaks, etc. The work support phrases may be phrases such as "Good luck at work!" or "Thank you for your hard work today." They may contain phrases intended to encourage work. Here, the workplace is used, but it may be replaced by a place the user regularly commutes to. In this way, the character's voice can be output according to the relationship between the user's home or place of commute and the user's location. Furthermore, the condition for generating a work support phrase may be that no work support phrase has been generated within the same day. In other words, a work support phrase can be generated up to once a day. In this way, the control unit 11 functions as an output processing unit, but here, it performs processing related to the work support function regardless of the indicator value or intimacy level.
[0232] Here, the character presentation related to the work support function will be described. FIG. 32 is a diagram for explaining this presentation content. In FIG. 32, the subcategory means the category (classification) of the presentation. For example, in FIG. 32, the row corresponding to the subcategory "home" specifies the character presentation to be executed when the electronic device 10 is at the user's home, and the row corresponding to the subcategory "workplace" specifies the character presentation to be executed when the electronic device 10 is at the user's workplace. For example, in the character presentation at "home", along with the display of the animation specified by "ID001", the voice of the phrase "You've completed today's mission. Well done." may be emitted. For example, in the character presentation at "workplace", along with the display of the animation specified by "ID001", the voice of the phrase "At the end of the day, you sometimes feel this way. It's nice to have a place to work and a place to go home to~" may be emitted. The presentation by the character related to the work support function is performed regardless of the intimacy level, but if it is made to change according to the intimacy level, an effect can be expected that the user will take actions in the direction of increasing the intimacy level.
[0233] <I: Temperature Phrase Function> The temperature phrase function is a function that performs a process of outputting a phrase related to the current temperature by the voice of a character. For example, the control unit 11 acquires the temperature from the sensor unit 20 (temperature sensor) 10 minutes after starting the electronic device 10. Then, the control unit 11 randomly vocalizes a temperature-specific phrase according to the temperature. The control unit 11 sets the condition for generating this phrase to be that no temperature phrase has occurred during the same day. That is, the temperature phrase is at most once a day. For example, when the temperature is 30°C or higher, a phrase for a hot situation, when the temperature is 10°C or lower, a phrase indicating cold, and when the temperature is 3°C or lower, an extremely cold phrase may be output by the voice of the character. Also, when the substrate on which the control unit 11 is mounted (for example, the temperature of the SoC substrate) is at a predetermined temperature or higher and is hot, it may be output by the voice of the character to that effect. Note that the control unit 11 may output a phrase as the voice of the character based on the detection of another sensor of the sensor unit 20.
[0234] FIG. 33 is a diagram showing temperature - dedicated phrases in each case where a ray is displayed and where a chibi ray is displayed. The temperature - dedicated phrase is emitted when Conditions 1 and Condition 2 are satisfied. When there are a plurality of phrases that satisfy Conditions 1 and Condition 2, any one of them may be selected according to a predetermined rule or randomly. The control unit 11 functions as an output processing unit. Here, the control unit 11 performs processing related to the temperature - phrase function regardless of the indicator value or the intimacy.
[0235] The phrase "SoC temperature high" shown in FIG. 33 may be a phrase indicating that the air temperature is high (that is, it is hot). In this way, the control unit 11 can use the fact that the SoC, which is the substrate constituting the control unit 11, is at a high temperature as an indicator of the fact that the vehicle interior temperature is high, and can output a phrase suitable for the case where the vehicle interior temperature is high by the voice of the character. Also, the threshold value that becomes the condition (Condition 1 or Condition 2) for emitting such a phrase may be 70°C.
[0236] The electronic device 10 having such a configuration is a system equipped with a function of outputting a phrase related to the air temperature by a character. Instead of the actual air temperature (in other words, the detection result of the sensor that detects the actual air temperature), when the temperature of the temperature sensor in the SoC (an example of the substrate constituting the control unit 11) exceeds a predetermined temperature, it can also be grasped as an example of a system that outputs a phrase indicating "(the air temperature is) hot". The state where the temperature of the SoC, which corresponds to the head (that is, the brain for the electronic device 10) inside the electronic device 10, is rising (for example, a state where a load is applied to the head such as a heavy processing load) can be indicated by saying "hot", and a feeling as if there is a person inside the system can be given to the user.
[0237] <J: Drowsiness·Sluggishness Function> The drowsiness and sucking function (drowsiness and sucking mode) is a function that performs processing related to the character's drowsiness and sucking function. When the user is driving safely, the control unit 11 may randomly generate drowsiness motions. In the case of Chibi Rey, the control unit 11 may add the utterance of sucking phrases. For example, when the value of the G-sensor is in a state where it is greater than the rear G-threshold of 0.2G, greater than the threshold G-threshold of 0.2G, and greater than the left-right G-threshold of 0.2G for more than 5 minutes, the control unit 11 may generate a drowsiness motion with a predetermined probability. After generating the drowsiness motion, the control unit 11 resets the state. Although the control unit 11 functions as an output processing unit, it may perform processing related to the drowsiness and sucking function regardless of the indicator value or intimacy, or it may vary the processing related to the drowsiness and sucking function according to the indicator value or intimacy.
[0238] <K: Special effect function for alarm (during transformation)> The special effect function for alarm (during transformation) is an example of the processing performed by the output processing unit. When displaying Chibi Rey, if the control unit 11 has a predetermined proximity relationship with the speed enforcement device, it may perform a special (e.g., rare) effect during the alarm of discovering Orbis. For example, Chibi Rey may be an image representing the state related to the three types of golf, radar, and scope.
[0239] The control unit 11 may be able to obtain clothing that can be worn by the character 200 according to the intimacy level. For example, each time the intimacy level increases, when the intimacy level reaches a predetermined value, and / or when a chibi ray is being displayed, one or more combinations of these conditions can be used as criteria to obtain clothing. Regarding the clothing selected according to the intimacy level, it may be changed, for example, according to the season, month, the state of the character, etc. Also, as types of clothing, there are dresses, pajamas, combat uniforms, summer clothes, autumn clothes, winter clothes, night dresses, and other clothing. The winning probability Cs of seasonal clothing may change according to an indicator value. For example, it may be set as Cs = indicator value × 0.2 probability (however, if Cs < 0, then Cs = 0). In the screen display of the alarm function and other functions for displaying rays, the control unit 11 may vary the image of the character 200 in the appearance (such as clothing) set by the user, or vary the content of the phrases to be generated. The control unit 11 functions as an output processing unit, but it may perform processing related to the special effect function of the alarm (during transformation) regardless of the indicator value and intimacy level, or it may vary the processing related to the special effect function of the alarm (during transformation) according to the indicator value and intimacy level.
[0240] <L: Status display function> The status display function is a function for displaying the status of the electronic device 10. The control unit 11 of the electronic device 10 may display the status on a predetermined screen. The status includes one of the following: intimacy level, number of consecutive startups, total number of startups, number of consecutive passes through the speed limit point (Orbis), number of times passing through the speed limit point (Orbis) while observing the speed limit (if violated, the count is reset), total number of passes through the speed limit point (Orbis), SA, PA, HO, number of times stopped at a rest area, number of prefectures conquered (which prefectures have been visited), and eco-drive score.
[0241] <M: Muttering phrase voice function> The monologue phrase utterance function is a function in which a character speaks to itself, and is an example of speech output processing. In addition to the phrases used in the dialogue processing described above, monologue phrases muttered by Rei / Chibi Rei may also be uttered. This monologue phrase utterance function is a function in which Rei or Chibi Rei mutters phrases while the standby screen, exemplified as the normal screen, is displayed. The monologue phrase utterance function differs from the dialogue processing function in that Rei or Chibi Rei utters speech with content different from that used in dialogue processing and in that it does not perform processing related to user responses, such as recognizing the user's response. The character effects related to the monologue phrase utterance are as shown in Figures 34A to 34G. Figures 34A to 34F show the effects when Rei is displayed, and Figure 34G shows part of the effects when Chibi Rei is displayed. In the speech output processing, the content of the speech changes depending on the level of intimacy.
[0242] (M-1) Vocalization probability The monologue phrases are also preferably grouped according to the degree of intimacy, and as the degree of intimacy increases, the probability of uttering phrases with a higher degree of intimacy is preferably increased. This occurrence probability is preferably determined in the same manner as in the case of the dialogue processing function, as described in FIG. 19. In this way, the control unit 11 preferably increases the frequency of utterances in the utterance output process as the degree of intimacy increases. In this way, the better the relationship between the user and the character, the more likely the character is to actively talk to the user, allowing the user to intuitively understand whether the relationship with the character is good or bad, and attracting the user's interest in the character's utterances.
[0243] (M-2) Phrase Selection Part 1 The selection of phrases in the monologue phrase utterance function may be performed by the dialogue processing function and method described in FIG. 20, with the monologue phrase being the subject of a lottery. In this manner, the control unit 11 may select either a phrase belonging to the third group or a phrase belonging to the fourth group, perform speech output processing based on the selected phrase, and vary the probability of selecting a phrase from the third group or the fourth group depending on the degree of intimacy. This reduces the duplication of phrases in the character's speech, while allowing the phrases uttered to the user to vary depending on the relationship with the character. Note that any one of groups G1, G2, and G3 is an example of the third group, and any of the others is an example of the fourth group.
[0244] (M-3) Phrase Selection Part 2 If the monologues uttered by the monologue phrase utterance function are repeated, the user may quickly become bored. As a measure to prevent the monologue from being repeated, the control unit 11 may prevent a phrase that has been uttered once by the monologue phrase utterance function from being selected (i.e., remove it from the phrase options). To this end, the control unit 11 may retain information about already selected phrases, for example by storing it in the memory unit 25, even when the power is turned off.
[0245] If phrases that have already been spoken are not prevented from being selected, it is possible that, for example, a character will speak a certain phrase, then the power will be turned off, then the power will be turned on, and the character will speak the same phrase. Alternatively, for example, if there are 100 phrases, one can be selected at random and spoken by the character, and then a phrase can be selected at random from the remaining 99 and spoken by the character. Then, when there are 0 phrases remaining, it is advisable to start from the beginning (i.e., from 100).
[0246] The frequency of monologue using the monologue phrase utterance function can be set by working backward from the expected period of time over which all phrases are uttered. For example, if the period is approximately one year, it may give the impression that the character speaks infrequently. Therefore, the inventors have considered that it is better to set the frequency to more than one month, preferably about three months, so that all phrases are spoken. Electronic device 10 having such a configuration is a system having a function for outputting audio of selected phrases using pre-stored phrase information, and can be understood as an example of a system having a processing function for ensuring that the period between the re-output of a selected and output phrase is more than one month, preferably about three months. Note that the period of more than one month, preferably about three months, is determined taking into account the length of time the vehicle will be used and the length of time the electronic device 10 will be used, but other periods of time are also conceivable.
[0247] (M-4) Relationship between monologue phrase production function and dialogue processing function The control unit 11 does not perform dialogue processing when the vehicle 40 is in a traveling state, but may perform a monologue phrase utterance function when the vehicle 40 is in a traveling state. In this way, dialogue processing involving a user's response is not performed when the vehicle 40 is in a traveling state, preventing the user from being distracted by dialogue processing while the user is driving, and consideration is given to the user's safe driving, while speech output processing that outputs speech such as a character's monologue, for example, is performed when the vehicle is in a traveling state, preventing the user from getting bored and attracting the user's attention.
[0248] The control unit 11 may execute the dialogue processing function and the monologue phrase utterance function based on the processing of the flowchart shown in FIG. 35. The control unit 11 determines the utterance interval using the same method as in step S24 (step S61). Next, the control unit 11 determines whether it is time to utter (step S62). The control unit 11 waits until the utterance timing arrives (step S62; NO). If it determines that the utterance timing has arrived (step S62; YES), it determines whether the vehicle 40 is in a traveling state (step S63). If it determines that the vehicle 40 is in a traveling state (step S63, YES), the control unit 11 does not perform dialogue processing, and therefore selects one phrase by lottery from the phrases of the monologue phrase utterance function (in this embodiment, the monologue phrases described in FIGS. 34A to 34G) (step S64). The control unit 11 performs speech output processing using the monologue utterance function based on the selected phrase (step S65).
[0249] When the control unit 11 determines that the vehicle is not in a moving state (step S63; NO), that is, when the control unit 11 determines that the vehicle is in a stopped state in this embodiment, it determines whether or not a dialogue process has already been performed on the same day (step S66). For example, this is because the number of dialogue processes is limited to a predetermined number of times per day in order to prevent an increase in the number of dialogue processes. When the control unit 11 determines that a dialogue process has already been performed on the same day (step S66; YES), it selects one phrase by lottery from the phrases of the monologue phrase utterance function, and performs speech output processing using the monologue utterance function based on the selected phrase (steps S64, S65).
[0250] If the control unit 11 determines that dialogue processing has not yet been performed on the same day (step S66; NO), it selects one phrase by lottery from phrases specifying the content of speech in the dialogue processing function (in this embodiment, the question phrases described in FIGS. 22A to 22K) and phrases in the monologue phrase utterance function (in this embodiment, the monologue phrases described in FIGS. 34A to 34G) (step S67). Next, the control unit 11 determines whether the selected phrase is a phrase specifying the content of speech in the dialogue processing function (i.e., a question phrase) (step S68). If the control unit 11 determines that the selected phrase is a phrase specifying the content of speech in the dialogue processing function (step S68; YES), it performs dialogue processing (step S69). The dialogue processing in this case may be the same as the processing from step S27 onwards in FIG. 16. If the control unit 11 determines that the selected phrase is not a phrase that specifies the content of the utterance in the dialogue processing function, the control unit 11 performs speech output processing because the selected phrase is a monologue phrase used in the monologue utterance function (step S65).
[0251] The number of dialogue processes per day does not have to be limited, in which case the process may skip step S66 and proceed to step S67. Furthermore, if the number of dialogue processes per day is limited to a predetermined number of times, such as two or more, the dialogue processes may be performed until the predetermined number of times is reached, and after that, speech output processing may be performed using the monologue speech function.
[0252] (M-5: Speech content of monologue phrase utterance function) The content (topic) of the speech content of the monologue phrase utterance function may be anything, but with reference to FIGS. 34A to 34G, examples include the following:
[0253] The control unit 11 may, for example, perform a speech related to vehicle driving in the speech output process. As such a speech, for example, there are phrases such as "People who can drive safely are really cool, aren't they? Ah, of course, you too." shown in FIG. 34A. By doing so, it is possible to make the user aware of the content related to vehicle driving through the interaction with the character. For example, it is possible to prompt the user to pay attention to safe driving. In addition to this, although the dialogue processing and phrases are different, there are phrases with the same content (topic) and different phrases. Also, the tone of the character's voice and the content of the phrases shall reflect the assumed personality of the character. For example, it shall reflect a strong personality.
[0254] <N: Ray's room display function> FIG. 36A is an example of a room screen IMG31, which is another example of the room screen displayed when entering Ray's room. In Ray's room, it is possible to set the Ray mode and check phrases, costumes, etc. Ray's room can be entered when the vehicle 40 is parked or not positioned (assuming operations at home, etc.). After entering, when the vehicle 40 starts to run, it will be forcibly returned to the normal screen. As shown in FIG. 36A, soft buttons corresponding to each of a plurality of menus are arranged on the room screen. Each menu enables the following functions.
[0255] Menu "My Data" · Set the birthday of the registered user. As a birthday event, a birthday phrase is played when the application of the electronic device 10 is started. · Register the home location information of the registered user. It is used to identify the location of the home in the work support function. · Register the workplace location information of the registered user. It is used to identify the location of the workplace in the work support function.
[0256] Menu "System Settings" · Set the startup screen. · Set the sensitivity of the G sensor.
[0257] Menu "Gallery" You can check the phrases and character motions that have been available so far.
[0258] Menu "Closet" You can check the costumes that have been available so far. For example, Fig. 36B(A) is an example of a screen corresponding to the display of Ray, and Fig. 36B(B) is an example of a screen corresponding to the display of Chibi Ray.
[0259] Menu "Status" You can check the user status. The status is as described in the section <L: Status display function>.
[0260] Menu "Item Storage" You can check the list, quantity, and effects of the items obtained so far. Fig. 36B(C) is an example of a screen corresponding to the item storage.
[0261] To display the room screen showing the room of Ray described above, the user may touch the touch sensor 191 while the normal screen is being displayed. When the control unit 11 receives this touch operation, it displays the menu screen shown in Fig. 36C. When the control unit 11 receives a touch operation on the menu corresponding to "Ray's Room" using the touch sensor 191, it may display the room screen shown in Fig. 36(A). In Fig. 36C, the menu corresponding to "Ray's Room" is grayed out because it is possible to enter when the vehicle 40 is stopped or not in a positioning state (assuming an operation at home, etc.). When it is possible to enter, the control unit 11 displays the menu corresponding to "Ray's Room" in the same manner as other menus and accepts touch operations.
[0262] The production by the character regarding the function of Ray's room is as shown in Figs. 37A to 37C.
[0263] Although not related to Ray's room display function, the electronic device 10 has functions for registering my area, registering a cancel area, adjusting the volume, zooming in / out the display, various settings, and switching modes (the Ray mode / normal mode mentioned above), and corresponding menus are arranged on the menu screen.
[0264] [2. About animation] 38A to 38D are diagrams illustrating the relationship between the animation (motion ID) used in the presentation when Rei is displayed as a character and the content of the animation (in this embodiment, the motion name, state, posture, and emotion). The motion ID corresponds to the character string described in the "Animation" column of the diagram illustrating the content of the character presentation, such as FIG. 6A. The motion name describes the character's movement (motion) expressed in the animation. The state describes the character's behavior, such as standing or warning. The posture is the character's posture. The emotion is the character's emotion, expressed, for example, by the character's facial expression. The estimated length indicates the duration of the animation. The classified motion indicates the classification of the motion, and "short" indicates an animation in which the time related to the character's movement (motion) is shorter than the others. FIG. 38E is a diagram illustrating Rei's facial expression (emotion) used in the animation. FIGS. 38F to 38I are diagrams illustrating the relationship between the animation (motion ID) used in the presentation when Chibi Rei is displayed as a character and the content of the animation (in this embodiment, the motion name, state, posture, and emotion). FIG. 38J is a diagram showing facial expressions (emotions) of Chibi Rei used in animation.
[0265] [3. Mechanism of Electronic Device 10] Next, the physical configuration of the electronic device 10 having the above functions will be described. The following description will focus on the physical configuration of the main body 101 of the electronic device 10. FIGS. 39 and 40 are diagrams showing the external configuration of the electronic device 10. FIG. 39(A) is a diagram showing the configuration of the electronic device 10 as viewed from diagonally above right on the front side. FIG. 39(B) is a diagram showing the configuration of the electronic device 10 as viewed from diagonally above left on the front side. FIG. 40(A) is a diagram showing the configuration of the electronic device 10 as viewed from diagonally below right on the rear side. FIG. 40(B) is a diagram showing the configuration of the electronic device 10 as viewed from diagonally above left on the rear side. FIG. 41 is a six-view diagram of the electronic device 10. FIG. 41 shows a front view, a top view, a right side view, a bottom view, a left side view, and a rear view of the electronic device 10.
[0266] The housing 103 is the housing of the main body 101. The housing 103 includes electronic components and other components. The housing 103 is formed by joining together a first housing 1031 located on the front side and a second housing 1032 located on the rear side.
[0267] The display unit 13, a touch sensor 191, and microphone holes 1033, 1034, and 1035 are provided on the front side of the first housing 1031. The display area of the display unit 13 and the touch sensor 191 are provided in a rectangular opening on the front side of the first housing 1031. The microphone holes 1033, 1034, and 1035 are each holes (through holes) opened in the first housing 1031. Here, the microphone holes 1033, 1034, and 1035 are cylindrical microphone holes. The microphone holes 1033, 1034, and 1035 may be made of any material that allows the user's voice to pass through, and may be provided with a mesh or other member.
[0268] An insertion opening 211 (i.e., an SD card slot) of the mounting section 21 for inserting an SD card is provided on the right side of the housing 103, at the boundary between the first housing 1031 and the second housing 1032. A plurality of holes 104 are formed in the top surface of the second housing 1032. A plurality of holes 107 are formed in the bottom surface of the second housing 1032, on both sides of the recess 105. The plurality of holes 104, 107 function as heat dissipation holes that dissipate heat inside the housing 103 to the outside.
[0269] The rear side of the second housing 1032 is provided with a lens holder 106, a lens 121, an illuminance sensor window 201, a power switch 222, a terminal portion 221, and a recess 105. The lens holder 106 is a through-hole that holds the lens 121. The lens holder 106 forms a window, which is an opening that allows communication between the inside and outside of the housing 103. When viewed from the rear side of the housing 103, the lens holder 106 has an elliptical shape with a major axis in the horizontal direction and a minor axis in the vertical direction. When the electronic device 10 is installed in a vehicle, the horizontal direction corresponds to the width direction of the vehicle, and the vertical direction corresponds to the height direction of the vehicle. The lens holder 106 has a radial dimension that increases toward the rear side, making it easier for oblique light to enter the lens 121. The lens holder 106 has a radial dimension that decreases toward the front side, and the portion that contacts the lens 121 is formed to match the shape and dimensions of the lens 121.
[0270] The lens 121 is fitted into the lens holder 106. The lens 121 is a condensing lens and corresponds to an incident portion into which the laser light from the speed measurement device 30 is incident. The lens 121 constitutes a part of the light receiving portion 12. The lens holder 106 and the lens 121 are provided above the center in the vertical direction and to the right of the center in the horizontal direction when viewed from the back side of the second housing 1032. In other words, the lens holder 106 and the lens 121 are arranged on the back side of the second housing 1032 at least above the center in the vertical direction and at least on the left side with respect to the traveling direction of the vehicle when viewed from the driver's seat side of the vehicle. This is because it may be easier to receive light from the speed measurement device 30 if the lens 121 is located relatively high on the back side of the second housing 1032 and on the side of the road where the speed measurement device 30 is likely to be located. The laser light Lout from the speed measuring device 30 is introduced into the housing 103 via the lens holder 106 and the lens 121 .
[0271] The entire lens 121 is formed using a material that transmits light. The lens 121 is transparent or translucent. The light incident surface of the lens 121 is aspherical. The lens 121 may be what is called an aspheric lens. The incident surface on the back side of the lens 121 is an aspherical curved surface. The incident surface is convex along the width direction of the vehicle 40. The incident surface protrudes most at the center in the width direction of the vehicle. The incident surface is also convex along the height direction of the vehicle. The curved surface protrudes most at the center in the height direction of the vehicle. The incident surface is, for example, parabolic, but may have any other shape as long as it is a surface consisting of a smooth curve. The length of the incident surface in the width direction of the vehicle is greater than the length in the height direction of the vehicle. The curvature of the curve of the incident surface is smaller than the curvature of the curve in the height direction of the vehicle. In this way, the incident surface of the lens 121 curves more gently in the width direction of the vehicle than in the height direction of the vehicle. On the other hand, the exit surface, which is opposite to the entrance surface and from which the light incident on the entrance surface exits, is, for example, a flat surface, although the exit surface may also be curved.
[0272] Because lens 121 is an aspherical lens, spherical aberration can be suppressed when forming an image on a light receiving element (light receiving element 123, described below) compared to when a spherical lens is used. The spot size obtained with an aspherical lens can be several orders of magnitude smaller than that of a spherical lens. Based on this concept, it is conceivable that the condenser lens may be realized by combining multiple lenses that have smaller spherical aberration than spherical lenses.
[0273] An illuminance sensor window 201 through which light enters the illuminance sensor of the sensor unit 20, and a power switch 222 are provided in the lower right portion of the second housing 1032 when viewed from the rear side. A terminal unit 24 is provided in the lower left portion of the second housing 1032 when viewed from the rear side. The terminal unit 24 is, for example, a terminal conforming to the miniUSB standard. A recess 105 is formed in the outer surface (i.e., the outer surface) on the rear side of the second housing 1032. In this embodiment, the recess 105 is located between the terminal unit 24 and the power switch 222 and in the center of the second housing 1032 in the left-right direction. The recess 105 forms a space that is open toward the rear side and downward. The recess 105 has a curved surface portion 1051, a flat surface portion 1052, a curved surface portion 1053, and a flat surface portion 1054. An attachment portion 1055 is further formed on the flat surface portion 1054.
[0274] The curved surface portion 1051 is formed in a smooth curved shape that forms the upper surface (ceiling surface) of the recess 105. The curved surface portion 1053 is formed inward of the curved surface portion 1051 and in a curved shape that is slightly smaller than the curved surface portion 1051 when viewed from the rear side of the second housing 1032. The curved surface portion 1053 is located closer to the front side than the curved surface portion 1051. Specifically, the front side end of the curved surface portion 1051 and the rear side end of the curved surface portion 1053 are connected by a flat portion 1052. The flat portion 1052 is a surface that is perpendicular (or nearly perpendicular) to the bottom surface of the electronic device 10. The flat portion 1052 is crescent-shaped when viewed from the rear side of the second housing 1032. The flat portion 1054 is connected to the front side end of the curved surface portion 1053 and is a surface that is perpendicular (or nearly perpendicular) to the bottom surface of the electronic device 10. The mounting portion 1055 formed on the flat portion 1054 is a portion to which the fixing portion 102 is attached (i.e., mounted). The mounting portion 1055 has a pair of grooves 1056, 1057 extending in the vertical direction. The electronic device 10 is attached to a vehicle using the fixing portion 102.
[0275] Fig. 42 is a diagram showing the external configuration of the fixed part 102. Fig. 42(A) is a diagram showing the fixed part 102 as viewed slightly to the right from the front. Fig. 42(B) is a diagram showing the fixed part 102 as viewed slightly to the left from the front.
[0276] The fixing part 102 includes a base part 1021, a socket part 1022, a ball stud 1023, and an attachment member 1024. The base part 1021 is attached to the dashboard of a vehicle. The bottom surface of the base part 1021 is attached to the dashboard using a fixing member 1020, such as an adhesive sheet or double-sided tape as disclosed in Japanese Patent No. 5958927. The base part 1021 includes a socket part 1022 having a space opening on the front side. A ball part of the ball stud 1023 is attached to the socket part 1022. The socket part 1022 and the ball stud 1023 attached to the socket part 1022 form a ball joint mechanism. When an external force is applied, the ball stud 1023 changes its position up, down, left, and right while attached to the socket part 1022. The attachment member 1024 is attached to the front side of the ball stud 1023. The mounting member 1024 is attached to the attachment portion 1055 of the electronic device 10. The mounting member 1024 has a pair of protrusions 1025, 1026 that protrude on both the left and right sides when viewed from the front. The protrusion 1025 protrudes toward the front side and also protrudes to the right when viewed from the front. The protrusion 1026 protrudes toward the front side and also protrudes to the left when viewed from the front. The protrusion 1025 is inserted into the groove 1056, and the protrusion 1026 is inserted into the groove 1057. Once attachment is complete, the electronic device 10 can change its position up, down, left, and right while attached to the fixing portion 102 in response to an external force. The user can point the electronic device 10 in a desired direction.
[0277] It has been found that this configuration allows the range in which the attitude of electronic device 10 can be changed, particularly in the forward and backward directions, to be wider than ever before. This is thought to be because recess 105 makes it less likely for main body 101 and fixing part 102 to interfere with each other, thereby widening the range of movement of mounting member 1024.
[0278] The configuration of the fixing unit 102 is not limited to this. For example, the mounting member 1024 may be configured to be able to change the height of the attached electronic device 10. The mounting member 1024 may be, for example, a curved arm-shaped member, and the mounting orientation may be rotated 180 degrees in the vertical direction, thereby changing the height of the electronic device 10.
[0279] FIG. 43 is a diagram showing the internal configuration of the electronic device 10 as seen from the front side. FIG. 43(A) shows the electronic device 10 with the first housing 1031, the display unit 13, and the touch sensor 191 removed. A first substrate 301 is disposed inside the first housing 1031. The substrate surface of the first substrate 301 is approximately parallel to the display area of the display unit 13. A processor 3021 is mounted on the first substrate 301. The processor 3021 is provided, for example, on the rear side of the first substrate 301. The processor 3021 may be equipped with electronic components that realize the functions of the control unit 11, the memory unit 25, and other components described above. A microphone 192 is provided below the first substrate 301. The microphone 192 is provided on the rear side of one of the microphone holes 1033, 1034, and 1035 (for example, the microphone hole 1033) and detects sound that passes through this microphone hole. Therefore, other microphone holes (for example, microphone holes 1034 and 1035) are actually dummy microphone holes (dummy microphone holes) that are not used as transmission paths for sounds detected by microphone 192. By providing such dummy microphone holes (dummy microphone holes), it is possible to prevent a foreign object from being inserted into a microphone hole for detecting the user's voice, thereby preventing the foreign object from getting caught in the microphone hole or damaging microphone 192.
[0280] FIG. 43(B) shows a state in which the first substrate 301 has been removed from the state shown in FIG. 43(A). FIG. 44 is a diagram showing a state in which the shield case 125 has been removed from the state shown in FIG. 43(B). As shown in FIGS. 43(B) and 44, a second substrate 302 is disposed inside the first housing 1031. The second substrate 302 is provided on the rear side of the first substrate 301. The substrate surface of the second substrate 302 is substantially parallel to the substrate surface of the first substrate 301 and the display area of the display unit 13. The GPS module 172 (GPS receiving circuit) of the position information acquisition unit 17, the shield case 125, and the attachment unit 21 are mounted on the front side of the second substrate 302. The shield case 125 is provided on the front side of the second substrate 302 and covers the entire light receiving element 123. The shielding case 125 is made of, for example, a conductive material (e.g., metal) and is a member for preventing the light receiving element 123 from generating noise due to the influence of external electromagnetic waves. The source of the electromagnetic waves is an electrical component such as a drive unit that drives the wipers provided on the vehicle 40. The light receiving element 123 receives light and outputs a signal according to the received light (e.g., the amount of received light). The light receiving element 123 is preferably, for example, a photodiode, but may also be a phototransistor or other light receiving element. The light receiving element 123 should preferably be sensitive to at least the infrared light region.
[0281] FIG. 45 is a diagram illustrating the internal configuration of the electronic device 10 as viewed from the rear side. FIG. 45(A) illustrates the electronic device 10 with the second housing 1032 removed. FIG. 45(B) illustrates the electronic device 10 with the lens 121 removed from the state illustrated in FIG. 45(A). The lens 121, wavelength selection unit 122, and shield plate 124 are mounted on the rear substrate surface of the second substrate 302 as components of the light receiving unit 12. The wavelength selection unit 122 selects the wavelength of light to be received by the light receiving element 123 and transmits that wavelength. The wavelength selection unit 122 is, for example, a visible light cut filter that cuts light in the visible light range. The wavelength selection unit 122 may have any configuration and may be removed. The shield plate 124 is, for example, a shield made of aluminum or a conductive material. The shield plate 124 is provided in an area surrounding three of the four sides of a rectangular through-hole provided in the second substrate 302. The shield plate 124 is intended to suppress the effects of static electricity and the like on the light receiving element 123 and other electronic components. The through-hole is an example of a light-transmitting portion that transmits light received by the light receiving element 123 from the back side to the front side of the second substrate 302. This allows the light receiving element 123 to receive light that has passed through the lens 121 and the wavelength selection unit 122. By arranging the light receiving element 123 on the front side of the second substrate 302, shielding can be achieved more reliably using a simple method, and since there is a space between the light receiving element 123 and the lens 121 equivalent to the thickness of the second substrate 302, the space equivalent to the focal length can be effectively used. As a result, this also contributes to achieving a more compact housing 103 as a whole.
[0282] Furthermore, it is preferable to position the light receiving element 123 at a position shorter than the focal length of the lens 121, rather than at the focal length. Because the lens 121 has a small curvature and bends light significantly, light around the lens 121 tends to gather near the center of the optical axis in front of the focal length. By positioning the light receiving element 123 in front of the focal length, more light can be collected. Furthermore, light coming from a steep angle also passes near the center of the optical axis in front of the focal length. By positioning the light receiving element 123 in front, light with a wide incident angle can be received. The lens 121 has a characteristic that allows it to detect pulsed light from the speed measurement device 30 even if it is weak. This allows the electronic device 10 to detect the presence of the speed measurement device 30 over an ultra-wide range and long distances, and to quickly report its presence.
[0283] The second substrate 302 further includes a GPS antenna 171 of the position information acquisition unit 17, an audio output unit 14, a battery 224, an illuminance sensor window 201 of the sensor unit 20, a power switch 222, a radar receiver 15, a wireless receiver 16, and an electric double layer capacitor 223 (also referred to as a supercapacitor) mounted on the rear substrate surface. The GPS antenna 171 is provided to the left of the lens 121, the wavelength selection unit 122, and the shield plate 124 when viewed from the rear, and receives signals from GNSS satellites. The audio output unit 14 is provided to the left of the GPS antenna 171 when viewed from the rear. The battery 224 is, for example, a button battery and is provided below the lens 121, the wavelength selection unit 122, and the shield plate 124. The battery 224 is an internal power source for minimum operations, such as timekeeping in the timer unit and acquisition of position information by the position information acquisition unit 17, even when the electronic device 10 is powered off. The illuminance sensor window 201 and the power switch 222 are provided further below the battery 224. The radar receiver 15 and the wireless receiver 16 are provided to the left of the battery 224, the illuminance sensor window 201, and the power switch 222 when viewed from the rear side.
[0284] The electric double layer capacitor 223 is provided to the left of the radar receiving unit 15 and the radio receiving unit 16 when viewed from the rear side, and is located in the lower left part of the second board 302. For example, even if the power supply to the electronic device 10 is cut off at an unintended timing, the electric double layer capacitor 223 enables the control unit 11 to receive power from the electric double layer capacitor 223 and perform processing to prevent operational malfunctions such as file corruption (protect the file system) caused by the power cut off. The electric double layer capacitor 223 is charged at a predetermined timing. For example, the control unit 11 may perform power control to charge the electric double layer capacitor 223 when the power is turned on, etc.
[0285] The electric double layer capacitor 223 is cylindrical and larger than the other electronic components. Therefore, the second housing 1032 has a sloped back surface so that the portion where the electric double layer capacitor 223 is provided is thicker than the portion where the light receiving unit 12 is provided. This allows the light receiving unit 12, which receives the laser light from the speed measurement device 30, to be appropriately configured by, for example, using the same construction as a conventional product, while still allowing the relatively large electric double layer capacitor 223 to be housed below the light receiving unit 12. Furthermore, the back side of the second housing 1032 is formed into a curved surface that smoothly protrudes from top to bottom toward the rear, thereby contributing to ensuring the aesthetic appearance of the main body 101.
[0286] [Variations] The present disclosure is not limited to the above-described embodiments, and can be modified as appropriate within the scope of the present disclosure.
[0287] (1) The control unit 11 may change the screen displayed on the display unit 13 during the startup process depending on the current level of intimacy. For example, the control unit 11 may select and display one of the screens depicting Rei wearing costumes that have already been obtained. The selection may be made randomly, for example. The control unit 11 may change the screen displayed on the display unit 13 during the startup process depending on the current time (for example, month or season) and other circumstances.
[0288] In the startup process, immediately after the application is started, the control unit 11 may output a startup phrase such as "Ray, starting up!" in the voice of a predetermined character. The startup phrase can be selected randomly from the time the application is started, and the voice of various characters can be output.
[0289] (2) The indicator value L may be calculated by the following equation (11).
number
[0290] As explained above, x is the distance traveled, with a maximum of 100 km recommended. Sf is the favorability coefficient, with a standard value of 1 and a maximum of 10 for 10 minutes when favorability is increased. Sv is the safe driving coefficient for speeding (i.e., speeding penalty points), with a standard value of 0. A value corresponding to the speeding (Vover) is deducted from the distance traveled (x) every second. Sd is the safe driving coefficient (dangerous driving penalty points) based on Ray's number of falls, with a standard value of 0. A value corresponding to the number of falls (Nr) is deducted from the distance traveled (x) for each fall. Sp is the safe driving coefficient for stop sign violations (stop sign violation penalty points), with a standard value of 0. A value corresponding to the number of temporary violations is deducted from the distance traveled (x) for each fall. τs is the safe driving time constant, calculated by multiplying Gs, the difficulty parameter based on G-sensor sensitivity (G-sensor difficulty coefficient), the favorability coefficient (Sf), and the adjustment parameter (Lx). Gs increases as the G-sensor sensitivity increases, and decreases as the G-sensor sensitivity decreases. Lx is a fixed value of 3000. For example, when Gs = 3 and Sf = 1, τs = 3000, and the distance traveled from when the accessory power was turned on to when it was turned off is 30 km, the indicator value L changes from 0% to 63% of its maximum value. In this way, the period until the intimacy level reaches its maximum value may be desirable for users and businesses that manufacture and sell electronic device 10.
[0291] Furthermore, the indicator value L in the dialogue processing function can be raised or lowered to 100% for affirmative, -100% for negative, -200% for ignored, and 0% for undetermined. In this way, as explained in "(M-4) Relationship between monologue phrase utterance function and dialogue processing function," since the number of dialogue processes is limited to a maximum of once per day, whether the opportunity is made good or lost depends on the user's response, and this can increase the effect of events in the dialogue processing function.
[0292] (3) As another display form of the indicator image described above, an indicator image 210A shown in FIG. 46(A) may be used. The indicator image 210A is an image resembling a heart, since the indicator value L is an indicator of the relationship between the user and Ray. FIG. 46(B) is a diagram explaining a method of displaying an indicator value using the indicator image 210A. When the indicator value L is "0", the indicator image 210A is an image in which the inside of the outline is not filled in and is transparent (i.e., the background (e.g., a map area) is displayed). When the indicator value L is "+0.5", the indicator image 210A is an image in which half of the inside of the outline is filled in and the other half is not filled in and is transparent. The larger the indicator value L, the larger the filled area becomes, and when it is "+1.0", the entire inside of the outline is filled in. When the indicator value L is "-0.5", the indicator image 210A is an image in which half of the outline is displayed and the other half is hidden and is transparent. The smaller the indicator value L, the larger the area that is hidden; in the case of "-1.0", the entire or most of the contour is preferably hidden.
[0293] Figure 47 shows a screen display according to this modified example. Figure 47(A) is an example of a normal screen. Figure 47(B) is an example of a character presentation using animation related to the alarm function, showing the screen at the point when Ray's ears are growing during his transformation. Figure 47(C) is an example of an alarm screen displayed after Figure 47(B).
[0294] (4) In the process of recognizing a user's response in the dialogue process, the control unit 11 recognizes the user's response by comparing the user's response with dictionary data corresponding to the selected utterance. The dictionary data used in this case is preferably prepared as individual dictionary data for each of the multiple utterances (i.e., multiple question phrases) in the dialogue process. Diversifying the question phrases will also diversify the user's responses. However, if common dictionary data is used to identify possible responses to multiple question phrases, the number of comparisons between the response and the dictionary data will increase, which may result in an increase in the time required for the response recognition process. Therefore, the inventor first considered preparing dictionary data based on FIG. 48(A).
[0295] FIG. 48(A) shows the structure of a user's response to the question phrase "Hey, don't you think it's about time you turned me into an anime?" The user's response is broadly divided into a subject, modifier 1, modifier 2 (positive modifier / negative modifier), and predicate. Multiple response options are possible for each of the subject, modifier 1, modifier 2 (positive modifier / negative modifier), and predicate (positive predicate / negative predicate), and there may even be parts where no response is present. Therefore, the inventors devised a system in which dictionary data corresponding to each of the subject, modifier 1, modifier 2 (positive modifier / negative modifier), and predicate (positive predicate / negative predicate) is prepared, and the combination of modifier 2 and the predicate determines whether the response is positive or negative. This system has the advantages of allowing for a high degree of freedom in combinations and making it easy to recognize longer colloquial speech due to the large number of breaks.
[0296] On the other hand, there are problems such as the increasing complexity and quantity of dictionary data, and the existence of combinations that are strange in Japanese, so the inventors have devised the following method.
[0297] As shown in Figure 48(B), the inventors came up with the idea of preparing dictionary data corresponding to each of the subject, modifier, and predicate, and determining whether the response content is positive or negative. In Figure 48(B), a "P" at the end of the predicate indicates a positive response, and an "N" at the end of the predicate indicates a negative response. The inventors discovered that using such dictionary data makes it possible to recognize predicates only, subjects + predicates, and subjects + modifiers + predicates. In addition, by adding an identifier to the predicate, either "P" indicating a positive response or "N" indicating a negative response, the software's determination can be simplified.
[0298] 49 and 50 show dictionary data for other question phrases. Thus, dictionary data corresponding to each subject, modifier, and predicate is prepared for each question phrase. If there are two or more question phrases for which the user's response content is similar, it may be possible to share the same dictionary data for those two or more question phrases.
[0299] In this way, by preparing dictionary data for each question phrase, even if the number of possible utterances made by a character in dialogue processing is increased, when recognizing a user's response, the recognition is based on dictionary data corresponding to the utterance actually selected, thereby shortening the process for recognizing the user's response and suppressing delays in subsequent processing. For example, after recognizing a user's response, when further utterances are made or information is output in response to that response, the user is less likely to get the impression that the system's response is slow.
[0300] Furthermore, by using the dictionary data described above, a variety of responses can be considered from the user in the dialogue processing, but parts of the user's response that are irrelevant to the system's judgment of whether the content of the utterance is positive or negative (for example, the subject or modifiers that are not necessary for the judgment) are not used in the judgment, and the judgment is made based on a combination of affirmative or negative modifiers and predicates extracted from the content of the user's response.This shortens the processing time for recognizing the user's response, suppresses delays in subsequent processing, and improves the accuracy of the judgment.
[0301] (4) The following may be done to reduce the size of dictionary data used for voice recognition. The electronic device 10 has a function of performing voice recognition using a voice recognition engine shared with an external communication terminal, such as a smartphone, and a function of controlling the behavior of the electronic device 10, such as the behavior of a character, based on the results of this voice recognition. The size of the dictionary data used in the electronic device 10 to achieve the same behavior should be smaller than the size of the dictionary data used in the communication terminal. This reduces the amount of resources required in the electronic device 10, reduces the price of the electronic device 10, and enables control using the communication terminal for recognition when voice recognition is insufficient.
[0302] Such electronic device 10 is a system that has a function of performing voice recognition using a voice recognition engine common to a communication terminal (e.g., a smartphone) and an in-vehicle device, and a function of controlling the actions of a character or the like based on the results of voice recognition using a voice recognition dictionary, and can be understood as an example of a system in which the size of the voice recognition dictionary used in the in-vehicle device to achieve the same action is smaller than the size of the voice recognition dictionary used in the communication terminal. In this way, the amount of resources required in the in-vehicle device can be reduced, thereby keeping the price of the in-vehicle device down, and when voice recognition is insufficient, it is possible to realize control by using the communication terminal to recognize the voice.
[0303] (5) The following configuration may be provided as a method for reducing the possibility of application 252 crashing. Electronic device 10 is a system that performs processing based on the current location indicated by location information acquired by location information acquisition unit 17 (or the current location identified by location identification means), and includes a function for recording a history of the current location and a function for reproducing the history of the current location and using it as the current location instead of the current location indicated by the location information acquired by location information acquisition unit 17. The current location history is recorded on a removable storage medium, such as an external storage medium attached to attachment unit 21, while the function for reproducing the history of the current location and using it as the current location does not directly use the history on the removable storage medium in the processing based on the current location, but rather uses history copied from the removable storage medium to a predetermined storage unit within the system (e.g., RAM connected to SoC constituting control unit 11). The copied history may be used, for example, before the processing based on the current location begins, such as when the system is started. The processing based on the current location may include, for example, a process for writing the history to a removable storage medium other than the one used for recording the history. By doing this, the recording medium can be removed from the system and the operation can be verified by referring to the history on another computer, etc., and the impact on processing caused by accessing the removable recording medium when performing processing based on the recorded history can be reduced.
[0304] (6) The following configuration may be provided as a method for reducing the possibility of the application 252 crashing. The electronic device 10 may periodically release memory resources. For example, the control unit 11 may release resources every 30 minutes, but may not release resources while a phrase is being executed, an alarm is being issued, or voice recognition is being performed, and may recheck after 5 minutes.
[0305] (6-1) For example, the electronic device 10 may be a system having a function for performing a process of displaying characters together with a map, and a function for performing garbage collection by a garbage collector to automatically release memory during the process, and may have a function for forcibly performing garbage collection at predetermined time intervals, and a function for skipping the execution of garbage collection at predetermined time intervals during event processing such as during phrase execution, alarm execution, voice recognition, etc.
[0306] Unity uses C# as its programming language. C# has garbage collection (GC), and unlike C, C# does not require the programmer to explicitly free memory. Unlike Rust, which manages memory through ownership statements that eliminate the need for GC or explicit memory freeing, C# also has GC. GC occurs when memory capacity is running low. In a system that displays maps and characters, GC can occur at the exact moment additional memory is allocated to update the map and characters (for example, at that very moment). This results in CPU execution time being allocated for GC processing, which can significantly slow down the rendering of maps and characters or cause the appearance of dropped frames. On the other hand, if GC is executed during event processing, the event processing that should be processed at that time will be delayed by the GC processing. Even in such cases, the above configuration can mitigate or resolve these issues.
[0307] (6-2) To prevent sudden frame rate drops due to GC spikes, it is recommended to perform the configuration in (6-1) after enabling incremental GC.
[0308] (7) It is advisable to add a periodic data saving process (for example, saving status and settings every 60 minutes) to prevent data from being saved if the application 252 crashes. The electronic device 10 may perform the periodic saving process every predetermined distance, such as every 100 km. The periodic saving process may be, for example, a process of writing the game status (for example, intimacy level) to the serial flash. Saving the game status to the serial flash is intended as a backup in case the data cannot be restored due to damage to the storage or other reasons. If the storage is damaged, the OS will need to be reprogrammed, so it is expected that the data will be read when the electronic device 10 is repaired, rather than for recovery by the customer.
[0309] Such electronic device 10 is an in-vehicle device having a function of recording information relating to character control based on the user's usage history, etc., and can be understood as an example of a system having a function of recording information indicating the relationship between the character and the user (such as intimacy) on a removable recording medium for the in-vehicle device at predetermined intervals, for example, and also recording information indicating the relationship between the character and the user on non-volatile storage means provided inside the in-vehicle device at predetermined intervals, for example. The character may be updated through interactions between the character and the user.
[0310] (8) The electronic device 10 may be a system that performs a process of lowering a predetermined value (e.g., an indicator value or a coefficient for calculating the indicator value) when the vehicle 40 exceeds the speed limit, and may be a system that treats a predetermined speed higher than the speed limit of a location where the speed limit is less than the predetermined speed limit as the speed limit. For example, to prevent the indicator value from dropping too much on expressways such as the Shuto Expressway, the speed limit may be fixed at 80 km / h when it is less than 80 km / h. This can improve the functionality of the electronic device 10, for example, improving the gameplay.
[0311] (9) If a specific file is not located directly under the external storage medium of the storage unit 25, the driving log function of the electronic device 10 may be disabled, i.e., modified so that data related to the driving history is not saved. Such an electronic device 10 can be understood as an example of a system having a function for recording a log related to the operation of the in-vehicle device on a removable storage medium and a function for not recording the log if a specific file is not located in the root of the storage medium. This improves the functionality of the electronic device 10, and, for example, allows for control over whether or not to record a log by whether or not to place a specific file in the root of the storage medium.
[0312] (10) The time of the OS 251 should be updated only once after the time is determined. Such electronic device 10 is a system that performs predetermined processing using time acquired from a GPS or the like, and is equipped with an OS. The time of the OS is updated once when time acquisition from the GPS is completed while the system power is maintained. This can be understood as an example of a system that does not update the time of the OS while the system power is maintained, even if the OS can acquire time from the GPS.
[0313] (11) Regarding the alarm function, in order to solve the problem of initiating an alarm for a passed target object (e.g., a warning POI), the following may be done: The electronic device 10 may store information about passed targets based on the relationship between the current position and the target position, and when selecting targets to be warned, the stored passed targets may not be included in the alarm.
[0314] (12) Regarding the alarm function, to solve the problem that the distance to the target does not become 0 m when the target is passed, the following may be done: The electronic device 10 has a function to display the distance between the current position and the selected target, and for a target that is determined to have been passed based on the relationship between the current position and the target position, the distance may be output as 0 m even if the actual calculated distance between the current position and the selected target is not 0 m.
[0315] (13) Regarding the alarm function, in order to solve the problem of not notifying of a checkpoint when a control point and a checkpoint are adjacent to each other, the electronic device 10 may be provided with a function to also notify of a checkpoint when a control point and a checkpoint are adjacent to each other.
[0316] (14) The electronic device 10 is a system having a function for simultaneously displaying two or more of the same character in different costumes on a screen other than the opening screen or the like during transformation, and it is preferable that the system performs processing so that two of the same character are not simultaneously displayed when the character transforms into different costumes.
[0317] (15) As a countermeasure to the problem of the boot animation being displayed at high brightness when the electronic device 10 is shut down during the day and started up at night, it is advisable to set the same brightness as that used for the boot animation when shutting down. Such electronic device 10 can be understood as a system having a function to adjust the display brightness according to the illuminance around the device detected by an illuminance sensor, and a system having a function to set the brightness of the screen displayed at least either at boot time or at shutdown time to a predetermined value that is not dazzling even at night, regardless of the illuminance around the device detected by the illuminance sensor.
[0318] (16) As a countermeasure to the issue of the frame rate decreasing, the following method can be used to counter the issue of the contents of the skirt worn by the character being visible. Electronic device 10 is a system equipped with a function for displaying a character, and can be understood as an example of a system that controls the rendering of a character so that the contents of the skirt are not visible when processing to move the character or the camera.
[0319] (17) With regard to the alarm function, the electronic device 10 may notify the user by using a caption and a phrase when the vehicle is stopped in a target area or a no-parking area. This makes it easier for the user to understand the target area or the no-parking area.
[0320] (18) The electronic device 10 may have a function to fade out sound when the power is turned off. The sound to be faded out may be Ray's speech. In this way, the user can feel as if they are saying goodbye to Ray when the power of the electronic device 10 is turned off.
[0321] (19) When the terminal unit 24 and an OBD-II connector mounted on the vehicle 40 are connected via a cable, the control unit 11 of the electronic device 10 may display OBD screens such as those shown in FIGS. 51(A) to 51(C) as screens for displaying information acquired from the OBD-II connector. The user may be able to set which OBD screen from FIGS. 51(A) to 51(C) to display (e.g., by using the "Settings" button on the menu screen shown in FIG. 36C). Each OBD screen displays information acquired from the OBD-II connector in the left area, and an image of a weapon resembling a gun in the right area. This gun-like weapon is one that Ray may possess, for example, when wearing a combat uniform. FIGS. 52(A) to 52(C) provide explanations of the information displayed on each OBD screen of FIGS. 51(A) to 51(C), respectively.
[0322] (20) Some of the configurations and operations described in the above embodiments may be omitted or modified. Furthermore, various modifications are possible with regard to the specific display content, parameters, and processing methods (e.g., calculation formulas and the format of data handled).
[0323] (21) The dialogue processing performed by the dialogue processing function, the monologue phrase utterance function, and other functions installed in the electronic device 10 may be installed in an electronic device other than an electronic device used in a vehicle. The electronic device may be, for example, an electronic device installed in a home, office, or other facility for monitoring or security purposes. The electronic device may be a robot-type device with an appearance that resembles a person, animal, or virtual creature. The electronic device may be an electronic device that the user can carry, such as a smartphone or tablet computer. Furthermore, even in an electronic device other than an electronic device used in a vehicle, it is possible to implement the above-described embodiment by replacing the vehicle's driving with the user's movement, or by replacing the period from when the accessory power is turned off until it is next turned on with a period during which the user did not use the electronic device (for example, a period during which an application was not running, or a period during which the electronic device was turned off).
[0324] The scope of the present invention is not limited to the structures explicitly described in the specification, but also includes combinations of various aspects of the present invention disclosed herein. The structures of the present invention that are sought to be patented are specified in the appended claims, but it is the intention of the present inventors to claim structures disclosed in this specification in the future, even if they are not currently specified in the claims.
[0325] The present invention is not limited to the configurations described in the above-described embodiments. The components of each of the above-described embodiments and variations may be arbitrarily selected and combined. Furthermore, any component of each embodiment or variation may be arbitrarily combined with any component described in the Summary of the Invention or any component embodying any component described in the Summary of the Invention. The present invention also intends to obtain rights to these configurations through amendments or divisional applications of the present application. Even if a description is made of "in the case of..." or "when...," it is not intended to describe a configuration limited to that case or time. Configurations that are not limited to those cases or times are also disclosed, and the present invention intends to obtain rights to them. Furthermore, any descriptions that specify an order are not limited to this order. Configurations in which some parts are deleted or the order is changed are also disclosed, and the present invention intends to obtain rights to them.
[0326] Furthermore, we intend to obtain rights to the overall design or partial design by converting the application to a design registration. The drawings depict the entire device in solid lines, but they also include partial designs claimed for parts of the device. For example, a partial design can be a partial design for a part of the device, or a part of that part. A partial design can be a part of the device, or a part of that part. We intend to obtain rights not only for the overall design, but also for partial designs in which any part of the solid line portion of the drawing is drawn as a broken line. Furthermore, the modules, components, and parts inside the device's casing, all of which are shown in the drawings, are subject to independent commerce, and we intend to similarly obtain rights by converting the application to a design registration. [Explanation of symbols]
[0327] 10:Electronic equipment 11: Control section 12: Light receiving part 13: Display section 14: Audio output section 15: Radar receiver 16: Wireless receiver 17: Location information acquisition section 18: Communications Department 19: Input section 20: Sensor section 21: Mounting part 22: Power supply section 23: Light-emitting part 24:Terminal section 25: Storage section 40: Vehicle 50:Detection device 60:Detection device 101: Main body 102:Fixed part 103: Housing 104: Hole 105: Recess 106: Lens holder 107: Hole 121: Lens 122: Wavelength selection unit 123: Photodetector 124: Shield plate 125: Shield case 171: GPS antenna 172: GPS module 191: Touch sensor 192: Microphone 200: Character 201: Illuminance sensor window 210: Indicator image 211: Insertion port 220: Intimacy image 221:Terminal section 222: Power switch 223: Electric double layer capacitor 224 :Battery 230: Notification information 252: Application 253: Display data 254: Intimacy data 255: Setting data 256: Phrase data 257: Item data 300: Map 301: First substrate 302: Second substrate 1020: Fixing member 1031: First enclosure 1032: Second enclosure 1033: Microphone hole 1034: Microphone hole 1035: Microphone hole 1055: Mounting part 3021: Processor
Claims
1. An electronic device comprising a control unit, the control unit having a function of establishing a predetermined relationship between an indicator value and a speech interval determined based on the indicator value, and determining the speech interval in accordance with the indicator value.
2. 2. The electronic device of claim 1, wherein the indicator value is a current indicator value.
3. 3. The electronic device according to claim 1, wherein the lower limit of the speech interval is five minutes regardless of the indicator value.
4. The electronic device according to claim 1 , wherein the upper limit of the speech interval is set to be smaller as the indicator value is larger.
5. The electronic device according to claim 1 , wherein the speech interval is determined randomly from the range between the lower limit and the upper limit.
6. The electronic device according to claim 1 , further comprising a function of outputting an indicator image based on an indicator value.
7. 7. The electronic device according to claim 6, wherein the indicator value is an index relating to a character based on the user's driving, and also serves as an index of the user's safe driving.
8. A program for causing a computer to implement the functions according to any one of claims 1 to 7.
Citation Information
Patent Citations
System and program
JP2013169873A