Information processing device, information processing method, and information processing program

Abstract

An information processing device (100a) of the present disclosure is provided with: an acquisition unit (132) that acquires content information to be output into a moving body; and an output control unit (133a) that causes the content information to be output when the type of the content information satisfies an output condition corresponding to the current condition of a passenger of the moving body. Furthermore, if the output condition was unsatisfied and the content information could not be output, the output control unit (133a) causes interrogation information to be output for obtaining permission from the passenger of the moving body to output the content information, within an allowable scope where output of the content information is allowed.

Description

Information processing device, information processing method, and information processing program

[0001] The present disclosure relates to an information processing device, an information processing method, and an information processing program.

[0002] Conventionally, techniques have been proposed for providing information by voice without causing discomfort to users.

[0003] JP 2017-67852 A

[0004] However, in the above-mentioned conventional technology, after detecting the end of the user's conversation in the vehicle, the system waits for a waiting time to elapse before starting to provide audio information, so the user's conversation is not interrupted, but information whose presentation period has expired during the waiting time is not presented. Therefore, the above-mentioned conventional technology has room for improvement in terms of providing useful information to users.

[0005] The present disclosure has been made in view of the above, and proposes an information processing device, an information processing method, and an information processing program that can provide useful information to users.

[0006] The information processing device described in claim 1 comprises an acquisition unit that acquires content information to be output within a vehicle, and an output control unit that outputs the content information if the type of content information satisfies output conditions according to the current situation of the occupant of the vehicle, and if the output conditions are not satisfied and the content information is not output, the output control unit outputs call information to obtain permission to output the content information from the occupant of the vehicle within an allowable range within which output of the content information is permitted.

[0007] The information processing method described in claim 9 is an information processing method executed by an information processing device, and includes an acquisition step of acquiring content information to be output within a mobile body, and an output control step of outputting the content information if the type of the content information satisfies output conditions according to the current situation of the occupant of the mobile body, and if the output conditions are not satisfied and the content information is not output, the output control step outputs call information to obtain permission to output the content information from the occupant of the mobile body within an allowable range within which output of the content information is allowed.

[0008] The information processing program described in claim 10 is an information processing program executed by an information processing device, which causes the information processing device to execute an acquisition procedure for acquiring content information to be output within a mobile body, and an output control procedure for outputting the content information if the type of the content information satisfies output conditions according to the current situation of the occupant of the mobile body, and if the output conditions are not satisfied and the content information is not output, the output control procedure causes the information processing device to output call information to obtain permission to output the content information from the occupant of the mobile body within an allowable range within which output of the content information is allowed.

[0009] FIG. 1 is a diagram illustrating an example of a system according to an embodiment. FIG. 2 is a diagram illustrating an example of the configuration of each device according to the first embodiment. FIG. 3 is a diagram illustrating an example of an output determination table according to the embodiment. FIG. 4 is a diagram illustrating an example of a content information storage unit according to the embodiment. FIG. 5 is a flowchart illustrating a procedure of output control processing according to the first embodiment. FIG. 6 is a diagram illustrating an example of a content information storage unit according to a modified example of the first embodiment. FIG. 7 is a diagram illustrating an example of the configuration of each device according to a second embodiment. FIG. 8 is a flowchart illustrating a procedure of output control processing for outputting unoutputted content. FIG. 9 is a flowchart illustrating a procedure of update processing for updating output conditions. FIG. 10 is a diagram illustrating an example of the configuration of each device according to a third embodiment. FIG. 11 is a flowchart illustrating a procedure of output control processing according to the third embodiment. FIG. 12 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the in-vehicle device 100.

[0010] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. Note that the information processing device, information processing method, and information processing program according to the present disclosure are not limited to these embodiments. Furthermore, the same components in the following embodiments will be designated by the same reference numerals, and duplicated descriptions will be omitted.

[0011] <Overview of the embodiment> [1. System configuration] First, the configuration of a system according to the embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of a system according to the embodiment. Fig. 1 shows a system 1 as an example of a system according to the embodiment. Various output control processes according to the embodiment may be realized in the system 1.

[0012] 1, the system 1 may include an in-vehicle device 100 and a server device 200. The in-vehicle device 100 and the server device 200 may be communicably connected via a network N by wire or wirelessly. The information processing system 1 shown in FIG. 1 may include any number of in-vehicle devices 100 and any number of server devices 200.

[0013] 2. Overview of Devices Included in the System (Regarding the In-Vehicle Device 100) The in-vehicle device 100 is an example of an information processing device according to an embodiment of the present disclosure, and is a central device that performs output control processing according to the embodiment. As shown in FIG. 1, the in-vehicle device 100 may be a dedicated navigation device that is built into or mounted on the vehicle VEx.

[0014] For example, the in-vehicle device 100 may be configured with a navigation device and a recording device. As one example, the in-vehicle device 100 may be a composite device in which a navigation device and a recording device are independent of each other and connected to each other so as to be able to communicate with each other. As another example, the in-vehicle device 100 may be a single device having both a navigation function and a recording function.

[0015] The in-vehicle device 100 may also include various sensors. For example, the in-vehicle device 100 may include various sensors such as a camera, an acceleration sensor, a gyro sensor, a GPS (Global Positioning System) sensor, and an air pressure sensor. For this reason, the in-vehicle device 100 may also have a function of providing dialogue and information to assist the user (e.g., an occupant of the vehicle VEx) in driving based on sensor information acquired by the various sensors.

[0016] Furthermore, the in-vehicle device 100 can use not only the sensors provided in the device itself, but also sensor information detected by sensors provided in the vehicle VEx itself as a safe driving system.

[0017] In addition, by installing specific application software into a portable terminal device (e.g., a smartphone, tablet terminal, notebook PC, PDA, etc.) that a user uses on a daily basis, the portable terminal device can be made to operate in the same manner as the in-vehicle device 100.

[0018] Here, an outline of the output control process executed by the in-vehicle device 100 will be given. For example, the in-vehicle device 100 outputs content information when an output condition according to the current situation of the occupant CWx of the vehicle VEx is satisfied.

[0019] For example, the in-vehicle device 100 identifies the interior situation of the vehicle VEx, i.e., the current situation of the occupant CWx, based on audio information collected by a microphone, images captured by a camera, the behavior of the vehicle VEx detected by a sensor, the attributes of the road on which the vehicle VEx is traveling detected by a sensor, etc. Then, the in-vehicle device 100 determines whether it is preferable to refrain from outputting the content information by matching a pair of the identified situation of the occupant CWx and the type of content information provided by the server device 200 to an output determination table described later.

[0020] For example, when the in-vehicle device 100 determines that it is not necessary to refrain from outputting the content information (when the output conditions are satisfied), it outputs the content information by voice. At this time, the in-vehicle device 100 may display an image indicating the content information in addition to the voice. On the other hand, when the in-vehicle device 100 determines that it is necessary to refrain from outputting the content information (when the output conditions are not satisfied), it suspends output of the content information.

[0021] Situations in which it is preferable to refrain from outputting content information include when occupant CWx is driving a vehicle under heavy load, when occupant CWx is having a conversation, when occupant CWx is on a phone call, when occupant CWx is concentrating on his / her favorite music, etc.

[0022] Furthermore, the in-vehicle device 100 also executes various output controls as described below, based on the output control process described above.

[0023] In the first embodiment, when the in-vehicle device 100 (in-vehicle device 100a described later) does not output content information because the output conditions are not met, it calls out to the occupant CWx within the allowable range in which the output of content information is permitted, and controls the output of the content information according to the response of the occupant CWx to the call.

[0024] The call information used for the call by the in-vehicle device 100 includes multiple meanings depending on the purpose. Specifically, the call information is output for the purpose of obtaining permission to output content information or for the purpose of calling attention to the content information, and is composed of appropriate expressions depending on these purposes. The call information may be output in various output forms, including video output and indicator lighting, as long as it is suitable for these purposes, but is typically output as audio. Furthermore, as will be described in detail later, the in-vehicle device 100 may also output summary information indicating an outline of the content information along with the call information.

[0025] In the second embodiment, when the output conditions are not satisfied and there is content information that has not been output within the allowable range, the in-vehicle device 100 (the in-vehicle device 100b described later) again outputs the content information that has not been output if the output conditions are satisfied after the allowable range is exceeded. At this time, the in-vehicle device 100 also outputs the reason why the content information was not output, i.e., the reason why the output of the content information was suspended. Furthermore, in the second embodiment, the in-vehicle device 100 also performs processing to update the content of the output conditions in response to the response of the occupant CWx when the content information is again output.

[0026] In the third embodiment, the in-vehicle device 100 (the in-vehicle device 100c described later) determines whether the vehicle VEx is traveling outside the living area of ​​the occupant CWx, and if it determines that the vehicle VEx is traveling outside the living area, it outputs a predetermined type of content information (for example, content information recommending spots located outside the living area) within an acceptable range even if the output conditions are not met.

[0027] The allowable range here may be any of a geographical range in which content information should be output, a time range, a range of travel distance of the vehicle VEx, a range of areas passed by the vehicle VEx, a range of vehicle speeds, etc. Furthermore, the limit value indicating the limit (boundary) of the allowable range can be interpreted as the output deadline for content information.

[0028] For example, if the allowable range is information indicating a geographical range, the limit value corresponds to an area limit in the geographical range, and if the allowable range is information indicating a temporal range, the limit value corresponds to a time limit in the temporal range.

[0029] The allowable range is added in association with each piece of content information provided by the server device 200 .

[0030] (Regarding the Server Device 200) The server device 200 records user attribute information (e.g., gender, age, hobbies, preferences, etc.) and various history information (e.g., visited destination history, search history, etc.) as user information, and identifies content information to be output by voice in the vehicle VEx based on the user information. Then, the server device 200 transmits the identified content information to the in-vehicle device 100 to output it. For example, the server device 200 may provide content information to which information indicating an acceptable range has been added.

[0031] Content information provided by the server device 200 includes recommendation information (e.g., information about various spots in the vicinity), news, weather information, email information (e.g., information about incoming calls, senders, titles, and text), schedules, route guidance information, and traffic information (e.g., information about traffic congestion and road closures).

[0032] <First embodiment> (1. Functional configuration of in-vehicle device) A first embodiment will now be described. Fig. 2 is a diagram showing an example of the configuration of each device according to the first embodiment. Fig. 2 shows an example of the configuration of an in-vehicle device 100a according to the first embodiment and an example of the configuration of a server device 200 according to the embodiment. First, the example of the configuration of the in-vehicle device 100a will be described.

[0033] As shown in FIG. 2, the in-vehicle device 100a according to the first embodiment includes a microphone MC, a speaker SP, a sensor SC, a communication unit 110, a storage unit 120, and a control unit 130a.

[0034] (Regarding the microphone MC) The microphone MC is a sound collecting device that collects sounds generated inside the vehicle VEx. For example, the microphone MC collects speech produced by the occupant CWx of the vehicle VEx.

[0035] (Speaker SP) The speaker SP corresponds to an output device that outputs various information by sound. For example, the speaker SP outputs content information in accordance with output control by the control unit 130a.

[0036] (Regarding the sensor SC) The sensor SC detects various information related to the vehicle VEx and identifies the situation related to the vehicle VEx based on the detected information. For example, the sensor SC identifies the situation of the vehicle VEx by detecting sounds, conditions, and behavior inside the vehicle VEx. For example, the sensor SC identifies the current situation of the occupant CWx of the vehicle VEx. The sensor SC then outputs situation information indicating the identified situation to the output control unit 133a.

[0037] For this reason, the sensor SC may be any of various sensors such as a microphone, a camera, an acceleration sensor, a gyro sensor, a GPS sensor, and an air pressure sensor.

[0038] (Communication Unit 110) The communication unit 110 is realized by, for example, a network interface card (NIC), etc. The communication unit 110 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the server device 200, for example.

[0039] (Storage Unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 may store, for example, data and programs related to the output control process according to the embodiment. According to the example of FIG. 2 , the storage unit 120 includes a map information storage unit 121, an output determination table 122, and a content information storage unit 123.

[0040] (Regarding the map information storage unit 121) The map information storage unit 121 stores map information corresponding to the area to which the current position CPTx of the vehicle VEx belongs. For example, the in-vehicle device 100a transmits current position information of the vehicle VEx to the server device 200, thereby receiving map information corresponding to the area to which the current position CPTx belongs from the server device 200 and storing the map information in the map information storage unit 121. The in-vehicle device 100a also provides navigation services based on this map information.

[0041] (Regarding the output determination table 122) The output determination table 122 stores a determination table for determining whether the current situation SAy of the occupant CWx in the vehicle VEx is such that it is preferable to refrain from outputting audio content information. The output determination table 122 defines output conditions for content information based on the relationship between the situation SAy of the occupant CWx and the type of content information.

[0042] 3 shows an example of the output determination table 122 according to the embodiment. The output determination table 122 is used regardless of the output control process according to the first embodiment.

[0043] 3, the output determination table 122 includes, as examples of types of content information, "collision warning," "route guidance information," "traffic information," "news and weather information," "email information," "recommended information," etc. This example indicates that the server device 200 may provide content information belonging to categories such as "collision warning," "route guidance information," "traffic information," "news and weather information," "email information," and "recommended information."

[0044] Furthermore, according to the example of Figure 3, the output determination table 122 shows examples of situations SAy in which it is preferable to refrain from outputting content information, such as "occupant is talking" (situation SA1), "occupant is having a conversation" (situation SA2), "occupant is driving a vehicle under heavy load" (situation SA3), and "occupant is concentrating on favorite music" (situation SA4).

[0045] Here, the output condition will be specifically described using situation SA2 as an example. According to the example in Fig. 3, "o" is associated with the combination of situation SA2 "occupants are talking" and the type of content information "collision warning." This example means that even if occupant CWx is "talking" in vehicle VEx, the content information belonging to "collision warning" is conditioned to be output.

[0046] That is, the information defined by the combination of the situation SA2 "occupants are talking" and the type of content information "collision warning" ("◯" in the example of FIG. 3) is the output condition corresponding to this combination. Therefore, if content information belonging to "collision warning" exists as content information to be output and "occupants are talking," the in-vehicle device 100 can determine that the output condition for the type "collision warning" is satisfied. In other words, if content information belonging to "collision warning" exists as content information to be output and "occupants are talking," the in-vehicle device 100 determines that it is not necessary to refrain from outputting the content information.

[0047] 3, a combination of the situation SA2 "occupants are talking" and the type of content information "route guidance information" is associated with "◯." This example means that even if the occupant CWx is "talking" in the vehicle VEx, the content information belonging to the "route guidance information" is conditioned to be output.

[0048] That is, the information defined by the combination of the situation SA2 "occupants are talking" and the type of content information "route guidance information" ("◯" in the example of FIG. 3) is the output condition corresponding to this combination. Therefore, if content information belonging to "route guidance information" exists as content information to be output and "occupants are talking," the in-vehicle device 100 can determine that the output condition for the type "route guidance information" is satisfied. In other words, if content information belonging to "route guidance information" exists as content information to be output and "occupants are talking," the in-vehicle device 100 determines that it is not necessary to refrain from outputting the content information.

[0049] 3, an "x" is associated with the combination of the situation SA2 "occupants are talking" and the type of content information "recommended information." This example means that if the occupant CWx in the vehicle VEx is "talking," the content information belonging to the "recommended information" is not output.

[0050] That is, the information defined by the combination of the situation SA2 "occupants are talking" and the type of content information "recommended information" ("x" in the example of FIG. 3) is the output condition corresponding to the combination. Therefore, if content information belonging to "recommended information" exists as content information to be output and the situation is "occupants are talking," the in-vehicle device 100 can determine that the output condition for the type "recommended information" is not satisfied. In other words, if content information belonging to "recommended information" exists as content information to be output and the situation is "occupants are talking," the in-vehicle device 100 determines that output should be refrained from.

[0051] (Regarding the content information storage unit 123) The content information storage unit 123 stores content information Cx provided from the server device 200. Here, FIG. 4 shows an example of the content information storage unit 123 according to the embodiment. FIG. 4 shows a content information storage unit 123-1 as an example of the content information storage unit 123. In the example of FIG. 4, the content information storage unit 123-1 has items such as a "content ID" (Cx), a "category," "location information" (SPTx), "content data," "acceptable range" (RAx), and "challenge information" (CF).

[0052] "Content ID" is identification information that identifies the content information. "Category" is information that indicates the type of content information. "Location information" is information that indicates the location of the spot that is the subject of the content information. "Content data" is data that is the substance of the content information. It is preferable that the "content data" be, for example, text data, as data that forms the basis of audio output.

[0053] The "acceptable range" is information indicating the range within which the output of content information is permitted, and may be information indicating any of a geographical range, a time range, a driving distance range of the vehicle VEx, a passing area range of the vehicle VEx, a vehicle speed range, etc. Furthermore, the "acceptable range" is set for each piece of content information, but multiple "acceptable ranges" may be set for one piece of content information.

[0054] The "call information" is information used to call the occupant CWx of the vehicle VEx, and may be composed of various data such as text data indicating content inquiring about permission to output content information or content calling attention to the content information. The "call information" may be provided by the server device 200 together with the content information. For this reason, the server device 200 may automatically generate call information corresponding to the content information, or call information manually created for each piece of content information may be submitted to the server device 200.

[0055] Figure 4 shows an example in which the content ID "C1", the category "facility recommendations", the location information "SPT1", the content data "There is a XX cafe famous for its cheesecake in...!", the allowable range "1,000 m to 30 m", and the call information "Is it okay to call now?" are associated with each other.

[0056] In this example, content information C1 belonging to the category "facility recommendations" is provided by the server device 200, and the content is "There is a cafe called XX that is famous for its cheesecake in ...!", and the in-vehicle device 100a stores this information in the content information storage unit 123.

[0057] In this example, the facility (XXXX Cafe) recommended in the content information C1 is located at a position "SPT1." The output of the content information C1 is permitted while the vehicle VEx is traveling within a range from "1,000 m" to "30 m" from the position "SPT1."

[0058] 2, the control unit 130a is realized by a central processing unit (CPU), a micro processing unit (MPU), etc., executing various programs (e.g., the information processing program according to the embodiment) stored in a storage device inside the in-vehicle device 100a using a RAM as a work area. The control unit 130a is also realized by an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

[0059] As shown in Fig. 2, the control unit 130a has an information matching engine 131, an acquisition unit 132, and an output control unit 133a, and realizes or executes the functions and actions of the information processing described below. Note that the internal configuration of the control unit 130a is not limited to the configuration shown in Fig. 2, and may be other configurations as long as they perform the information processing described below. Furthermore, the connection relationships between the processing units of the control unit 130a are not limited to the connection relationships shown in Fig. 2, and may be other connection relationships.

[0060] (Information Matching Engine 131) For example, the information matching engine 131 estimates the driving conditions of the vehicle VEx from sensor information related to the driving of the vehicle VEx, and calculates the output priority of each of the plurality of content information items scheduled for output based on the estimation result. Then, the information matching engine 131 determines the output order when outputting the plurality of content information items according to the calculated priority.

[0061] For example, when an overlap within an allowable range is detected between pieces of content information, the information matching engine 131 may determine the output order based on the driving conditions of the vehicle VEx in the range corresponding to the detected overlap. For example, when an overlap is detected, the information matching engine 131 calculates the distance traveled by the vehicle VEx in accordance with the playback time of the content information based on the driving speed of the vehicle VEx in the range corresponding to the detected overlap, which is the driving speed at a predetermined timing estimated from sensor information, and the playback time of each piece of content information to be output in the range corresponding to the detected overlap. The information matching engine 131 may then determine the output order based on the relationship between the calculated distance and the overlap.

[0062] More specifically, the information matching engine 131 extracts, from the plurality of pieces of content information, combinations that allow the plurality of pieces of content information to be output in order without interfering with each other at a predetermined timing based on the distances and relationships, and determines the output order of the extracted combinations. For example, the information matching engine 131 may further use the priorities calculated for each of the plurality of pieces of content information to extract appropriate combinations from the plurality of pieces of content information, determine the output order of the extracted combinations according to the priorities, and control the content information to be output from the speaker SP in accordance with the output order.

[0063] (Regarding the Acquisition Unit 132) The acquisition unit 132 acquires content information Cx to be output within the vehicle VEx. For example, the content information Cx is provided in advance from the server device 200 at a timing before the tolerance range is reached, with information indicating the tolerance range added. In other words, the content information Cx is provided from the server device 200 in a reserved form based on the tolerance range. The acquisition unit 132 acquires the content information Cx provided in this manner. Furthermore, the acquisition unit 132 stores the acquired content information Cx in the content information storage unit 123.

[0064] (Regarding the Output Control Unit 133a) When the acquisition unit 132 acquires content information Cx, the output control unit 133a acquires situation information indicating the current situation SAy of the occupant CWx. The situation information may be provided by the sensor SC. The output control unit 133a then determines whether the output condition is satisfied by comparing the combination of the situation SAy of the occupant CWx and the type of content information Cx with the output determination table 122. In other words, the output control unit 133a determines whether the situation SAy of the occupant CWx is a situation in which output of the content information Cx should be refrained from.

[0065] In the first embodiment, if the output conditions are not met and the content information Cx is not output, the output control unit 133a outputs challenge information CF to obtain permission to output the content information Cx from the occupant CWx within the allowable range RAx in which the output of the content information Cx is allowed.

[0066] The output control unit 133a determines whether the current margin remaining before the tolerance limit, which is the limit value of the tolerance range RAx, is equal to or greater than a first threshold. If the margin is equal to or greater than the first threshold (i.e., if it is determined that there is still margin until the deadline), the output control unit 133a may not output the challenge information CF and may re-determine whether the output condition is satisfied. When this re-determination is made, the latest status information at this time is used.

[0067] Here, if the allowable range RAx is a time range, the margin value can be interpreted as the current grace period remaining until the time limit, which is the limit value of the allowable range RAx. In such a case, the output control unit 133a determines whether the grace period is equal to or greater than the first threshold value.

[0068] On the other hand, if the allowable range RAx is a geographical range, the margin value can be interpreted as the current margin distance remaining before the area limit, which is the limit value of the allowable range RAx. In such a case, the output control unit 133a determines whether the margin distance is equal to or greater than the first threshold value.

[0069] Although the determination process by comparing the margin value with the first threshold value has been described with a specific example of the margin value, the same can be said for other threshold values ​​(for example, the second threshold value) described later.

[0070] Furthermore, when the output control unit 133a determines that the margin value is less than the first threshold value while the output condition is not satisfied, it outputs the call information CF. At this time, if the occupant CWx does not permit the output of the content information Cx in response to the call information CF, the output control unit 133a suspends the output of the content information Cx and determines again whether the output condition is satisfied. When this re-determination is made, the latest situation information at that time is used.

[0071] The output control unit 133a then outputs the challenge information CF at predetermined timings according to the decrease in the margin value while the output condition is not satisfied and the occupant CWx does not permit the output of the content information Cx in response to the challenge information CF. For example, the output control unit 133a determines whether the margin value has fallen below a second threshold value that is lower than the first threshold value, and when it determines that the margin value has fallen below the second threshold value, outputs the challenge information CF again.

[0072] In this way, multiple thresholds may be set in multiple stages corresponding to the allowable range RAx so as to approach the limit value. Then, the output control unit 133a determines whether the margin value is equal to or greater than the threshold value, using a new threshold value according to the number of times the challenge information CF has been output and the current margin value.

[0073] If the output condition is satisfied or if the occupant CWx permits the output of the content information Cx in response to the call information CF, the output control unit 133a determines whether the tolerance range is satisfied. If the output control unit 133a determines that the tolerance range is satisfied, the output control unit 133a causes the content information Cx to be output.

[0074] 2. Functional Configuration of the Server Device An example configuration of the server device 200 will be described with reference to Fig. 2. The configuration of the server device 200 may be common to all the embodiments. As shown in Fig. 2, the server device 200 includes a communication unit 211, a storage unit 220, and a control unit 230.

[0075] (Communication Unit 210) The communication unit 210 is realized by, for example, a NIC, etc. The communication unit 210 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the in-vehicle device 100, for example.

[0076] (Regarding the storage unit 220) The storage unit 220 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 220 may include a user information storage unit 221, a map information storage unit 222, and a content information storage unit 223.

[0077] (Regarding the user information storage unit 221) The user information storage unit 221 stores user attribute information (e.g., gender, age, hobbies, preferences, etc.) and various history information (e.g., visited destination history, search history, etc.) as user information. For example, the server device 200 may acquire the user information via the in-vehicle device 100, or part of the user information may be registered by the user himself / herself.

[0078] (Map Information Storage Unit 222) The map information storage unit 222 stores map information that covers road link information for the entire country. The map information may be updated periodically.

[0079] (Content Information Storage Unit 223) The content information storage unit 223 stores candidate content information to be provided to the in-vehicle device 100a. The content information may be input from an external server device. Alternatively, the server device 200 may generate the content information based on user information.

[0080] (Regarding the control unit 230) The control unit 230 is realized by a CPU, an MPU, or the like executing various programs stored in a storage device inside the server device 200 using RAM as a work area. The control unit 230 is also realized by an integrated circuit such as an ASIC or FPGA, for example.

[0081] As shown in Fig. 2, the control unit 230 has an acquisition unit 231, an identification unit 232, and a provision unit 233, and realizes or executes the functions and actions of the information processing described below. Note that the internal configuration of the control unit 230 is not limited to the configuration shown in Fig. 2, and may have other configurations as long as they perform the information processing described below. Furthermore, the connection relationships between the processing units of the control unit 230 are not limited to the connection relationships shown in Fig. 2, and may be other connection relationships.

[0082] (Regarding the Acquisition Unit 231) The acquisition unit 231 acquires user information and stores it in the user information storage unit 221. For example, the acquisition unit 231 can acquire the user information from the in-vehicle device 100.

[0083] (Regarding the Identification Unit 232) The identification unit 232 identifies content information Cx to be output by voice within the vehicle VEx based on the user information. The identification unit 232 may also identify additional information to be added to the identified content information Cx. For example, the identification unit 232 may identify, as the additional information, information indicating the type of the content information Cx, information indicating an acceptable range within which the output of the content information Cx is permitted, call information, and summary information indicating an overview of the content information Cx.

[0084] The identification unit 232 may set an appropriate tolerance range based on the content of the content information Cx and the current position CPTx of the vehicle VEx. The identification unit 232 may also set an appropriate tolerance range based on the content of the content information Cx and the current time at which the vehicle VEx is traveling. The identification unit 232 may also set an appropriate tolerance range based on the content of the content information Cx and the behavior of the vehicle VEx. On the other hand, the tolerance range may be set in advance when the content information Cx is submitted.

[0085] The identifying unit 232 identifies individual content information Cx corresponding to each vehicle VEx. Therefore, the content information Cx acquired by the in-vehicle device 100a mounted on each vehicle VEx varies for each vehicle VEx.

[0086] (Regarding the providing unit 233) The providing unit 233 provides the content information Cx identified by the identifying unit 232 to an occupant of the vehicle VEx. Specifically, the providing unit 233 transmits the content information Cx to the in-vehicle device 100a. Note that the providing unit 233 may provide the content information Cx with the additional information identified by the identifying unit 232 added thereto.

[0087] 3. Processing Procedure A specific example of the output control process according to the first embodiment will now be described with reference to FIG. 5. FIG. 5 is a flowchart showing the procedure of the output control process according to the first embodiment. FIG. 5 shows a scene in which the on-board device 100a mounted on the vehicle VE1 performs the output control process. Note that the output control process shown in FIG. 5 may be started, for example, when the engine of the vehicle VE1 is started, and may be ended when the engine of the vehicle VE1 is stopped.

[0088] First, the acquisition unit 132 determines whether or not the content information Cx to be output has been acquired (step S501). That is, the acquisition unit 132 determines whether or not the content information Cx has been acquired in response to the content information Cx provided by the server device 200.

[0089] While the acquisition unit 132 has not been able to acquire the content information Cx to be output (step S501; No), the acquisition unit 132 waits until it is able to acquire the content information Cx to be output.

[0090] When the acquisition unit 132 acquires the content information Cx (step S501; Yes), the output control unit 133a refers to the output determination table 122 and determines whether the output condition is satisfied (step S502). Specifically, the output control unit 133a acquires situation information indicating the current situation SAy of the occupant CW1 of the vehicle VE1, and compares the combination of the situation SAy and the type of the content information Cx with the output determination table 122 to determine whether the output condition is satisfied.

[0091] If the output control unit 133a determines that the output condition is satisfied (step S502; Yes), it recognizes that the state SAy of the occupant CW1 is a state in which it is not necessary to refrain from outputting the content information Cx. Then, the output control unit 133a determines whether the state SAy of the occupant CW1 exceeds the allowable range RAx corresponding to the content information Cx (step S503).

[0092] If the output control unit 133a determines that the allowable range RAx is not exceeded (step S503; No), the output control unit 133a controls the output so that the content information Cx is output from the speaker SP (step S504).

[0093] For example, assume that the content information Cx is recommendation information such as "There's a cafe called XX with a reputation for its cheesecake in . . . .!" In this case, the output control unit 133a may calculate the positional relationship (e.g., distance and direction) of the position SPTx, starting from the current position CPT1 of the vehicle VE1, based on the position SPTx of the spot (the cafe called XX) targeted by the content information Cx and the current position CPT1 of the vehicle VE1. Then, the output control unit 133a may process the content information Cx based on the calculation result, synthesize a voice that reads out the processed content information Cx, and output this voice from the speaker SP.

[0094] FIG. 5 shows an example in which the speaker SP outputs, as processed content information Cx, "200 m ahead on the left, there is a cafe called XX, famous for its cheesecake!"

[0095] On the other hand, if the output control unit 133a determines that the allowable range RAx is exceeded (step S503; Yes), the process proceeds to step A. The output control process executed from step A onwards will be described as a second embodiment.

[0096] Returning to step S502, if the output control unit 133a determines that the output condition is not satisfied (step S502; No), it recognizes that the state SAy of the occupant CW1 is a state in which output of the content information Cx should be refrained from. According to the example of the output determination table 122 shown in Fig. 3, if the occupant CW1 is in the state SA2 "conversing" and the type of the content information Cx is "recommended," the output control unit 133a recognizes that output of the content information Cx should be refrained from at the moment when the occupant CW1 is currently conversing.

[0097] In this state, the output control unit 133a first determines whether all of the thresholds set in stages toward the allowable limit, which is the limit value of the allowable range RAx, have been exhausted (step S505).

[0098] For example, if the allowable range RAx is a geographical range of "1,000 m to 30 m," multiple thresholds may be set, such as a first threshold of "500 m," a second threshold of "250 m," and a third threshold of "100 m." In this example, while the output condition is not satisfied and the occupant CW1 does not permit the output of the content information Cx in response to the call information CF, the output control unit 133a determines whether the current allowable distance (margin value) remaining until the area limit (allowable limit), which is the limit value of the allowable range RAx, exceeds the first threshold, the second threshold, or the third threshold, in order according to the number of times the call information CF is output.

[0099] As another example, if the allowable range RAx is a time range of "11:00 on July 12, 2022 to 12:00 on July 12, 2022," multiple thresholds may be set, such as a first threshold of "11:30," a second threshold of "11:40," and a third threshold of "11:50." In this example, while the output condition is not satisfied and the occupant CW1 does not permit the output of the content information Cx in response to the call information CF, the output control unit 133a determines whether the current grace period (margin value) remaining until the time limit (allowable limit), which is the limit value of the allowable range RAx, exceeds the first threshold, whether it exceeds the second threshold, or whether it exceeds the third threshold, in order according to the number of times the call information CF is output.

[0100] According to the above example, the output control unit 133a can determine that all thresholds have been exhausted, for example, if the current margin remaining until the allowable limit is less than the third threshold and the call information CF has been output three times so far in accordance with the three thresholds.

[0101] If the output control unit 133a determines that all of the multiple thresholds that are set in stages toward the allowable limit have been consumed (step S505; Yes), it proceeds to step S502 and determines again whether the output conditions have been met.

[0102] On the other hand, if the output control unit 133a determines that all of the thresholds that are set in stages toward the allowable limit have not been exhausted (step S505; No), it determines the number n of times that the call information CF has been output (step S506).

[0103] An example of a method for outputting the challenge information CF based on a threshold will be described in more detail. For example, if the margin value is equal to or greater than the first threshold and the challenge information CF has not yet been output since the content information Cx was acquired, the output control unit 133a determines that the number of times n is 1 (output number_1). On the other hand, if the occupant CW1 does not permit the output of the content information Cx in response to the first challenge information CF output because the first threshold has been exceeded and the output condition has not yet been satisfied, the output control unit 133a determines that the number of times n is 2 (output number_2). Furthermore, if the occupant CW1 does not permit the output of the content information Cx in response to the second challenge information CF output because the second threshold has been exceeded and the output condition has not yet been satisfied, the output control unit 133a determines that the number of times n is 3 (output number_3). Such a specific loop is realized by the following procedure.

[0104] Specifically, the output control unit 133a determines whether the surplus value is equal to or greater than a threshold value corresponding to the number n (nth time) (step S507). For example, when the output control unit 133a determines that the number n=1 (number of outputs_1st time), it determines whether the surplus value is equal to or greater than a first threshold value corresponding to the first time. When the output control unit 133a determines that the number n=2 (number of outputs_2nd time), it determines whether the surplus value is equal to or greater than a second threshold value corresponding to the second time. When the output control unit 133a determines that the number n=3 (number of outputs_3rd time), it determines whether the surplus value is equal to or greater than a third threshold value corresponding to the third time.

[0105] If the output control unit 133a determines that the margin value is equal to or greater than the threshold value corresponding to the number of times n (step S507; Yes), it recognizes that there is a margin until the timing to output the challenge information CF. In this case, the output control unit 133a temporarily suspends the output of the content information Cx (step S508), and proceeds to step S502 to determine again whether the output condition is satisfied.

[0106] If the output control unit 133a determines that the margin value is less than the threshold value corresponding to the number of times n (step S507; No), it recognizes that the timing for outputting the challenge information CF has passed and there is no margin anymore. In this case, the output control unit 133a controls the output so that the challenge information CF is output from the speaker SP (step S509).

[0107] For example, the output control unit 133a may synthesize a voice that reads out the call information CF and output this voice from the speaker SP.

[0108] FIG. 5 shows an example in which the speaker SP outputs "Is it okay to speak now?" as the call information CF.

[0109] Next, the output control unit 133a determines whether the occupant CW1 has permitted the output of the content information Cx in response to the call information CF (step S510). For example, the output control unit 133a can determine whether the occupant CW1 has permitted the output of the content information Cx based on the content of the utterance analyzed from the speech data collected by the microphone MC. Alternatively, the output control unit 133a may determine whether the occupant CW1 has permitted the output of the content information Cx based on the content of the input entered by operating a yes button or a no button provided on the in-vehicle device 100a.

[0110] If the output control unit 133a determines that the occupant CW1 has permitted the output of the content information Cx (step S510; Yes), it proceeds to step S503 and determines whether the content information Cx exceeds the allowable range RAx corresponding to the content information Cx.

[0111] On the other hand, if the output control unit 133a determines that the occupant CW1 has refused the output of the content information Cx (step S510; No), it temporarily suspends the output of the content information Cx and proceeds to step S502.

[0112] 5, even if the state SAy of the occupant CWx indicates that the output of the content information Cx should be refrained from, the call information CF inquiring about the availability of the content information Cx is output within the output deadline of the content information Cx. Then, the output of the content information Cx is controlled according to the response of the occupant CWx to the call information CF. According to this output control process, it is possible to find an opportunity to output the content information Cx without damaging the impression of the occupant CWx, thereby increasing the opportunities to provide useful information to the user.

[0113] Furthermore, according to the output control process of the first embodiment, the call information CF is output only when the margin value falls below the threshold value, which prevents the accumulation of discomfort for the user, for example, caused by the call information CF being continuously output unless the output conditions are met.

[0114] 5. Modifications of the First Embodiment The in-vehicle device 100a according to the first embodiment may be implemented in a manner different from the output control process described as the first embodiment. Therefore, the following describes modifications of the output control process according to the first embodiment.

[0115] (Regarding the output control unit 133a in the modified example) In the above first embodiment, an example was shown in which, when the output control unit 133a does not output the content information Cx because the output conditions are not met, it outputs call information CF to obtain permission from the occupant CWx to output the content information Cx within the allowable range RAx.

[0116] However, if the output conditions are not met and the content information Cx is not output, the output control unit 133a may output, within the allowable range RAx, call information CFn (CF1, CF2, etc.) to alert the occupant CWx to the content information Cx, and summary information OVn (OV1, OV2, etc.) that indicates an overview of the content information.

[0117] For example, while the output control unit 133a is not outputting content information Cx, it outputs call information CFn and summary information OVn associated with the call information CFn at predetermined timings within the allowable range RAx, and changes the content of at least one of the call information CFn and summary information OVn in accordance with an increase in the number of times the output is made.

[0118] Specifically, if the current margin remaining before the tolerance limit, which is the limit value of the tolerance range RAx, is equal to or greater than the first threshold, the output control unit 133a does not output the challenge information CFn and the summary information OVn and determines again whether the output condition is satisfied. If the margin value falls below the first threshold while the output condition is not satisfied, the output control unit 133a outputs the challenge information CFn and the summary information OVn. For example, the output control unit 133a may output the challenge information CFn to which the summary information OVn has been added.

[0119] If the occupant CWx gives a negative response to the call information CFn to which the summary information OVn is attached, the output control unit 133a does not output the content information Cx, but instead determines again whether the output conditions are met.

[0120] In this manner, while the output condition is not satisfied and the occupant CWn shows a negative response to the challenge information CFn, the output control unit 133a causes the challenge information CFn and the summary information OVn to be output at predetermined timings corresponding to a decrease in the margin value. For example, the output control unit 133a causes the challenge information CFn to which the summary information OVn is added to be output, and changes the content of at least one of the challenge information CFn and the summary information OVn in accordance with an increase in the number of times the challenge information CFn is output.

[0121] For example, the output control unit 133a may output, as the number of times of output increases, challenge information CFn (e.g., CF2) having content that is more attention-grabbing than challenge information CFn (e.g., CF1) previously output. Furthermore, the output control unit 133a may output, as the number of times of output increases, summary information OVn (e.g., OV2) having content that is more simplified than summary information OVn (e.g., OV1) previously output. The output control unit may output challenge information CFn associated with the current number of outputs (the number of times the challenge has been made), and output summary information OVn associated with the current number of outputs.

[0122] The in-vehicle device 100a may have a content information storage unit 123 that stores a data structure capable of implementing an output control process according to a modified example in which the content of at least one of the call information CFn and the summary information OVn is changed in response to an increase in the number of outputs. Hereinafter, the content information storage unit 123 according to the modified example of the first embodiment will be described with reference to FIG. 6 .

[0123] (Regarding the content information storage unit 123 according to the modified example) Fig. 6 is a diagram showing an example of a data structure capable of realizing the output control process according to the modified example of the first embodiment stored in the content information storage unit 123. Fig. 6 shows a content information storage unit 123-2 as an example of the content information storage unit 123 according to the modified example of the first embodiment.

[0124] 6, the content information storage unit 123-2 has items such as "content ID" (Cx), "category," "location information" (SPTx), "content data," "allowable range" (RAx), and "challenge information" (CF). These items are the same as those in the content information storage unit 123-1, and therefore will not be described here.

[0125] 6, the content information storage unit 123-2 has an item such as “Number of outputs_nth time.” For example, the content information storage unit 123-2 may have items for the number of outputs n, such as “Number of outputs_1st time,” “Number of outputs_2nd time,” etc., as shown in FIG.

[0126] The "output number_nth time" corresponds to the current output number, which is specified depending on the number of times that the challenge information CFn to which the summary information OVn is added has been output.

[0127] 6, for the item "output count_nth," call information CFn and summary information OVn are registered in a correlated state. For example, for the item "output count_1st" identified by the content ID "C1" (content information C1), call information CF1 "Is it okay now?" and summary information OV1 "We have information about a cafe recommended for you" are registered in a correlated state. Also, for the item "output count_2nd" identified by the content ID "C1," call information CF2 "We have information recommended for you!" and summary information OV2 "Information about a cafe" are registered in a correlated state.

[0128] Here, when the content of the call information CF1 "Are you ready now?" and the content of the call information CF2 "I have some information I would like to recommend to you" are compared, the content of the call information CF2 is more detailed and likely to attract more attention. As a result, the output control unit 133a can output call information with content that attracts more attention than the call information that has been output so far, as the number of outputs n increases.

[0129] Furthermore, when the content of summary information OV1 "Here is information about a cafe recommended for you" is compared with the content of summary information OV2 "This is information about a cafe," the content of summary information OV2 is more simplified. As a result, the output control unit 133a can output summary information with more simplified content compared to the summary information output so far, as the number of output times n increases.

[0130] 6. Operational Example in Modification Next, an operational example implemented as an output control process according to a modification of the first embodiment will be described. Specifically, a specific operational example of the in-vehicle device 100a that operates in accordance with the content information storage unit 123-2 having the data structure shown in FIG. 6 will be described.

[0131] 5 shows an example in which the output control unit 133a outputs the challenge information CF based on a threshold value corresponding to the current output number, which is specified depending on the number of times the challenge information CF has been output, and a current margin value. Following this example, in a modified example, the output control unit 133a may output the challenge information CFn to which the summary information OVn has been added, based on a threshold value corresponding to the current output number, which is specified depending on the number of times the challenge information has been output, and a current margin value.

[0132] For example, while the output condition is not satisfied and the occupant CWx does not permit the output of the content information Cx in response to the call information CFn to which the summary information OVn is added, the output control unit 133a sequentially determines whether the threshold value corresponding to the current margin value remaining up to the allowable limit has been exceeded in accordance with the number of times the call information has been output. In other words, using the example of Fig. 5, the output control unit 133a can gradually output the call information CFn to which the summary information OVn is added, instead of the call information CF.

[0133] 5, more specifically, when the margin value is equal to or greater than the first threshold value while the output condition is not satisfied, the output control unit 133a determines that the number of times n is 1 (output number_1). As a result, the output control unit 133a outputs call information CF1 to which summary information OV1 is added. For example, in response to control by the output control unit 133a, the speaker SP outputs "Is it OK now? (call information), I have information about a cafe I recommend to you. (summary information)" as call information CF1 to which summary information OV1 is added.

[0134] If the output control unit 133a determines that the occupant CW1 has responded negatively to the call information CF1 and determines that the output condition remains unsatisfied even after a second condition determination, the output control unit 133a determines that the current number of times n is 2 (output number_2). As a result, the output control unit 133a outputs the call information CF2 to which the summary information OV2 has been added. For example, in response to control by the output control unit 133a, the speaker SP outputs, as the call information CF2 to which the summary information OV2 has been added, "We have some information we recommend for you (call information), and it's information about a cafe (summary information)."

[0135] [7. Summary of the Modification of the First Embodiment] According to the output control process of the modification of the first embodiment, the call information CFn is output as the grace period for the output deadline of the content information decreases. As the grace period decreases, the content of the call information CFn is changed to be more attention-grabbing. As a result, it is possible to prevent the same call from being repeated, and to realize a natural call. Furthermore, when summary information is added when a call is repeated, the summary information is simplified as the number of calls increases, so that the summary of the content information can be conveyed in short words without repeating the same summary information.

[0136] <Second embodiment> [1. Functional configuration of in-vehicle device] From here, the second embodiment will be described. Fig. 7 is a diagram showing an example of the configuration of each device according to the second embodiment. Fig. 7 shows an example of the configuration of an in-vehicle device 100b according to the second embodiment and an example of the configuration of a server device 200 according to the embodiment. The configuration of the server device 200 may be the same between the first embodiment and the second embodiment, and therefore a description thereof will be omitted.

[0137] In addition, detailed explanations of processing units that share the same symbols between the in-vehicle device 100a according to the first embodiment and the in-vehicle device 100b according to the second embodiment will be omitted, and the following explanation will focus on the new processing units possessed by the in-vehicle device 100b according to the second embodiment.

[0138] As shown in FIG. 7, the in-car device 100b according to the second embodiment includes a microphone MC, a speaker SP, a sensor SC, a communication unit 110, a storage unit 120, and a control unit 130b.

[0139] The control unit 130b is realized by a CPU, an MPU, or the like executing various programs (e.g., the information processing program according to the embodiment) stored in a storage device inside the in-vehicle device 100b using a RAM as a work area. The control unit 130b is also realized by an integrated circuit such as an ASIC or an FPGA.

[0140] As shown in Fig. 7, the control unit 130b has an information matching engine 131, an acquisition unit 132, an output control unit 133b, an identification unit 134b, and an update unit 135b, and realizes or executes the functions and actions of the information processing described below. Note that the internal configuration of the control unit 130b is not limited to the configuration shown in Fig. 7, and may be other configurations as long as they perform the information processing described below. Furthermore, the connection relationships between the processing units of the control unit 130b are not limited to the connection relationships shown in Fig. 7, and may be other connection relationships.

[0141] (Regarding the Identifying Unit 134b) The identifying unit 134b identifies, as unoutputted content NCx, content information Cx that has not been output because the output conditions are not satisfied within the allowable range RAx associated with the content information Cx.

[0142] (Regarding the Output Control Unit 133b) When the identifying unit 134b identifies the content NCx that has not yet been output, the output control unit 133b controls the output of the content NCx that has not yet been output.

[0143] Specifically, when the output condition for the un-outputted content NCx is satisfied, the output control unit 133b outputs the un-outputted content NCx together with the reason why the un-outputted content NCx was not output at the original timing. For example, the output control unit 133b may output the un-outputted content NCx by adding the situation SAy of the occupant CWx at the time within the allowable range RAx as the reason.

[0144] In addition, the output control unit 133b may identify the original timing at which the unoutputted content NCx should have been output based on the movement history of the vehicle VEx and the allowable range RAx associated with the unoutputted content NCx, and further output information indicating the identified timing.

[0145] Here, if the unoutputted content NCx is recommendation information recommending a specific spot, the associated allowable range RAx may be defined as area information corresponding to the position SPTx of the specific spot. In such an example, the output control unit 133b may identify the positional relationship between the position SPTx of the specific spot and the current position CPTx of the vehicle VEx at the time of outputting the unoutputted content NCx, and output information indicating the identified positional relationship together with the unoutputted content NCx. For example, the output control unit 133b may output information indicating the distance to the specific spot when the current position CPTx of the vehicle VEx is used as the starting point, added to the unoutputted content NCx as information indicating the positional relationship.

[0146] The output control unit 133b is substantially the same processing unit as the output control unit 133a according to the first embodiment, and also has the functions of the output control unit 133a.

[0147] (Regarding the Updater 135b) The updater 135b updates the contents of the output conditions (i.e., the contents of the output determination table 122) according to the response of the occupant CWx when the unoutput content NCx is output.

[0148] As a prerequisite for the function of the update unit 135b, the output control unit 133b first performs the following processing. Specifically, the output control unit 133b outputs question information Q that inquires of the occupant CWx about whether or not to output the content information, based on the reason why the unoutput content NCx was not output within the allowable range RAx. More specifically, the output control unit 133b outputs question information Q that inquires of the occupant CWx about whether or not to output the content information when the situation SAy is met, based on the situation SAy of the occupant CWx at the time within the allowable range RAx.

[0149] The update unit 135b updates the output conditions defined based on the relationship between the type of unoutput content NCx and the situation SAy (specifically, the situation SAy of the occupant CWx at the time within the allowable range RAx) that is the subject of the question information Q, in accordance with the response of the occupant CWx to the question information Q. Specifically, when the occupant CWx permits the output of content information in the situation SAy that is the subject of the question information Q, the update unit 135b updates the content of the output conditions in the output determination table 122 to content that will thereafter output the above type of content in the subject situation SAy.

[0150] 8 and 9, a specific example of the output control process according to the second embodiment will be described. In Fig. 8, the output control process for the unoutputted content NCx will be described. In Fig. 9, the update process in response to the response of the occupant CWx to the unoutputted content NCx will be described.

[0151] 8 is a flowchart showing the procedure of the output control process for outputting the unoutputted content NCx. The output control process for outputting the unoutputted content NCx may be started when the process proceeds to step A, as described in FIG. 5. Specifically, the output control process for outputting the unoutputted content NCx may be started when it is determined in step S503 of FIG. 5 that the allowable range RAx is exceeded. Therefore, the output control process procedure shown in FIG. 8 will be described by continuing to use the example of FIG. 5.

[0152] First, the identifying unit 134b identifies the content information Cx that has not been output within the allowable range RAx as unoutputted content NCx (step S801).

[0153] Next, the output control unit 133b identifies the status SAy of the occupant CW1 at the time when the unoutput content NCx was not output as the reason for not outputting the unoutput content NCx (step S802). Here, the status SAy of the occupant CW1 at the time when the unoutput content NCx was not output refers to the status SAy of the occupant CW1 at the time when the allowable range RAx was exceeded before the output conditions were satisfied, and essentially refers to the status SAy at the time when the allowable range RAx was exceeded. Hereinafter, the status SAy of the occupant CW1 of the vehicle VE1 at the time will be referred to as "status SAy(P)." Using the example of FIG. 5, the output control unit 133b identifies the status SAy(P) that occurred before the timing when it was determined that the output conditions were satisfied (step S502; Yes) but the allowable range RAx was exceeded (step S503; Yes).

[0154] Next, the output control unit 133b determines the original timing TM at which the content information Cx should have been output based on the movement history LG1 of the vehicle VE1 and the allowable range RAx (step S803). For example, based on the movement history LG1 and the allowable range RAx, the output control unit 133b may determine the date and time at which the content information Cx was acquired (i.e., the date and time at the time of step S501) as the timing TM. The output control unit 133b may also determine the position information of the vehicle VE1 at the timing TM based on the movement history LG1.

[0155] The output control unit 133b also generates preface information PF based on the situation SAy(P) and the timing TM (step S804). For example, the output control unit 133b can generate text information such as "I refrained from outputting the information earlier because I was talking, but I have some information to share with you at time TM." In this example, "talking" included in the preface information PF corresponds to the situation SAy(P), and "time TM" corresponds to the timing TM.

[0156] Next, the output control unit 133b calculates the positional relationship (e.g., distance and direction) of the position SPTx starting from the current position CPT1 of the vehicle VE1 based on the position SPTx of the spot targeted by the content information Cx and the current position CPT1 of the vehicle VE1 (step S805).

[0157] For example, assume that the content information Cx is recommendation information such as "There's a XX cafe with a good reputation for its cheesecake in...!" In this case, the output control unit 133b calculates the positional relationship (e.g., distance and direction) of the position SPTx, with the current position CPT1 as the starting point, based on the position SPTx of the spot (XX cafe) targeted by the content information Cx and the current position CPT1 of the vehicle VE1.

[0158] Then, the output control unit 133a processes the content information Cx by adding information indicating the calculated positional relationship to the content information Cx (step S806). For example, if the output control unit 133b calculates the positional relationship "300 m behind, on the left" in S805, it can process the content information Cx using this to generate content information TCx with content such as "300 m behind, on the left, there is a XX cafe that is famous for its cheesecake."

[0159] In this state, the output control unit 133b first controls the output so that the preface information PF is output from the speaker SP (step S807). For example, the output control unit 133b may synthesize a voice that reads out the preface information PF and output this voice from the speaker SP.

[0160] FIG. 8 shows an example in which the speaker SP outputs the introductory information PF, "I refrained from outputting this earlier because I was speaking, but I have some information to provide you at time TM."

[0161] The output control unit 133b also controls the output so that the processed content information TCx is output from the speaker SP (step S808). For example, the output control unit 133b may synthesize a voice that reads out the content information TCx and output this voice from the speaker SP.

[0162] FIG. 8 shows an example in which the speaker SP outputs, as content information TCx, "300 m behind you on the left, there is a cafe called XX, famous for its cheesecake."

[0163] After this, the process proceeds to step B. The output control process executed from step B onwards will be described with reference to FIG.

[0164] 2-2. Processing Procedure (2) Figure 9 is a flowchart showing the procedure of the update process for updating the output conditions. The update process for updating the output conditions may be started when the processed content information TCx is output in step S808 of Figure 8. Therefore, the example of Figure 8 will be continued to be used to explain the update process procedure shown in Figure 9.

[0165] First, the output control unit 133b determines whether the occupant CW1 has responded to the content information TCx (step S901). For example, the output control unit 133a can determine whether the occupant CW1 has responded to the content information TCx based on speech data collected by the microphone MC or input content input by operating the in-vehicle device 100b.

[0166] When the output control unit 133b determines that the occupant CW1 has responded to the content information TCx (step S901; Yes), the output control unit 133b determines whether the response is positive (step S902). For example, the output control unit 133b can determine whether the response is positive based on the speech content analyzed from the speech voice data collected by the microphone MC or the input content input by operating the in-vehicle device 100b.

[0167] For example, if the occupant CW1 says, "Thank you! It's okay," or if the "affirmative" button on the screen of the in-vehicle device 100b is pressed, the output control unit 133b can determine that the response is affirmative. On the other hand, if the occupant CW1 says, "It's too late to tell me now!" or if the "negative" button on the screen of the in-vehicle device 100b is pressed, the output control unit 133b can determine that the response is negative.

[0168] If the output control unit 133b determines that the response content is not positive (step S902; No), it outputs question information Q inquiring of occupant CW1 as to whether or not to output the content information, based on the situation SAy(P) of occupant CW1 at the time when the allowable range RAx was exceeded before the output conditions were met (step S903).

[0169] Specifically, the output control unit 133b generates question information Q that asks the occupant CW1 whether or not it is OK for the content information to be output in the situation SAy(P), and controls the output so that the question information Q is output from the speaker SP. For example, the output control unit 133b may synthesize a voice that reads out the question information Q and output the voice from the speaker SP.

[0170] For example, the output control unit 133b can generate question information Q with content such as "Should I notify you without waiting even if you are talking next time?" In this example, "talking" included in the question information Q corresponds to the situation SAy(P).

[0171] FIG. 9 shows an example in which the speaker SP outputs the question information Q, "Should we notify you without waiting from the next time onwards, even if you are currently speaking?"

[0172] Next, the output control unit 133b determines whether the occupant CW1 has permitted the output of the content information in the situation SA(y) in response to the question information Q (step S904). For example, the output control unit 133b can determine whether the occupant CW1 has permitted the output of the content information in the situation SA(y) based on the speech content analyzed from the speech voice data collected by the microphone MC and the input content input by operating the in-vehicle device 100b.

[0173] If the occupant CW1 permits the content information to be output even during the situation SA(y) (step S904; Yes), the update unit 135b updates the output conditions defined based on the relationship between the type of the unoutputted content NCx and the situation SAy(P) (step S905). Specifically, the update unit 135b updates the contents of the output conditions in the output determination table 122 to contents that output content of the type of the unoutputted content NCx in the situation SAy(P).

[0174] Here, taking as an example a case where the situation SAy(P) is situation SA2, i.e., "occupants are talking," and the type of the unoutputted content NCx is "recommended information," the update unit 135b updates the contents of the output conditions in the output determination table 122, as shown in Fig. 9. That is, the update unit 135b updates the condition information "x," which is defined by the combination of situation SA2 "occupants are talking," and the type of content information "recommended information," to "o."

[0175] Returning to the explanation, if the occupant CW1 does not respond to the content information TCx (step S901; No), if the response content is determined to be positive (step S902; Yes), or if the occupant CW1 does not allow the output of content information in situation SA(y) (step S904; No), the update unit 135b terminates the process without performing the update process.

[0176] 8, when the state SAy of the occupant CWx changes to a state where it is no longer necessary to refrain from outputting the content information Cx after the output deadline, the content information Cx that was not output within the output deadline is output along with the reason why it was not output. This output control process can increase the opportunities to provide useful information to the user without damaging the impression of the occupant CWx.

[0177] 9, when the state SAy of the occupant CWx is such that the output of the content information Cx should be refrained from, the content information Cx is not output. On the other hand, when the state SAy is such that the output of the content information Cx is refrained from, the occupant CWx's intention as to whether the content information Cx should be output is inquired, and the content of the condition information is updated so that the content information Cx will be output in accordance with the intention in the future. Such output control processing can increase the opportunities to provide useful information to the user without damaging the occupant CWx's impression.

[0178] <Third embodiment> [1. Functional configuration of in-vehicle device] From here, the third embodiment will be described. Fig. 10 is a diagram showing an example of the configuration of each device according to the third embodiment. Fig. 10 shows an example of the configuration of an in-vehicle device 100c according to the third embodiment and an example of the configuration of a server device 200 according to the embodiment. The configuration of the server device 200 may be the same between the first embodiment and the third embodiment, and therefore a description thereof will be omitted.

[0179] In addition, detailed explanations of processing units that share the same symbols between the in-vehicle device 100a according to the first embodiment and the in-vehicle device 100c according to the third embodiment will be omitted, and the following explanation will focus on the new processing units possessed by the in-vehicle device 100c according to the third embodiment.

[0180] As shown in FIG. 10, an in-car device 100c according to the third embodiment includes a microphone MC, a speaker SP, a sensor SC, a communication unit 110, a storage unit 120, and a control unit 130c.

[0181] The control unit 130c is realized by a CPU, an MPU, or the like executing various programs (e.g., the information processing program according to the embodiment) stored in a storage device inside the in-vehicle device 100c using a RAM as a work area. The control unit 130c is also realized by an integrated circuit such as an ASIC or an FPGA.

[0182] As shown in Fig. 10, the control unit 130c has an information matching engine 131, an acquisition unit 132, an output control unit 133c, a living area information acquisition unit 136c, and a determination unit 137c, and realizes or executes the functions and actions of the information processing described below. Note that the internal configuration of the control unit 130c is not limited to the configuration shown in Fig. 10, and may be other configurations as long as they perform the information processing described below. Furthermore, the connection relationships between the processing units of the control unit 130c are not limited to the connection relationships shown in Fig. 10, and may be other connection relationships.

[0183] (Regarding the output control unit 133c) The output control process according to the third embodiment aims to forcibly output content information Cx provided by the server device 200 while the occupant CWx is traveling outside of his / her living area (for example, at a travel destination) if the content information Cx recommends a specific spot that is within the allowable range RAx, so as not to miss this spot (if the spot is passed by, it is unclear when the spot will be available again in the future).

[0184] In other words, when the judgment unit 137c described later determines that the vehicle VEx is moving outside the living area of ​​the occupant CWx, the output control unit 133c outputs content information of a specified type within the allowable range RAx associated with the content information, even if the output conditions are not satisfied.

[0185] Specifically, when the output control unit 133c determines that the vehicle VEx is moving outside the living area of ​​the occupant CWx, even if the output conditions are not met, the output control unit 133c outputs recommendation information recommending specified spots around the vehicle VEx within the allowable range RAx associated with the recommendation information.

[0186] For example, when the current margin remaining up to the tolerance limit, which is the limit value of the tolerance range RAx within which the output of recommendation information is permitted, falls below a threshold value, the output control unit 133c outputs the recommendation information if the vehicle VEx is moving outside the living area.

[0187] For example, the output control unit 133c may specify the positional relationship between the position SPTx of the predetermined spot and the current position CPTx of the vehicle VEx at the time when the recommendation information is output, and output information indicating the specified positional relationship together with the recommendation information. For example, the output control unit 133c may output information indicating the distance to the predetermined spot when the current position CPTx of the vehicle VEx is used as the starting point, together with the recommendation information, as information indicating the positional relationship.

[0188] The output control unit 133c is substantially the same processing unit as the output control unit 133a according to the first embodiment, and also has the functions of the output control unit 133a.

[0189] (Regarding the Living Zone Information Acquisition Unit 136c) The living zone information acquisition unit 136c acquires living zone information related to the living zone of the occupant CWx identified based on the movement history of the occupant CWx. For example, the in-vehicle device 100c may have a function of periodically determining the living zone based on the movement history of the vehicle VEx and updating the living zone information to the latest state. With this function, for example, the living zone may be determined based on the distribution of locations where the vehicle VEx has traveled and stopped.

[0190] (Regarding the determination unit 137c) The determination unit 137c determines whether the vehicle VEx is traveling outside the living area of ​​the occupant CWx. Specifically, the determination unit 137c determines whether the vehicle VEx is traveling outside the living area of ​​the occupant CWx based on the current position CPTx of the vehicle VEx and the living area information.

[0191] [2. Processing Procedure] A specific example of the output control process according to the third embodiment will now be described with reference to Fig. 11. Fig. 11 is a flowchart showing the procedure of the output control process according to the third embodiment. Fig. 11 shows a scene in which the in-vehicle device 100c mounted on the vehicle VE1 performs the output control process.

[0192] The output control process according to the third embodiment may be executed together with the output control process according to the first embodiment. For this reason, the flowchart shown in Fig. 11 is a partial modification of the flowchart shown in Fig. 5. Specifically, steps S1101 to S1104 shown in Fig. 11 show the procedure for the output control process according to the third embodiment. In Fig. 11, the output control process procedure according to the third embodiment will be described with a focus on this step.

[0193] The output control unit 133c determines whether the margin value is equal to or greater than the threshold value corresponding to the number n (nth time) (step S507). If the output control unit 133c determines that the margin value is equal to or greater than the threshold value corresponding to the number n (step S507; Yes), it recognizes that there is a margin of time until the timing to output the challenge information CF.

[0194] In this state, the living area information acquisition unit 136c acquires the living area information of the occupant CW1 (step S1101). The in-vehicle device 100c may store the latest living area information of the occupant CW1 in the storage unit 120, and the living area information acquisition unit 136c may acquire the latest living area information of the occupant CW1 from there.

[0195] The determination unit 137c determines whether the vehicle VE1 is moving through the living area of ​​the occupant CW1 based on the current position CPTx of the vehicle VEx and the living area information (step S1102).

[0196] If it is determined that the vehicle VE1 is moving through the living area of ​​the occupant CW1 (step S1102; Yes), the output control unit 133c controls the output so that the call information CF is output from the speaker SP (step S509).

[0197] On the other hand, if the output control unit 133c determines that the vehicle VE1 is not moving within the living area of ​​the occupant CW1 (i.e., the vehicle VE1 is moving outside the living area of ​​the occupant CW1) (step S1102; No), it determines whether the type of the content information Cx acquired in step S501 is a recommendation and whether the current margin value remaining up to the tolerance limit, which is the limit value of the tolerance range RAx within which the output of the content information Cx is acceptable, is less than a predetermined threshold value (step S1103).

[0198] If the output control unit 133c determines that the type of content information Cx is not a recommendation or that the current margin remaining until the tolerance limit of the content information Cx is not less than a predetermined threshold value (step S1103; No), it proceeds to step S509.

[0199] In this way, by determining that the type of content information Cx is a recommendation and that the current margin remaining up to the allowable limit of the output of the content information Cx is less than a predetermined threshold, even if the type of content information Cx is a recommendation, if there is a large margin remaining up to the allowable limit of the output of the content information Cx, the call information CF can be output once in step S509.

[0200] On the other hand, if the output control unit 133c determines that the type of content information Cx is a recommendation and that the current margin remaining until the allowable limit for the output of the content information Cx is less than a predetermined threshold (step S1103; Yes), it recognizes that the output conditions are not met at this point, but that the time has come to output the current content information Cx, which recommends spots located outside the living area.

[0201] Then, the output control unit 133c controls the output so that the content information Cx is output from the speaker SP (step S1104).

[0202] For example, assume that the content information Cx is recommendation information such as "There's a cafe called XX with a reputation for its cheesecake in . . . .!" In this case, the output control unit 133c may calculate the positional relationship (e.g., distance and direction) of the position SPTx, starting from the current position CPT1 of the vehicle VE1, based on the position SPTx of the spot (the cafe called XX) targeted by the content information Cx and the current position CPT1 of the vehicle VE1. Then, the output control unit 133c may process the content information Cx based on the calculation result, synthesize a voice that reads out the processed content information Cx, and output this voice from the speaker SP.

[0203] FIG. 11 shows an example in which the speaker SP outputs, as the processed content information Cx, "200 m ahead on the left, there is a cafe called XX, famous for its cheesecake!"

[0204] In step S1103, it is possible to determine only whether the type of the content information Cx acquired in step S501 is a recommendation, and if it is determined that the type of the content information Cx is a recommendation, to output the content information Cx immediately.

[0205] 11 , even if the situation SAy of the occupant CWx indicates that the output of the content information Cx should be refrained from, if the vehicle is traveling outside the living area of ​​the occupant CWx (e.g., a travel destination), only the content information Cx recommending spots located in the area outside the living area is output within the allowable range RAx of the content information Cx. This output control process makes it possible to provide information about spots that are visited only occasionally, thereby increasing the opportunities to provide useful information to the user.

[0206] <Other> [1. Hardware Configuration] The above-described in-vehicle device 100 (in-vehicle devices 100a, 100b, 100c) is realized, for example, by a computer 1000 configured as shown in Fig. 12. Fig. 12 is a hardware configuration diagram showing an example of a computer that realizes the functions of the in-vehicle device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, an HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0207] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 starts up, programs that depend on the hardware of the computer 1000, and the like.

[0208] The HDD 1400 stores programs executed by the CPU 1100, data used by such programs, etc. The communication interface 1500 receives data from other devices via a predetermined communication network and sends it to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.

[0209] The CPU 1100 controls an output device such as a display and an input device such as a keyboard via the input / output interface 1600. The CPU 1100 acquires data from the input device via the input / output interface 1600. The CPU 1100 also outputs generated data to the output device via the input / output interface 1600.

[0210] Media interface 1700 reads a program or data stored in recording medium 1800 and provides it to CPU 1100 via RAM 1200. CPU 1100 loads the program or data from recording medium 1800 onto RAM 1200 via media interface 1700 and executes the loaded program. Recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0211] For example, when the computer 1000 functions as the in-vehicle device 100 according to the embodiment, the CPU 1100 of the computer 1000 realizes the functions of the control units 130 (130a, 130b, 130c) by executing programs loaded onto the RAM 1200. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via a predetermined communication network.

[0212] [2. Other] Furthermore, among the processes described in each of the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0213] Furthermore, the components of each device shown in the figure are functional concepts and do not necessarily have to be physically configured as shown. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of the devices can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc. For example, in the first to third embodiments described above, at least part of the output control processing according to the embodiment described as being mainly performed by the in-vehicle device 100 may be processed by the server device 200.

[0214] Furthermore, the above-described embodiments can be combined as appropriate within the scope of not causing any contradiction in the processing content.

[0215] <Summary> Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present disclosure can be implemented in other forms that include the aspects described in the section on this disclosure, as well as in various modifications and improvements based on the knowledge of those skilled in the art.

[0216] REFERENCE SIGNS LIST 1 System 100 In-vehicle device 120 Storage unit 121 Map information storage unit 122 Output determination table 123 Content information storage unit 131 Information matching engine 132 Acquisition unit 100a In-vehicle device 133a Output control unit 100b In-vehicle device 133b Output control unit 134b Identification unit 135b Update unit 100c In-vehicle device 133c Output control unit 136c Living area information acquisition unit 137c Determination unit

Claims

1. An acquisition unit that acquires content information to be outputted into a moving object; an output control unit that outputs the content information when a type of the content information satisfies an output condition according to a current situation of a passenger of the moving body; Equipped with When the output condition is not satisfied and the content information is not output, the output control unit outputs information for obtaining permission to output the content information from a passenger of the moving body.

23. An information processing apparatus comprising:

2. The output control unit outputs the call information within a permissible range in which the output of the content information is permitted.

2. The information processing apparatus according to claim 1,

3. When a current margin value remaining up to an allowable limit, which is a limit value of the allowable range, is equal to or greater than a first threshold value, the output control unit does not output the call information and determines again whether or not the output condition is satisfied.

3. The information processing apparatus according to claim 2.

4. The output control unit outputs the challenge information when the margin value becomes less than the first threshold value while the output condition is not satisfied.

4. The information processing apparatus according to claim 3.

5. When the occupant does not permit the output of the content information in response to the call information, the output control unit does not output the content information and determines again whether the output condition is satisfied.

5. The information processing apparatus according to claim 4.

6. The output control unit outputs the call information at each predetermined timing according to a decrease in the margin value while the output condition is not satisfied and the occupant does not permit the output of the content information in response to the call information.

6. The information processing apparatus according to claim 5,

7. The output control unit determines whether the margin value falls below a second threshold value that is lower than the first threshold value, and outputs the interrogation information when the margin value falls below the second threshold value.

7. The information processing apparatus according to claim 6,

8. The output control unit determines whether the permissible range is satisfied when the output condition is satisfied or when the occupant permits output of the content information in response to the call information, and outputs the content information when the permissible range is satisfied.

3. The information processing apparatus according to claim 2.

9. When the output condition is satisfied, or when the occupant permits output of the content information in response to the call information, the output control unit determines whether or not the permissible range is satisfied, and when the permissible range is not satisfied, adds a reason why the content information could not be output within the permissible range and outputs the content information.

3. The information processing apparatus according to claim 2.

10. An information processing method executed by an information processing device, An acquisition step of acquiring content information to be outputted into a moving object; an output control step of outputting the content information when a type of the content information satisfies an output condition according to a current situation of a passenger of the moving body; Including, The output control step includes outputting information for obtaining permission to output the content information from a passenger of the moving body when the output condition is not satisfied and the content information is not output.

23. An information processing method comprising:

11. An information processing program executed by an information processing device, An acquisition step of acquiring content information to be outputted into a mobile object; an output control step of outputting the content information when a type of the content information satisfies an output condition according to a current situation of a passenger of the moving body; causing the information processing device to execute the above; The output control step includes outputting information for obtaining permission to output the content information from a passenger of the moving body when the output condition is not satisfied and the content information is not output.

2. An information processing program comprising: