Information processing device, information processing method, and information processing program

Abstract

An information processing device (100a) of the present disclosure is provided with: an acquisition unit (132) that acquires content information to be output into a moving body; and an output control unit (133a) that causes the content information to be output when the type of the content information satisfies an output condition corresponding to the current condition of a passenger of the moving body. Furthermore, if the output condition was unsatisfied and the content information could not be output, the output control unit (133a) causes interrogation information to be output for obtaining permission from the passenger of the moving body to output the content information, within an allowable scope where output of the content information is allowed.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and an information processing program.

Background Art

[0002] Conventionally, technologies for providing information by voice without giving discomfort to users have been proposed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the above prior art, after detecting the end of the conversation of the user in the vehicle, the provision of voice information is started after waiting for the elapse of the waiting time. Therefore, while not interrupting the user's conversation, information whose presentation deadline has passed during the waiting time is not presented. For this reason, there is room for improvement in the above prior art in terms of providing useful information to the user.

[0005] The present disclosure has been made in view of the above, and proposes an information processing apparatus, an information processing method, and an information processing program capable of providing useful information to a user.

Means for Solving the Problems

[0006] The information processing apparatus according to claim 1 includes an acquisition unit that acquires content information to be output inside a moving body, and an output control unit that outputs the content information when the type of the content information satisfies an output condition according to the current situation of the passengers in the moving body. When the output condition is not satisfied and the content information is not output, the output control unit ,beforeIn order to obtain permission from the occupants of the mobile vehicle to output the aforementioned content information The feelings Output the report.

[0007] Claim 10 The information processing method described herein is an information processing method performed by an information processing device, comprising: an acquisition step of acquiring content information to be output into a mobile vehicle; and an output control step of outputting the content information when the type of content information satisfies output conditions corresponding to the current status of the occupants of the mobile vehicle, wherein the output control step shall, if the output conditions are not met and the content information is not output, ,before In order to obtain permission from the occupants of the mobile vehicle to output the aforementioned content information The feelings Output the report.

[0008] Claim 11 The information processing program described herein is an information processing program executed by an information processing device, which causes the information processing device to execute an acquisition procedure for acquiring content information to be output into a mobile vehicle, and an output control procedure for outputting the content information when the type of content information satisfies output conditions corresponding to the current status of the occupants of the mobile vehicle, wherein the output control procedure shall, if the output conditions are not met and the content information is not output, ,before In order to obtain permission from the occupants of the mobile vehicle to output the aforementioned content information The feelings Output the report. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 shows an example of a system according to an embodiment. [Figure 2] Figure 2 shows an example of the configuration of each device according to the first embodiment. [Figure 3] Figure 3 shows an example of an output determination table according to the embodiment. [Figure 4] Figure 4 shows an example of a content information storage unit according to the embodiment. [Figure 5]FIG. 5 is a flowchart showing the procedure of the output control process according to the first embodiment. [Figure 6] FIG. 6 is a diagram showing an example of the content information storage unit according to a modification of the first embodiment. [Figure 7] FIG. 7 is a diagram showing a configuration example of each device according to the second embodiment. [Figure 8] FIG. 8 is a flowchart showing the procedure of the output control process for outputting unoutput content. [Figure 9] FIG. 9 is a flowchart showing the procedure of the update process for updating the output condition. [Figure 10] FIG. 10 is a diagram showing a configuration example of each device according to the third embodiment. [Figure 11] FIG. 11 is a flowchart showing the procedure of the output control process according to the third embodiment. [Figure 12] FIG. 12 is a hardware configuration diagram showing an example of a computer that realizes the functions of the in-vehicle device 100.

MODE FOR CARRYING OUT THE INVENTION

[0010] Hereinafter, embodiments of the present disclosure will be described in detail based on the drawings. Note that the information processing apparatus, information processing method, and information processing program according to the present disclosure are not limited by this embodiment. Also, in the following embodiments, the same parts are denoted by the same reference numerals, and duplicate explanations are omitted.

[0011] <OVERALL VIEW OF THE EMBODIMENT> 〔1. SYSTEM CONFIGURATION〕 First, the configuration of the system according to the embodiment will be described using FIG. 1. FIG. 1 is a diagram showing an example of the system according to the embodiment. In FIG. 1, a system 1 is shown as an example of the system according to the embodiment. Various output control processes according to the embodiment may be realized in the system 1.

[0012] As shown in FIG. 1, the system 1 may include an in-vehicle device 100 and a server device 200. Further, the in-vehicle device 100 and the server device 200 may be communicably connected by wire or wirelessly via a network N. Also, the information processing system 1 shown in FIG. 1 may include an arbitrary number of in-vehicle devices 100 and an arbitrary number of server devices 200.

[0013] [2. Outline of Each Device Included in the System] (Regarding the In-Vehicle Device 100) The in-vehicle device 100 is an example of an information processing device according to an embodiment of the present disclosure, and is a central device responsible for the output control process according to the embodiment. As shown in FIG. 1, the in-vehicle device 100 may be a dedicated navigation device built-in or mounted in the vehicle VEx.

[0014] For example, the in-vehicle device 100 may be composed of a navigation device and a recording device. As an example, the in-vehicle device 100 may be a composite device in which a navigation device and a recording device independent of each other are communicably connected. As another example, the in-vehicle device 100 may be a single device having a navigation function and a recording function.

[0015] Further, the in-vehicle device 100 may include various sensors. For example, the in-vehicle device 100 may include various sensors such as a camera, an acceleration sensor, a gyro sensor, a GPS (Global Positioning System) sensor, and a barometric pressure sensor. From this, the in-vehicle device 100 may also have a function of performing dialogue and information provision for assisting the driving of a user (for example, a passenger in the vehicle VEx) based on sensor information acquired by various sensors. [[ID=z18]]

[0016] Further, the in-vehicle device 100 can use not only the sensors provided in the device itself but also the sensor information detected by the sensors provided in the vehicle VEx itself as a safe driving system.

[0017] Furthermore, users can operate their everyday portable devices (e.g., smartphones, tablet devices, notebook PCs, PDAs, etc.) in the same way as the in-vehicle device 100 by installing a predetermined application software on these devices.

[0018] Here is an overview of the output control processing performed by the in-vehicle device 100. For example, the in-vehicle device 100 outputs content information when it meets the output conditions corresponding to the current status of the occupant CWx of the vehicle VEx.

[0019] For example, the in-vehicle device 100 identifies the conditions inside the vehicle VEx, i.e., the current conditions of the occupants CWx, based on audio information collected by a microphone, images captured by a camera, the behavior of the vehicle VEx detected by sensors, and the attributes of the road on which the vehicle VEx is traveling, as detected by sensors. The in-vehicle device 100 then applies the identified conditions of the occupants CWx and the type of content information provided by the server device 200 to an output determination table, which will be described later, to determine whether it is preferable to refrain from outputting this content information.

[0020] For example, if the in-vehicle device 100 determines that it is not necessary to withhold the output of content information (i.e., the output conditions are met), it will output the content information by voice. In this case, the in-vehicle device 100 may also display an image indicating the content information in addition to the voice. On the other hand, if the in-vehicle device 100 determines that it should withhold the output of content information (i.e., the output conditions are not met), it will withhold the output of the content information.

[0021] Situations in which it is preferable to refrain from outputting content information include when the occupant CWx is performing demanding driving tasks, when the occupant CWx is having a conversation, when the occupant CWx is on a phone call, and when the occupant CWx is listening to their favorite music.

[0022] Furthermore, the in-vehicle device 100 also performs various output controls as shown below, based on the output control processing described above.

[0023] In the first embodiment, if the in-vehicle device 100 (in-vehicle device 100a, described later) does not output content information because the output conditions are not met, it will call out to the occupant CWx within the permissible range in which the output of content information is permitted, and will control the output of content information according to the response of the occupant CWx to the call.

[0024] The call information used by the in-vehicle device 100 includes multiple meanings depending on the purpose. Specifically, the call information is output for the purpose of obtaining permission to output content information or to draw attention to the content information, and is composed of appropriate expressions according to these purposes. The call information may be output in various forms, including video output and indicator illumination, as long as it is suitable for these purposes, but it is typically output as audio. Furthermore, as will be described in detail later, the in-vehicle device 100 may also output summary information that shows an overview of the content information along with the call information.

[0025] In the second embodiment, the in-vehicle device 100 (in-vehicle device 100b, described later) outputs the previously unoutput content information if there is content information that was not output within the acceptable range because the output conditions were not met, and the output conditions are met after the acceptable range has been exceeded. At this time, the in-vehicle device 100 also outputs the reason why the content information was not output, i.e., the reason why the output of the content information was withheld. Furthermore, in the second embodiment, the in-vehicle device 100 also performs a process to update the content of the output conditions in response to the response of the occupant CWx as a result of the content information being output again.

[0026] In the third embodiment, the in-vehicle device 100 (in-vehicle device 100c, described later) determines whether the vehicle VEx is traveling outside the living area of ​​the occupant CWx. If it determines that the vehicle is traveling outside the living area, even if the output conditions are not met, it outputs content information of a predetermined type (for example, content information that recommends spots located outside the living area) within an acceptable range.

[0027] The term "acceptable range" here refers to any of the following: the geographical range, time range, vehicle VEx mileage range, vehicle VEx pass-through area range, vehicle speed range, etc., over which content information should be output. Furthermore, the limit value indicating the boundary of the acceptable range can be understood as the deadline for outputting the content information.

[0028] For example, if the tolerance range indicates a geographical range, the limit value corresponds to the area limit within that geographical range. Similarly, if the tolerance range indicates a temporal range, the limit value corresponds to the time limit within that temporal range.

[0029] Furthermore, the acceptable range is added in association with each piece of content information provided by the server device 200.

[0030] (Regarding server device 200) The server device 200 records user attribute information (e.g., gender, age, hobbies, preferences, etc.) and various history information (e.g., visit history, search history, etc.) as user information, and identifies content information to be output to the vehicle VEx via voice based on the user information. The server device 200 then transmits the identified content information to the in-vehicle device 100 for output. For example, the server device 200 may provide content information with added information indicating acceptable ranges.

[0031] Content information provided by the server device 200 includes recommendation information (e.g., information on various spots in the vicinity), news, weather information, email information (e.g., incoming emails, sender, title, body information), schedules, route guidance information, traffic information (e.g., traffic congestion, road closure information), and the like.

[0032] <First Embodiment> [1. Functional configuration of in-vehicle equipment] From here, we will describe the first embodiment. Figure 2 is a diagram showing examples of the configurations of each device according to the first embodiment. Figure 2 shows an example of the configuration of the in-vehicle device 100a and an example of the configuration of the server device 200 according to the first embodiment. First, we will describe the example of the configuration of the in-vehicle device 100a.

[0033] As shown in Figure 2, the in-vehicle device 100a according to the first embodiment includes a microphone MC, a speaker SP, a sensor SC, a communication unit 110, a storage unit 120, and a control unit 130a.

[0034] (Regarding the microphone MC) The microphone (MC) is a sound collection device that collects sounds generated inside the vehicle (VEx). For example, the microphone (MC) collects speech uttered by the vehicle's occupant (CWx).

[0035] (Speaker SP) The speaker SP corresponds to an output device that outputs various information via sound. For example, the speaker SP outputs content information in accordance with the output control by the control unit 130a.

[0036] (Regarding the sensor SC) The sensor SC detects various information about the vehicle VEx and identifies the status of the vehicle VEx based on the detected information. For example, the sensor SC identifies the status of the vehicle VEx by detecting sounds, appearances, and behavior inside the vehicle VEx. For example, the sensor SC identifies the current status of the vehicle VEx's occupant CWx. The sensor SC then outputs status information indicating the identified status to the output control unit 133a.

[0037] For these reasons, the sensor SC may be various types of sensors, such as a microphone, camera, accelerometer, gyroscope, GPS sensor, or barometric pressure sensor.

[0038] (Communications Department 110) The communication unit 110 is implemented, for example, by a NIC (Network Interface Card). The communication unit 110 is connected to the network N by wire or wireless connection and performs information transmission and reception with, for example, the server device 200.

[0039] (Storage unit 120) The storage unit 120 is implemented by, for example, a semiconductor memory element such as RAM (Random Access Memory) or flash memory, or a storage device such as a hard disk or optical disc. The storage unit 120 may store, for example, data and programs related to the output control processing according to the embodiment. In addition, according to the example in Figure 2, the storage unit 120 has a map information storage unit 121, an output determination table 122, and a content information storage unit 123.

[0040] (Regarding the map information storage unit 121) The map information storage unit 121 stores map information corresponding to the area to which the vehicle VEx's current location CPTx belongs. For example, the in-vehicle device 100a transmits the vehicle VEx's current location information to the server device 200, receives map information corresponding to the area to which the current location CPTx belongs from the server device 200, and stores it in the map information storage unit 121. The in-vehicle device 100a also provides navigation services based on this map information.

[0041] (Regarding output determination table 122) The output determination table 122 stores a determination table for determining whether it is preferable to refrain from outputting audio content information based on the current status SAy of the occupant CWx in the vehicle VEx. In the output determination table 122, the output conditions for content information are defined based on the relationship between the status SAy of the occupant CWx and the type of content information.

[0042] Here, Figure 3 shows an example of the output determination table 122 according to the embodiment. The output determination table 122 is used regardless of the output control processing according to the first embodiment.

[0043] As shown in the example in Figure 3, the output determination table 122 includes, as an example of content information types, "collision warning," "route guidance information," "traffic information," "news / weather information," "email information," and "recommendation information." This example shows that the server device 200 may provide content information belonging to categories such as "collision warning," "route guidance information," "traffic information," "news / weather information," "email information," and "recommendation information."

[0044] Furthermore, as shown in the example in Figure 3, the output determination table 122 shows examples of situations SAy in which it is preferable to refrain from outputting content information, such as "occupant on a phone call" (situation SA1), "occupant in conversation" (situation SA2), "occupant performing demanding driving" (situation SA3), and "occupant concentrating on their favorite music" (situation SA4).

[0045] Here, we will explain the output conditions in detail using situation SA2 as an example. In the example in Figure 3, the combination of situation SA2 "occupants are talking" and content information type "collision warning" is associated with "○". This example means that even if the occupant CWx in the vehicle VEx is "talking", content information belonging to "collision warning" is conditioned to be output.

[0046] In other words, the information defined by the combination of situation SA2 "occupants are talking" and content information type "collision warning" (in the example of Figure 3, "○") is the output condition corresponding to that combination. Therefore, the in-vehicle device 100 can determine that the output condition for type "collision warning" is met if there is content information belonging to "collision warning" to be output and "occupants are talking". In other words, the in-vehicle device 100 determines that it does not need to withhold output if there is content information belonging to "collision warning" to be output and "occupants are talking".

[0047] Furthermore, as shown in the example in Figure 3, the combination of situation SA2 "occupants are conversing" and content information type "route guidance information" is associated with "○". This example means that even if the occupant CWx in the vehicle VEx is "conversing", content information belonging to "route guidance information" is conditioned to be output.

[0048] In other words, the information defined by the combination of situation SA2 "occupants are talking" and content information type "route guidance information" (in the example of Figure 3, "○") is the output condition corresponding to that combination. Therefore, the in-vehicle device 100 can determine that the output condition for type "route guidance information" is met if there is content information belonging to "route guidance information" to be output and "occupants are talking". In other words, the in-vehicle device 100 determines that it does not need to refrain from outputting if there is content information belonging to "route guidance information" to be output and "occupants are talking".

[0049] Furthermore, as shown in the example in Figure 3, the combination of situation SA2 "occupants are conversing" and content information type "recommendation information" is associated with "×". This example means that in vehicle VEx, if occupant CWx is "conversing", content information belonging to "recommendation information" is not output.

[0050] In other words, the information defined by the combination of situation SA2 "occupants are talking" and content information type "recommendation information" (shown as "×" in the example in Figure 3) is the output condition corresponding to that combination. Therefore, if there is content information belonging to "recommendation information" that should be output, the in-vehicle device 100 can determine that the output condition for type "recommendation information" is not met when "occupants are talking" is present. To put it another way, if there is content information belonging to "recommendation information" that should be output, the in-vehicle device 100 will determine that output should be withheld when "occupants are talking" is present.

[0051] (Regarding the content information storage unit 123) The content information storage unit 123 stores content information Cx provided from the server device 200. Here, Figure 4 shows an example of the content information storage unit 123 according to the embodiment. In Figure 4, the content information storage unit 123-1 is shown as an example of the content information storage unit 123. In the example in Figure 4, the content information storage unit 123-1 has items such as "Content ID" (Cx), "Category", "Location Information" (SPTx), "Content Data", "Acceptable Range" (RAx), and "Call Information" (CF).

[0052] "Content ID" is identification information that identifies the content information. "Category" is information that indicates the type of content information. "Location information" is information that indicates the location where the spot targeted by the content information exists. "Content data" is the data that constitutes the content information. "Content data" is preferably text data, for example, as the data that forms the basis of the audio output.

[0053] The "acceptable range" indicates the range within which the output of content information is permitted, and may represent any of the following: a geographical range, a time range, a vehicle VEx mileage range, a vehicle VEx passing area range, a vehicle speed range, etc. Furthermore, while the "acceptable range" is set for each piece of content information, multiple "acceptable ranges" may be set for a single piece of content information.

[0054] "Call information" is information used to call out to the CWx (Civil Wave Driver) of a vehicle VEx, and may consist of various data, including text data that inquires about permission to output content information or that draws attention to content information. "Call information" may be provided together with content information by the server device 200. For this reason, the server device 200 may automatically generate call information according to the content information, or call information created manually for each piece of content information may be submitted to the server device 200.

[0055] Figure 4 shows an example where content ID "C1", category "Facility Recommendation", location information "SPT1", content data "The famous XX Cafe with its cheesecake is located in...!", acceptable range "1,000m~30m", and call to action information "Is now a good time?" are associated.

[0056] The example in question shows that content information C1, which belongs to the category "Facility Recommendation" and contains the message "The famous XX Cafe with its cheesecake is located in...", is provided by the server device 200, and the in-vehicle device 100a stores it in the content information storage unit 123.

[0057] Furthermore, this example shows a case where the facility recommended by content information C1 (○○ Cafe) is located at location "SPT1". It also shows an example where the output of content information C1 is permitted while the vehicle VEx is traveling within a range from 1,000m to 30m before location "SPT1".

[0058] (Regarding control unit 130a) Returning to Figure 2, the control unit 130a is realized by a CPU (Central Processing Unit) or MPU (Micro Processing Unit), etc., executing various programs (for example, the information processing program according to the embodiment) stored in the memory device inside the in-vehicle device 100a using RAM as the working area. Alternatively, the control unit 130a can be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

[0059] As shown in Figure 2, the control unit 130a includes an information matching engine 131, an acquisition unit 132, and an output control unit 133a, and realizes or executes the information processing functions and operations described below. Note that the internal configuration of the control unit 130a is not limited to the configuration shown in Figure 2, and other configurations are also possible as long as they perform the information processing described later. Furthermore, the connection relationships of the various processing units in the control unit 130a are not limited to the connection relationships shown in Figure 2, and other connection relationships are also possible.

[0060] (Information matching engine 131) For example, the information matching engine 131 estimates the driving status of the vehicle VEx from sensor information related to the vehicle VEx's movement, and calculates the output priority for each of the multiple content information items whose output is reserved based on the estimation result. Then, the information matching engine 131 determines the output order when outputting the multiple content information items according to the calculated priority.

[0061] For example, if the information matching engine 131 detects an overlap of acceptable ranges between content information, it may determine the output order based on the vehicle VEx's driving status within the range corresponding to the detected overlap. For example, if an overlap is detected, the information matching engine 131 calculates the distance the vehicle VEx travels in the range corresponding to the detected overlap, based on the vehicle VEx's driving speed within the range corresponding to the detected overlap, the driving speed at a predetermined timing estimated from sensor information, and the playback time of each piece of content information that should be output within the range corresponding to the detected overlap, according to the playback time of the content information. The information matching engine 131 may then determine the output order based on the relationship between the calculated distance and the overlap.

[0062] More specifically, the information matching engine 131 extracts combinations of content information from among multiple content information, based on distance and relationships, that allow multiple content information to be output sequentially without interfering with each other at a predetermined timing, and determines the output order for the extracted combinations. For example, the information matching engine 131 may further use the priority calculated for each of the multiple content information to extract an appropriate combination from among the multiple content information, determine the output order for the extracted combinations according to their priority, and control the output of content information from the speaker SP according to the output order.

[0063] (Regarding acquisition section 132) The acquisition unit 132 acquires content information Cx to be output within the vehicle VEx. For example, the content information Cx is provided in advance by the server device 200 at the timing when the acceptable range is reached, with information indicating the acceptable range added to it. In other words, the content information Cx is provided by the server device 200 in a reserved manner based on the acceptable range. The acquisition unit 132 acquires the content information Cx provided in this manner. The acquisition unit 132 also stores the acquired content information Cx in the content information storage unit 123.

[0064] (Regarding the output control unit 133a) When content information Cx is acquired by the acquisition unit 132, the output control unit 133a acquires status information SAy indicating the current status of the occupant CWx. The status information may be provided by the sensor SC. The output control unit 133a then compares the combination of the occupant CWx's status SAy and the type of content information Cx with the output determination table 122 to determine whether the output conditions are met. In other words, the output control unit 133a determines whether the occupant CWx's status SAy is such that the output of content information Cx should be withheld.

[0065] In the first embodiment, if the output conditions are not met and content information Cx is not output, the output control unit 133a outputs call information CF to obtain permission from crew member CWx to output content information Cx within the allowable range RAx in which output of content information Cx is permitted.

[0066] The output control unit 133a determines whether the current margin remaining before the tolerance limit, which is the limit of the tolerance range RAx, is equal to or greater than the first threshold. If the margin is equal to or greater than the first threshold (i.e., if it is determined that there is sufficient time before the deadline), the output control unit 133a may not output the call information CF and may re-determine whether the output conditions have been met. When such a re-determination is performed, the latest status information at that point is used.

[0067] In this case, if the allowable range RAx is a time range, the margin value can be understood as the current grace period remaining until the time limit, which is the limit value of the allowable range RAx. In such cases, the output control unit 133a will determine whether the grace period is greater than or equal to the first threshold.

[0068] On the other hand, if the allowable range RAx is a geographical range, the margin value can be understood as the current leeway distance remaining until the area limit, which is the limit value of the allowable range RAx. In such cases, the output control unit 133a will determine whether or not the leeway distance is greater than or equal to the first threshold.

[0069] While we have explained the determination process by comparing the margin value with the first threshold, along with specific examples of margin values, the same applies to other thresholds (for example, the second threshold) which will be discussed later.

[0070] Furthermore, if the output control unit 133a determines that the margin value has fallen below the first threshold while the output conditions are not met, it outputs the call information CF. At this time, if the crew member CWx does not authorize the output of the content information Cx in response to the call information CF, the output control unit 133a withholds the output of the content information Cx and re-determines whether the output conditions are met. When such a re-determination is performed, the latest status information at that point is used.

[0071] Then, the output control unit 133a outputs the call information CF at predetermined intervals corresponding to the decrease in the margin value, as long as the output conditions are not met and the crew member CWx does not authorize the output of content information Cx in response to the call information CF. For example, the output control unit 133a determines whether the margin value has fallen below a second threshold which is lower than the first threshold, and if it determines that it has fallen below the second threshold, it outputs the call information CF again.

[0072] In this way, multiple thresholds may be set in multiple stages, corresponding to the allowable range RAx, to approach the limit value. Then, the output control unit 133a uses a new threshold corresponding to the number of times the call information CF has been output and the current margin value to determine whether the margin value is greater than or equal to the threshold value.

[0073] The output control unit 133a determines whether the acceptable range is met when the output conditions are met, or when the crew member CWx authorizes the output of content information Cx in response to the call information CF. If the output control unit 133a determines that the acceptable range is met, it outputs the content information Cx.

[0074] [2. Functional Configuration of Server Devices] Next, we will describe an example of the configuration of the server device 200 using Figure 2. The configuration of the server device 200 may be common to each embodiment. As shown in Figure 2, the server device 200 has a communication unit 211, a storage unit 220, and a control unit 230.

[0075] (Communications Department 210) The communication unit 210 is implemented by, for example, a NIC. The communication unit 210 is connected to the network N by wire or wireless connection and performs, for example, sending and receiving information with the in-vehicle device 100.

[0076] (Regarding memory unit 220) The storage unit 220 is implemented by, for example, semiconductor memory elements such as RAM and flash memory, or storage devices such as hard disks and optical discs. The storage unit 220 may include a user information storage unit 221, a map information storage unit 222, and a content information storage unit 223.

[0077] (Regarding the user information storage unit 221) The user information storage unit 221 stores user attribute information (e.g., gender, age, hobbies, preferences, etc.) and various history information (e.g., visit history, search history, etc.) as user information. For example, the server device 200 may acquire user information via the in-vehicle device 100, or some of the user information may be registered by the user themselves.

[0078] (Regarding the map information storage unit 222) The map information storage unit 222 stores map information that covers road link information for the entire country. The map information may be updated periodically.

[0079] (Regarding the content information storage unit 223) The content information storage unit 223 stores candidate content information to be provided to the in-vehicle device 100a. Content information may be input from an external server device. In addition, the server device 200 may generate content information based on user information.

[0080] (Regarding the control unit 230) The control unit 230 is implemented by a CPU, MPU, etc., which executes various programs stored in the storage device inside the server device 200 using RAM as the working area. Alternatively, the control unit 230 can be implemented by an integrated circuit such as an ASIC or FPGA.

[0081] As shown in Figure 2, the control unit 230 includes an acquisition unit 231, a specification unit 232, and a provision unit 233, and realizes or executes the information processing functions and operations described below. Note that the internal configuration of the control unit 230 is not limited to the configuration shown in Figure 2, and other configurations are also possible as long as they perform the information processing described later. Furthermore, the connection relationships of the various processing units in the control unit 230 are not limited to the connection relationships shown in Figure 2, and other connection relationships are also possible.

[0082] (Regarding acquisition section 231) The acquisition unit 231 acquires user information and stores it in the user information storage unit 221. For example, the acquisition unit 231 can acquire user information from the in-vehicle device 100.

[0083] (Regarding Section 232) The identification unit 232 identifies content information Cx that should be output to the vehicle VEx via voice, based on user information. The identification unit 232 may also identify additional information to be added to the identified content information Cx. For example, the identification unit 232 may identify additional information such as information indicating the type of content information Cx, information indicating the permissible range for outputting content information Cx, call information, and summary information indicating the outline of content information Cx.

[0084] The specific unit 232 may set an appropriate tolerance range based on the content of the content information Cx and the current position CPTx of the vehicle VEx. Alternatively, the specific unit 232 may set an appropriate tolerance range based on the content of the content information Cx and the current time the vehicle VEx is traveling. Furthermore, the specific unit 232 may set an appropriate tolerance range based on the content of the content information Cx and the behavior of the vehicle VEx. On the other hand, the tolerance range may also be pre-set when the content information Cx is submitted.

[0085] Furthermore, the identification unit 232 identifies individual content information Cx corresponding to each vehicle VEx. Therefore, the content of the content information Cx acquired by the in-vehicle device 100a installed in each vehicle VEx will differ.

[0086] (Regarding Section 233) The providing unit 233 provides the content information Cx identified by the identification unit 232 to the occupants of the vehicle VEx. Specifically, the providing unit 233 transmits the content information Cx to the in-vehicle device 100a. The providing unit 233 may provide the content information Cx with additional information identified by the identification unit 232 added.

[0087] [3. Processing Procedure] From here, a specific example of the output control process according to the first embodiment will be explained using Figure 5. Figure 5 is a flowchart showing the procedure of the output control process according to the first embodiment. Figure 5 shows a scene in which the on-board device 100a mounted on the vehicle VE1 performs the output control process. Note that the output control process shown in Figure 5 may, for example, start when the engine of the vehicle VE1 is started and end when the engine of the vehicle VE1 is stopped.

[0088] First, the acquisition unit 132 determines whether or not it has been able to acquire the content information Cx to be output (step S501). In other words, the acquisition unit 132 determines whether or not it has been able to acquire the content information Cx in response to the provision of the content information Cx by the server device 200.

[0089] The acquisition unit 132 waits until it can acquire the content information Cx to be output (step S501; No) while it has not yet acquired the content information Cx to be output.

[0090] If the content information Cx is acquired by the acquisition unit 132 (step S501; Yes), the output control unit 133a refers to the output determination table 122 and determines whether the output conditions are met (step S502). Specifically, the output control unit 133a acquires status information indicating the current status SAy of the occupant CW1 of the vehicle VE1, and compares the combination of status SAy and the type of content information Cx with the output determination table 122 to determine whether the output conditions are met.

[0091] If the output control unit 133a determines that the output conditions are met (step S502; Yes), it recognizes that the status SAy of crew member CW1 is such that there is no need to refrain from outputting content information Cx. Then, the output control unit 133a determines whether or not the content information Cx exceeds the allowable range RAx (step S503).

[0092] If the output control unit 133a determines that the allowable range RAx is not exceeded (step S503; No), it controls the output so that the content information Cx is output from the speaker SP (step S504).

[0093] For example, suppose the content information Cx is recommendation information such as "The famous XX Cafe with its cheesecake is located at...!" In this case, the output control unit 133a may calculate the positional relationship (e.g., distance and direction) of position SPTx from the current position CPT1 based on the position SPTx of the spot (XX Cafe) that is the target of the content information Cx and the current position CPT1 of the vehicle VE1. Then, the output control unit 133a may process the content information Cx based on the calculation result, synthesize an audio reading of the processed content information Cx, and output this audio from the speaker SP.

[0094] Figure 5 shows an example where speaker SP outputs the processed content information Cx, "There is a famous cheesecake cafe called XX 200m ahead on the left!"

[0095] On the other hand, if the output control unit 133a determines that the allowable range RAx is exceeded (step S503; Yes), the process proceeds to step A. The output control processing performed in step A and below will be described in the second embodiment.

[0096] Returning to step S502, if the output control unit 133a determines that the output conditions are not met (step S502; No), it recognizes that the crew member CW1's status SAy is such that output of content information Cx should be refrained from. According to the example of the output determination table 122 shown in Figure 3, if crew member CW1 is in status SA2 "in conversation" and the type of content information Cx is "recommendation", the output control unit 133a recognizes that output of content information Cx should be refrained from at this time while in conversation.

[0097] In this state, first, the output control unit 133a determines whether all of the threshold values, which are set in stages toward the limit of the allowable range RAx, have been consumed (step S505).

[0098] For example, if the permissible range RAx is a geographical range of "1,000m to 30m", then multiple thresholds may be set, such as a first threshold of "500m", a second threshold of "250m", and a third threshold of "100m". In such an example, as long as the output conditions are not met and the crew member CW1 does not authorize the output of content information Cx in response to the call information CF, the output control unit 133a will sequentially determine whether the current margin distance (safety margin) remaining up to the area limit (permissible limit), which is the limit of the permissible range RAx, exceeds the first threshold, the second threshold, and the third threshold, according to the number of times the call information CF has been output.

[0099] As another example, if the acceptable range RAx is a time range of "July 12, 2022, 11:00 to July 12, 2022, 12:00", then multiple thresholds may be set, such as the first threshold "11:30", the second threshold "11:40", and the third threshold "11:50". In such an example, as long as the output conditions are not met and the crew CW1 does not permit the output of content information Cx in response to the call information CF, the output control unit 133a will sequentially determine whether the current grace period (margin value) remaining until the time limit (acceptable limit), which is the limit of the acceptable range RAx, has exceeded the first threshold, the second threshold, and the third threshold, according to the number of times the call information CF has been output.

[0100] According to the above example, the output control unit 133a can determine that all thresholds have been consumed if, for example, the current margin remaining before the permissible limit is less than the third threshold, and the call information CF has been output three times so far according to the three thresholds.

[0101] If the output control unit 133a determines that all of the thresholds set in stages toward the tolerance limit have been consumed (step S505; Yes), it proceeds to step S502 and determines again whether the output conditions have been met.

[0102] On the other hand, if the output control unit 133a determines that none of the thresholds set in stages toward the permissible limit have been consumed (step S505; No), it identifies the number of times the call information CF has been output in this instance, n (step S506).

[0103] Let's explain in more detail an example of a threshold-based method for outputting call information CF. For example, if the margin value is greater than or equal to the first threshold and the call information CF has not yet been output since the content information Cx was acquired, the output control unit 133a identifies the count as n=1 (output count_1st time). On the other hand, if the crew member CW1 does not permit the output of content information Cx for the first call information CF output after the first threshold has been exceeded, and the output conditions are not yet met, the output control unit 133a identifies the count as n=2 (output count_2nd time). Furthermore, if the crew member CW1 does not permit the output of content information Cx for the second call information CF output after the second threshold has been exceeded, and the output conditions are not yet met, the output control unit 133a identifies the count as n=3 (output count_3rd time). Such specific loops are implemented using the following procedure.

[0104] Specifically, the output control unit 133a determines whether the margin value is greater than or equal to the threshold corresponding to the nth time (step S507). For example, if the output control unit 133a determines that the number of times n=1 (output count_1st time), it determines whether it is greater than or equal to the first threshold corresponding to the first time. If the output control unit 133a determines that the number of times n=2 (output count_2nd time), it determines whether it is greater than or equal to the second threshold corresponding to the second time. If the output control unit 133a determines that the number of times n=3 (output count_3rd time), it determines whether it is greater than or equal to the third threshold corresponding to the third time.

[0105] If the output control unit 133a determines that the margin value is greater than or equal to the threshold corresponding to the number of times n (step S507; Yes), it recognizes that there is sufficient time before outputting the call information CF. In this case, the output control unit 133a temporarily suspends the output of the content information Cx (step S508), proceeds to step S502, and determines again whether the output conditions have been met.

[0106] If the output control unit 133a determines that the margin value is less than the threshold corresponding to the number of times n (step S507; No), it recognizes that the timing for outputting the call information CF has been exceeded and the margin has run out. In this case, the output control unit 133a controls the output so that the call information CF is output from the speaker SP (step S509).

[0107] For example, the output control unit 133a may synthesize a voice that reads out the call information CF and output this voice from the speaker SP.

[0108] Figure 5 shows an example where speaker SP outputs "Is now a good time?" as a call information CF.

[0109] Next, the output control unit 133a determines whether the occupant CW1 has authorized the output of content information Cx in response to the call information CF (step S510). For example, the output control unit 133a can determine whether the occupant CW1 has authorized the output of content information Cx based on the speech content analyzed from the speech voice data collected by the microphone MC. Alternatively, the output control unit 133a may determine whether the occupant CW1 has authorized the output of content information Cx based on the input content entered by operating the affirmative or negative button provided on the in-vehicle device 100a.

[0110] If the output control unit 133a determines that crew member CW1 has authorized the output of content information Cx (step S510; Yes), it proceeds to step S503 to determine whether the content information Cx exceeds the allowable range RAx corresponding to it.

[0111] On the other hand, if the output control unit 133a determines that crew member CW1 has refused to output the content information Cx (step S510; No), it temporarily suspends the output of the content information Cx and proceeds to step S502.

[0112] [4. Summary of output control according to the first embodiment] According to the output control process of the first embodiment described in Figure 5, even if the crew member CWx's status SAy indicates a situation where outputting content information Cx should be refrained from, a call information CF is output within the content information Cx output deadline to inquire about the possibility of outputting content information Cx. Then, the output of content information Cx is controlled according to the crew member CWx's response to the call information CF. With such output control processing, it is possible to look for an opportunity to output content information Cx without damaging the crew member CWx's perception, thereby increasing the opportunities to provide useful information to users.

[0113] Furthermore, according to the output control processing of the first embodiment, since the call information CF is output only when the margin value falls below the threshold, it is possible to suppress the accumulation of user discomfort caused by the continuous output of call information CF unless the output conditions are met.

[0114] [5. Modified examples according to the first embodiment] The in-vehicle device 100a according to the first embodiment may be implemented in a manner different from the output control processing described as the first embodiment. Therefore, the following describes modifications of the output control processing according to the first embodiment.

[0115] (Regarding the output control unit 133a in the modified example) In the first embodiment described above, if the output control unit 133a fails to output content information Cx because the output conditions are not met, it outputs call information CF to obtain permission from crew member CWx to output content information Cx within the allowable range RAx.

[0116] However, if the output conditions are not met and content information Cx is not output, the output control unit 133a may output call information CFn (CF1, CF2...) to prompt the crew member CWx to pay attention to content information Cx, and summary information OVn (OV1, OV2...) showing an overview of the content information, within the permissible range RAx.

[0117] For example, while not outputting content information Cx, the output control unit 133a outputs call information CFn and summary information OVn associated with call information CFn at predetermined intervals within the allowable range RAx, and changes the content of at least one of the call information CFn and summary information OVn in accordance with the increase in the number of such outputs.

[0118] Specifically, if the current margin value remaining up to the limit of the allowable range RAx is greater than or equal to the first threshold, the output control unit 133a does not output the call information CFn and summary information OVn, and re-determines whether the output conditions have been met. Then, if the output conditions have not been met and the margin value falls below the first threshold, the output control unit 133a outputs the call information CFn and summary information OVn. For example, the output control unit 133a may output the call information CFn with the summary information OVn added.

[0119] If the crew member CWx gives a negative response to the call information CFn to which the summary information OVn has been added, the output control unit 133a does not output the content information Cx, but instead re-determines whether the output conditions have been met.

[0120] Thus, as long as the output conditions are not met and the crew member CWn gives a negative response to the call information CFn, the output control unit 133a outputs the call information CFn and the summary information OVn at predetermined intervals corresponding to the decrease in the margin value. For example, the output control unit 133a outputs the call information CFn with the summary information OVn added, and changes the content of at least one of the call information CFn and the summary information OVn in accordance with the increase in the number of outputs.

[0121] For example, the output control unit 133a may output a call information CFn (e.g., CF2) with more attention-grabbing content compared to previously outputted call information CFn (e.g., CF1) as the number of outputs increases. Also, the output control unit 133a may output a summary information OVn (e.g., OV2) with more simplified content compared to previously outputted summary information OVn (e.g., OV1) as the number of outputs increases. The output control unit may output a call information CFn associated with the current number of outputs (which call it is) and output a summary information OVn associated with the current number of outputs.

[0122] Furthermore, the in-vehicle device 100a may have a content information storage unit 123 that stores a data structure capable of implementing output control processing related to a modified example, in which the content of at least one of the call information CFn and summary information OVn is changed in accordance with the increase in the number of outputs.Therefore, a content information storage unit 123 related to a modified example of the first embodiment will be described below with reference to Figure 6.

[0123] (Regarding the modified content information storage unit 123) Figure 6 shows an example in which a data structure capable of realizing the output control processing according to a modified version of the first embodiment is stored in the content information storage unit 123. In Figure 6, a content information storage unit 123-2 is shown as an example of the content information storage unit 123 according to a modified version of the first embodiment.

[0124] In the example shown in Figure 6, the content information storage unit 123-2 has items such as "Content ID" (Cx), "Category," "Location Information" (SPTx), "Content Data," "Acceptable Range" (RAx), and "Call Information" (CF). Since these items are the same as those in the content information storage unit 123-1, their explanation is omitted.

[0125] Furthermore, in the example shown in Figure 6, the content information storage unit 123-2 has an item such as "Output count_nth time". For example, as shown in Figure 6, the content information storage unit 123-2 may have items for n output counts, such as "Output count_1st time", "Output count_2nd time", etc.

[0126] "Output count_nth time" refers to the current output count, which is determined by the number of times the call information CFn with the summary information OVn attached has been output.

[0127] Furthermore, as shown in the example in Figure 6, the call information CFn and summary information OVn are registered in association with "Output Count_nth Time". For example, for the item "Output Count_1st Time" identified by content ID "C1" (content information C1), the call information CF1 "Is now a good time?" and the summary information OV1 "We have information about a cafe that we recommend for you." are registered in association. Similarly, for the item "Output Count_2nd Time" identified by content ID "C1", the call information CF2 "We have information that we recommend for you!" and the summary information OV2 "This is information about a cafe." are registered in association.

[0128] Comparing the content of the call information CF1 "Is now a good time?" and the call information CF2 "We have some information that we would like to recommend to you," the content of call information CF2 is more detailed and likely to attract more attention. As a result, the output control unit 133a can output call information that is more likely to attract attention compared to the call information output so far, in accordance with the increase in the number of outputs n.

[0129] Furthermore, comparing the content of summary information OV1, "Here is some information about cafes we recommend for you," and summary information OV2, "This is information about cafes," it is clear that the content of summary information OV2 is more simplified. As a result, the output control unit 133a can output summary information that is simpler than the summary information output so far, in accordance with the increase in the number of outputs n.

[0130] [6. Example of operation in a modified example] Next, we will describe an example of operation implemented as an output control process according to a modified version of the first embodiment. Specifically, we will describe a concrete example of operation of the in-vehicle device 100a that operates according to the data structure of the content information storage unit 123-2 as shown in Figure 6.

[0131] For example, Figure 5 shows an example in which the output control unit 133a outputs the call information CF based on a threshold value corresponding to the current output count, which is determined according to the number of times the call information CF has been output, and the current margin value. Following this example, in a modified example, the output control unit 133a may output the call information CFn with summary information OVn added, based on a threshold value corresponding to the current output count, which is determined according to the number of times the call information has been output, and the current margin value.

[0132] For example, as long as the output conditions are not met and the crew member CWx does not authorize the output of content information Cx for the call information CFn to which summary information OVn has been added, the output control unit 133a sequentially determines whether the threshold corresponding to the current margin remaining up to the allowable limit has been exceeded, according to the number of call information outputs. In other words, using the example in Figure 5, the output control unit 133a can sequentially output call information CFn to which summary information OVn has been added instead of call information CF.

[0133] More specifically, as shown in the example in Figure 5, the output control unit 133a determines that the count n=1 (output count_1st time) if the margin value is greater than or equal to the first threshold when the output conditions are not met. As a result, the output control unit 133a outputs the call information CF1 with summary information OV1 added. For example, in response to the control by the output control unit 133a, the speaker SP outputs the call information CF1 with summary information OV1 added, which reads, "Is now a good time? (Call information), We have information about a cafe we ​​recommend for you. (Summary information)."

[0134] The output control unit 133a determines that the occupant CW1 has given a negative response to the call information CF1, and if it determines that the output conditions are still not met even after a second condition check, it identifies the number of calls as n=2 (output count_2). As a result, the output control unit 133a outputs the call information CF2 with the summary information OV2 added. For example, in response to the control by the output control unit 133a, the speaker SP outputs the call information CF2 with the summary information OV2 added, which reads, "We have some information we recommend for you. (Call information), it's information about a cafe. (Summary information)."

[0135] [7. Summary of modified examples according to the first embodiment] According to the output control process of the modified first embodiment, the call information CFn is output in accordance with the decrease in the grace period for outputting content information. As the grace period decreases, the content of the call information CFn is changed to content that is more likely to attract attention. As a result, it is possible to suppress the situation in which the same call is repeated and to achieve a natural call. Furthermore, when summary information is added when the call is repeated, the summary information is simplified as the number of calls increases, so that the summary of the content information can be conveyed in short words without repeating the same summary information.

[0136] <Second Embodiment> [1. Functional configuration of in-vehicle equipment] From here, a second embodiment will be described. Figure 7 is a diagram showing an example of the configuration of each device according to the second embodiment. Figure 7 shows an example of the configuration of the in-vehicle device 100b according to the second embodiment and an example of the configuration of the server device 200 according to the embodiment. The configuration of the server device 200 may be the same between the first embodiment and the second embodiment, and therefore the explanation will be omitted.

[0137] Furthermore, a detailed explanation of the processing units whose reference numerals are common between the in-vehicle device 100a according to the first embodiment and the in-vehicle device 100b according to the second embodiment will be omitted, and the following explanation will focus on the new processing units that the in-vehicle device 100b according to the second embodiment has.

[0138] As shown in Figure 7, the in-vehicle device 100b according to the second embodiment includes a microphone MC, a speaker SP, a sensor SC, a communication unit 110, a storage unit 120, and a control unit 130b.

[0139] (Regarding the control unit 130b) The control unit 130b is implemented by a CPU or MPU, etc., which executes various programs (for example, information processing programs according to the embodiment) stored in the memory device inside the in-vehicle device 100b using RAM as a working area. Alternatively, the control unit 130b can be implemented by an integrated circuit such as an ASIC or FPGA.

[0140] As shown in Figure 7, the control unit 130b includes an information matching engine 131, an acquisition unit 132, an output control unit 133b, a specific unit 134b, and an update unit 135b, and realizes or executes the information processing functions and operations described below. Note that the internal configuration of the control unit 130b is not limited to the configuration shown in Figure 7, and other configurations are also possible as long as they perform the information processing described later. Furthermore, the connection relationships of the various processing units in the control unit 130b are not limited to the connection relationships shown in Figure 7, and other connection relationships are also possible.

[0141] (Regarding specific section 134b) The identification unit 134b identifies the content information Cx that was not output because the output conditions were not met, within the acceptable range RAx associated with the content information Cx, as unoutput content NCx.

[0142] (Regarding the output control unit 133b) The output control unit 133b performs output control related to the unoutput content NCx when the unoutput content NCx is identified by the identification unit 134b.

[0143] Specifically, the output control unit 133b outputs the unoutput content NCx along with the reason why it was not output at the intended time, if the output conditions for the unoutput content NCx are met. For example, the output control unit 133b may output the unoutput content NCx with the reason given, which is the situation SAy of the crew member CWx at the time within the allowable range RAx.

[0144] Furthermore, the output control unit 133b may identify the original timing at which the unoutput content NCx should have been output, based on the vehicle VEx movement history and the permissible range RAx associated with the unoutput content NCx, and may output information indicating the identified timing.

[0145] Here, assuming that the unoutput content NCx is recommendation information that recommends a predetermined spot, the associated allowable range RAx may be defined as area information corresponding to the location SPTx of this predetermined spot. In such an example, the output control unit 133b may identify the positional relationship between the location SPTx of the predetermined spot and the current location CPTx of the vehicle VEx at the time of outputting the unoutput content NCx, and output information indicating the identified positional relationship together with the unoutput content NCx. For example, the output control unit 133b may output the unoutput content NCx with information indicating the distance to the predetermined spot, starting from the current location CPTx of the vehicle VEx, added as information indicating the positional relationship.

[0146] Furthermore, the output control unit 133b is substantially the same processing unit as the output control unit 133a in the first embodiment, and also has the function of the output control unit 133a.

[0147] (Regarding update section 135b) The update unit 135b updates the output condition content (i.e., the content of the output determination table 122) according to the response content of the crew member CWx when non-output content NCx is output.

[0148] As a prerequisite for the function of the update unit 135b, the output control unit 133b first performs the following processing. Specifically, the output control unit 133b outputs question information Q, which inquires with the crew member CWx whether or not content information should be output, based on the reason why the unoutput content NCx was not output within the allowable range RAx. More specifically, the output control unit 133b outputs question information Q, which inquires with the crew member CWx whether or not content information should be output if the situation is SAy, based on the crew member CWx's situation SAy at that time within the allowable range RAx.

[0149] The update unit 135b updates the output conditions, which are defined based on the relationship between the type of unoutput content NCx and the situation SAy targeted by the question information Q (specifically, the situation SAy of the crew member CWx at that time within the acceptable range RAx), according to the crew member CWx's response to the question information Q. Specifically, if the crew member CWx permits the output of content information in the situation SAy targeted by the question information Q, the update unit 135b updates the content of the output conditions in the output determination table 122 to output content of the above type in the targeted situation SAy from then on.

[0150] [2. Processing Procedure] Next, specific examples of the output control process according to the second embodiment will be explained using Figures 8 and 9. Figure 8 illustrates the output control procedure for unoutput content NCx. Figure 9 illustrates the update process procedure in response to the crew CWx's response to the unoutput content NCx.

[0151] [2-1. Processing Procedure (1)] Figure 8 is a flowchart showing the procedure for output control processing to output unoutputted content NCx. Output control processing to output unoutputted content NCx may be started when the system moves to step A, as explained in Figure 5. Specifically, output control processing to output unoutputted content NCx may be started in step S503 of Figure 5 if it is determined that the acceptable range RAx is exceeded. For this reason, we will continue to use the example in Figure 5 and explain the output control processing procedure shown in Figure 8.

[0152] First, the identification unit 134b identifies the content information Cx that was not output within the acceptable range RAx as unoutput content NCx (step S801).

[0153] Next, the output control unit 133b identifies the status SAy of the occupant CW1 at the time the unoutput content NCx was not output as the reason why it was not output (step S802). Here, the status SAy of the occupant CW1 at the time the content was not output refers to the status SAy of the occupant CW1 at the time when the allowable range RAx was exceeded before the output conditions were met, and in effect, it refers to the status SAy at the time when it was within the allowable range RAx. Hereafter, the status SAy of the occupant CW1 of vehicle VE1 at that time will be referred to as "status SAy(P)". Using the example in Figure 5, the output control unit 133b identifies the status SAy(P) that occurred before the timing when it was determined that the output conditions were met (step S502; Yes) but the allowable range RAx was exceeded (step S503; Yes).

[0154] Next, the output control unit 133b identifies the original timing TM at which the content information Cx should have been output, based on the vehicle VE1's movement history LG1 and the allowable range RAx (step S803). For example, the output control unit 133b may identify the timing TM as the date and time at which the content information Cx was acquired (i.e., the date and time at step S501) among the dates and times when the vehicle VE1 was traveling within the allowable range RAx, based on the movement history LG1 and the allowable range RAx. The output control unit 133b may also identify the position information of the vehicle VE1 at the timing TM based on the movement history LG1.

[0155] Furthermore, the output control unit 133b generates pre-information PF based on the situation SAy(P) and the timing TM (step S804). For example, the output control unit 133b can generate text information as pre-information PF that includes the content, "We refrained from outputting earlier because you were in a conversation, but we have information to provide at time TM." In this example, "in a conversation" in the pre-information PF corresponds to the situation SAy(P), and "time TM" corresponds to the timing TM.

[0156] Next, the output control unit 133b calculates the positional relationship (e.g., distance and direction) of position SPTx from the current position CPT1 based on the position SPTx of the target spot in the content information Cx and the current position CPT1 of the vehicle VE1 (step S805).

[0157] For example, suppose the content information Cx is recommendation information such as "The famous XX Cafe, known for its cheesecake, is located at...!" In this case, the output control unit 133b calculates the positional relationship (e.g., distance and direction) of position SPTx from the current position CPT1, based on the position SPTx of the spot (XX Cafe) targeted by the content information Cx and the current position CPT1 of the vehicle VE1.

[0158] Then, the output control unit 133a processes the content information Cx by adding the calculated positional relationship information to the content information Cx (step S806). For example, if the output control unit 133b has calculated the positional relationship "300m behind and to the left" in S805, it can use this to process the content information Cx and generate content information TCx with content such as "300m behind and to the left, there was a cafe famous for its cheesecake."

[0159] In this state, the output control unit 133b first controls the output so that the preamble information PF is output from the speaker SP (step S807). For example, the output control unit 133b may synthesize an audio recording that reads out the preamble information PF and output this audio from the speaker SP.

[0160] Figure 8 shows an example where speaker SP outputs the following as introductory information PF: "We refrained from outputting earlier because you were in the middle of a conversation, but we have some information to provide at time TM."

[0161] Furthermore, the output control unit 133b controls the output so that the processed content information TCx is output from the speaker SP (step S808). For example, the output control unit 133b may synthesize a voice that reads out the content information TCx and output this voice from the speaker SP.

[0162] Figure 8 shows an example where speaker SP outputs the content information TCx, "300m behind and to the left, there was a cafe known for its cheesecake."

[0163] Next, the process moves to step B. The output control processing performed in step B and below is explained in Figure 9.

[0164] [2-2. Processing Procedure (2)] Figure 9 is a flowchart showing the procedure for updating the output conditions. The update process for updating the output conditions may be started when the processed content information TCx is output in step S808 of Figure 8. For this reason, we will continue to use the example in Figure 8 and explain the update process procedure shown in Figure 9.

[0165] First, the output control unit 133b determines whether or not the occupant CW1 has given any response to the content information TCx (step S901). For example, the output control unit 133a can determine whether or not the occupant CW1 has given any response to the content information TCx based on the spoken voice data collected by the microphone MC or the input content entered through operations on the in-vehicle device 100b.

[0166] If the output control unit 133b determines that the occupant CW1 has responded to the content information TCx (step S901; Yes), it determines whether the response is positive or negative (step S902). For example, the output control unit 133b can determine whether the response is positive or negative based on the speech content analyzed from the speech audio data collected by the microphone MC, or on the input content entered through operations on the in-vehicle device 100b.

[0167] For example, the output control unit 133b can determine that the response is positive if the occupant CW1 says something like, "Thank you! I'm fine," or if the "affirmative" button on the screen of the in-vehicle device 100b is pressed. On the other hand, the output control unit 133b can determine that the response is negative if the occupant CW1 says something like, "It's too late to tell me now!" or if the "negative" button on the screen of the in-vehicle device 100b is pressed.

[0168] If the output control unit 133b determines that the response is not positive (step S902; No), it outputs question information Q to inquire with crew member CW1 whether or not to output content information, based on the situation SAy(P) of crew member CW1 at the time when the acceptable range RAx was exceeded before the output conditions were met (step S903).

[0169] Specifically, the output control unit 133b generates question information Q that asks the crew member CW1 whether it is acceptable to output content information when the situation is SAy(P), and controls the output so that the question information Q is output from the speaker SP. For example, the output control unit 133b may synthesize an audio recording that reads out the question information Q and output this audio from the speaker SP.

[0170] For example, the output control unit 133b can generate question information Q such as, "Next time, should I notify you without waiting even if we are in the middle of a conversation?" In this example, "in the middle of a conversation" included in the question information Q corresponds to the situation SAy(P).

[0171] Figure 9 shows an example where speaker SP outputs the question information Q: "Next time, should I notify you without waiting, even if we are in the middle of a conversation?"

[0172] Next, the output control unit 133b determines whether the occupant CW1 has authorized the output of content information in situation SA(y) in response to the question information Q (step S904). For example, the output control unit 133b can determine whether the occupant CW1 has authorized the output of content information in situation SA(y) based on the speech content analyzed from the speech audio data collected by the microphone MC, or the input content entered through operations on the in-vehicle device 100b.

[0173] If crew member CW1 authorizes that content information may be output even during situation SA(y) (step S904; Yes), the update unit 135b updates the output conditions defined based on the relationship between the type of unoutput content NCx and situation SAy(P) (step S905). Specifically, the update unit 135b updates the content of the output conditions in the output determination table 122 to output content of the type of unoutput content NCx in situation SAy(P).

[0174] Here, taking the example where situation SAy(P) is situation SA2, i.e., "crew members are talking", and the type of unoutput content NCx is "recommendation information", the update unit 135b updates the content of the output condition in the output determination table 122, as shown in Figure 9. In other words, the update unit 135b updates the condition information "×" defined by the combination of situation SA2 "crew members are talking" and the content information type "recommendation information" to "〇".

[0175] Returning to the explanation, the update unit 135b terminates without performing the update process if the crew member CW1 does not respond to the content information TCx (step S901; No), if it determines that the response is positive (step S902; Yes), or if the crew member CW1 does not permit the output of the content information in situation SA(y) (step S904; No).

[0176] [3. Summary of output control according to the second embodiment] According to the output control processing of the second embodiment described in Figure 8, if the crew member CWx's status SAy changes after the output deadline to a state where it is no longer necessary to withhold the output of content information Cx, the reason why the content information Cx was not output will be output along with the content information Cx that was not output within the output deadline. Such output control processing increases the opportunities to provide useful information to users without damaging the crew member CWx's perception.

[0177] Furthermore, according to the output control processing of the second embodiment described in Figure 9, if the crew member CWx's status SAy is such that the output of content information Cx should be withheld, the content information Cx will not be output. On the other hand, in a status SAy where the output of content information Cx has been withheld, the crew member CWx's intention to output content information Cx is sought, and the content of the condition information is updated so that content information Cx will be output according to that intention in the future. Such output control processing increases the opportunities to provide useful information to users without damaging the crew member CWx's perception.

[0178] <Third Embodiment> [1. Functional configuration of in-vehicle equipment] From here, a third embodiment will be described. Figure 10 is a diagram showing examples of the configurations of each device according to the third embodiment. Figure 10 shows an example of the configuration of the in-vehicle device 100c and an example of the configuration of the server device 200 according to the third embodiment. The configuration of the server device 200 may be the same between the first embodiment and the third embodiment, so the explanation will be omitted.

[0179] Furthermore, a detailed explanation of the processing units whose reference numerals are common between the in-vehicle device 100a according to the first embodiment and the in-vehicle device 100c according to the third embodiment will be omitted, and the following explanation will focus on the new processing units that the in-vehicle device 100c according to the third embodiment has.

[0180] As shown in Figure 10, the in-vehicle device 100c according to the third embodiment includes a microphone MC, a speaker SP, a sensor SC, a communication unit 110, a storage unit 120, and a control unit 130c.

[0181] (Regarding the control unit 130c) The control unit 130c is implemented by a CPU or MPU, which executes various programs (for example, information processing programs according to the embodiment) stored in the memory device inside the in-vehicle device 100c using RAM as a working area. Alternatively, the control unit 130c can be implemented by an integrated circuit such as an ASIC or FPGA.

[0182] As shown in Figure 10, the control unit 130c includes an information matching engine 131, an acquisition unit 132, an output control unit 133c, a living area information acquisition unit 136c, and a determination unit 137c, and realizes or executes the information processing functions and operations described below. Note that the internal configuration of the control unit 130c is not limited to the configuration shown in Figure 10, and other configurations are also possible as long as they perform the information processing described later. Also, the connection relationships of the various processing units in the control unit 130c are not limited to the connection relationships shown in Figure 10, and other connection relationships are also possible.

[0183] (Regarding the output control unit 133c) The output control processing according to the third embodiment aims to forcibly output content information Cx provided by the server device 200 when the vehicle is traveling outside the occupant CWx's living area (for example, a travel destination), if the content information Cx recommends a predetermined spot located within the acceptable range RAx, so as not to miss this spot (because if it passes by, it is uncertain when it can be visited again).

[0184] In other words, if the determination unit 137c, described later, determines that the vehicle VEx is moving outside the living area of ​​the occupant CWx, the output control unit 133c will output content information of a predetermined type within the permissible range RAx associated with that content information, even if the output conditions are not met.

[0185] Specifically, if the output control unit 133c determines that the vehicle VEx is moving outside the living area of ​​the occupant CWx, it will output recommendation information recommending predetermined spots around the vehicle VEx, even if the output conditions are not met, within the permissible range RAx associated with the recommendation information.

[0186] For example, the output control unit 133c outputs the recommendation information when the current margin remaining before the allowable limit, which is the limit value of the allowable range RAx for which the output of recommendation information is permitted, falls below a threshold, and the vehicle VEx is moving outside the living area.

[0187] For example, the output control unit 133c may identify the positional relationship between the position SPTx of a predetermined spot and the current position CPTx of the vehicle VEx at the time the recommendation information is output, and output information indicating the identified positional relationship along with the recommendation information. For example, the output control unit 133c may output the recommendation information with information indicating the distance to the predetermined spot, starting from the current position CPTx of the vehicle VEx, added as information indicating the positional relationship.

[0188] Furthermore, the output control unit 133c is substantially the same processing unit as the output control unit 133a in the first embodiment, and also has the function of the output control unit 133a.

[0189] (Regarding the 136c section of the Living Area Information Acquisition Unit) The living area information acquisition unit 136c acquires living area information relating to the living area of ​​the occupant CWx, which has been identified based on the occupant CWx's movement history. For example, the in-vehicle device 100c may have a function to periodically determine the living area based on the vehicle VEx's movement history and to keep the living area information up to date. According to such a function, for example, the living area may be determined based on the distribution of locations where the vehicle VEx has traveled and where it has stopped.

[0190] (Regarding the determination unit 137c) The determination unit 137c determines whether the vehicle VEx is moving outside the living area of ​​the occupant CWx. Specifically, the determination unit 137c determines whether the vehicle VEx is moving outside the living area of ​​the occupant CWx based on the vehicle VEx's current location CPTx and the living area information.

[0191] [2. Processing Procedure] From here, a specific example of the output control process according to the third embodiment will be explained using Figure 11. Figure 11 is a flowchart showing the procedure of the output control process according to the third embodiment. Figure 11 shows a scene in which the on-board device 100c mounted on the vehicle VE1 performs the output control process.

[0192] Note that the output control process according to the third embodiment may be executed together with the output control process according to the first embodiment. For this reason, the flowchart shown in Figure 11 is a modification of the flowchart shown in Figure 5. Specifically, steps S1101 to S1104 shown in Figure 11 represent the procedure for the output control process according to the third embodiment. Figure 11 will explain the procedure for the output control process according to the third embodiment, focusing on these steps.

[0193] The output control unit 133c determines whether the margin value is greater than or equal to the threshold corresponding to the nth time (step S507). If the output control unit 133c determines that the margin value is greater than or equal to the threshold corresponding to the nth time (step S507; Yes), it recognizes that there is enough time before the timing to output the call information CF.

[0194] In this state, the living area information acquisition unit 136c acquires living area information of occupant CW1 (step S1101). The in-vehicle device 100c may have the latest living area information of occupant CW1 stored in the storage unit 120, and the living area information acquisition unit 136c may acquire the latest living area information of occupant CW1 from there.

[0195] The determination unit 137c determines whether vehicle VE1 is moving within the living area of ​​occupant CW1 based on the current location CPTx of vehicle VEx and living area information (step S1102).

[0196] If the output control unit 133c determines that the vehicle VE1 is moving within the living area of ​​the occupant CW1 (step S1102; Yes), it controls the output so that the call information CF is output from the speaker SP (step S509).

[0197] On the other hand, if the output control unit 133c determines that the vehicle VE1 is not moving within the living area of ​​the occupant CW1 (i.e., the vehicle VE1 is moving outside the living area of ​​the occupant CW1) (step S1102; No), it determines whether the type of content information Cx acquired in step S501 is a recommendation, and whether the current margin remaining up to the allowable limit, which is the limit value of the allowable range RAx for which the output of the content information Cx is permitted, is less than a predetermined threshold (step S1103).

[0198] If the output control unit 133c determines that the type of content information Cx is not a recommendation, or that the current margin remaining up to the tolerance limit of content information Cx is not less than a predetermined threshold (step S1103; No), it proceeds to step S509.

[0199] In this way, by determining both that the type of content information Cx is a recommendation and that the current margin remaining before the acceptable limit of content information Cx output is less than a predetermined threshold, even if the type of content information Cx is a recommendation, if there is a lot of margin remaining before the acceptable limit of content information Cx output, the call information CF can be output in step S509.

[0200] On the other hand, if the output control unit 133c determines that the type of content information Cx is a recommendation and that the current margin remaining before the allowable limit for outputting content information Cx is less than a predetermined threshold (step S1103; Yes), it recognizes that although the output conditions are not met at this point, it is time to output the content information Cx, which recommends spots located outside the living area.

[0201] Then, the output control unit 133c controls the output so that the content information Cx is output from the speaker SP (step S1104).

[0202] For example, suppose the content information Cx is recommendation information such as "The famous XX Cafe with its cheesecake is located at...!" In this case, the output control unit 133c may calculate the positional relationship (e.g., distance and direction) of position SPTx from the current position CPT1, based on the position SPTx of the spot (XX Cafe) targeted by the content information Cx and the current position CPT1 of the vehicle VE1. Then, the output control unit 133c may process the content information Cx based on the calculation result, synthesize an audio reading of the processed content information Cx, and output this audio from the speaker SP.

[0203] Figure 11 shows an example where speaker SP outputs the processed content information Cx, "There is a famous cheesecake cafe called XX 200m ahead on the left!"

[0204] Alternatively, in step S1103, it may be necessary to determine only whether the type of content information Cx obtained in step S501 is a recommendation, and if it is determined that the type of content information Cx is a recommendation, the content information Cx may be output immediately.

[0205] [3. Summary of output control according to the third embodiment] According to the output control processing of the third embodiment described in Figure 11, even if the occupant CWx's status SAy is such that output of content information Cx should be refrained from, if the vehicle is traveling outside the occupant CWx's living area (for example, a travel destination), only content information Cx recommending spots located in areas outside the living area will be output within the acceptable range RAx of content information Cx. With such output control processing, information about spots that are difficult to visit can be provided without fail, thereby increasing the opportunities to provide useful information to users.

[0206] <Other> [1. Hardware Configuration] Furthermore, the in-vehicle devices 100 (in-vehicle devices 100a, 100b, and 100c) described above are realized by a computer 1000 having a configuration such as that shown in Figure 12. Figure 12 is a hardware configuration diagram showing an example of a computer that realizes the functions of the in-vehicle devices 100. The computer 1000 has a CPU 1100, RAM 1200, ROM 1300, HDD 1400, communication interface (I / F) 1500, input / output interface (I / F) 1600, and media interface (I / F) 1700.

[0207] The CPU 1100 operates based on programs stored in the ROM 1300 or HDD 1400, controlling various components. The ROM 1300 stores boot programs executed by the CPU 1100 when the computer 1000 starts up, as well as programs that depend on the computer 1000's hardware.

[0208] The HDD1400 stores programs executed by the CPU1100, as well as data used by such programs. The communication interface1500 receives data from other devices via a predetermined communication network and sends it to the CPU1100, and transmits data generated by the CPU1100 to other devices via the predetermined communication network.

[0209] The CPU 1100 controls output devices such as displays and input devices such as keyboards via the input / output interface 1600. The CPU 1100 acquires data from input devices via the input / output interface 1600. The CPU 1100 also outputs the generated data to output devices via the input / output interface 1600.

[0210] The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase Change Rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0211] For example, when the computer 1000 functions as an in-vehicle device 100 according to the embodiment, the CPU 1100 of the computer 1000 realizes the functions of the control unit 130 (130a, 130b, 130c) by executing programs loaded on the RAM 1200. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, these programs may be obtained from other devices via a predetermined communication network.

[0212] [2. Others] Furthermore, among the processes described in each of the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, specific names, and information including various data and parameters shown in the above document and drawings can be changed at will unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown.

[0213] Furthermore, each component of each illustrated device is a functional concept and does not necessarily have to be physically configured as shown. In other words, the specific forms of distribution and integration of each device are not limited to those shown, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads and usage conditions. For example, in the first to third embodiments described above, at least a part of the output control processing described as being primarily handled by the in-vehicle device 100 may be processed by the server device 200.

[0214] Furthermore, the above embodiments can be combined as appropriate, provided that the processing content is not contradictory.

[0215] <Summary> Although some embodiments of the present application have been described in detail above with reference to the drawings, these are illustrative examples, and the present disclosure can be implemented in various modified and improved forms based on the knowledge of those skilled in the art, starting with the embodiments described in this section of the disclosure. [Explanation of symbols]

[0216] 1 System 100 In-vehicle equipment 120 Storage section 121 Map Information Storage Unit 122 Output Determination Table 123 Content Information Storage Unit 131 Information Integrity Engine 132 Acquisition Department 100a On-board equipment 133a Output control unit 100b On-vehicle device 133b Output control unit 134b Specific part 135b Update section 100c in-vehicle device 133c Output Control Unit 136c Area Information Acquisition Department 137c Judgment part

Claims

1. An acquisition unit that acquires content information to be output into the mobile device, An output control unit that outputs the content information when the type of content information satisfies output conditions corresponding to the current status of the occupants of the mobile body, Equipped with, If the output condition is not met and the content information is not output, the output control unit will output information to obtain permission from the occupant of the mobile vehicle to output the content information. An information processing device characterized by the following:

2. The output control unit causes the call information to output within the permissible range in which the output of the content information is permitted. The information processing apparatus according to feature 1.

3. If the output control unit determines that the current margin remaining up to the tolerance limit, which is the limit of the tolerance range, is equal to or greater than the first threshold, it will not output the call information and will re-determine whether the output condition has been met. The information processing apparatus according to feature 2.

4. The output control unit outputs the call information when the output conditions are not met and the margin value falls below the first threshold. The information processing apparatus according to claim 3.

5. If the occupant does not authorize the output of the content information in response to the call information, the output control unit will not output the content information and will instead re-determine whether the output conditions have been met. The information processing apparatus according to feature 4.

6. The output control unit will output the call information at predetermined intervals corresponding to the decrease in the margin value, as long as the output conditions are not met and the occupant does not authorize the output of the content information in response to the call information. The information processing apparatus according to feature 5.

7. The output control unit determines whether the margin value has fallen below a second threshold, which is lower than the first threshold, and outputs the call information if it has fallen below the second threshold. The information processing apparatus according to feature 6.

8. The output control unit, when the output conditions are met, or when the occupant authorizes the output of the content information in response to the call information, determines whether the acceptable range is met, and if the acceptable range is met, outputs the content information. The information processing apparatus according to feature 2.

9. The output control unit, when the output conditions are met, or when the occupant authorizes the output of the content information in response to the call information, determines whether the acceptable range is met, and if the acceptable range is not met, outputs the content information with an explanation of why the content information could not be output within the acceptable range. The information processing apparatus according to feature 2.

10. An information processing method performed by an information processing device, The acquisition process involves obtaining content information to be output into the mobile device, An output control step that causes the content information to be output when the type of content information satisfies output conditions corresponding to the current status of the occupants of the mobile body, Includes, If the output control step fails to output the content information because the output conditions are not met, it will output information to obtain permission from the occupant of the mobile vehicle to output the content information. An information processing method characterized by the following:

11. An information processing program executed by an information processing device, Procedure for obtaining content information to be output into a mobile device, An output control procedure that causes the content information to be output when the type of content information satisfies output conditions corresponding to the current status of the occupants of the mobile body, The information processing device is made to execute the above, If the output control procedure fails to output the content information because the output conditions are not met, it will output information to obtain permission from the occupant of the mobile vehicle to output the content information. An information processing program characterized by the following features.

Images