Information processing device, information processing method and information processing program
The information processing device optimizes the playback and output of multiple audio streams in vehicles by using an information matching engine to prioritize and control the output order based on driving conditions and geographical ranges, addressing interference issues in conventional systems.
Patent Information
- Application Number
- JP2025109597
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-06-27
- Publication Date
- 2025-08-28
AI Technical Summary
Conventional systems fail to support appropriate output settings for applications providing content information in vehicles, leading to potential interference and difficulty in hearing multiple audio information streams during vehicle travel.
An information processing device and method that includes an acquisition unit to gather performance information, a generation unit to analyze and generate usage information, and an output unit to set optimal playback and output of content information based on driving conditions and geographical ranges, using an information matching engine to prioritize and control the output order.
Ensures non-interfering and efficient playback of multiple audio streams by determining optimal output order and timing, reducing the risk of missed content and enhancing user experience during vehicle travel.
Smart Images

Figure 2025126318000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]
[0002] BACKGROUND ART Conventionally, there is known a technique for outputting information such as warning information, route guidance information, road traffic information, tourist information, and advertisement information as audio information to a driver while the vehicle is traveling.
[0003] However, if the playback and output timing of these pieces of audio information overlaps, it may be difficult to hear or may interfere with driving. Therefore, a system has been proposed that schedules the playback and output timing of these pieces of audio information so that they do not interfere with each other. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-221837 Summary of the Invention [Problem to be solved by the invention]
[0005] However, the above-described conventional technology has a problem in that it may not be possible to support appropriate output settings for an application that provides content information to be reproduced and output in a vehicle.
[0006] For example, in the above-mentioned conventional technology, when there is a risk of interference between the playback of multiple pieces of audio information, the playback order of the combination of these audio information playback orders is simply selected to be the combination that will result in the least amount of loss due to non-playback and delayed playback, and there is no mention or suggestion of the existence of an application that provides the audio information or the provision of information to the application.
[0007] Therefore, the above-described conventional technology does not necessarily support appropriate output settings for an application that provides content information to be reproduced and output in a vehicle.
[0008] The present invention has been made in consideration of the above, and aims to provide an information processing device, an information processing method, and an information processing program that can assist an application that provides content information to be played and output in a vehicle in appropriately setting its output. [Means for solving the problem]
[0009] The information processing device of claim 1 is an information processing device that plays and outputs content information acquired from an application that can provide content information to a mobile body, and is characterized by having an acquisition unit that acquires performance information including output performance information on whether the content information has been played and output, a generation unit that analyzes the performance information acquired by the acquisition unit and generates usage information to be used for setting the output of the content information by the application, and an output unit that outputs the usage information generated by the generation unit to the application.
[0010] The information processing method of claim 11 is an information processing method executed by an information processing device that plays and outputs content information acquired from an application capable of providing content information to a mobile body, and is characterized by including an acquisition step of acquiring performance information including output performance indicating whether the content information has been played and output, a generation step of analyzing the performance information acquired by the acquisition step and generating usage information to be used for setting the output of the content information by the application, and an output step of outputting the usage information generated by the generation step to the application.
[0011] The information processing program of claim 12 is an information processing program executed by an information processing device that plays and outputs content information acquired from an application that can provide content information to a mobile body, and is characterized in that it causes a computer provided in the information processing device to function as an acquisition means that acquires performance information including output performance indicating whether the content information has been played and output, a generation means that analyzes the performance information acquired by the acquisition means and generates usage information that is used for setting the output of the content information by the application, and an output unit that outputs the usage information generated by the generation means to the application. [Brief explanation of the drawings]
[0012] [Figure 1] FIG. 1 is a diagram illustrating an example of a system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of the information matching process. [Figure 3] FIG. 3 is a diagram illustrating an example of the configuration of the information processing device according to the first embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a content database according to the first embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of the travel information database according to the first embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of information processing according to the first embodiment. [Figure 7] FIG. 7 is a diagram illustrating another example of information processing according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing modifications corresponding to the information processing according to the first embodiment. [Figure 9] FIG. 9 is a flowchart showing an overview of an information processing procedure according to the first embodiment. [Figure 10] FIG. 10 is a flowchart showing a determination process procedure included in the information processing procedure according to the first embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of the configuration of an information processing device according to the second embodiment. [Figure 12] FIG. 12 is a diagram illustrating an example of the performance information database according to the second embodiment. [Figure 13] FIG. 13 is a flowchart showing an overall image of an information processing procedure focusing on output results. [Figure 14] FIG. 14 is a flowchart showing an overview of an information processing procedure focusing on advertising performance. [Figure 15] FIG. 15 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device. DETAILED DESCRIPTION OF THE INVENTION
[0013] Hereinafter, a mode for carrying out the present invention (hereinafter referred to as an embodiment) will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.
[0014] In the following embodiments, a vehicle can be read as a moving body, a driving situation as a moving situation, and a driving speed as a moving speed. The expression "playback output in a vehicle" includes the meaning of "playback output to a terminal device moving with the vehicle." The expression "output control so that a vehicle plays back and outputs content information" includes the meaning of output control to a terminal device and provision (output) of content information to a user of the vehicle.
[0015] 1. Introduction Examples of terminal devices that travel with a vehicle include terminal devices installed in the vehicle (e.g., in-vehicle devices) and terminal devices such as smartphones owned by users (e.g., vehicle passengers, including the driver), and applications that provide various types of content to such terminal devices are known.
[0016] For example, there are applications that assist users in driving by providing content information that is tailored to the vehicle's driving status or the situation of the user driving the vehicle, or content information that provides route guidance according to various inputs (e.g., text input or voice input). There are also applications that assist users in driving more comfortably by providing various content information such as tourist guides, store guides, advertising information, and other useful information in accordance with the vehicle's driving.
[0017] Here, applications may be classified into specific types depending on the categories of content information they can provide. For example, an application related to ADAS (Advanced Driver-Assistance Systems) provides content information categorized as "warnings" or "cautions," and is therefore classified into a type such as "ADAS" or "safety support." On the other hand, an application related to various types of guidance (e.g., route guidance, tourist information, etc.) provides content information categorized as "guidance," and is therefore classified into a type such as "guidance support." Furthermore, an application related to store information (e.g., store advertisements) provides content information categorized as "advertisement," and is therefore classified into a type such as "advertising provision."
[0018] The application also passes content information it wishes to provide to the user to an information matching engine (more specifically, a computer equipped with the information matching engine), which will be described later, and plays back and outputs the content information via the information matching engine. At this time, the application assigns meta information to the content information, including range information indicating the range to be played back and output, category information indicating the category of the content information, and the length (playback time) of the content information.
[0019] The range information indicating the range in which the content information should be played back corresponds to condition information that specifies the geographical range in which the content information should be played back, the time range, the vehicle travel distance range, the vehicle passing area range, the vehicle speed range, etc., and conditions the content information to be played back so long as it is within that range. In the following embodiment, the description focuses on area information (an example of range information) indicating the geographical range in which the content information should be played back, but the information processing according to the embodiment can also be applied to ranges other than the geographical range, i.e., the time range, the vehicle travel distance range, the vehicle passing area range, and the vehicle speed range.
[0020] Furthermore, when each application sets a geographical range in this manner, some or all of the geographical ranges may overlap between the applications. This can result in a problem of interference between playback and output of content information corresponding to the overlapping geographical ranges. Furthermore, since the content information is configured as a voice message, taking into consideration that the intended user is a vehicle passenger, interference in playback and output may hinder driving. For this reason, a computer equipped with an information matching engine determines an appropriate output order and appropriate output timing under the control of the information matching engine. Furthermore, the computer predicts the driving conditions of a vehicle, which change from time to time, and prioritizes the content information to be played and output in order to optimize the content information to be played and output.
[0021] Furthermore, depending on the determined priority and output order, some content information may be discarded without being played back. For this reason, applications may attempt to dynamically control (output setting) the range in which their own content information is played back as efficiently as possible, but a computer equipped with an information matching engine can also support the application in setting the output by providing feedback to the application according to performance information regarding the playback output.
[0022] [2. About the system] Next, a system including the above-described application and a computer equipped with an information matching engine will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of a system according to an embodiment. Fig. 1 shows an information processing system Sy as an example of a system according to an embodiment. Information processing according to an embodiment, which will be described later, is realized by the information processing system Sy.
[0023] (Regarding terminal device 10) The terminal device 10 (edge terminal) is an information processing terminal used by a user (a passenger in a vehicle). The terminal device 10 may be, for example, a stationary in-vehicle device installed in a vehicle, or a portable terminal device (for example, a smartphone, a tablet terminal, a notebook PC, a desktop PC, a PDA, etc.) owned by a user. In this embodiment, the terminal device 10 is assumed to be an in-vehicle device.
[0024] In the example of FIG. 1, the terminal device 10 is provided in a vehicle VE1 driven by a user U1, and reproduces and outputs content information in accordance with output control by a computer equipped with an information matching engine. For example, the terminal device 10 has a notification unit (output unit) and causes the content information to be output from the notification unit. For example, the notification unit may be a speaker or a display screen, and the terminal device 10 reproduces and outputs content information in the form of a voice message (audio content) via the speaker. Furthermore, the notification unit may be a display screen, and the terminal device 10 can display information supporting the details of the audio content on the display screen.
[0025] In addition, various applications such as an ADAS application, a navigation application, a music application, a delivery application, an insurance application, etc. may be installed in the terminal device 10 at the user's discretion, and such applications can transmit user information including, for example, account information and setting information set by the user to the cloud computer CCP2 described below.
[0026] The application introduced into the terminal device 10 may be an application for an edge terminal corresponding to an application that provides content information in the form of a voice message along with range information (hereinafter, sometimes referred to as the "application relating to the embodiment"), or it may be any application different from the application relating to the embodiment.
[0027] (About the ECP1 edge computer) The edge computer ECP1 is a computer that performs data processing (edge processing) near the terminal device 10, and includes a situation assessment engine E30-1 and an information matching engine E100-1. According to the example of Fig. 1, the edge computer ECP1 is provided with an application AP1x (e.g., an application AP11, an application AP12, an application AP13, etc.) as an application according to the embodiment.
[0028] 1, the application AP1x is provided inside the edge computer ECP1, but the application AP1x may be independent from the edge computer ECP1. In such a case, for example, the information processing system Sy may further include a server device (application server) corresponding to the application AP1x, while the edge computer ECP1 may not have the application AP1x inside.
[0029] Furthermore, since the application AP1x is an application that provides content information of which output to the user is of a high urgency, it is incorporated into the edge computer ECP1 located near the terminal device 10. As a result, the content information provided by the application AP1x can be reproduced and output with a shorter time lag in accordance with the driving conditions of the vehicle VE1. For this reason, the application AP1x may be, for example, an application related to ADAS, and provides content information categorized as "warning" or "caution."
[0030] Furthermore, the edge computer ECP1 may further include a general-purpose proxy application as shown in FIG.
[0031] (About Cloud Computer CCP2) The cloud computer CCP2 is a computer that exists on the cloud side and provides various types of information, for example, in a push format, and has a situation assessment engine E30-2 and an information matching engine E100-2 built in. Also, according to the example of Fig. 1, the cloud computer CCP2 is provided with an application AP2x (for example, an application AP21, an application AP22, an application AP23, etc.) as an application according to the embodiment.
[0032] 1, the application AP2x is provided inside the cloud computer CCP2, but the application AP2x may be independent of the cloud computer CCP2. In such a case, for example, the information processing system Sy may further include a server device (application server) corresponding to the application AP2x, while the cloud computer CCP2 may not have the application AP2x inside.
[0033] The application AP2x may be an application that provides content information that does not require immediate output to the user. For this reason, the application AP2x is installed in a cloud computer CCP2 on the cloud side, which is separate from the terminal device 10. For this reason, the application AP2x may be an application related to guidance support or advertisement provision, for example, and provides content information categorized as "guidance" or "advertisement."
[0034] (Specific examples of information processing) Next, specific examples of processes performed by the application, the situation understanding engine, and the information matching engine according to the embodiment will be described. In the following, the content information will be described as audio content. The content information is not limited to audio content, but may also be, for example, video content.
[0035] First, a specific example of processing by an application according to the embodiment will be described. Since the processing content is the same for both applications AP1x and AP2x, the application AP1x will be used as an example for the description.
[0036] The application AP1x personalizes the voice content provided to each user based on the user's usage history. The application AP1x also determines the content of the voice message to respond to based on the content of the voice input by the user, so that the application AP1x can communicate with the user. The application AP1x can also determine the voice content to be provided to the user and the content of the voice message to respond to the user based on the user's situation.
[0037] The application AP1x also performs a generation process to generate audio content. For example, the application AP1x determines the category of audio content to be played back based on data received from the situation recognition engine E30-1 (or the situation recognition engine E30-2 in the case of the application AP2x), and generates audio content of the determined category.
[0038] For example, the application AP1x generates audio content according to the vehicle's traveling situation grasped by the situation grasp engine E30-1. Note that the audio content generated by the generation process may be, for example, text data that will be the basis for a voice message that will ultimately be notified to the user, and may define the content of the voice message that will be obtained by later converting it into voice data. In other words, the application AP1x is not limited to generating voice data as audio content, and may generate data in other formats that will be the basis for a voice message as audio content.
[0039] The application AP1x can also specify the timing for playing back and outputting the audio content. For example, the application AP1x can generate range information indicating the range within which the audio content is permitted to be played back and output, using a geographical range, a time range, a vehicle travel distance range, a vehicle passing area range, a vehicle speed range, or the like within which the audio content is to be played back and output. In this case, the application AP1x transmits the audio content to which meta information including the range information is attached to the information matching engine E100-1 (or the information matching engine E100-2 in the case of the application AP2x), thereby requesting (reserving) the terminal device 10 to play back and output the audio content under the conditions indicated by the range information.
[0040] Next, a specific example of processing by the situation recognition engine will be described. Since the processing content is the same for both the situation recognition engine E30-1 and E30-2, the situation recognition engine E30-1 will be used as an example.
[0041] The situation assessment engine E30-1 performs a situation assessment process, which is an analysis process for assessing the vehicle's driving situation. For example, the situation assessment engine E30-1 senses the vehicle's driving situation based on sensor information obtained from various sensors. Note that the sensors referred to here may be, for example, sensors provided in the vehicle or sensors included in the terminal device 10, such as an acceleration sensor, a gyro sensor, a magnetic sensor, a GPS, a camera, a microphone, etc.
[0042] For example, the situation awareness engine E30-1 can perform the following series of analysis processes. For example, the situation awareness engine E30-1 performs sensing based on sensor information acquired from the above sensors and performs base analysis by using the sensing results as core elements. In the base analysis, the situation awareness engine E30-1 extracts necessary data using the core elements as information sources and converts and processes the extracted data. Next, the situation awareness engine E30-1 performs high-level analysis using the converted and processed data. In the high-level analysis, the situation awareness engine E30-1 analyzes specific driving situations based on the converted and processed data. For example, the situation awareness engine E30-1 analyzes the driving situation of the vehicle, such as whether the vehicle is traveling on a straight road or a curve, the driving speed, the direction of travel, and the traffic congestion situation.
[0043] According to the example of FIG. 1, the situation recognition engine E30-2 may use statistical information obtained by statistical processing of logs relating to the driving situation and user operations in the situation recognition processing.
[0044] Next, a specific example of processing by the information matching engine will be described. Since the processing content is the same for both information matching engines E100-1 and E100-2, the information matching engine E100-1 will be used as an example. As shown in Figures 2 and 3, the information matching engine E100-1 has a request manager function and a response manager function.
[0045] The request manager function accepts requests from application AP1x (application AP2x in the case of information matching engine E100-2) and performs queuing according to the accepted request. Note that the request here may be an output request requesting that the generated audio content be played back and output, and is transmitted, for example, including the audio content. The request manager function also queues the accepted audio content in the content buffer.
[0046] The response manager function performs output determination processing in accordance with rules. For example, the response manager function performs output determination processing according to an output determination algorithm. More specifically, the response manager function determines the priority and output order of audio content that has been reserved for output, based on driving information indicating the driving situation grasped by the situation grasp engine E30-1 (or the situation grasp engine E30-2 in the case of the information matching engine E100-2) and range information included in the request. The response manager function then controls the terminal device 10 to play and output the audio content in the output order according to the determined priority.
[0047] [3. Information processing flow] Next, the flow of information processing (information processing according to the embodiment) realized by the information processing system Sy will be described with reference to Fig. 1. Here, a situation is assumed in which audio content is reproduced and output to a user U1 driving a vehicle VE1 via a terminal device 10 corresponding to an in-vehicle device of the vehicle VE1. In this situation, the terminal device 10 transmits sensor information detected by a sensor possessed by the terminal device 10 to the edge computer ECP1 as needed.
[0048] In this state, the flow of information originating from the edge computer ECP1 is shown first. When the situation assessment engine E30-1 of the edge computer ECP1 acquires sensor information transmitted from the terminal device 10, it performs a situation assessment process to assess the traveling state of the vehicle VE1. For example, the situation assessment engine E30-1 performs a series of analysis processes, such as sensing using the sensor information, base analysis using the sensing results as core elements, and higher-level analysis using data obtained as a result of the base analysis, to perform a detailed situation assessment process.
[0049] Then, the situation awareness engine E30-1 transmits driving information indicating the driving situation grasped by the situation awareness processing to a user that uses the driving information. For example, the situation awareness engine E30-1 transmits the driving information to the information matching engine E100-1, the application AP1x, and the situation awareness engine E30-2. Note that the driving situation here may be, for example, the position, driving speed, and traveling direction of the vehicle VE1.
[0050] When the application AP1x acquires driving information from the situation assessment engine E30-1, it performs a generation process to generate audio content based on the acquired driving information. For example, the application AP1x generates audio content according to the driving situation of the vehicle VE1 based on the driving information acquired from the situation assessment engine E30-1. The application AP1x also generates range information indicating the range within which the audio content is permitted to be played back, using the geographical range, time range, driving distance range of the vehicle VE1, passing area range of the vehicle VE1, or vehicle speed range within which the audio content should be played back, and assigns meta information including the generated range information to the audio content. The application AP1x then inputs the audio content with the assigned meta information to the information matching engine E100-1.
[0051] When the situation awareness engine E30-2 acquires the driving information from the situation awareness engine E30-1, the situation awareness engine E30-2 performs a situation awareness process for understanding the driving state of the vehicle VE1 based on the acquired driving information. For example, the driving information acquired from the situation awareness engine E30-1 is accumulated in a predetermined database of the cloud computer CCP2. The database may also accumulate logs related to user operations, and the situation awareness engine E30-2 performs statistical processing on the accumulated driving information and operation logs, thereby performing the situation awareness process for understanding the driving state of the vehicle VE1 using statistical information indicating the results of the statistical processing and external data acquired from outside.
[0052] The external data referred to here is data that can be acquired because it exists in the cloud and is useful for understanding the driving situation. For example, the external data may include weather information indicating the weather conditions, traffic information indicating the traffic conditions, and road information indicating the road conditions. Of course, the external data is not limited to these examples.
[0053] Then, the situation recognition engine E30-2 transmits driving information indicating the driving situation recognized by the situation recognition process to a user that uses the driving information. For example, the situation recognition engine E30-2 transmits the driving information to the information matching engine E100-2 and the application AP2x. Note that the driving situation referred to here may be, for example, the position, driving speed, and traveling direction of the vehicle VE1.
[0054] Furthermore, in response to the situation assessment process being performed between the situation assessment engines E30-1 and E30-2 and the generation process being performed between the applications AP1x and AP2x, the information matching engines E100-2 to E100-1 perform information matching process. For example, the information matching engines E100-2 to E100-1 perform information matching process to match the optimal combination of audio content among the output candidate audio content generated by the generation process so that the audio content is output in the optimal order.
[0055] For example, area information (an example of range information) indicating the geographical range in which the audio content should be played back is associated as meta-information with each audio content generated by the generation process. Therefore, in the information consistency process, a playback output priority is calculated for each of the audio content items based on the driving information indicating the driving situation grasped by the situation grasping process. Furthermore, in the information consistency process, an output order for a combination of audio content items according to priority is determined based on the playback time, area information, and driving information of each of the audio content items. Then, output control is performed so that the audio content items included in this combination are played back in the determined output order so as not to interfere with each other.
[0056] In addition, area information indicating a geographical location or a geographical range where the playback output should be terminated may be associated with the audio content as meta information. In such a case, the information matching process may determine the output start timing for starting the playback output based on the playback time of each of the multiple audio contents and the area information.
[0057] An example of the information matching process and the output control process according to the result of the information matching process will be described below using the example of FIG.
[0058] First, the information matching engine E100-2 performs output determination processing in accordance with area information (rules) that correspond to each audio content input from the application AP2x and indicate the geographical range in which the audio content should be played back. For example, the response manager function of the information matching engine E100-2 performs output determination processing in accordance with an output determination algorithm.
[0059] More specifically, the response manager function determines the priority and output order of the audio contents to be output, taking into consideration the driving information indicating the driving situation grasped by the situation grasp engine E30-2 and the playback time of each audio content. For example, the response manager function determines the output order of a combination of audio contents according to the priority. Note that the response manager function may perform the output determination process by further using user information transmitted from an application inserted in the terminal device 10, as shown in FIG. 1.
[0060] Then, the information matching engine E100-2 outputs the information determined by the response manager function as information according to the output determination result to the edge computer ECP1. The information output to the edge computer ECP1 is input to the information matching engine E100-1 via the general-purpose proxy application of the edge computer ECP1.
[0061] The information matching engine E100-2 performs output determination processing in accordance with area information (rules) corresponding to the audio content input from the application AP1x and the audio content indicated by the combination input from the information matching engine E100-2 as the output determination result. For example, the response manager function of the information matching engine E100-1 performs output determination processing in accordance with an output determination algorithm.
[0062] More specifically, the response manager function determines the final priority and output order of the audio contents that have been scheduled for output, taking into consideration the driving information indicating the driving situation grasped by the situation grasping engine E30-1, the playback time of each audio content, and the information (priority, output order) determined by the information matching engine E100-2. For example, the response manager function determines the output order of a combination of audio contents according to priority.
[0063] Then, the information matching engine E100-2 performs output control on the terminal device 10 so that the audio contents are reproduced and output in the output order according to the determined priority. In accordance with the output control, the terminal device 10 reproduces and outputs the audio contents included in the combination according to the priority in order so as not to interfere with each other.
[0064] 1, the information matching engine E100-2 can also perform LED control on the terminal device 10 to cause the LED to emit light according to a category so that the user can recognize, for example, to which category the audio content currently being played and output belongs. Also, according to the example of Fig. 1, the information matching engine E100-2 can also perform display control on the terminal device 10 to display information supporting the details of the audio content on the display screen.
[0065] [4. Specific examples of information consistency processing] Next, the information matching process performed by the information matching engine will be described in more detail using a specific example. Figure 2 is a diagram showing an example of the information matching process. Figure 2 shows a scene in which the information matching process is performed by the information matching engine E100-1.
[0066] Figure 2 shows an example in which application AP11, an ADAS-related application residing on edge computer ECP1, generates audio content C111 (safety support information C111) with the message content "Watch out for vehicles jumping out into the road," and reserves (requests) playback output by sending an output request to information matching engine E100-1 requesting playback output of the generated audio content C111.
[0067] Figure 2 also shows an example in which application AP21, a guidance support-related application residing on cloud computer CCP2, generates audio content C211 (tourist information C211) with the message content "Turn right ahead," and reserves (requests) playback output by sending an output request to information matching engine E100-1 requesting playback output of the generated audio content C211.
[0068] Figure 2 also shows an example in which application AP22, an advertising provision-related application residing on cloud computer CCP2, generates audio content C221 (store advertisement C221) with the message content "Up ahead, there is a three-star restaurant..." and reserves (requests) playback output by sending an output request to information matching engine E100-1 requesting playback output of the generated audio content C221.
[0069] 2, the request manager function of the information matching engine E100-1 performs queuing in response to output requests received from the applications AP11, AP21, and AP22. For example, the request manager function queues, in the content buffer, audio contents C111, C211, and C221 received together with the output requests.
[0070] Furthermore, the response manager function of the information matching engine E100-1 performs output determination processing in accordance with rules. For example, the response manager function performs output determination processing according to an output determination algorithm. More specifically, the response manager function determines the priority and output order of each audio content to be output and in what order based on the driving information indicating the driving situation grasped by the situation recognition engine E30-1, the area information included in the output request, and the playback time of each audio content scheduled for output. The response manager function then determines the output order for the combination of audio content according to the determined priority. The response manager function also controls the terminal device 10 to play and output the audio content corresponding to the combination in the determined output order.
[0071] 5. Information Processing Device According to the Embodiment 1 shows an example in which information processing according to the embodiment is performed between an edge computer ECP1 and a cloud computer CCP2. From here, the following first and second embodiments will be described, in which a computer having an information matching engine E100-1 or an information matching engine E100-2 is used as an information processing device according to the embodiment.
[0072] The information processing device according to the embodiment may be a server device corresponding to the edge computer ECP1 or a server device corresponding to the cloud computer CCP2. Furthermore, the information processing device according to the embodiment may be a single server device configured by integrating the functions of the edge computer ECP1 and the functions of the cloud computer CCP2.
[0073] In the following description, the information processing device according to the first embodiment will be referred to as the information processing device 100, and the information processing device according to the second embodiment will be referred to as the information processing device 200.
[0074] In the first embodiment, a priority of playback output for each of the plurality of content information is calculated using area information corresponding to each of the plurality of content information, the area information indicating a geographical range in which the content information should be played back, the playback time of each of the plurality of content information, and further, driving information relating to the driving status of the vehicle. Also, in the first embodiment, the output order when the plurality of content information is played back and output to the vehicle is determined according to the calculated priority.
[0075] Furthermore, in the second embodiment, feedback is given to the application based on performance information relating to the reproduction output of content information.
[0076] 5-1. First embodiment From here on, information processing according to the first embodiment will be described. Specifically, of the information processing according to the above-described embodiments, information processing performed by the information processing device 100 according to the first embodiment will be described in more detail.
[0077] 5-1-1. Configuration of Information Processing Device First, an information processing device 100 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the configuration of the information processing device 100 according to the first embodiment. As shown in Fig. 3, the information processing device 100 includes a communication unit 110, a storage unit 120, an application APx, and a control unit 130.
[0078] (Regarding the communication unit 110) The communication unit 110 is realized by, for example, a NIC etc. The communication unit 110 is connected to a network by wire or wirelessly, and transmits and receives information to and from the terminal device 10, for example.
[0079] (Regarding the storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk, an optical disk, etc. The storage unit 120 has a content database 121 (content buffer) and a driving information database 122.
[0080] (About Content Database 121) The content database 121 stores various types of information related to content information. An example of the content database 121 according to the first embodiment is shown in Fig. 4. In the example of Fig. 4, the content database 121 has items such as "application ID," "content ID," "content data," "category," "meta information," and "range information."
[0081] "Application ID" indicates identification information for identifying an application (application capable of providing content information) according to an embodiment. "Content ID" indicates identification information for identifying content information (audio content) generated by the application indicated by the "Application ID."
[0082] "Content data" is content information generated by the application indicated by the "app ID." "Category" indicates the category to which the content information generated by the application indicated by the "app ID" belongs. "Categories" include warnings, cautions, guidance, advertisements, entertainment, etc.
[0083] The "meta information" is attached to the content information and includes range information indicating the range within which the content information should be played back, category information indicating the category of the content information, the length of the content information (playback time), etc.
[0084] The "range information" corresponds to condition information that conditions the range within which the content information should be played back (the allowable range within which the content information should be played back). For example, one example of the "range information" is area information that indicates the geographical range within which the content information should be played back. Other examples of the "range information" include the time range within which the content information should be played back, the vehicle's travel distance range, the vehicle's passing area range, the vehicle's speed range, etc. The "range information" may be set by the application according to the embodiment.
[0085] That is, the example in Figure 4 shows an example in which an application (application AP11) identified by the application ID "AP11" has generated content information (content information C111) identified by the content ID "C111" and consisting of data #111.
[0086] In addition, the example of FIG. 4 shows an example in which content information C111 is classified into the category "warning" based on the content indicated by data #111.
[0087] In addition, in the example of Figure 4, content information C111 is assigned meta information #111, and this meta information #111 includes area information indicating that the geographical range in which content information C111 should be played back is geographical range #111.
[0088] In the example of FIG. 4, conceptual symbols such as "#111" are used for ease of explanation, but in reality, valid information corresponding to each item is entered.
[0089] (About the driving information database 122) The travel information database 122 stores travel information relating to the travel conditions of a vehicle. An example of the travel information database 122 according to the first embodiment is shown in Fig. 5. In the example of Fig. 5, the travel information database 122 has items such as "vehicle ID," "number of passengers," "terminal ID," "time," and "travel information."
[0090] "Vehicle ID" indicates identification information for identifying a vehicle. "Number of passengers" indicates the number of passengers riding in the vehicle identified by the "Vehicle ID."
[0091] "Terminal ID" indicates identification information for identifying the terminal device 10 (on-vehicle device) installed in the vehicle identified by the "vehicle ID".
[0092] "Time" indicates the date and time when the "driving information" was acquired. "Driving information" indicates the driving status of the vehicle identified by the "vehicle ID" at the date and time indicated by "Time." Furthermore, the driving status indicates, for example, whether the vehicle is driving on a straight road or not, whether the vehicle is turning, the driving speed, the driving position, the direction of travel, and the traffic congestion status.
[0093] (About the application APx) Returning to FIG. 3, the application APx corresponds to the application AP1x or AP2x according to the embodiment described with reference to FIG.
[0094] (Regarding the control unit 130) The control unit 130 is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like executing various programs (for example, the information processing program according to the embodiment) stored in a storage device inside the information processing device 100 using RAM as a work area. The control unit 130 is also realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
[0095] As shown in Fig. 3, the control unit 130 is equipped with an information matching engine E100. The information matching engine E100 corresponds to the information matching engine E100-1 or E100-2 described in Fig. 1. The information matching engine E100 includes a request manager function E101 and a response manager function E102.
[0096] The request manager function E101 may include a request receiving unit and a queuing unit, which are not shown in Fig. 3. The response manager function E102 includes a first acquisition unit 131, a second acquisition unit 132, an identification unit 133, a prediction unit 134, a detection unit 135, a calculation unit 136, a determination unit 137, an output control unit 138, and an information control unit 139, as shown in Fig. 3.
[0097] (Regarding the first acquisition unit 131) The first acquisition unit 131 acquires driving information relating to the driving situation of the vehicle. For example, the first acquisition unit 131 acquires driving information indicating the driving situation of the vehicle grasped by the situation grasping process by the situation grasping engine E30-1 (E30-2).
[0098] (Regarding the second acquisition unit 132) The second acquisition unit 132 acquires area information corresponding to each of a plurality of pieces of content information, the area information indicating a geographical range in which the content information should be reproduced and output. For example, the second acquisition unit 132 acquires area information indicating a geographical range in which content information having a time range (playback time) should be reproduced and output from start to finish. For example, the area information is included in meta information and transmitted by the application APx together with the content information. Therefore, the second acquisition unit 132 can also acquire area information by acquiring content information input by the application APx.
[0099] (Regarding the identification unit 133) The identification unit 133 identifies a destination vehicle to which the content information is to be distributed, based on driving information related to the vehicle's driving status. The destination vehicle to which the content information is to be distributed refers to the destination terminal device 10 to which the content information is to be distributed. The driving information here may be driving information acquired by the first acquisition unit 131.
[0100] In addition, the identification unit 133 may identify a destination vehicle from among the vehicles traveling on the road to be processed based on the driving information of each vehicle traveling on the road to be processed, or may identify a destination vehicle based on statistical information (statistical driving conditions) obtained from the driving information corresponding to each vehicle that has traveled on the road to be processed in the past.
[0101] For example, the identification unit 133 extracts a vehicle traveling toward a destination point according to the content information (for example, a facility that is an advertisement target according to the content information) based on the travel information, and identifies the extracted vehicle as a delivery destination vehicle. In this regard, for example, the identification unit 133 can identify a vehicle that is predicted to reach a geographical range indicated by the area information in the future based on the travel information, and extract the identified vehicle as a vehicle traveling toward the destination point.
[0102] Furthermore, for example, the identification unit 133 may extract vehicles traveling in the lane on the side where the target point corresponding to the content information is located, based on the traveling information, and identify the extracted vehicles as vehicles to which the content information is to be distributed.
[0103] (Regarding the prediction unit 134) The prediction unit 134 predicts the vehicle's travel status within a geographical range based on the travel information. For example, the prediction unit 134 updates the prediction result by repeating the prediction of the vehicle's travel status within a geographical range, which is the travel status at a predetermined timing in the future, over time.
[0104] The driving information may include direction information indicating the direction of travel of the vehicle, and the prediction unit 134 updates the predicted result of the direction of travel by repeatedly predicting the direction of travel of the vehicle at a predetermined timing based on the direction information as time passes.
[0105] In addition, the driving information may include lane information indicating the lane in which the vehicle is traveling, and the prediction unit 134 updates the predicted result of the driving lane by repeating the prediction of the vehicle's driving lane at a predetermined timing based on the lane information over time.
[0106] In addition, the travel information may include speed information regarding the speed of the vehicle, and the prediction unit 134 updates the position prediction result by repeating the position prediction of the vehicle at a predetermined timing based on the speed information as time passes.
[0107] Furthermore, the travel information may include traffic congestion information related to the vehicle, and the prediction unit 134 updates the predicted position result by repeating the prediction of the vehicle's position at a predetermined timing based on the traffic congestion information as time passes.
[0108] The travel information may also include speed information related to the speed of the vehicle within a geographical range, and the prediction unit 134 may predict the travel speed of the vehicle at a predetermined timing as a travel status based on the speed information. Also, for example, the prediction unit 134 may predict the travel speed of the vehicle at a predetermined timing based on traffic congestion information.
[0109] (Regarding the detection unit 135) The detection unit 135 detects overlapping areas between the geographical ranges indicated by the pieces of area information acquired by the second acquisition unit. For example, the detection unit 135 detects the extent of overlap between areas by comparing the geographical ranges indicated by the pieces of area information.
[0110] (Regarding the calculation unit 136) The calculation unit 136 calculates the priority of reproduction output for each of the plurality of content information based on the prediction result by the prediction unit .
[0111] For example, the calculation unit 136 calculates the priority of reproduction output for each of the plurality of content information based on the latest prediction result among the prediction results obtained over time.
[0112] For example, in a situation where prediction of the traveling direction is repeated over time and the prediction result is updated, the calculation unit 136 calculates the priority of playback output for each of the plurality of content information based on the latest traveling direction. Also, for example, in a situation where prediction of the traveling lane is repeated over time and the prediction result is updated, the calculation unit 136 calculates the priority of playback output for each of the plurality of content information based on the latest traveling lane.
[0113] Furthermore, for example, in a situation where prediction of a traveling position is repeated over time and the prediction result is updated, the calculation unit 136 calculates the priority of playback output for each of the plurality of content information based on the latest traveling position. Furthermore, for example, in a situation where prediction of a traveling speed is repeated over time and the prediction result is updated, the calculation unit 136 calculates the priority of playback output for each of the plurality of content information based on the latest traveling speed.
[0114] The calculation unit 136 can calculate a higher priority for content information among the plurality of content information, the higher the relevance of the content information to the prediction result by the prediction unit 134. For example, assume that the prediction unit 134 predicts that a vehicle will turn right at a predetermined timing. In this case, the calculation unit 136 can calculate a higher priority for content information advertising a store located at the destination of the right turn.
[0115] (Regarding the decision unit 137) The determination unit 137 determines the output order when a plurality of pieces of content information are reproduced and output to the vehicle.
[0116] In one aspect, the determination unit 137 determines the output order when the plurality of pieces of content information are to be reproduced and output to the vehicle based on the reproduction time of each piece of content information and the area information. For example, the determination unit 137 determines the output order that allows the plurality of pieces of content information to be reproduced and output in order without interfering with each other when the predetermined timing arrives based on the driving conditions of the vehicle in a geographical area, which is the driving conditions at a predetermined timing in the future.
[0117] For example, when the detection unit 135 detects an overlap of areas, the determination unit 137 determines an output order in which the plurality of pieces of content information can be played back and output in order so as not to interfere with each other when a predetermined timing is reached, based on the relationship of the detected overlap and the playback time of each piece of content information corresponding to the geographical range including the overlap.
[0118] For example, when the detection unit 135 detects an overlap of areas, the determination unit 137 determines the output order by further using travel information related to the travel conditions of vehicles present in a geographical range including the detected overlap. For example, when the detection unit 135 detects an overlap of areas, the determination unit 137 calculates a distance traveled by the vehicle in accordance with the playback time of the content information based on the travel speed of the vehicle in the geographical range including the detected overlap, which is the travel speed at a predetermined timing predicted from the speed information, and the playback time of each piece of content information corresponding to the geographical range, and determines the output order based on the relationship between the calculated distance and the overlap. Also, for example, when the detection unit 135 detects an overlap of areas, the determination unit 137 calculates a distance traveled by the vehicle in accordance with the playback time of the content information based on the travel speed of the vehicle in the geographical range including the detected overlap, which is the travel speed at a predetermined timing predicted from traffic congestion information, and the playback time of each piece of content information corresponding to the geographical range, and determines the output order based on the relationship between the calculated distance and the overlap.
[0119] More specifically, the determination unit 137 extracts, from the plurality of pieces of content information, combinations that allow the plurality of pieces of content information to be reproduced and output in order without interfering with each other at a predetermined timing based on the distances and relationships, and determines the output order of the extracted combinations. For example, the determination unit 137 further uses priorities calculated from meta information assigned to each piece of content information to extract combinations from the plurality of pieces of content information, and determines the output order of the extracted combinations according to the priorities.
[0120] In another aspect, the determination unit 137 determines an output order when a plurality of pieces of content information are to be reproduced and output to a vehicle, based on the driving information and the area information. For example, the determination unit 137 uses a prediction result obtained by the prediction unit 134 based on the driving information to determine an output order in which the plurality of pieces of content information can be reproduced and output in order without interfering with each other when a predetermined timing arrives. For example, the determination unit 137 uses a driving speed predicted by the prediction unit 134 based on speed information and traffic congestion information to determine an output order in which the plurality of pieces of content information can be reproduced and output in order without interfering with each other when a predetermined timing arrives.
[0121] Then, when the detection unit 135 detects an overlap of areas, the determination unit 137 determines the output order based on the relationship of the detected overlap and the travel speed predicted by the prediction unit. For example, when the detection unit 135 detects an overlap of areas, the determination unit 137 determines the output order based on the travel speed of the vehicle in a geographical range including the detected overlap, among the travel speeds predicted by the prediction unit 134, and the relationship of the overlap.
[0122] More specifically, when the detection unit 135 detects an overlap of areas, the determination unit 137 calculates the distance the vehicle will travel in accordance with the playback time of the content information based on the driving speed in the geographical range including the overlap and the playback time of each piece of content information corresponding to the geographical range, and determines the output order based on the relationship between the calculated distance and the overlap.
[0123] As an example, the determination unit 137 extracts, from the plurality of pieces of content information, combinations that allow the plurality of pieces of content information to be played back and output in order without interfering with each other at a predetermined timing based on the distance and the relationship, and determines the output order of the extracted combinations. For example, the determination unit 137 further uses priorities calculated from meta information assigned to each piece of content information to extract combinations from the plurality of pieces of content information, and determines the output order of the extracted combinations according to the priorities.
[0124] In still another aspect, the determination unit 137 determines the output order when the plurality of pieces of content information are to be reproduced and output to the vehicle, according to the priority calculated by the calculation unit 136. For example, the determination unit 137 determines the output order in which the plurality of pieces of content information can be reproduced and output in order so as not to interfere with each other at a predetermined timing, according to the priority.
[0125] (Regarding output control unit 138) The output control unit 138 performs output control so that the content information to be output is reproduced and output in the vehicle in accordance with the priority and output order determined by the determination unit 137. For example, the output control unit 138 performs output control on the terminal device 10 so that the content information to be output is reproduced and output in the output order according to the priority determined by the determination unit 137. For example, the output control unit 138 distributes the content information to be output to a destination vehicle (specifically, a terminal device 10 provided in the destination vehicle, or a terminal device 10 owned by a user of the destination vehicle).
[0126] (Regarding the information control unit 139) When a combination that allows multiple pieces of content information to be played back and output in sequence without interfering with each other is extracted and there is content information excluded from the combination, the information control unit 139 estimates whether or not a margin area of grace will remain in the geographical range corresponding to the excluded content information even when the playback and output of the content information included in the combination is completed, and if it estimates that a margin area will remain, it acquires content information controlled to a playback time according to the margin area as additional content information to be played back and output in the margin area.
[0127] 5-1-2. Specific example of information processing according to the first embodiment From here, a specific example of information processing (decision processing) according to the first embodiment will be shown using Fig. 6 and Fig. 7. Fig. 6 is a diagram showing an example of information processing according to the first embodiment. Fig. 7 is a diagram showing another example of information processing according to the first embodiment. Fig. 6 describes information processing according to the first embodiment (pattern 1). Fig. 7 describes information processing according to the first embodiment (patterns 2 and 3).
[0128] 6 and 7 also show a determination process for determining the output order when content information C111, C121, C211, and C221 are played back and output to a vehicle VE1 (from the MAP in FIG. 6) traveling on road RD1 toward a target point G1.
[0129] Also, according to the examples of Figures 6 and 7, vehicle VE1 is traveling on road RD1 at a speed of 60 km / h, and because a geographical range has been set for road RD1, content information C111, C121, C211, and C221 are candidate content information for output.
[0130] 6 and 7, the content information C111 has a playback time of 15 seconds, and a geographical range #111 on road RD1 is attached as meta information. In other words, the geographical range #111 in which the content information C111 should be played back exists on road RD1. Furthermore, the content information C121 has a playback time of 15 seconds, and a geographical range #121 on road RD1 is attached as meta information. In other words, the geographical range #121 in which the content information C121 should be played back exists on road RD1.
[0131] Furthermore, the content information C211 has a playback time of 30 seconds, and a geographical range #211 on road RD1 is attached as meta information. In other words, the geographical range #211 in which the content information C211 should be played back exists on road RD1. Furthermore, the content information C221 has a playback time of 30 seconds, and a geographical range #221 on road RD1 is attached as meta information. In other words, the geographical range #221 in which the content information C221 should be played back exists on road RD1.
[0132] Here, pattern 1 shows an example in which the output order is determined so that the content information C111, C121, C211, and C221 can be played back in order without interfering with each other, without taking into consideration the priority between the content information C111, C121, C211, and C221, based on the distance traveled by the vehicle VE1 according to the playback time of each piece of content information and the relationship between the overlapping areas between each geographical range.
[0133] The playback time of the content information C111 is "15 seconds", so the distance traveled by the vehicle VE1 traveling at "60 km / h" during this time is "250 m". Also, the playback time of the content information C121 is "15 seconds", so the distance traveled by the vehicle VE1 traveling at "60 km / h" during this time is "250 m".
[0134] Furthermore, since the playback time of the content information C211 is "30 seconds", the distance traveled by the vehicle VE1 traveling at "60 km / h" during this time is "500 m". Furthermore, since the playback time of the content information C221 is "30 seconds", the distance traveled by the vehicle VE1 traveling at "60 km / h" during this time is "500 m".
[0135] 6, the detection unit 135 detects overlapping areas by comparing the geographical ranges #111, #121, #211, and #221. As a result, the detection unit 135 detects four overlapping areas, namely, the geographical range #121-#221, the geographical range #121-#211-#221, the geographical range #211-#221, and the geographical range #111-#211, as shown by the dotted lines in FIG.
[0136] In this state, the determination unit 137 determines the output order in which the content information can be played back and output in order so as not to interfere with each other, based on the distance and overlap relationship, on the premise that, depending on the driving conditions of the vehicle VE1, content information C111 is played back and output within geographical range #111, content information C121 is played back and output within geographical range #121, content information C211 is played back and output within geographical range #211, and content information C221 is played back and output within geographical range #221.
[0137] As a result, according to the example of pattern 1 in FIG. 6, the determination unit 137 can determine the output order as follows: content information C221 (No. 1) → C121 (No. 2) → C111 (No. 3) → C211 (No. 4).
[0138] Furthermore, the determination unit 137 can determine, for each of the content information C111, C121, C211, and C221, which geographical range is to be actually reproduced and output.
[0139] Specifically, the determination unit 137 determines the range position within the geographical range #111 as the range position within which the content information C111 will actually be played back and output. According to the example of pattern 1 in Fig. 6, the determination unit 137 can determine range position #11-1, which does not overlap with the range positions of other content information, as the range position within which the content information C111 will actually be played back and output. Furthermore, the distance width indicating range position #11-1 may correspond to the distance "250 m" traveled by the vehicle VE1 at "60 km / h" in response to the playback time "15 seconds."
[0140] Furthermore, the determination unit 137 determines the range position within the geographical range #121 in which the content information C121 will actually be played back and output. According to the example of pattern 1 in Fig. 6, the determination unit 137 can determine range position #12-1, which does not overlap with the range positions of other content information, as the range position in which the content information C121 will actually be played back and output. Furthermore, the distance width indicating range position #12-1 may correspond to the distance "250 m" traveled by the vehicle VE1 at "60 km / h" in response to the playback time "15 seconds."
[0141] Furthermore, the determination unit 137 determines the range position within the geographical range #211 in which the content information C211 will actually be played back and output. According to the example of pattern 1 in Fig. 6, the determination unit 137 can determine range position #21-1, which does not overlap with the range positions of other content information, as the range position in which the content information C211 will actually be played back and output. Furthermore, the distance width indicating range position #21-1 may correspond to the distance "500 m" traveled by the vehicle VE1 at "60 km / h" in response to the playback time "30 seconds."
[0142] Furthermore, the determination unit 137 determines the range position within the geographical range #221 in which the content information C221 will actually be played back and output. According to the example of pattern 1 in Fig. 6, the determination unit 137 can determine range position #22-1, which does not overlap with the range positions of other content information, as the range position in which the content information C221 will actually be played back and output. Furthermore, the distance width indicating range position #22-1 may correspond to the distance "500 m" traveled by the vehicle VE1 at "60 km / h" in response to the playback time "30 seconds."
[0143] Next, pattern 2 will be described with reference to Fig. 7. In pattern 2, an example is shown in which the output order is determined so that the content information C111, C121, C211, and C221 can be reproduced and output in order without interfering with each other, taking into consideration the priority among the content information C111, C121, C211, and C221, based on the distance traveled by the vehicle VE1 according to the reproduction time of each piece of content information and the relationship of area overlap between each geographical range. Note that, except for taking into consideration the priority, the condition settings are the same as those of pattern 1, so a duplicated explanation will be omitted.
[0144] For example, the prediction unit 134 predicts the driving status of the vehicle VE1 at a predetermined timing in the future, which is the driving status within a geographical range consisting of geographical ranges #111, #121, #211, and #221, based on driving information indicating the current driving status (which may be statistical driving information obtained from the driving status history).The calculation unit 136 calculates the priority of playback output for each piece of content information based on the prediction result.
[0145] 7, it is assumed that the calculation unit 136 has at least calculated that the content information C121 has a higher priority than the content information C221. As in pattern 1, the determination unit 137 determines an output order in which the content information can be played back and output in order so as not to interfere with each other, based on the relationships of distance and overlap, on the premise that the content information C111 is played back and output within the geographical range #111, the content information C121 is played back and output within the geographical range #121, the content information C211 is played back and output within the geographical range #211, and the content information C221 is played back and output within the geographical range #221, in accordance with the travel of the vehicle VE1.
[0146] However, in this case, unlike the example of pattern 1, the determination unit 137 determines the overall output order so that the content information C121 is output earlier than the content information C221, as shown in Fig. 7. For example, the determination unit 137 can determine the output order as follows: content information C121 (No. 1) → C221 (No. 2) → C111 (No. 3) → C211 (No. 4).
[0147] Next, pattern 3 will be described with reference to Fig. 7. In pattern 3, an example is shown in which the output order is determined taking into consideration the priorities among the content information C111, C121, C211, and C221, but the priorities are different from those in the example of pattern 2.
[0148] 7, it is assumed that the calculation unit 136 has at least calculated that the content information C211 has a higher priority than the content information C111. As in pattern 1, the determination unit 137 determines an output order in which the content information can be played back and output in order so as not to interfere with each other, based on the relationships of distance and overlap, on the premise that the content information C111 is played back and output within the geographical range #111, the content information C121 is played back and output within the geographical range #121, the content information C211 is played back and output within the geographical range #211, and the content information C221 is played back and output within the geographical range #221, in accordance with the travel of the vehicle VE1.
[0149] However, in this case, unlike the example of pattern 1, the determination unit 137 determines the overall output order so that the content information C211 is output earlier than C111, as shown in Fig. 7. For example, the determination unit 137 can determine the output order as follows: content information C221 (No. 1) → C121 (No. 2) → C211 (No. 3) → C111 (No. 4).
[0150] 5-1-3. Modification of Information Processing According to the First Embodiment Next, the processing performed by the information control unit 139 will be described with reference to Fig. 8 as a modified example of the content described in Fig. 6. Fig. 8 is a diagram showing a modification corresponding to the information processing according to the first embodiment. In the example of Fig. 8, for the convenience of explaining the processing performed by the information control unit 139, the geographical range #211 corresponding to the content information C211 is narrower than in Fig. 6.
[0151] For example, the determination unit 137 extracts a combination that allows the content information to be reproduced and output in order without interfering with each other, based on the relationship of overlapping areas between geographical ranges and the distance traveled by the vehicle VE1 according to the reproduction time of each piece of content information. Then, the determination unit 137 determines, from among the extracted combinations, a combination arranged in accordance with the priority calculated by the calculation unit 136 as the content information to be output, and determines the order of the combination as the output order. According to this determination process, some content information may be excluded from the combination, i.e., not extracted as the content information to be output.
[0152] 8 shows an example in which content information C211 is excluded from content information C111, C121, C211, and C221. In this example, content information C221, C121, and C111 are played back and output in this order, but it is estimated that a marginal area MAR will remain in the geographical range #211 corresponding to the excluded content information C211 when the playback and output of content information C111, which is last in the output order, is completed. When it is estimated that a marginal area MAR will remain, the information control unit 139 acquires content information controlled to a playback time according to the marginal area MAR as additional content information to be played back and output in the marginal area MAR.
[0153] For example, if a short version of the excluded content information C211 has the same content as the excluded content information C211 but a shorter playback time and is registered in advance in the storage unit, the information control unit 139 can acquire this short version of the content information C211 as additional content information to be played back and output in the margin area MAR. In this case, the output control unit 138 can play back and output the short version of the content information C211 when the playback and output of the content information C111 ends and the vehicle VE1 enters the margin area MAR.
[0154] If it is estimated that the blank area MAR will remain, the information control unit 139 may dynamically generate a short version of the excluded content information C211 that has the same content as the excluded content information C211 but a shorter playback time. If it is estimated that the blank area MAR will remain, the information control unit 139 may control the playback times of the content information C111, C121, C211, and C221 to be shorter than the current playback times so that all of the content information C111, C121, C211, and C221 are played back and output. For example, the information control unit 139 may shorten the playback time of all of the content information C111, C121, C211, and C221, or may shorten the playback time of at least one of the content information C111, C121, C211, and C221.
[0155] 5-1-4. Information Processing Procedure According to the First Embodiment Next, the procedure of information processing according to the first embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an overview of the procedure of information processing according to the first embodiment.
[0156] First, the second acquisition unit 132 recognizes which road is the target road from among a number of candidate roads (step S101). Using the example of Fig. 6, it is assumed that the second acquisition unit 132 recognizes road RD1 as the target road.
[0157] Next, the second acquisition unit 132 acquires area information for which a geographical range is set on the road RD1 recognized in step S101 from the area information input by each application (step S102). Similarly, using the example of Fig. 6, it is assumed that the second acquisition unit 132 has acquired, as the area information for which a geographical range is set on the road RD1, area information corresponding to the geographical range #111 set as meta information by the application AP11, area information corresponding to the geographical range #121 set as meta information by the application AP12, area information corresponding to the geographical range #211 set as meta information by the application AP21, and area information corresponding to the geographical range #221 set as meta information by the application AP22.
[0158] Furthermore, the second acquisition unit 132 acquires content information associated with each area information acquired in step S102 as content information of output candidates (step S103). According to the above example, the second acquisition unit 132 acquires content information C111, C121, C211, and C221 as content information of output candidates.
[0159] Furthermore, the first acquisition unit 131 acquires driving information relating to the driving situation of the vehicle (step S104). For example, the first acquisition unit 131 acquires driving information indicating the recognized driving situation in response to the driving situation being recognized at any time by the situation recognition engine E30-1 (E30-2). For example, the first acquisition unit 131 may acquire driving information indicating the driving situation of a vehicle currently traveling on road RD1, a vehicle currently traveling near road RD1, or a vehicle predicted to enter road RD1 in the future.
[0160] Next, the identification unit 133 identifies a destination vehicle to which the content information is to be distributed based on the travel information acquired in step S104 (step S105). For example, the identification unit 133 can extract vehicles traveling in the lane on the side where the destination point corresponding to each of the content information C111, C121, C211, and C221 is located based on the travel information, and identify the extracted vehicles as destination vehicles. Furthermore, the identification unit 133 can extract vehicles traveling in the lane on the side where the destination point corresponding to each of the content information C111, C121, C211, and C221 is located based on the travel information, and identify the extracted vehicles as destination vehicles. In the example of FIG. 6, the identification unit 133 identifies the vehicle VE1 as the destination vehicle based on the destination point G1. Of course, the identification unit 133 may identify multiple destination vehicles. However, for simplicity of explanation, it is assumed here that the identification unit 133 identifies one vehicle VE1.
[0161] In this state, the prediction unit 134 determines whether or not the vehicle VE1 has approached the geographical range indicated by the area information acquired in step S102 (step S106). For example, the prediction unit 134 determines whether or not the vehicle VE1 has approached the geographical range consisting of geographical ranges #111, #121, #211, and #221. While the prediction unit 134 determines that the vehicle VE1 has not approached the geographical range (step S106; No), the prediction unit 134 waits until it can determine that the vehicle VE1 has approached the geographical range.
[0162] On the other hand, if the prediction unit 134 determines that the vehicle VE1 has approached the geographical range (step S106; Yes), it sets a future timing for predicting the driving conditions of the vehicle VE1 (step S107). In other words, the prediction unit 134 determines at what future timing the driving conditions of the vehicle VE1 will be predicted. As an example, the prediction unit 134 may set a timing a predetermined time after the present time (for example, 30 seconds from now) as the future timing, and in this case, performs a prediction process to predict the driving conditions of the vehicle VE1 at this timing. Hereinafter, the timing set in step S107 will be referred to as the "set timing."
[0163] Next, the prediction unit 134 predicts the traveling state of the vehicle VE1 at the set timing based on the current traveling information by a loop, which will be described later (step S108).
[0164] Here, the prediction unit 134 repeats a prediction process of predicting the driving situation at the set timing as time passes, using a loop to be described later. Therefore, if the prediction unit 134 has already predicted the driving situation at the set timing from the driving information at that time before the current time, the prediction unit 134 updates the prediction result up to that point to the prediction result at the current time (the prediction result based on the prediction in step S108) (step S109).
[0165] Next, the detection unit 135 detects overlaps between the geographical ranges indicated by each piece of area information (step S110). Specifically, the detection unit 135 compares the geographical ranges #111, #121, #211, and #221 to detect the extent of overlap between the areas in the geographical ranges #111, #121, #211, and #221.
[0166] From here, the flow of processing when an area overlap is detected among the geographical ranges #111, #121, #211, and #221 (step S110; Yes) will be described.
[0167] The calculation unit 136 calculates the playback output priority for each of the output candidate content information (content information C111, C121, C211, C221) based on the current prediction result (latest prediction result) predicted in step S108 (step S111).
[0168] For example, the calculation unit 136 may calculate a higher priority for content information that advertises a facility (e.g., a store) in a direction closer to the traveling direction of the vehicle VE1 at the set timing. Furthermore, for example, the calculation unit 136 may calculate a higher priority for content information that advertises a facility that is located on the driving lane side of the vehicle VE1 at the set timing. Furthermore, for example, the calculation unit 136 may calculate a higher priority for content information that advertises a facility that is closer to the position of the vehicle VE1 at the set timing. Thus, the calculation unit 136 can calculate a higher priority for content information that is more highly relevant to the prediction result by the prediction unit 134, among the content information C111, C121, C211, and C221.
[0169] Next, the determination unit 137 determines an output order, in accordance with the priorities calculated in step S111, of the combinations of output candidate content information (content information C111, C121, C211, C221), indicating which combinations of content information should be played back and output in the vehicle in what order (step S112). For example, the determination unit 137 extracts combinations that allow the content information to be played back and output in order without interfering with each other, based on the relationship between the overlapping areas detected in step S111 and the distance traveled by the vehicle VE1 according to the playback time of each piece of content information. Then, the determination unit 137 determines, from the extracted combinations, a combination that corresponds to the order based on the priorities calculated by the calculation unit 136 as the content information to be output, and determines the order of the combination as the output order.
[0170] In step S112, the determination unit 137 may also determine, for each piece of content information to be output, the range position within the geographical range corresponding to the content information in question, in which the content information is to be actually reproduced and output.
[0171] Next, the output control unit 138 controls the output so that the content information included in the combination (content information to be output) is played back and output in the output order in step S112 when the set timing arrives (step S113). For example, the output control unit 138 controls the output of the terminal device 10 so that the content information to be output is played back and output in the output order according to the priority determined by the determination unit 137 and at the range position.
[0172] Here, the prediction unit 134 determines whether the set timing set in step S107 has passed (step S114). If the prediction unit 134 determines that the set timing has passed (step S114; Yes), the process returns to step S107, and the process from step S107 onwards is repeated by setting a new next timing.
[0173] On the other hand, if the prediction unit 134 determines that the set timing has not elapsed (step S114; No), the prediction unit 134 determines whether a predetermined time has elapsed since the prediction was made in step S108 (step S115). For example, the prediction unit 134 determines whether five seconds have elapsed since the prediction was made in step S108.
[0174] While the prediction unit 134 determines that the predetermined time has not elapsed since the prediction was made in step S108 (step S115; No), it waits until it can determine that the predetermined time has elapsed. On the other hand, when the prediction unit 134 determines that the predetermined time has elapsed (step S115; Yes), it returns to step S108.
[0175] Next, the flow of processing when no area overlap is detected among the geographical ranges #111, #121, #211, and #221 (step S110; No) will be described.
[0176] In this example, the determination unit 137 determines, for each of the content information items (content information items C111, C121, C211, C221) that are candidates for output, the range position within the geographical range corresponding to the content information item in which the content information item will actually be played back (step S116).
[0177] When the set timing arrives, the output control unit 138 controls the terminal device 10 to play back and output the content information of each output candidate at the range position in step S116 (step S117).
[0178] [5-1-5. Decision Processing Procedure] Next, the procedure of the decision process performed in step S112 of Fig. 9 will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the procedure of the decision process included in the information processing procedure according to the first embodiment.
[0179] For example, the determining unit 137 acquires content information corresponding to the geographical range including the overlap detected in step S110 from among the content information of the output candidates (content information C111, C121, C211, C221) (step S201).
[0180] In addition, the determination unit 137 acquires the traveling speed of the vehicle VE1 at the set timing from among the traveling speeds (an example of traveling conditions) predicted by the prediction unit 134 in the geographical range including the overlap detected in step S110 (step S202).
[0181] Then, for each piece of content information of the output candidate, the determining unit 137 calculates the distance the vehicle will travel in accordance with the playback time based on the playback time of the content information and the traveling speed acquired in step S202 (step S203).
[0182] Next, the determination unit 137 extracts a combination that allows the content information of the output candidates to be played back and output in order without interfering with each other, based on the relationship and distance of the overlap detected in step S110 (step S204).
[0183] Then, the determining unit 137 determines the combination of the extracted combinations, arranged in the order according to the priority, as the content information to be output, and determines the order of the combination as the output order (step S205).
[0184] Furthermore, for each content to be output that is included in the combination extracted in step S204, the determination unit 137 determines the range position within the geographical range corresponding to the content information in which the content information is to be actually played back (step S206).
[0185] [5-1-6. Summary] The information processing device 100 according to the first embodiment acquires area information corresponding to each of a plurality of pieces of content information, the area information indicating a geographical range in which the content information should be reproduced and output. Then, the information processing device 100 determines the output order of the plurality of pieces of content information when the plurality of pieces of content information is to be reproduced and output to a vehicle, based on the reproduction time of each piece of content information and the area information. According to the information processing device 100, each piece of content information associated with a geographical range in which the content information should be reproduced and output can be reproduced and output from the vehicle in order without interfering with each other within the geographical range.
[0186] Furthermore, the information processing device 100 according to the first embodiment acquires driving information relating to the driving conditions of the vehicle, and also acquires area information corresponding to each of a plurality of pieces of content information, which area information indicates a geographical range in which the content information should be reproduced and output. Then, the information processing device 100 determines the output order in which the plurality of pieces of content information should be reproduced and output by the vehicle, based on the driving information and the area information. According to the information processing device 100, each piece of content information associated with a geographical range in which the content information should be reproduced and output can be reproduced and output from the vehicle in order without interfering with each other within the geographical range.
[0187] Furthermore, the information processing device 100 according to the first embodiment acquires driving information relating to the vehicle's driving conditions, and also acquires area information corresponding to each of a plurality of pieces of content information, which area information indicates a geographical range in which the content information should be reproduced and output. The information processing device 100 then predicts the vehicle's driving conditions within the geographical range based on the driving information, and calculates a playback output priority for each of the plurality of pieces of content information based on the prediction result. The information processing device 100 then determines the output order for the plurality of pieces of content information to be reproduced and output by the vehicle, based on the calculated priority. According to this information processing device 100, the vehicle's driving conditions can be predicted in advance, thereby optimizing the playback output of content information in response to changes in the driving conditions.
[0188] 5-2. Second embodiment Up to this point, the first embodiment has been described. From here on, information processing according to the second embodiment will be described. Specifically, information processing performed by the information processing device 200 according to the second embodiment will be described.
[0189] 5-2-1. Configuration of information processing device First, an information processing device 200 according to the second embodiment will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of the configuration of the information processing device 200 according to the second embodiment. As shown in Fig. 11, the information processing device 200 has a communication unit 110, a storage unit 220, an application APx, and a control unit 230. Descriptions of processing units denoted by the same reference numerals as those of the information processing device 100 according to the first embodiment will be omitted.
[0190] (Regarding the storage unit 220) The storage unit 220 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 220 further has a performance information database 223 in addition to the content database 121 and the driving information database 122.
[0191] (About Performance Information Database 223) The performance information database 223 stores performance information related to the reproduction output of content information. Here, Fig. 12 shows an example of the performance information database 223 according to the second embodiment. In the example of Fig. 12, the performance information database 223 has items such as "category," "app ID," "content ID," "range information," and "performance information." Furthermore, according to the example of Fig. 12, the "performance information" has items such as "output tag," "output date and time," "range position," "output destination vehicle information," "other content output information," and "conversion information."
[0192] "Category" indicates the category to which the content information identified by the corresponding "Content ID" belongs.
[0193] "Application ID" indicates identification information for identifying an application (application capable of providing content information) according to an embodiment. "Content ID" indicates identification information for identifying content information (audio content) generated by the application indicated by the "Application ID."
[0194] The "range information" corresponds to condition information that conditions the range within which the content information should be played back (the allowable range within which the content information should be played back). For example, one example of the "range information" is area information that indicates the geographical range within which the content information should be played back. Other examples of the "range information" include the time range within which the content information should be played back, the vehicle's travel distance range, the vehicle's passing area range, the vehicle's speed range, etc. The "range information" may be set by the application according to the embodiment.
[0195] The "performance information" indicates various performance information related to the reproduction and output of content information. Specifically, examples of performance information include items such as "output tag," "output date and time," "range position," "output destination vehicle information," "other content output information," and "conversion information."
[0196] In the first embodiment, it has been explained that some content information may be discarded without being played back depending on the priority or the output order. The "output tag" is information indicating whether the content information identified by the corresponding "content ID" has been played back or discarded without being played back. For example, the "content ID" of the content information that has been played back is associated with the output tag "○". On the other hand, the "content ID" of the content information that has been discarded without being played back is associated with the output tag "×". The example in FIG. 12 shows an example in which the content information C111 has been played back, while the content information C112 and C211 have not been played back.
[0197] “Output date and time” indicates information relating to the date and time when the content information identified by the “content ID” was reproduced and output. In the example of Fig. 12, content information C111 was reproduced and output at output date and time #111.
[0198] The "range position" is information indicating the range position at which the content information identified by the "content ID" was actually played back within the geographical range indicated by the "range information." The example in Fig. 12 shows an example in which content information C111 was actually played back within geographical range #111 at range position #111.
[0199] The "destination vehicle information" is information indicating a destination vehicle (terminal device 10) to which the content information identified by the "content ID" is delivered so as to be played back. In the example of Fig. 12, content information C111 is delivered to vehicle #111.
[0200] "Other content output information" indicates information about other content that is preferentially reproduced and output instead of content information identified by "content ID" when that content information is discarded without being reproduced and output. In the example of Fig. 12, output information #112 is shown as information about other content that is preferentially reproduced and output instead of content information C112 that was not reproduced and output.
[0201] The "conversion information" is information indicating how much the content information identified by the "content ID" contributed to the user's conversion to the advertising target. For example, the "conversion information" may be the conversion rate of the content information identified by the "content ID". In the example of FIG. 12, the content information C111 shows an example of the conversion rate indicated by the conversion information #111.
[0202] 12, the performance information database 223 may store information other than the "conversion information" as long as the information is capable of evaluating the advertising effectiveness. For example, the performance information database 223 can store various types of advertisement evaluation values.
[0203] (Regarding the control unit 230) 11, the control unit 230 is realized by a CPU, an MPU, or the like executing various programs (for example, the information processing program according to the embodiment) stored in a storage device inside the information processing device 200 using a RAM as a work area. The control unit 230 is also realized by an integrated circuit such as an ASIC or an FPGA.
[0204] In the second embodiment, the control unit 230 further includes a performance acquisition unit 231, a generation unit 232, an output unit 233, a selection unit 234, and a proposal unit 235.
[0205] (Regarding the performance acquisition unit 231) The result acquisition unit 231 acquires result information related to the reproduction output of content information. As explained above, content information is associated with range information indicating the range to be reproduced and output. Therefore, the result acquisition unit 231 acquires result information related to the reproduction output within the range indicated by the range information.
[0206] Furthermore, the result acquisition unit 231 can acquire result information indicating an output result, which is a result of content information being played back and output in a vehicle. Note that the output result here may be, for example, the "output tag," "output date and time," "range position," "output destination vehicle information," and "other content output information" in the result information database 223.
[0207] Furthermore, the result acquisition unit 231 can acquire result information indicating the advertising results resulting from the content information being reproduced and output in the vehicle. Note that the advertising results here may be, for example, the "conversion information" in the result information database 223.
[0208] (Regarding the generation unit 232) In one aspect, the generation unit 232 generates information to be output to an application based on the performance information acquired by the performance acquisition unit 231. For example, the generation unit 232 generates, as the information to be output, information indicating an output result depending on whether the content information was played back and output or was discarded without being played back and output, based on the performance information.
[0209] For example, when the performance information indicates that the content information has been played back in the corresponding geographical range, the generation unit 232 generates, as information to be output, information indicating the range position within the geographical range in which the content information was actually played back.
[0210] On the other hand, when the performance information indicates that the content information was discarded without being played back in the corresponding geographical range, the generation unit 232 identifies, from among the other content information, content information that was played back in priority over the content information in the corresponding geographical range, based on performance information corresponding to other content information different from the content information in question. The generation unit 232 then generates, as information to be output, information indicating an output result for the identified content information. The generation unit 232 may generate, as information to be output, information indicating the output result, including identification information capable of identifying an application that provided the identified other content information and information indicating the range position within the geographical range where the other content information was actually played back. The generation unit 232 may also analyze the reason why the identified other content information was played back in priority, based on, for example, range information or meta information, and generate, as information to be output, information indicating the analysis result.
[0211] Furthermore, for example, the generation unit 232 may calculate an advertising effect (e.g., a conversion rate) due to the output of the content information based on behavioral information about the user of the vehicle that is the output destination to which the content information is played back and output, and thereby generate output target information that includes information about the calculated advertising effect. For example, the generation unit 232 may calculate the advertising effect for each piece of content information, and thereby generate output target information that includes comparison information that allows comparison of advertising effects between applications that provide content information.
[0212] In another aspect, the generation unit 232 analyzes the performance information acquired by the performance acquisition unit 231, and generates usage information to be used for setting the output of content information by an application.
[0213] For example, the generation unit 232 analyzes the performance information to predict a delivery probability that content information will be delivered to a vehicle as an output target based on the output performance, and generates information indicating the predicted delivery probability as usage information. For example, the generation unit 232 predicts a delivery probability that content information will be delivered to a vehicle as one of the content information to be output as an output target to be played and output in order when the predetermined timing arrives, based on the driving conditions of the vehicle at a predetermined timing in the future, which are driving conditions predicted from the driving information, and the output performance indicated by the performance information. The generation unit 232 may generate usage information that further includes location information indicating a location where the delivery probability is predicted to occur, or time information indicating a time where the delivery probability is predicted to occur. The generation unit 232 may also calculate a risk level at a predetermined timing based on the driving information, thereby generating usage information that further includes information indicating the calculated risk level.
[0214] Furthermore, for example, the generation unit 232 may analyze the performance information by calculating the appeal of the content information as an advertisement at a predetermined time in the future based on the advertising performance indicated by the performance information, and generate information indicating the calculated appeal as usage information.
[0215] (Regarding the output unit 233) The output unit 233 outputs (provides) the information to be output, which is generated by the generation unit 232, to an application. For example, the output unit 233 outputs the usage information generated by the generation unit 232 to the application. For example, the output unit 233 outputs information indicating the delivery probability predicted by the generation unit 232 to the application. Furthermore, the output unit 233 outputs information indicating the advertising appeal calculated by the generation unit 232 to the application.
[0216] (Regarding the performance acquisition unit 231, the generation unit 232, and the output unit 233) The performance acquisition unit 231 acquires performance information classified by category to which the content information belongs as performance information. The generation unit 232 analyzes the performance information classified into each category to generate usage information to be used for output settings of the content information by an application, and the output unit 233 outputs the usage information generated by analyzing the performance information classified into the category to an application that has provided the content information belonging to the category.
[0217] (Regarding the selection unit 234) The selection unit 234 associates content information with meta information including at least one of range information indicating a range to be played back, category information indicating a category to which the content belongs, and time information indicating a playback time, and based on this meta information, selects an application according to a predetermined situation related to the vehicle. For example, the selection unit 234 selects an application according to a traveling situation of the vehicle based on the meta information. Furthermore, for example, the selection unit 234 may select an application according to a situation of a user of the vehicle based on the meta information.
[0218] (Regarding Proposal Section 235) The suggestion unit 235 suggests to the application selected by the selection unit 234 that content information having content corresponding to a predetermined situation related to the vehicle be provided as content information to be played and output in a vehicle corresponding to the predetermined situation. For example, the suggestion unit 235 suggests to the application selected by the selection unit 234 that content information having content corresponding to a driving situation be provided as content information to be played and output in a vehicle corresponding to the driving situation. Also, for example, the suggestion unit 235 suggests to the application selected by the selection unit 234 that content information having content corresponding to a situation of a user of the vehicle be provided as content information to be played and output in a vehicle corresponding to the user's situation.
[0219] For this reason, the selection unit 234 selects the optimal application according to the vehicle's driving conditions and the vehicle user's conditions. For example, suppose that the vehicle VE1, which has been traveling on a national highway, enters a narrow side street in a residential area. On the narrow side street, the user U1 of the vehicle VE1 is required to drive more carefully. Therefore, in such a case, the selection unit 234 can select, for example, an ADAS-related application AP11. Then, the suggestion unit 235 suggests to the application AP11 that, for example, content information encouraging the user U1 to drive slowly while being careful of pedestrians suddenly appearing outside the vehicle be provided as content information to be played and output by the vehicle VE1.
[0220] Furthermore, for example, assume that the vehicle VE1 is traveling around an urban area during the lunch hour, and therefore it is estimated that the user U1 of the vehicle VE1 is looking for a place to take a lunch break. In this case, the selection unit 234 can select the advertisement provision-related application AP22. Then, the suggestion unit 235 suggests to the application AP22 that content information advertising stores in this urban area be provided as content information to be played and output by the vehicle VE1.
[0221] The selection unit 234 may also select an optimal application based on the ranks assigned to the applications, the user's preferences, or the user's behavior history. For example, if it is determined from the past behavior history that the user U1 often stops at ramen restaurants while driving the vehicle VE1, the selection unit 234 may select the advertisement provision-related application AP22. If there are multiple advertisement provision-related applications, the selection unit 234 may select, for example, an application with a higher rank.
[0222] 5-2-2. Information Processing Procedure According to the Second Embodiment Next, the procedure of information processing according to the second embodiment will be described with reference to Fig. 13 and Fig. 14. Fig. 13 is a flowchart showing an overview of the information processing procedure focusing on the output record. Fig. 14 is a flowchart showing an overview of the information processing procedure focusing on the advertising record.
[0223] First, Fig. 13 will be described. The result acquisition unit 231 determines whether it is time to output information for an arbitrary application APx among the applications according to the embodiment (step S301). While it is determined that it is not time to output information for the application APx (step S301; No), the result acquisition unit 231 waits until it can determine that it is time to output information for the application APx.
[0224] On the other hand, when it is determined that the timing for outputting information for the application APx has arrived (step S301; Yes), the result acquisition unit 231 acquires result information regarding the reproduction output of the content information provided by the application APx (step S302). For example, the result acquisition unit 231 acquires the result information regarding the reproduction output of the content information provided by the application APx from the result information database 223.
[0225] Next, the generation unit 232 recognizes the driving condition of the distribution destination vehicle at the set timing (from FIG. 9), which is predicted from the driving information of the distribution destination vehicle (step S303).
[0226] Furthermore, the generation unit 232 predicts a distribution probability that the content information of application APx will be distributed to the destination vehicle as one of the content information to be output to be played back and output in sequence when the set timing is reached, based on the output record indicated by the record information acquired in step S302 and the driving conditions in step S303 (step S304). For example, the generation unit 232 can predict a distribution probability that the content information of application APx will be distributed to the destination vehicle based on a history of record information obtained by distributing similar content information similar to the content information of application APx up to now. As an example, the generation unit 232 may predict the distribution probability by inputting the record information acquired in step S302 into a prediction model learned from the distribution record of similar content information.
[0227] Furthermore, the similar content information referred to here may be, for example, other content information having a similar category to the content information of application APx, other content information having a similar playback time to the content information of application APx, other content information having a similar geographical range to the content information of application APx, etc.
[0228] Next, the generating unit 232 generates information indicating the delivery probability as usage information (step S305), and outputs the generated usage information to be provided to the application APx (step S306).
[0229] Next, Fig. 14 will be described. The result acquisition unit 231 determines whether it is time to output information for an arbitrary application APx among the applications according to the embodiment (step S401). While it is determined that it is not time to output information for the application APx (step S401; No), the result acquisition unit 231 waits until it can determine that it is time to output information for the application APx.
[0230] On the other hand, when it is determined that the timing for outputting information for the application APx has arrived (step S401; Yes), the result acquisition unit 231 acquires result information regarding the reproduction output of the content information provided by the application APx (step S402). For example, the result acquisition unit 231 acquires the result information regarding the reproduction output of the content information provided by the application APx from the result information database 223.
[0231] Next, the generation unit 232 recognizes the driving condition of the distribution destination vehicle at the set timing (from FIG. 9), which is predicted from the driving information of the distribution destination vehicle (step S403).
[0232] Furthermore, the generation unit 232 calculates the advertising appeal at the set timing for the content information of application APx based on the advertising performance indicated by the performance information acquired in step S402 and the driving conditions in step S403 (step S404). For example, the generation unit 232 can calculate the advertising appeal at the set timing based on conversion information of similar content information that is similar to the content information of application APx. As an example, the generation unit 232 may calculate the advertising appeal (e.g., conversion rate) by inputting the performance information acquired in step S402 into a prediction model learned from the conversion information of similar content information.
[0233] Next, the generation unit 232 generates information indicating the advertising appeal as usage information (step S405), and outputs the generated usage information to be provided to the application APx (step S406).
[0234] [5-2-3. Summary] The information processing device 200 according to the second embodiment is an information processing device that reproduces and outputs content information acquired from an application capable of providing content information (an application according to the embodiment) to a vehicle. The information processing device 200 acquires performance information related to the reproduction and output of the content information, analyzes the acquired performance information, and generates usage information that is used for setting the output of the content information by the application. The information processing device 200 then outputs the generated usage information to the application. The information processing device 200 can assist the application that provides the content information to be reproduced and output in the vehicle in appropriately setting the output.
[0235] [6. Hardware Configuration] The information processing device 100 according to the first embodiment and the information processing device 200 according to the second embodiment described above are realized, for example, by a computer 1000 configured as shown in Fig. 15. The information processing device 100 will be described below as an example. Fig. 15 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, an HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.
[0236] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 starts up, programs that depend on the hardware of the computer 1000, and the like.
[0237] The HDD 1400 stores programs executed by the CPU 1100, data used by such programs, etc. The communication interface 1500 receives data from other devices via a predetermined communication network and sends it to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.
[0238] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.
[0239] Media interface 1700 reads a program or data stored in recording medium 1800 and provides it to CPU 1100 via RAM 1200. CPU 1100 loads the program or data from recording medium 1800 onto RAM 1200 via media interface 1700 and executes the loaded program. Recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.
[0240] For example, when the computer 1000 functions as the information processing device 100 according to the first embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200, thereby realizing the functions of the control unit 130. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via a predetermined communication network.
[0241] Furthermore, for example, when the computer 1000 functions as the information processing device 200 in the second embodiment, the CPU 1100 of the computer 1000 executes a program loaded onto the RAM 1200 to realize the functions of the control unit 230.
[0242] [7. Other] Furthermore, among the processes described in each of the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.
[0243] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.
[0244] Furthermore, the above-described embodiments can be combined as appropriate within the scope of not causing any contradiction in the processing content.
[0245] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that include the embodiments described in the Disclosure of the Invention section and that have undergone various modifications and improvements based on the knowledge of those skilled in the art.
[0246] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, a decision unit can be read as a decision means or a decision circuit. [Explanation of symbols]
[0247] Sy Information Processing System 100 Information processing device 120 Storage section 121 Content Database 122 Driving Information Database 130 Control Unit 131 First acquisition part 132 Second acquisition part 133 Specific part 134 Prediction Department 135 Detector 136 Calculation Unit 137 Decision Section 138 Output control section 139 Information Control Department 200 Information processing device 220 Storage section 223 Performance Information Database 230 Control Unit 231 Performance Acquisition Department 232 Generation part 233 Output section 234 Selection Section 235 Proposal Department
Claims
1. An information processing device that reproduces and outputs content information acquired from an application capable of providing content information to a mobile object, an acquisition unit that acquires performance information including an output performance indicating whether the content information has been reproduced and output; a generation unit that analyzes the performance information acquired by the acquisition unit and generates usage information that is used for setting output of the content information by the application; an output unit that outputs the usage information generated by the generation unit to the application; An information processing device comprising:
2. the performance information includes performance information indicating an output performance, which is a performance of the content information being reproduced and output on the mobile object; the generation unit, as an analysis of the performance information, predicts a delivery probability that the content information will be delivered to the mobile body as an output target based on the output performance, and generates information indicating the predicted delivery probability as the usage information; The output unit outputs information indicating the delivery probability to the application.
2. The information processing apparatus according to claim 1, wherein:
3. The generation unit predicts a distribution probability that the content information will be distributed to the mobile body as one piece of content information to be output to be reproduced and output in order when the predetermined timing arrives, based on the movement status of the mobile body at a predetermined timing in the future, which is predicted from movement information regarding the movement status of the mobile body, and the output record indicated by the record information.
3. The information processing apparatus according to claim 2, wherein:
4. The generation unit generates the usage information further including location information indicating a location where the delivery probability is predicted to occur or time information indicating a time where the delivery probability is predicted to occur.
4. The information processing apparatus according to claim 3,
5. The generation unit calculates a risk level at the predetermined timing based on the movement information, and generates the usage information further including information indicating the calculated risk level.
5. The information processing apparatus according to claim 3, wherein the information processing apparatus is a computer.
6. the performance information includes performance information indicating an advertising performance resulting from the content information being reproduced and output at the mobile object, the generation unit, as an analysis of the performance information, calculates an appeal of the content information as an advertisement at a predetermined timing in the future based on the advertising performance indicated by the performance information, and generates information indicating the calculated appeal as the usage information; The output unit outputs information indicating the appeal to the application.
6. The information processing device according to claim 1, wherein:
7. the acquiring unit acquires, as the performance information, performance information classified by category to which the content information belongs; the generation unit analyzes performance information classified into each of the categories to generate usage information to be used for output setting of the content information by the application; The output unit outputs usage information generated by analyzing performance information classified into the category to an application that has provided the content information belonging to the category.
7. The information processing device according to claim 1, wherein:
8. The content information is associated with meta information including at least one of range information indicating a range to be reproduced, category information indicating a category to which the content belongs, and time information indicating a reproduction time, a selection unit that selects an application according to a predetermined situation related to the mobile object based on the meta information; a suggestion unit that suggests to the application selected by the selection unit to provide content information corresponding to the predetermined situation as content information to be reproduced and output in the mobile object corresponding to the predetermined situation; Further having 8. The information processing device according to claim 1, wherein:
9. the selection unit selects an application according to a movement status of the moving object based on the meta information; The suggestion unit suggests to the application selected by the selection unit to provide content information corresponding to the moving status as content information to be reproduced and output in the moving object corresponding to the moving status. The information processing device according to claim 8 .
10. the selection unit selects an application according to a situation of the user of the mobile object based on the meta information; The suggestion unit suggests to the application selected by the selection unit to provide content information having details corresponding to the user's situation as content information to be reproduced and output in the mobile object corresponding to the user's situation.
10. The information processing device according to claim 8.
11. An information processing method executed by an information processing device that reproduces and outputs content information acquired from an application capable of providing content information to a mobile object, the method comprising: an acquisition step of acquiring performance information including an output performance indicating whether the content information has been reproduced and output; a generating step of analyzing the performance information acquired by the acquiring step and generating usage information to be used for setting output of the content information by the application; an output step of outputting the usage information generated by the generation step to the application; An information processing method comprising:
12. An information processing program executed by an information processing device that reproduces and outputs content information acquired from an application capable of providing content information to a mobile object, The computer included in the information processing device an acquisition means for acquiring performance information including an output performance indicating whether the content information has been reproduced and output; a generating means for analyzing the performance information acquired by the acquiring means and generating usage information to be used for setting output of the content information by the application; an output unit that outputs the usage information generated by the generation unit to the application; An information processing program characterized by causing the program to function as:
Citation Information
Patent Citations
Advertisement provision system, cellphone used for advertisement provision system, navigation device used for advertisement provision system, advertisement provision method, advertisement reception method, advertisement provision program, advertisement reception program and recording medium
JP2009080733A
Information distribution system, center device, in-vehicle unit, questionnaire answer acquisition method
JP2009237828A
Delivery system and center device
JP2009276299A
Information provision device, information provision program, and information provision method
JP2017058765A
Action control system and action control method
JP2017059099A