Information processing device, information processing method, and information processing program

The information processing device addresses the challenge of providing useful feedback to applications on the performance of content information in vehicles by acquiring performance information and generating feedback, thereby optimizing the reproduction and output process to minimize interference.

JP7672487B2Active Publication Date: 2025-05-07PIONEER IP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023525204
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-05-31
Publication Date
2025-05-07
Estimated Expiration
2041-05-31

AI Technical Summary

Technical Problem

Existing technologies struggle to provide useful feedback to applications regarding the performance of content information reproduced and outputted in vehicles, particularly when there is a risk of interference between multiple audio information streams.

Method used

An information processing device and method that acquires performance information related to the reproduction and output of content information from applications, and generates feedback information to be outputted to the applications based on this performance information.

Benefits of technology

Enables the provision of useful feedback to applications regarding the performance of content information, optimizing the reproduction and output process to minimize interference and improve user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007672487000001
    Figure 0007672487000001
  • Figure 0007672487000002
    Figure 0007672487000002
  • Figure 0007672487000003
    Figure 0007672487000003
Patent Text Reader

Abstract

An information processing device (200), for causing content information acquired from an application that is capable of providing content information to be reproduced and output to a moving body, has an acquisition unit (231) for acquiring result information relating to reproduction and output of content information, and a generation unit (232) for generating information to be output that is output by the application on the basis of the result information acquired by the acquisition unit (231).
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known a technique for outputting information such as warning information, route guidance information, road traffic information, tourist information, and advertisement information as voice information to a driver while a vehicle is traveling.

[0003] However, if the timing of the playback and output of these pieces of audio information overlaps, it may be difficult to hear them or may interfere with driving. Therefore, a mechanism has been proposed for scheduling the playback and output timing of these pieces of audio information so that they do not interfere with each other. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2013-221837 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, one example of a problem with the above-mentioned conventional technology is that it may not be possible to provide useful feedback to the application based on the output performance of the content information provided by the application in the vehicle.

[0006] For example, in the above-mentioned conventional technology, when there is a risk of interference between the playback of multiple pieces of audio information, the playback order of these pieces of audio information is simply selected from the various combinations of playback orders that result in the smallest degree of loss due to non-playback and delayed playback, and there is no mention or suggestion of the existence of an application that provides the audio information or the provision of information to the application.

[0007] Therefore, the above-mentioned conventional technology does not necessarily allow useful feedback to be given to the application according to the track record regarding the playback output in the vehicle of the content information provided from the application.

[0008] The present invention has been made in consideration of the above, and aims to provide an information processing device, an information processing method, and an information processing program that are capable of providing useful feedback to an application based on the performance of the playback output in a vehicle of content information provided by the application. [Means for solving the problem]

[0009] The information processing device of claim 1 is an information processing device that reproduces and outputs content information acquired from an application capable of providing content information to a mobile body, and is characterized in having an acquisition unit that acquires performance information regarding the reproduction and output of the content information, and a generation unit that generates information to be output to the application based on the performance information acquired by the acquisition unit.

[0010] The information processing method of claim 9 is an information processing method executed by an information processing device that reproduces and outputs content information acquired from an application capable of providing content information to a mobile body, and is characterized in including an acquisition step of acquiring performance information regarding the reproduction and output of the content information, and a generation step of generating information to be provided to the application based on the performance information acquired by the acquisition step.

[0011] The information processing program of claim 10 is an information processing program executed by an information processing device that plays and outputs content information acquired from an application capable of providing content information to a mobile body, and is characterized in that it causes a computer provided in the information processing device to function as an acquisition means for acquiring performance information regarding the playback and output of the content information, and as a generation means for generating information to be provided to the application based on the performance information acquired by the acquisition means. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating an example of a system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the information matching process. [Diagram 3] FIG. 3 is a diagram illustrating an example of the configuration of the information processing device according to the first embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a content database according to the first embodiment. [Diagram 5] FIG. 5 is a diagram illustrating an example of the travel information database according to the first embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of information processing according to the first embodiment. [Figure 7] FIG. 7 is a diagram illustrating another example of the information processing according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing modifications corresponding to the information processing according to the first embodiment. [Figure 9] FIG. 9 is a flowchart showing an overall information processing procedure according to the first embodiment. [Figure 10] FIG. 10 is a flowchart showing a decision process procedure included in the information processing procedure according to the first embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of the configuration of an information processing device according to the second embodiment. [Figure 12] FIG. 12 is a diagram illustrating an example of the performance information database according to the second embodiment. [Figure 13] FIG. 13 is a flowchart showing an overall information processing procedure according to the second embodiment. [Figure 14] FIG. 14 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, a mode for carrying out the present invention (hereinafter, referred to as an embodiment) will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.

[0014] In the following embodiments, a vehicle can be read as a moving body, a driving condition as a moving condition, and a driving speed as a moving speed. An expression such as "playing and outputting in a vehicle" includes the meaning of playing and outputting to a terminal device moving with the vehicle. An expression such as "controlling the output of a vehicle to play and output content information" includes the meaning of output control of a terminal device and provision (output) of content information to a user of the vehicle.

[0015] 1. Introduction Examples of terminal devices that travel with a vehicle include terminal devices (e.g., in-vehicle devices) installed in the vehicle and terminal devices such as smartphones owned by users (e.g., vehicle passengers, including the driver), and applications that provide various types of content to such terminal devices are known.

[0016] For example, there are applications that assist users in driving by providing content information according to the driving state of the vehicle or the situation of the user driving the vehicle, or content information that guides the user along the way according to various inputs (e.g., text input or voice input). There are also applications that assist users in driving more comfortably by providing various content information such as tourist information, store information, advertising information, and other useful information in accordance with the driving of the vehicle.

[0017] Here, applications may be classified into specific types depending on what category of content information they can provide. For example, an application related to ADAS (Advanced Driver-Assistance Systems) provides content information categorized as "warning" or "caution", and is therefore classified into a type such as "ADAS" or "safety support". On the other hand, an application related to various types of guidance (e.g., route guidance, tourist information, etc.) provides content information categorized as "guidance", and is therefore classified into a type such as "guidance support". Furthermore, an application related to store information (e.g., advertisements related to stores) provides content information categorized as "advertisement", and is therefore classified into a type such as "advertisement provision".

[0018] The application also passes content information to be provided to the user to an information matching engine (specifically, a computer equipped with an information matching engine) described later, and reproduces and outputs the content information via the information matching engine. At this time, the application gives meta information to the content information, including range information indicating the range to be reproduced and output, category information indicating the category of the content information, and the length (reproduction time) of the content information.

[0019] The range information indicating the range in which the content information should be played back corresponds to condition information that specifies the geographical range in which the content information should be played back, the time range, the vehicle's travel distance range, the vehicle's passing area range, the vehicle's speed range, etc., and conditions the content information to be played back and output within the range. In the following embodiment, the description focuses on area information (one example of range information) indicating the geographical range in which the content information should be played back and output, but the information processing according to the embodiment can also be applied to other ranges than the geographical range, i.e., the time range, the vehicle's travel distance range, the vehicle's passing area range, and the vehicle's speed range.

[0020] Furthermore, when each application sets a geographical range in this way, some or all of the geographical ranges may overlap between the applications. This causes a problem of interference between the playback output of content information corresponding to each overlapping geographical range. Furthermore, since the content information is configured as a voice message considering that the user to whom the information is provided is a passenger in a vehicle, interference between the playback output may hinder driving. For this reason, a computer equipped with an information matching engine determines an appropriate output order and an appropriate output timing according to the control of the information matching engine. Furthermore, the computer predicts the driving situation of a vehicle while it is running, in response to the changes in the driving situation from time to time, and prioritizes the content information to be played and output in order to optimize the content information.

[0021] Also, depending on the determined priority and output order, some content information may be discarded without being played back. For this reason, applications may attempt to dynamically control (set output) the range in which their own content information is played back as efficiently as possible, but a computer equipped with an information matching engine can support the application in setting output by providing feedback to the application according to performance information regarding playback output.

[0022] [2. About the System] Next, a system including the above-described application and a computer equipped with an information matching engine will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of a system according to an embodiment. Fig. 1 shows an information processing system Sy as an example of a system according to an embodiment. Information processing according to an embodiment described later is realized by the information processing system Sy.

[0023] (Regarding terminal device 10) The terminal device 10 (edge ​​terminal) is an information processing terminal used by a user (a passenger in a vehicle). The terminal device 10 may be, for example, a stationary in-vehicle device installed in a vehicle, or a portable terminal device (for example, a smartphone, a tablet terminal, a notebook PC, a desktop PC, a PDA, etc.) owned by a user. In this embodiment, the terminal device 10 is assumed to be an in-vehicle device.

[0024] Also, in the example of FIG. 1, the terminal device 10 is provided in a vehicle VE1 driven by a user U1, and reproduces and outputs content information according to output control by a computer equipped with an information matching engine. For example, the terminal device 10 has a notification unit (output unit) and causes the content information to be output from this notification unit. For example, the notification unit may be a speaker or a display screen, and the terminal device 10 reproduces and outputs content information in the form of a voice message (audio content) via the speaker. Also, the notification unit may be a display screen, and the terminal device 10 can display information to support the details of the audio content on the display screen.

[0025] In addition, various applications such as an ADAS application, a navigation application, a music application, a delivery application, an insurance application, etc. may be installed in the terminal device 10 at the user's discretion, and such applications can transmit user information including, for example, account information and setting information set by the user to a cloud computer CCP2 described later.

[0026] The application installed in the terminal device 10 may be an application for an edge terminal corresponding to an application that provides content information in the form of a voice message together with range information (hereinafter, may be referred to as the "app of the embodiment"), or it may be any application different from the app of the embodiment.

[0027] (About the ECP1 edge computer) The edge computer ECP1 is a computer that performs data processing (edge ​​processing) near the terminal device 10, and includes a situation assessment engine E30-1 and an information matching engine E100-1. According to the example of Fig. 1, the edge computer ECP1 includes an application AP1x (e.g., an application AP11, an application AP12, an application AP13, etc.) as an application according to the embodiment.

[0028] 1, the application AP1x is provided inside the edge computer ECP1, but the application AP1x may be independent of the edge computer ECP1. In such a case, for example, the information processing system Sy may further include a server device (application server) corresponding to the application AP1x, while the edge computer ECP1 may not have the application AP1x inside.

[0029] Furthermore, since the application AP1x is an application that provides content information of which the output to the user is of a higher urgency, it is incorporated in the edge computer ECP1 that exists near the terminal device 10. As a result, the content information provided by the application AP1x can be reproduced and output with a shorter time lag in accordance with the driving conditions of the vehicle VE1. For this reason, the application AP1x may be, for example, an application related to ADAS, and provides content information categorized as "warning" or "caution."

[0030] Furthermore, the edge computer ECP1 may further include a general-purpose proxy application as shown in FIG.

[0031] (About Cloud Computer CCP2) The cloud computer CCP2 is a computer that exists on the cloud side and provides various types of information, for example, in a push format, and has a situation grasping engine E30-2 and an information matching engine E100-2 built in. Also, according to the example of Fig. 1, the cloud computer CCP2 is provided with an application AP2x (for example, an application AP21, an application AP22, an application AP23, etc.) as an application according to the embodiment.

[0032] 1, the application AP2x is provided inside the cloud computer CCP2, but the application AP2x may be independent of the cloud computer CCP2. In such a case, for example, the information processing system Sy may further include a server device (application server) corresponding to the application AP2x, while the cloud computer CCP2 may not have the application AP2x inside.

[0033] The application AP2x may be an application that provides content information that is less urgent to be output to the user. For this reason, the application AP2x is incorporated in a cloud computer CCP2 on the cloud side that is separate from the terminal device 10. For this reason, the application AP2x may be an application related to, for example, guidance support or advertisement provision, and provides content information categorized as "guidance" or "advertisement."

[0034] (Specific examples of information processing) Next, specific examples of processes performed by the application, the situation grasping engine, and the information matching engine according to the embodiment will be described. In addition, the content information will be described below as audio content. Note that the content information is not limited to audio content, and may be, for example, video content.

[0035] First, a specific example of processing by an application according to the embodiment will be described. Since the processing content is the same regardless of whether the application is AP1x or AP2x, the application AP1x will be described here as an example.

[0036] The application AP1x personalizes the voice content provided to each user based on the user's usage history. The application AP1x also performs processing to determine what voice message should be responded to based on the utterance content indicated by the voice input by the user so as to realize a dialogue with the user. The application AP1x can also determine the voice content to be provided to the user and the content of the voice message to be responded to the user based on the user's situation.

[0037] Furthermore, the application AP1x performs a generation process to generate audio content. For example, the application AP1x determines which category of audio content should be played back based on data received from the situation recognition engine E30-1 (in the case of the application AP2x, the situation recognition engine E30-2), and generates audio content of the determined category.

[0038] For example, the application AP1x generates voice content according to the vehicle's traveling situation grasped by the situation grasping engine E30-1. The voice content generated by the generation process may be, for example, text data that is the basis of a voice message that is finally notified to the user, and may define the content of the voice message that is later converted into voice data. That is, the application AP1x is not limited to generating voice data as the voice content, and may generate data of other formats that are the basis of a voice message as the voice content.

[0039] The application AP1x can also specify the timing for playing and outputting the audio content. For example, the application AP1x can generate range information indicating the range in which the audio content is permitted to be played and output, using the geographic range, time range, vehicle travel distance range, vehicle passing area range, vehicle speed range, etc., in which the audio content is to be played and output. In this case, the application AP1x transmits the audio content to which meta information including the range information is added to the information matching engine E100-1 (information matching engine E100-2 in the case of the application AP2x), thereby requesting (reserving) the terminal device 10 to play and output the audio content under the conditions indicated by the range information.

[0040] Next, a specific example of the process performed by the situation recognition engine will be described. Since the process performed by the situation recognition engine E30-1 or E30-2 is the same, the situation recognition engine E30-1 will be described as an example.

[0041] The situation awareness engine E30-1 performs a situation awareness process, which is an analysis process for understanding the traveling situation of the vehicle. For example, the situation awareness engine E30-1 senses the traveling situation of the vehicle based on sensor information obtained from various sensors. Note that the sensor referred to here may be, for example, a sensor provided in the vehicle or a sensor provided in the terminal device 10, and examples thereof include an acceleration sensor, a gyro sensor, a magnetic sensor, a GPS, a camera, and a microphone.

[0042] For example, the situation recognition engine E30-1 can perform a series of analysis processes as follows. For example, the situation recognition engine E30-1 performs sensing based on sensor information acquired from the above sensors, and performs base analysis by using the sensing result as a core element. In the base analysis, the situation recognition engine E30-1 extracts necessary data using the core element as an information source, and converts and processes the extracted data. Next, the situation recognition engine E30-1 performs high-level analysis using the converted and processed data. In the high-level analysis, the situation recognition engine E30-1 analyzes specific driving conditions based on the converted and processed data. For example, the situation recognition engine E30-1 analyzes the driving conditions of the vehicle, such as whether the vehicle is driving on a straight road or not, whether the vehicle is turning or not, the driving speed, the traveling direction, and the traffic congestion condition.

[0043] According to the example of FIG. 1, the situation recognition engine E30-2 may use statistical information obtained by statistical processing of logs related to the driving situation and user operations in the situation recognition processing.

[0044] Next, a specific example of processing by the information matching engine will be described. Since the processing content is the same regardless of whether it is the information matching engine E100-1 or E100-2, the information matching engine E100-1 will be used as an example for the description. As shown in Fig. 2 and Fig. 3, the information matching engine E100-1 has a request manager function and a response manager function.

[0045] The request manager function accepts requests from application AP1x (application AP2x in the case of the information matching engine E100-2) and performs queuing according to the accepted request. Note that the request here may be an output request requesting that the generated audio content be played back and output, and is transmitted, for example, including the audio content. The request manager function also queues the accepted audio content in a content buffer.

[0046] The response manager function performs output decision processing according to rules. For example, the response manager function performs output decision processing according to an output decision algorithm. More specifically, the response manager function determines the priority and output order in which the audio content reserved for output is actually output, based on driving information indicating the driving situation grasped by the situation grasp engine E30-1 (in the case of the information matching engine E100-2, the situation grasp engine E30-2) and range information included in the request. Then, the response manager function controls the terminal device 10 to play and output the audio content in the output order according to the determined priority.

[0047] [3. Information processing flow] Next, a flow of information processing (information processing according to the embodiment) realized by the information processing system Sy will be described with reference to Fig. 1. Here, a scene is assumed in which audio content is reproduced and output to a user U1 driving a vehicle VE1 via a terminal device 10 corresponding to an in-vehicle device of the vehicle VE1. In this scene, the terminal device 10 transmits sensor information detected by a sensor possessed by the terminal device 10 to the edge computer ECP1 at any time.

[0048] In this state, the flow of information originating from the edge computer ECP1 is shown first. When the situation recognition engine E30-1 of the edge computer ECP1 acquires the sensor information transmitted from the terminal device 10, it performs a situation recognition process for grasping the traveling state of the vehicle VE1. For example, the situation recognition engine E30-1 performs a series of analysis processes such as sensing using the sensor information, base analysis using the sensing result as a core element, and higher-level analysis using data obtained as a result of the base analysis, thereby performing a detailed situation recognition process.

[0049] Then, the situation recognition engine E30-1 transmits the driving information indicating the driving situation recognized by the situation recognition process to a user that uses the driving information. For example, the situation recognition engine E30-1 transmits the driving information to the information matching engine E100-1, the application AP1x, and the situation recognition engine E30-2. The driving situation here may be, for example, the position, driving speed, and traveling direction of the vehicle VE1.

[0050] When the application AP1x acquires the driving information from the situation recognition engine E30-1, the application AP1x performs a generation process to generate audio content based on the acquired driving information. For example, the application AP1x generates audio content according to the driving situation of the vehicle VE1 based on the driving information acquired from the situation recognition engine E30-1. The application AP1x also generates range information indicating a range in which the audio content is allowed to be played back using a geographic range, a time range, a driving distance range of the vehicle VE1, a passing area range of the vehicle VE1, or a speed range of the vehicle, in which the audio content should be played back, and assigns meta information including the generated range information to the audio content. The application AP1x then inputs the audio content to which the meta information has been assigned to the information matching engine E100-1.

[0051] When the situation recognition engine E30-2 acquires the driving information from the situation recognition engine E30-1, the situation recognition engine E30-2 performs a situation recognition process for grasping the driving state of the vehicle VE1 based on the acquired driving information. For example, the driving information acquired from the situation recognition engine E30-1 is accumulated in a predetermined database of the cloud computer CCP2. In addition, logs related to user operations may also be accumulated in the database, and the situation recognition engine E30-2 performs a statistical process on the driving information and operation logs accumulated so far, and performs a situation recognition process for grasping the driving state of the vehicle VE1 using statistical information indicating the results of the statistical process and external data acquired from the outside.

[0052] The external data referred to here is data that can be acquired because it exists in the cloud, and is useful for understanding the driving conditions. For example, the external data may include weather information indicating the weather conditions, traffic information indicating the traffic conditions, and road information indicating the road conditions. Of course, the external data is not limited to these examples.

[0053] Then, the situation recognition engine E30-2 transmits the driving information indicating the driving situation recognized by the situation recognition process to a user that uses the driving information. For example, the situation recognition engine E30-2 transmits the driving information to the information matching engine E100-2 and the application AP2x. The driving situation here may be, for example, the position, driving speed, and traveling direction of the vehicle VE1.

[0054] In addition, in response to the situation grasping process being performed between the situation grasping engines E30-1 and E30-2 and the generation process being performed between the applications AP1x and AP2x, the information matching process is performed from the information matching engines E100-2 to E100-1. For example, the information matching process is performed from the information matching engines E100-2 to E100-1 to match the optimal combination of sound contents among the sound contents of the output candidates generated by the generation process so that they are output in the optimal order.

[0055] For example, area information (an example of range information) indicating the geographical range in which the audio content should be played back is associated as meta-information with each audio content generated by the generation process. Therefore, in the information consistency process, a priority for playing back is calculated for each of the audio contents based on the driving information indicating the driving situation grasped by the situation grasping process. In addition, in the information consistency process, an output order of the audio contents in combination according to the priority is determined based on the playback time, area information, and driving information of each of the audio contents. Then, the audio contents included in this combination are output controlled so that they are played back in the order determined in the output order so as not to interfere with each other.

[0056] In addition, area information indicating a geographical location or a geographical range where the playback output should be ended may be associated with the audio content as meta information. In such a case, in the information matching process, the output start timing for starting the playback output may be determined based on the playback time of each of the multiple audio contents and the area information.

[0057] An example of the information matching process and the output control process according to the result of the information matching process will be described below with reference to the example of FIG.

[0058] First, the information matching engine E100-2 performs output determination processing according to area information (rules) that correspond to each audio content input from the application AP2x and indicate a geographical range to be played back. For example, the response manager function of the information matching engine E100-2 performs output determination processing according to an output determination algorithm.

[0059] More specifically, the response manager function determines the priority and output order of the audio contents reserved for output, taking into consideration the driving information indicating the driving situation grasped by the situation grasping engine E30-2 and the playback time of each audio content. For example, the response manager function determines the output order of the combination of audio contents according to the priority. Note that the response manager function may perform the output determination process by further using user information transmitted from an application inserted in the terminal device 10, as shown in FIG. 1.

[0060] Then, the information matching engine E100-2 outputs the information determined by the response manager function to the edge computer ECP1 as information according to the output determination result. The information output to the edge computer ECP1 is input to the information matching engine E100-1 via the general-purpose proxy application of the edge computer ECP1.

[0061] The information matching engine E100-2 performs output judgment processing according to area information (rules) corresponding to the audio contents input from the application AP1x and the audio contents indicated by the combination input from the information matching engine E100-2 side as the output judgment result. For example, the response manager function of the information matching engine E100-1 performs output judgment processing according to an output judgment algorithm.

[0062] More specifically, the response manager function determines the final priority and output order of the audio contents scheduled for output, taking into consideration the driving information indicating the driving situation grasped by the situation grasping engine E30-1, the playback time of each audio content, and the information (priority, output order) determined by the information matching engine E100-2. For example, the response manager function determines the output order of the combination of audio contents according to the priority.

[0063] Then, the information matching engine E100-2 performs output control on the terminal device 10 so as to play and output the audio contents in the output order according to the determined priority. In accordance with the output control, the terminal device 10 plays and outputs the audio contents included in the combination according to the priority in order so as not to interfere with each other.

[0064] According to the example of Fig. 1, the information matching engine E100-2 can also perform LED control on the terminal device 10 to emit LED light according to a category so that the user can recognize to what category the currently played and output audio content belongs, for example. Also, according to the example of Fig. 1, the information matching engine E100-2 can perform display control on the terminal device 10 to display information for supporting the details of the audio content on the display screen.

[0065] [4. Specific examples of information consistency processing] Next, the information matching process performed by the information matching engine will be described in more detail using a specific example. Fig. 2 is a diagram showing an example of the information matching process. Fig. 2 shows a scene where the information matching process is performed by the information matching engine E100-1.

[0066] Figure 2 shows an example in which application AP11, an ADAS-related application residing in edge computer ECP1, generates audio content C111 (safety support information C111) with the message content "Watch out for vehicles jumping out into the road," and reserves (requests) the playback output by sending an output request to the information matching engine E100-1 to play back the generated audio content C111.

[0067] Figure 2 also shows an example in which application AP21, a guidance support-related application residing in cloud computer CCP2, generates audio content C211 (tourist information C211) with the message content "It's on the right ahead," and reserves (requests) the playback output by sending an output request to the information matching engine E100-1 to play back the generated audio content C211.

[0068] Figure 2 also shows an example in which application AP22, an advertising-related application residing in cloud computer CCP2, generates audio content C221 (store advertisement C221) with the message content "Up ahead, there is a three-star restaurant...", and reserves (requests) the playback output by sending an output request to the information matching engine E100-1 to request that the generated audio content C221 be played back.

[0069] 2, the request manager function of the information matching engine E100-1 performs queuing in response to output requests received from the applications AP11, AP21, and AP22. For example, the request manager function queues, in the content buffer, the audio contents C111, C211, and C221 received together with the output requests.

[0070] Furthermore, the response manager function of the information matching engine E100-1 performs output decision processing according to rules. For example, the response manager function performs output decision processing according to an output decision algorithm. More specifically, the response manager function determines the priority and output order of which audio content among the audio contents is to be output and in what order based on the driving information indicating the driving situation grasped by the situation grasping engine E30-1, the area information included in the output request, and the playback time of each audio content reserved for output. Then, the response manager function determines the output order for the combination of audio contents according to the determined priority. Furthermore, the response manager function performs output control on the terminal device 10 so as to play and output the audio contents corresponding to the combination in the determined output order.

[0071] 5. Information Processing Apparatus According to the Embodiment 1 shows an example in which information processing according to the embodiment is performed between an edge computer ECP1 and a cloud computer CCP2. From here on, the following first and second embodiments will be described as an information processing device according to the embodiment, in which a computer having an information matching engine E100-1 or an information matching engine E100-2 is used.

[0072] The information processing device according to the embodiment may be a server device corresponding to the edge computer ECP1 or a server device corresponding to the cloud computer CCP2. The information processing device according to the embodiment may be a single server device configured by integrating the functions of the edge computer ECP1 and the functions of the cloud computer CCP2.

[0073] In the following description, the information processing device according to the first embodiment is referred to as an information processing device 100, and the information processing device according to the second embodiment is referred to as an information processing device 200.

[0074] In the first embodiment, a priority of the reproduction output for each of the plurality of content information is calculated using area information corresponding to each of the plurality of content information, which indicates a geographical range in which the content information is to be reproduced, the reproduction time of each of the plurality of content information, and further, driving information related to the driving situation of the vehicle. Also, in the first embodiment, the output order when the plurality of content information is reproduced and output by the vehicle is determined according to the calculated priority.

[0075] Furthermore, in the second embodiment, feedback is provided to the application based on performance information regarding the reproduction output of content information.

[0076] 5-1. First embodiment From here on, information processing according to the first embodiment will be described. Specifically, of the information processing according to the above-mentioned embodiments, information processing performed by the information processing device 100 according to the first embodiment will be described in more detail.

[0077] 5-1-1. Configuration of information processing device First, the information processing device 100 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the configuration of the information processing device 100 according to the first embodiment. As shown in Fig. 3, the information processing device 100 has a communication unit 110, a storage unit 120, an application APx, and a control unit 130.

[0078] (Regarding communication unit 110) The communication unit 110 is realized by, for example, a NIC etc. The communication unit 110 is connected to a network by wire or wirelessly, and transmits and receives information to and from the terminal device 10, for example.

[0079] (Regarding the storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk, an optical disk, etc. The storage unit 120 has a content database 121 (content buffer) and a driving information database 122.

[0080] (About Content Database 121) The content database 121 stores various information related to content information. An example of the content database 121 according to the first embodiment is shown in Fig. 4. In the example of Fig. 4, the content database 121 has items such as "application ID", "content ID", "content data", "category", "meta information", and "range information".

[0081] The "application ID" indicates identification information for identifying an application (application capable of providing content information) according to the embodiment. The "content ID" indicates identification information for identifying content information (audio content) generated by the application indicated by the "application ID".

[0082] "Content data" is content information generated by the application indicated by the "App ID." "Category" indicates the category to which the content information generated by the application indicated by the "App ID" belongs. "Category" includes warning, caution, guidance, advertisement, entertainment, etc.

[0083] The "meta information" is added to the content information, and includes range information indicating the range within which the content information should be played back, category information indicating the category of the content information, the length of the content information (playback time), and the like.

[0084] The "range information" corresponds to condition information that conditions the range within which the content information should be played and output (the allowable range within which the content information should be played and output). For example, one example of the "range information" is area information that indicates the geographical range within which the content information should be played and output. Other examples of the "range information" include the time range within which the content information should be played and output, the vehicle's travel distance range, the vehicle's passing area range, the vehicle's speed range, and the like. The "range information" may be set by the application according to the embodiment.

[0085] That is, the example in FIG. 4 shows an example in which an application (application AP11) identified by an application ID “AP11” has generated content information (content information C111) identified by a content ID “C111” and consisting of data #111.

[0086] Also, in the example of FIG. 4, the content information C111 is classified into the category "Warning" based on the content indicated by the data #111.

[0087] In addition, the example in Figure 4 shows an example in which meta information #111 is attached to content information C111, and this meta information #111 includes area information indicating that the geographical area in which the content information C111 should be played back is geographical area #111.

[0088] In the example of FIG. 4, conceptual symbols such as "#111" are used for ease of explanation, but in reality, valid information corresponding to each item is entered.

[0089] (About the driving information database 122) The travel information database 122 stores travel information related to the travel conditions of the vehicle. An example of the travel information database 122 according to the first embodiment is shown in Fig. 5. In the example of Fig. 5, the travel information database 122 has items such as "vehicle ID", "number of passengers", "terminal ID", "time", and "travel information".

[0090] "Vehicle ID" indicates identification information for identifying a vehicle. "Number of passengers" indicates the number of passengers riding in the vehicle identified by the "Vehicle ID".

[0091] "Terminal ID" indicates identification information for identifying the terminal device 10 (vehicle-mounted device) installed in the vehicle identified by the "vehicle ID".

[0092] "Time" indicates the date and time when "driving information" was acquired. "Driving information" indicates the driving status of the vehicle identified by "Vehicle ID" at the date and time indicated by "Time". In addition, the driving status indicates, for example, whether the vehicle is driving on a straight road or not, whether the vehicle is turning, the driving speed, the driving position, the traveling direction, and the traffic congestion status.

[0093] (About the application APx) Returning to FIG. 3, application APx corresponds to application AP1x or AP2x according to the embodiment described in FIG.

[0094] (Regarding the control unit 130) The control unit 130 is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like, executing various programs (for example, the information processing program according to the embodiment) stored in a storage device inside the information processing device 100 using a RAM as a working area. The control unit 130 is also realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0095] As shown in Fig. 3, the control unit 130 is equipped with an information matching engine E100. The information matching engine E100 corresponds to the information matching engine E100-1 or E100-2 described in Fig. 1. The information matching engine E100 includes a request manager function E101 and a response manager function E102.

[0096] Although not shown in Fig. 3, the request manager function E101 may have a request receiving unit and a queuing unit. Also, the response manager function E102 has a first acquisition unit 131, a second acquisition unit 132, an identification unit 133, a prediction unit 134, a detection unit 135, a calculation unit 136, a determination unit 137, an output control unit 138, and an information control unit 139, as shown in Fig. 3.

[0097] (Regarding the first acquisition unit 131) The first acquisition unit 131 acquires driving information related to the driving situation of the vehicle. For example, the first acquisition unit 131 acquires driving information indicating the driving situation of the vehicle grasped by the situation grasping process by the situation grasping engine E30-1 (E30-2).

[0098] (Regarding the second acquisition unit 132) The second acquisition unit 132 acquires area information corresponding to each of a plurality of pieces of content information, and indicating a geographical range in which the content information should be reproduced and output. For example, the second acquisition unit 132 acquires area information indicating a geographical range in which content information having a time width (playback time) should be reproduced and output from start to finish. For example, the area information is included in meta information and transmitted by the application APx together with the content information. Therefore, the second acquisition unit 132 can also acquire area information by acquiring content information input by the application APx.

[0099] (Regarding the specific unit 133) The identification unit 133 identifies a destination vehicle to which the content information is to be distributed, based on driving information related to the driving status of the vehicle. The destination vehicle to which the content information is to be distributed indicates the destination terminal device 10 to which the content information is to be distributed. The driving information here may be the driving information acquired by the first acquisition unit 131.

[0100] In addition, the identification unit 133 may identify a destination vehicle from among the vehicles traveling on the road to be processed based on the driving information of each vehicle traveling on the road to be processed, or may identify a destination vehicle based on statistical information (statistical driving conditions) obtained from the driving information corresponding to each vehicle that has traveled on the road to be processed in the past.

[0101] For example, the identification unit 133 extracts a vehicle traveling toward a destination point (e.g., a facility that is an advertising target according to the content information) based on the travel information, and identifies the extracted vehicle as a delivery destination vehicle. In this regard, for example, the identification unit 133 can identify a vehicle that is predicted to reach a geographical range indicated by the area information in the future based on the travel information, and extract the identified vehicle as a vehicle traveling toward the destination point.

[0102] Furthermore, for example, the identification unit 133 may extract vehicles traveling in a lane on the side where a target point corresponding to the content information is located, based on the driving information, and identify the extracted vehicles as vehicles to which the content information is to be distributed.

[0103] (Regarding the prediction unit 134) The prediction unit 134 predicts the travel status of the vehicle in a geographical range based on the travel information. For example, the prediction unit 134 updates the prediction result by repeating the prediction of the travel status of the vehicle in the geographical range, which is the travel status at a predetermined timing in the future, over time.

[0104] The travel information may include direction information indicating the vehicle's traveling direction, and the prediction unit 134 updates the predicted traveling direction result by repeating prediction of the vehicle's traveling direction at a predetermined timing based on the direction information over time.

[0105] In addition, the driving information may include lane information indicating the lane in which the vehicle is traveling, and the prediction unit 134 updates the prediction result of the driving lane by repeating prediction of the vehicle's driving lane at a predetermined timing based on the lane information over time.

[0106] Furthermore, the travel information may include speed information regarding the speed of the vehicle, and the prediction unit 134 updates the predicted position result by repeating the vehicle position prediction at a predetermined timing based on the speed information over time.

[0107] Furthermore, the travel information may include traffic congestion information related to the vehicle, and the prediction unit 134 updates the predicted position result by repeating the vehicle position prediction at a predetermined timing based on the traffic congestion information over time.

[0108] The travel information may include speed information related to the speed of the vehicle in a geographical range, and the prediction unit 134 predicts the travel speed of the vehicle at a predetermined timing as a travel status based on the speed information. For example, the prediction unit 134 may predict the travel speed of the vehicle at a predetermined timing based on traffic congestion information.

[0109] (Regarding the detection unit 135) The detection unit 135 detects an overlap between the geographical ranges indicated by each piece of area information acquired by the second acquisition unit. For example, the detection unit 135 detects the extent of the overlap between which areas by comparing the geographical ranges indicated by each piece of area information.

[0110] (Regarding the calculation unit 136) The calculation unit 136 calculates the priority of reproduction output for each of the plurality of content information based on the prediction result by the prediction unit .

[0111] For example, the calculation unit 136 calculates the priority of reproduction output for each of the multiple pieces of content information based on the latest prediction result among the prediction results obtained over time.

[0112] For example, in a situation where prediction of the traveling direction is repeated over time and the prediction result is updated, the calculation unit 136 calculates the priority of playback output for each of the plurality of content information based on the latest traveling direction. Also, for example, in a situation where prediction of the driving lane is repeated over time and the prediction result is updated, the calculation unit 136 calculates the priority of playback output for each of the plurality of content information based on the latest driving lane.

[0113] Also, for example, in a situation where prediction of a driving position is repeated over time and the prediction result is updated, the calculation unit 136 calculates a priority of reproduction output for each of the plurality of content information based on the latest driving position. Also, for example, in a situation where prediction of a driving speed is repeated over time and the prediction result is updated, the calculation unit 136 calculates a priority of reproduction output for each of the plurality of content information based on the latest driving speed.

[0114] The calculation unit 136 can calculate a higher priority for content information that is more highly related to the prediction result by the prediction unit 134 among the multiple content information. For example, it is assumed that the prediction unit 134 predicts that the vehicle will turn right at a predetermined timing. In this case, the calculation unit 136 can calculate a higher priority for content information that advertises a store located at the destination of the right turn.

[0115] (Regarding the decision unit 137) The determination unit 137 determines the output order when a plurality of pieces of content information are reproduced and outputted to the vehicle.

[0116] In one aspect, the determination unit 137 determines an output order when the plurality of pieces of content information are reproduced and output to the vehicle based on the reproduction time of each piece of content information and the area information. For example, the determination unit 137 determines an output order in which the plurality of pieces of content information can be reproduced and output in order without interfering with each other when the predetermined timing is reached based on the driving conditions of the vehicle in a geographical range, which is a driving condition at a predetermined timing in the future.

[0117] For example, when the detection unit 135 detects an overlap of areas, the determination unit 137 determines an output order in which the multiple content information can be played back in sequence without interfering with each other at a specified timing based on the relationship of the detected overlap and the playback time of each piece of content information corresponding to the geographical range including the overlap.

[0118] For example, when the detection unit 135 detects an overlap of areas, the determination unit 137 further uses travel information related to the travel status of the vehicle present in the geographic range including the detected overlap to determine the output order. For example, when the detection unit 135 detects an overlap of areas, the determination unit 137 calculates the distance traveled by the vehicle according to the playback time of the content information based on the travel speed of the vehicle in the geographic range including the detected overlap, which is the travel speed at a predetermined timing predicted from the speed information, and the playback time of each piece of content information corresponding to the geographic range, and determines the output order based on the relationship between the calculated distance and the overlap. Also, for example, when the detection unit 135 detects an overlap of areas, the determination unit 137 calculates the distance traveled by the vehicle according to the playback time of the content information based on the travel speed of the vehicle in the geographic range including the detected overlap, which is the travel speed at a predetermined timing predicted from the traffic congestion information, and the playback time of each piece of content information corresponding to the geographic range, and determines the output order based on the relationship between the calculated distance and the overlap.

[0119] More specifically, the determination unit 137 extracts combinations from the plurality of pieces of content information that can be played back and output in order without interfering with each other at a predetermined timing based on the distance and the relationship, and determines the output order of the extracted combinations. For example, the determination unit 137 further uses priorities calculated from meta information assigned to each of the plurality of pieces of content information to extract combinations from the plurality of pieces of content information, and determines the output order of the extracted combinations according to the priorities.

[0120] In another aspect, the determination unit 137 determines an output order when the plurality of pieces of content information are reproduced and output to the vehicle based on the driving information and the area information. For example, the determination unit 137 uses a prediction result obtained by the prediction unit 134 based on the driving information to determine an output order in which the plurality of pieces of content information can be reproduced and output in order without interfering with each other when a predetermined timing is reached. For example, the determination unit 137 uses a driving speed predicted by the prediction unit 134 based on speed information and traffic congestion information to determine an output order in which the plurality of pieces of content information can be reproduced and output in order without interfering with each other when a predetermined timing is reached.

[0121] Then, when the detection unit 135 detects an overlap of areas, the determination unit 137 determines the output order based on the relationship of the detected overlap and the travel speed predicted by the prediction unit. For example, when the detection unit 135 detects an overlap of areas, the determination unit 137 determines the output order based on the vehicle travel speed in a geographical range including the detected overlap, among the travel speeds predicted by the prediction unit 134, and the relationship of the overlap.

[0122] More specifically, when the detection unit 135 detects an overlap of areas, the determination unit 137 calculates the distance the vehicle will travel in accordance with the playback time of the content information based on the driving speed in the geographical range including the overlap and the playback time of each piece of content information corresponding to the geographical range, and determines the output order based on the relationship between the calculated distance and the overlap.

[0123] As an example, the determination unit 137 extracts combinations from the plurality of content information that can be played back and output in order without interfering with each other at a predetermined timing based on the distance and the relationship, and determines the output order of the extracted combinations. For example, the determination unit 137 further uses priorities calculated from meta information assigned to each of the plurality of content information to extract combinations from the plurality of content information, and determines the output order of the extracted combinations according to the priorities.

[0124] In still another aspect, the determination unit 137 determines an output order when the plurality of pieces of content information are reproduced and output to the vehicle, according to the priority calculated by the calculation unit 136. For example, the determination unit 137 determines an output order in which the plurality of pieces of content information can be reproduced and output in order without interfering with each other at a predetermined timing, according to the priority.

[0125] (Regarding output control unit 138) The output control unit 138 performs output control so that the content information to be output is reproduced and output in the vehicle according to the priority and output order determined by the determination unit 137. For example, the output control unit 138 performs output control on the terminal device 10 so that the content information to be output is reproduced and output in the output order according to the priority determined by the determination unit 137. For example, the output control unit 138 distributes the content information to be output to a destination vehicle (specifically, the terminal device 10 provided in the destination vehicle, or the terminal device 10 owned by the user of the destination vehicle).

[0126] (About the information control unit 139) When a combination is extracted in which a plurality of pieces of content information can be played back in sequence without interfering with each other, and there is content information excluded from the combination, the information control unit 139 estimates whether or not a margin area of ​​grace will remain in the geographical range corresponding to the excluded content information even when the playback output of the content information included in the combination is completed, and if it is estimated that a margin area will remain, the information control unit 139 acquires content information whose playback time is controlled according to the margin area as additional content information to be played back in the margin area.

[0127] 5-1-2. Specific Example of Information Processing According to the First Embodiment From here, a specific example of information processing (decision processing) according to the first embodiment will be shown with reference to Figs. 6 and 7. Fig. 6 is a diagram showing an example of information processing according to the first embodiment. Fig. 7 is a diagram showing another example of information processing according to the first embodiment. Fig. 6 describes information processing (pattern 1) according to the first embodiment. Fig. 7 describes information processing (patterns 2 and 3) according to the first embodiment.

[0128] 6 and 7 show a determination process for determining the output order of the content information C111, C121, C211, and C221 when the content information C111, C121, C211, and C221 is reproduced and output to a vehicle VE1 (from the MAP in FIG. 6) traveling on a road RD1 toward a target point G1.

[0129] Also, according to the examples of Figures 6 and 7, vehicle VE1 is traveling on road RD1 at a speed of 60 km / h, and since a geographical range has been set for road RD1, content information C111, C121, C211, and C221 are candidate content information for output.

[0130] 6 and 7, the content information C111 has a playback time of 15 seconds, and a geographical range #111 on road RD1 is added as meta information. In other words, the geographical range #111 in which the content information C111 should be played back exists on road RD1. The content information C121 has a playback time of 15 seconds, and a geographical range #121 on road RD1 is added as meta information. In other words, the geographical range #121 in which the content information C121 should be played back exists on road RD1.

[0131] Furthermore, the content information C211 has a playback time of 30 seconds, and is provided with a geographical area #211 on road RD1 as meta information. In other words, the geographical area #211 in which the content information C211 should be played back exists on road RD1. Furthermore, the content information C221 has a playback time of 30 seconds, and is provided with a geographical area #221 on road RD1 as meta information. In other words, the geographical area #221 in which the content information C221 should be played back exists on road RD1.

[0132] Here, pattern 1 shows an example in which the output order is determined so that the content information C111, C121, C211, and C221 can be played back in sequence without interfering with each other, without taking into consideration the priority between the content information C111, C121, C211, and C221, based on the distance traveled by the vehicle VE1 according to the playback time of each piece of content information and the relationship between the overlapping areas between each geographical range.

[0133] Since the playback time of the content information C111 is "15 seconds", the distance traveled by the vehicle VE1 traveling at "60 km / h" during this time is "250 m". Also, since the playback time of the content information C121 is "15 seconds", the distance traveled by the vehicle VE1 traveling at "60 km / h" during this time is "250 m".

[0134] In addition, since the playback time of the content information C211 is "30 seconds", the distance traveled by the vehicle VE1 traveling at "60 km / h" during this time is "500 m". In addition, since the playback time of the content information C221 is "30 seconds", the distance traveled by the vehicle VE1 traveling at "60 km / h" during this time is "500 m".

[0135] 6, the detection unit 135 detects overlapping areas by comparing the geographical ranges #111, #121, #211, and #221. As a result, the detection unit 135 detects four overlapping areas, namely, the geographical ranges #121-#221, #121-#211-#221, #211-#221, and #111-#211, as shown by the dotted lines in FIG.

[0136] In this state, the determination unit 137 determines an output order in which the content information can be played and output in sequence without interfering with each other, based on the distance and overlap relationships, on the premise that, depending on the driving conditions of the vehicle VE1, content information C111 is played and output within geographical range #111, content information C121 is played and output within geographical range #121, content information C211 is played and output within geographical range #211, and content information C221 is played and output within geographical range #221.

[0137] As a result, according to the example of pattern 1 in FIG. 6, the determination unit 137 can determine the output order as follows: content information C221 (No. 1) → C121 (No. 2) → C111 (No. 3) → C211 (No. 4).

[0138] Furthermore, the determination unit 137 can determine, for each of the content information C111, C121, C211, and C221, in what geographical range the content is actually reproduced and output.

[0139] Specifically, the determination unit 137 determines the range position within the geographical range #111 in which the content information C111 is to be actually played back. According to the example of pattern 1 in Fig. 6, the determination unit 137 can determine the range position #11-1, which does not overlap with the range positions of other content information, as the range position in which the content information C111 is to be actually played back. The distance width indicating the range position #11-1 may correspond to the distance "250 m" traveled by the vehicle VE1 at "60 km / h" in response to the playback time "15 seconds".

[0140] Furthermore, the determination unit 137 determines the range position within the geographical range #121 in which the content information C121 is to be actually played and output. According to the example of pattern 1 in Fig. 6, the determination unit 137 can determine the range position #12-1, which does not overlap with the range positions of other content information, as the range position in which the content information C121 is to be actually played and output. Furthermore, the distance width indicating the range position #12-1 may correspond to the distance "250 m" traveled by the vehicle VE1 at "60 km / h" in response to the playback time "15 seconds".

[0141] Furthermore, the determination unit 137 determines the range position within the geographical range #211 in which the content information C211 is to be actually played and output. According to the example of pattern 1 in Fig. 6, the determination unit 137 can determine the range position #21-1, which does not overlap with the range positions of other content information, as the range position in which the content information C211 is to be actually played and output. Furthermore, the distance width indicating the range position #21-1 may correspond to the distance "500 m" traveled by the vehicle VE1 at "60 km / h" in response to the playback time of "30 seconds".

[0142] Furthermore, the determination unit 137 determines the range position within the geographical range #221 in which the content information C221 is to be actually played and output. According to the example of pattern 1 in Fig. 6, the determination unit 137 can determine the range position #22-1, which does not overlap with the range positions of other content information, as the range position in which the content information C221 is to be actually played and output. Furthermore, the distance width indicating the range position #22-1 may correspond to the distance "500 m" traveled by the vehicle VE1 at "60 km / h" in response to the playback time of "30 seconds".

[0143] Next, pattern 2 will be described with reference to Fig. 7. In pattern 2, an example is shown in which the output order is determined so that the content information C111, C121, C211, and C221 can be reproduced and output in order without interfering with each other, taking into consideration the priority among the content information C111, C121, C211, and C221, based on the distance traveled by the vehicle VE1 according to the reproduction time of each piece of content information and the relationship of area overlap between each geographical range. Note that, except for taking into consideration the priority, the condition setting is the same as that of pattern 1, so a duplicated description will be omitted.

[0144] For example, the prediction unit 134 predicts the driving status of the vehicle VE1 at a predetermined timing in the future within a geographical range consisting of geographical ranges #111, #121, #211, and #221, based on driving information indicating the current driving status (which may be statistical driving information obtained from the history of the driving status).The calculation unit 136 calculates the priority of playback output for each piece of content information based on the prediction result.

[0145] 7, the calculation unit 136 at least calculates a higher priority for the content information C121 than for the content information C221. As in the case of the pattern 1, the determination unit 137 determines an output order in which the content information can be played back and output in order without interfering with each other, based on the distance and overlapping relationship, on the premise that the content information C111 is played and output within the geographical range #111, the content information C121 is played and output within the geographical range #121, the content information C211 is played and output within the geographical range #211, and the content information C221 is played and output within the geographical range #221, in accordance with the travel of the vehicle VE1.

[0146] However, in this case, unlike the example of pattern 1, the determination unit 137 determines the overall output order such that the content information C121 is output earlier than the content information C221, as shown in Fig. 7. For example, the determination unit 137 can determine the output order as follows: content information C121 (No. 1) → C221 (No. 2) → C111 (No. 3) → C211 (No. 4).

[0147] Next, pattern 3 will be described with reference to Fig. 7. In pattern 3 as well, an example is shown in which the output order is determined taking into consideration the priorities among the content information C111, C121, C211, and C221, but the priorities are different from those in the example of pattern 2.

[0148] 7, the calculation unit 136 at least calculates a higher priority for the content information C211 than for the content information C111. As in the case of the pattern 1, the determination unit 137 determines an output order in which the content information can be played back and output in order without interfering with each other, based on the distance and overlapping relationship, on the premise that the content information C111 is played and output within the geographical range #111, the content information C121 is played and output within the geographical range #121, the content information C211 is played and output within the geographical range #211, and the content information C221 is played and output within the geographical range #221, in accordance with the travel of the vehicle VE1.

[0149] However, at this time, unlike the example of pattern 1, the determination unit 137 determines the overall output order such that the content information C211 is output earlier than C111, as shown in Fig. 7. For example, the determination unit 137 can determine the output order as follows: content information C221 (No. 1) → C121 (No. 2) → C211 (No. 3) → C111 (No. 4).

[0150] 5-1-3. Modification of Information Processing According to the First Embodiment Next, the process performed by the information control unit 139 will be described with reference to Fig. 8 as a modified example of the content described in Fig. 6. Fig. 8 is a diagram showing a modification corresponding to the information processing according to the first embodiment. In the example of Fig. 8, for convenience of explaining the process performed by the information control unit 139, the geographical range #211 corresponding to the content information C211 is narrower than that in Fig. 6.

[0151] For example, the determination unit 137 extracts a combination that allows the content information to be played back and output in order without interfering with each other, based on the relationship of overlapping areas between geographical ranges and the distance traveled by the vehicle VE1 according to the playback time of each piece of content information.Then, the determination unit 137 determines, from among the extracted combinations, a combination in an order according to the priority calculated by the calculation unit 136 as the content information to be output, and determines the order of the combination as the output order. According to such a determination process, some content information may be excluded from the combination, i.e., not extracted as the content information to be output.

[0152] 8 shows an example in which the content information C211 is excluded from among the content information C111, C121, C211, and C221. In this example, the content information C221, C121, and C111 are reproduced and output in this order, but it is estimated that a marginal margin area MAR will remain in the geographical range #211 corresponding to the excluded content information C211 at the time when the reproduction and output of the content information C111, which is the last in the output order, is completed. When it is estimated that the marginal area MAR will remain, the information control unit 139 acquires content information controlled to a reproduction time according to the marginal area MAR as additional content information to be reproduced and output in the marginal area MAR.

[0153] For example, if a short version of the excluded content information C211, which has the same content but a shorter playback time, is registered in advance in the storage unit, the information control unit 139 can acquire the short version of the content information C211 as additional content information to be played back and output in the margin area MAR. In this case, the output control unit 138 can play back and output the short version of the content information C211 when the playback and output of the content information C111 ends and the vehicle VE1 enters the margin area MAR.

[0154] When it is estimated that the blank area MAR will remain, the information control unit 139 may dynamically generate a short version that is similar to the excluded content information C211 but has a shorter playback time. When it is estimated that the blank area MAR will remain, the information control unit 139 may control the playback time of the content information C111, C121, C211, and C221 to be shorter than the current playback time so that all of the content information C111, C121, C211, and C221 are played and output. For example, the information control unit 139 may shorten the playback time for all of the content information C111, C121, C211, and C221, or may shorten the playback time for at least one of the content information C111, C121, C211, and C221.

[0155] 5-1-4. Information Processing Procedure According to the First Embodiment Next, the procedure of information processing according to the first embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an overall image of the procedure of information processing according to the first embodiment.

[0156] First, the second acquisition unit 132 recognizes which road is the target road from among a number of candidate roads (step S101). Using the example of Fig. 6, it is assumed that the second acquisition unit 132 recognizes road RD1 as the target road.

[0157] Next, the second acquisition unit 132 acquires area information in which a geographical range is set on the road RD1 recognized in step S101 from among the area information input by each application (step S102). Similarly, using the example of Fig. 6, the second acquisition unit 132 acquires area information corresponding to the geographical range #111 set as meta information by the application AP11, area information corresponding to the geographical range #121 set as meta information by the application AP12, area information corresponding to the geographical range #211 set as meta information by the application AP21, and area information corresponding to the geographical range #221 set as meta information by the application AP22 as area information in which a geographical range is set on the road RD1.

[0158] In addition, the second acquisition unit 132 acquires content information associated with each area information acquired in step S102 as content information of output candidates (step S103). According to the above example, the second acquisition unit 132 acquires the content information C111, C121, C211, and C221 as content information of output candidates.

[0159] The first acquisition unit 131 also acquires driving information related to the driving conditions of the vehicle (step S104). For example, the first acquisition unit 131 acquires driving information indicating the recognized driving conditions in response to the driving conditions being recognized at any time by the situation recognition engine E30-1 (E30-2). For example, the first acquisition unit 131 may acquire driving information indicating the driving conditions of a vehicle traveling on road RD1, a vehicle traveling near road RD1, or a vehicle predicted to enter road RD1 in the future.

[0160] Next, the identification unit 133 identifies a vehicle to which the content information is to be distributed based on the travel information acquired in step S104 (step S105). For example, the identification unit 133 can extract a vehicle traveling in a lane on the side where a target point corresponding to each of the content information C111, C121, C211, and C221 exists based on the travel information, and identify the extracted vehicle as a vehicle to which the content information is to be distributed. In addition, the identification unit 133 can extract a vehicle traveling in a lane on the side where a target point corresponding to each of the content information C111, C121, C211, and C221 exists based on the travel information, and identify the extracted vehicle as a vehicle to which the content information is to be distributed. In the example of FIG. 6, the identification unit 133 identifies the vehicle VE1 as a vehicle to which the content information is to be distributed based on the target point G1. Of course, the identification unit 133 may identify multiple vehicles to which the content information is to be distributed, but for the sake of simplicity, it is assumed here that the identification unit 133 identifies one vehicle VE1.

[0161] In this state, the prediction unit 134 determines whether or not the vehicle VE1 has approached the geographical range indicated by the area information acquired in step S102 (step S106). For example, the prediction unit 134 determines whether or not the vehicle VE1 has approached the geographical range consisting of geographical ranges #111, #121, #211, and #221. While the prediction unit 134 determines that the vehicle VE1 has not approached the geographical range (step S106; No), the prediction unit 134 waits until it can determine that the vehicle VE1 has approached the geographical range.

[0162] On the other hand, when the prediction unit 134 determines that the vehicle VE1 has approached the geographical range (step S106; Yes), it sets the future timing at which the driving status of the vehicle VE1 is predicted (step S107). In other words, the prediction unit 134 decides at what future timing the driving status of the vehicle VE1 is predicted. As an example, the prediction unit 134 may set a timing after a predetermined time has elapsed from the present time (for example, a time 30 seconds from now) as the future timing, and in this case, a prediction process is performed to predict the driving status of the vehicle VE1 at this timing. Hereinafter, the timing set in step S107 is referred to as the "set timing".

[0163] Next, the prediction unit 134 predicts the traveling state of the vehicle VE1 at the set timing based on the current traveling information by a loop described later (step S108).

[0164] Here, the prediction unit 134 repeats a prediction process of predicting the driving situation at the set timing according to the passage of time by a loop described later. Therefore, when the prediction unit 134 has already predicted the driving situation at the set timing from the driving information at the time before the current time, the prediction unit 134 updates the prediction result up to that point to the prediction result at the current time (the prediction result based on the prediction at step S108) (step S109).

[0165] Next, the detection unit 135 detects overlaps between the geographical ranges indicated by each piece of area information (step S110). Specifically, the detection unit 135 detects the extent of overlap between which areas in the geographical ranges #111, #121, #211, and #221 by comparing the geographical ranges #111, #121, #211, and #221, respectively.

[0166] From here, a process flow in the case where area overlap is detected among the geographical ranges #111, #121, #211, and #221 (step S110; Yes) will be described.

[0167] The calculation unit 136 calculates the priority of reproduction output for each of the output candidate content information (content information C111, C121, C211, C221) based on the current prediction result (latest prediction result) predicted in step S108 (step S111).

[0168] For example, the calculation unit 136 may calculate a higher priority for content information that advertises a facility (e.g., a store) in a direction closer to the traveling direction of the vehicle VE1 at the set time. Also, for example, the calculation unit 136 may calculate a higher priority for content information that advertises a facility that exists on the driving lane side of the vehicle VE1 at the set time. Also, for example, the calculation unit 136 may calculate a higher priority for content information that advertises a facility closer to the position of the vehicle VE1 at the set time. Thus, the calculation unit 136 can calculate a higher priority for content information that is more related to the prediction result by the prediction unit 134 among the content information C111, C121, C211, and C221.

[0169] Next, the determination unit 137 determines the output order of the combination of the content information (content information C111, C121, C211, C221) of the output candidates according to the priority calculated in step S111, and in what order the content information is to be reproduced and output in the vehicle (step S112). For example, the determination unit 137 extracts a combination that can reproduce and output each piece of content information in order without interfering with each other, based on the relationship between the overlapping areas detected in step S111 and the distance traveled by the vehicle VE1 according to the reproduction time of each piece of content information. Then, the determination unit 137 determines the combination according to the order according to the priority calculated by the calculation unit 136 from the extracted combinations as the content information to be output, and determines the order of the combination as the output order.

[0170] Furthermore, in step S112, the determination unit 137 may also determine, for each piece of content information to be output, a range position within a geographical range corresponding to the content information, in which the content information is actually reproduced and output.

[0171] Next, the output control unit 138 controls the output so that the content information included in the combination (content information to be output) is reproduced and output in the output order in step S112 when the set timing is reached (step S113). For example, the output control unit 138 controls the output of the terminal device 10 so that the content information to be output is reproduced and output in the output order according to the priority determined by the determination unit 137 and at the range position.

[0172] Here, the prediction unit 134 judges whether the set timing set in step S107 has passed (step S114). If the prediction unit 134 judges that the set timing has passed (step S114; Yes), the prediction unit 134 returns to step S107 and sets a new next timing, thereby repeating the processes from step S107 onwards.

[0173] On the other hand, when the prediction unit 134 determines that the set timing has not passed (step S114; No), the prediction unit 134 determines whether or not a predetermined time has passed since the prediction was made in step S108 (step S115). For example, the prediction unit 134 determines whether or not five seconds have passed since the prediction was made in step S108.

[0174] While the prediction unit 134 determines that the predetermined time has not elapsed since the prediction was made in step S108 (step S115; No), it waits until it can determine that the predetermined time has elapsed. On the other hand, when the prediction unit 134 determines that the predetermined time has elapsed (step S115; Yes), it returns to step S108.

[0175] Next, a process flow in the case where no area overlap is detected among the geographical ranges #111, #121, #211, and #221 (step S110; No) will be described.

[0176] In this example, the determination unit 137 determines, for each piece of output candidate content information (content information C111, C121, C211, C221), the range position within the geographical range corresponding to the content information in question, in which range the content information will actually be played back (step S116).

[0177] When the set timing arrives, the output control unit 138 controls the terminal device 10 to play back and output the content information of each output candidate at the range position in step S116 (step S117).

[0178] [5-1-5. Decision Processing Procedure] Next, the procedure of the decision process performed in step S112 in Fig. 9 will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the procedure of the decision process included in the information processing procedure according to the first embodiment.

[0179] For example, the determination unit 137 acquires content information corresponding to the geographical range including the overlap detected in step S110 from among the content information of the output candidates (content information C111, C121, C211, C221) (step S201).

[0180] In addition, the determination unit 137 acquires the traveling speed at the set timing, which is the traveling speed of the vehicle VE1 in the geographical range including the overlap detected in step S110, from among the traveling speeds (an example of a traveling condition) predicted by the prediction unit 134 (step S202).

[0181] Then, for each piece of content information of the output candidates, the determining unit 137 calculates the distance the vehicle will travel according to the playback time based on the playback time of the content information and the traveling speed acquired in step S202 (step S203).

[0182] Next, the determination unit 137 extracts a combination that allows the content information of the output candidates to be played back in order without interfering with each other, based on the relationship and distance of the overlap detected in step S110 (step S204).

[0183] Then, the determination unit 137 determines the combination, of the extracted combinations, whose order corresponds to the priority as the content information to be output, and determines the order of the combination as the output order (Step S205).

[0184] In addition, for each content to be output that is included in the combination extracted in step S204, the determination unit 137 determines a range position within the geographical range corresponding to the content information in which the content information is to be actually played back (step S206).

[0185] [5-1-6. Summary] The information processing device 100 according to the first embodiment acquires area information corresponding to each of a plurality of pieces of content information, which indicates a geographical range in which the content information is to be reproduced and output. Then, the information processing device 100 determines an output order when the plurality of pieces of content information is to be reproduced and output to the vehicle, based on the reproduction time of each piece of content information and the area information. According to such an information processing device 100, each piece of content information associated with a geographical range in which the content information is to be reproduced and output can be reproduced and output from the vehicle in order without interfering with each other within the geographical range.

[0186] Moreover, the information processing device 100 according to the first embodiment acquires driving information related to the driving conditions of the vehicle, and also acquires area information corresponding to each of the plurality of pieces of content information, which indicates a geographical range in which the content information is to be reproduced and output. Then, the information processing device 100 determines an output order when the plurality of pieces of content information are to be reproduced and output by the vehicle, based on the driving information and the area information. According to such an information processing device 100, each piece of content information associated with a geographical range in which the content information is to be reproduced and output can be reproduced and output from the vehicle in order without interfering with each other within the geographical range.

[0187] Moreover, the information processing device 100 according to the first embodiment acquires driving information related to the driving conditions of the vehicle, and also acquires area information corresponding to each of the plurality of pieces of content information, which indicates a geographical range in which the content information should be reproduced and output. Then, the information processing device 100 predicts the driving conditions of the vehicle in the geographical range based on the driving information, and calculates the priority of reproduction and output for each of the plurality of pieces of content information based on the prediction result. Then, the information processing device 100 determines the output order when the plurality of pieces of content information are reproduced and output by the vehicle according to the calculated priority. According to such an information processing device 100, it is possible to optimize the reproduction and output of the content information according to changes in the driving conditions by predicting the driving conditions of the vehicle.

[0188] 5-2. Second embodiment Up to this point, the first embodiment has been described. From here on, information processing according to the second embodiment will be described. Specifically, information processing performed by the information processing device 200 according to the second embodiment will be described.

[0189] 5-2-1. Configuration of information processing device First, an information processing device 200 according to the second embodiment will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of the configuration of the information processing device 200 according to the second embodiment. As shown in Fig. 11, the information processing device 200 has a communication unit 110, a storage unit 220, an application APx, and a control unit 230. Descriptions of processing units having the same reference numerals as those of the information processing device 100 according to the first embodiment will be omitted.

[0190] (Regarding the storage unit 220) The storage unit 220 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk, an optical disk, etc. The storage unit 220 further has a performance information database 223 in addition to the content database 121 and the driving information database 122.

[0191] (About performance information database 223) The performance information database 223 stores performance information related to the reproduction output of content information. Here, Fig. 12 shows an example of the performance information database 223 according to the second embodiment. In the example of Fig. 12, the performance information database 223 has items such as "category", "app ID", "content ID", "range information", and "performance information". Also, according to the example of Fig. 12, the "performance information" has items such as "output tag", "output date and time", "range position", "output destination vehicle information", "other content output information", and "conversion information".

[0192] "Category" indicates the category to which the content information identified by the corresponding "Content ID" belongs.

[0193] The "application ID" indicates identification information for identifying an application (application capable of providing content information) according to the embodiment. The "content ID" indicates identification information for identifying content information (audio content) generated by the application indicated by the "application ID".

[0194] The "range information" corresponds to condition information that conditions the range within which the content information should be played and output (the allowable range within which the content information should be played and output). For example, one example of the "range information" is area information that indicates the geographical range within which the content information should be played and output. Other examples of the "range information" include the time range within which the content information should be played and output, the vehicle's travel distance range, the vehicle's passing area range, the vehicle's speed range, and the like. The "range information" may be set by the application according to the embodiment.

[0195] The "performance information" indicates various performance information related to the reproduction output of the content information. Specifically, items such as "output tag", "output date and time", "range position", "output destination vehicle information", "other content output information", and "conversion information" are examples of performance information.

[0196] Here, in the first embodiment, it has been described that some content information may be discarded without being played back depending on the priority or the output order. An "output tag" is information indicating whether the content information identified by the corresponding "content ID" has been played back or discarded without being played back. For example, an output tag "○" is associated with the "content ID" of the content information that has been played back. On the other hand, an output tag "×" is associated with the "content ID" of the content information that has been discarded without being played back. The example in FIG. 12 shows an example in which the content information C111 has been played back, while the content information C112 and C211 have not been played back.

[0197] "Output date and time" indicates information related to the date and time when the content information identified by the "content ID" was reproduced and output. In the example of Fig. 12, the content information C111 was reproduced and output at output date and time #111.

[0198] The "range position" is information indicating at what range position the content information identified by the "content ID" was actually played out within the geographical range indicated by the "range information". The example in Fig. 12 shows an example in which the content information C111 was actually played out at range position #111 within the geographical range #111.

[0199] The "destination vehicle information" is information indicating a destination vehicle (terminal device 10) to which the content information identified by the "content ID" is delivered so as to be reproduced and output. In the example of Fig. 12, the content information C111 is delivered to the vehicle #111.

[0200] "Other content output information" indicates information about other content that is preferentially reproduced and output instead of the content information identified by the "content ID" when the content information is discarded without being reproduced and output. In the example of Fig. 12, the information about other content that is preferentially reproduced and output instead of the content information C112 that was not reproduced and output is output information #112.

[0201] The "conversion information" is information indicating how much the content information identified by the "content ID" contributed to the user's conversion to the advertising target. For example, the "conversion information" may be the conversion rate of the content information identified by the "content ID". In the example of FIG. 12, the content information C111 shows an example of the conversion rate indicated by the conversion information #111.

[0202] 12, the performance information database 223 may further store information other than the "conversion information" as long as the information is capable of evaluating the advertising effectiveness. For example, the performance information database 223 may store various types of advertising evaluation values.

[0203] (Regarding the control unit 230) 11, the control unit 230 is realized by a CPU, an MPU, or the like executing various programs (for example, an information processing program according to the embodiment) stored in a storage device inside the information processing device 200 using a RAM as a working area. The control unit 230 is also realized by an integrated circuit such as an ASIC or an FPGA.

[0204] In the second embodiment, the control unit 230 further includes a result acquisition unit 231, a generation unit 232, an output unit 233, a selection unit 234, and a proposal unit 235.

[0205] (Regarding the performance acquisition unit 231) The result acquisition unit 231 acquires result information related to the reproduction output of content information. As described above, content information is associated with range information indicating the range to be reproduced. Therefore, the result acquisition unit 231 acquires, as the result information, result information related to the reproduction output within the range indicated by the range information.

[0206] The result acquisition unit 231 can also acquire result information indicating an output result, which is a result of content information being reproduced and output in a vehicle. Note that the output result referred to here may be, for example, the "output tag," "output date and time," "range position," "output destination vehicle information," and "other content output information" in the result information database 223.

[0207] In addition, the result acquisition unit 231 can acquire result information indicating the advertising result by playing back and outputting the content information in the vehicle. Note that the advertising result here may be, for example, the “conversion information” in the result information database 223.

[0208] (Regarding the generation unit 232) In one aspect, the generation unit 232 generates information to be output to an application based on the performance information acquired by the performance acquisition unit 231. For example, the generation unit 232 generates, as the information to be output, information indicating an output result depending on whether the content information was reproduced and output or was discarded without being reproduced and output, based on the performance information.

[0209] For example, when the performance information indicates that the content information has been played back in a corresponding geographical range, the generation unit 232 generates, as information to be output, information indicating the range position within the geographical range in which the content information has actually been played back.

[0210] On the other hand, when the performance information indicates that the content information was discarded without being played back in the corresponding geographical range, the generating unit 232 identifies, from among the other content information, the content information that was played back in this geographical range with priority over the content information, based on performance information corresponding to other content information different from the content information. Then, the generating unit 232 generates information indicating an output result related to the identified content information as information to be output. Note that, as information indicating this output result, the generating unit 232 may generate, as information to be output, identification information capable of identifying an application that provided the identified other content information, and information indicating a range position within the geographical range where the other content information was actually played back. Furthermore, the generating unit 232 may analyze the reason why the identified other content information was played back in this geographical range with priority, for example, based on range information or meta information, and generate information indicating the analysis result as information to be output.

[0211] Furthermore, for example, the generation unit 232 may calculate an advertising effect (e.g., a conversion rate) due to the output of the content information based on behavioral information on the user of the output destination vehicle to which the content information is reproduced and output, thereby generating output target information including information on the calculated advertising effect. For example, the generation unit 232 may calculate the advertising effect for each piece of content information, thereby generating output target information including comparison information that allows the advertising effect to be compared between applications that provide the content information.

[0212] In another aspect, the generation unit 232 analyzes the performance information acquired by the performance acquisition unit 231, and generates usage information used for output settings of content information by an application.

[0213] For example, the generation unit 232 predicts a distribution probability that the content information will be distributed to the vehicle as an output target based on the output record as an analysis of the performance information, and generates information indicating the predicted distribution probability as the usage information. For example, the generation unit 232 predicts a distribution probability that the content information will be distributed to the vehicle as one of the content information to be output to be reproduced and output in order when the predetermined timing is reached, based on the driving status of the vehicle at a predetermined timing in the future, which is a driving status predicted from the driving information, and the output record indicated by the performance information. The generation unit 232 may generate usage information further including location information indicating a location where the distribution probability is predicted to be achieved, or time information indicating a time where the distribution probability is predicted to be achieved. The generation unit 232 may generate usage information further including information indicating the calculated risk level by calculating the risk level at the predetermined timing based on the driving information.

[0214] Also, for example, the generation unit 232 may analyze the performance information by calculating the appeal of the content information as an advertisement at a specified time in the future based on the advertising performance indicated by the performance information, and generate information indicating the calculated appeal as usage information.

[0215] (Regarding the output unit 233) The output unit 233 outputs (provides) the information to be output, which is generated by the generation unit 232, to an application. For example, the output unit 233 outputs the usage information generated by the generation unit 232 to the application. For example, the output unit 233 outputs information indicating the delivery probability predicted by the generation unit 232 to the application. In addition, the output unit 233 outputs information indicating the advertising appeal calculated by the generation unit 232 to the application.

[0216] (Regarding the performance acquisition unit 231, the generation unit 232, and the output unit 233) The performance acquisition unit 231 acquires performance information classified by category to which the content information belongs as performance information. The generation unit 232 generates usage information used for output setting of the content information by an application by analyzing the performance information classified into the category for each category, and the output unit 233 outputs the usage information generated by the analysis of the performance information classified into the category to the application that has provided the content information belonging to the category.

[0217] (Regarding the selection unit 234) The selection unit 234 selects an application according to a predetermined situation related to the vehicle based on meta information, which is associated with the content information and includes at least one of range information indicating a range to be played back, category information indicating a category to which the content belongs, and time information indicating a playback time. For example, the selection unit 234 selects an application according to a driving situation of the vehicle based on the meta information. Also, for example, the selection unit 234 may select an application according to a situation of a user of the vehicle based on the meta information.

[0218] (About Proposal Section 235) The suggestion unit 235 suggests to the application selected by the selection unit 234 that the content information having the content according to a predetermined situation regarding the vehicle be provided as the content information to be played and output in the vehicle corresponding to the predetermined situation. For example, the suggestion unit 235 suggests to the application selected by the selection unit 234 that the content information having the content according to the driving situation be provided as the content information to be played and output in the vehicle corresponding to the driving situation. Also, for example, the suggestion unit 235 suggests to the application selected by the selection unit 234 that the content information having the content according to the situation of the user of the vehicle be provided as the content information to be played and output in the vehicle corresponding to the user's situation.

[0219] For this reason, the selection unit 234 selects an optimal application according to the vehicle's driving conditions and the vehicle user's conditions. For example, assume that the vehicle VE1, which has been driving on a national highway, enters a narrow side road in a residential area. In the narrow side road, the user U1 of the vehicle VE1 is required to drive more carefully. Therefore, in this case, the selection unit 234 can select, for example, an ADAS-related application AP11. Then, the suggestion unit 235 suggests to the application AP11 that, for example, content information that encourages the user to drive slowly while being careful of people jumping out into the road be provided as content information to be played and output by the vehicle VE1.

[0220] Also, for example, it is assumed that the user U1 of the vehicle VE1 is searching for a place to take a lunch break because the vehicle VE1 is traveling around the city area during the lunch hour. In this case, the selection unit 234 can select the advertisement provision-related application AP22. Then, the suggestion unit 235 suggests to the application AP22 to provide, for example, content information advertising stores in this city area as content information to be played and output by the vehicle VE1.

[0221] Furthermore, the selection unit 234 may select an optimal application based on a rank given to the application, a user's preferences, or a user behavior history. For example, if it is found from the past behavior history that the user U1 often stops by ramen shops while driving the vehicle VE1, the selection unit 234 may select the advertisement provision-related application AP22. Furthermore, if there are multiple advertisement provision-related applications, the selection unit 234 may select, for example, an application with a higher rank.

[0222] 5-2-2. Information Processing Procedure According to the Second Embodiment Next, the procedure of information processing according to the second embodiment will be described with reference to Fig. 13. Fig. 13 is a flowchart showing an overall image of the procedure of information processing according to the second embodiment.

[0223] First, the result acquisition unit 231 determines whether or not it is time to output information to a predetermined first application, which is one of the applications APx according to the embodiment (step S301). While it is determined that it is not time to output information to the first application (step S301; No), the result acquisition unit 231 waits until it can be determined that it is time to output information to the first application.

[0224] On the other hand, when it is determined that it is time to output information to the first application (step S301; Yes), the result acquisition unit 231 acquires result information regarding the reproduction output of the first content information provided by the first application (step S302). For example, the result acquisition unit 231 acquires the result information regarding the reproduction output of the first content information provided by the first application from the result information database 223.

[0225] Next, the generating unit 232 determines whether the first content information has been reproduced and output, or has been discarded without being reproduced and output, based on the performance information acquired in step S302 (step S303).

[0226] From here on, a process flow in the case where the first content information is reproduced and output (step S303; Yes) will be described.

[0227] The generation unit 232 generates, based on the performance information, information indicating a first range position, which is a range position where the first content information was actually played back and output, within a geographical range corresponding to the first content information, as information to be output (step S304).

[0228] Next, a process flow in a case where the first content information is discarded without being reproduced and output (step S303; No) will be described.

[0229] The generating unit 232 identifies content information that has been reproduced and output in preference to the first content information in the geographical range corresponding to the first content information based on the performance information (step S305). Here, it is assumed that the generating unit 232 identifies the second content information as the content information that has been reproduced and output in preference to the first content information.

[0230] Next, the generation unit 232 generates, as information to be output, identification information for identifying a second application that is an application that has provided the second content information, and information indicating a second range position that is a range position where the second content information was actually played and output within the geographical range corresponding to the first content information (step S306).

[0231] Furthermore, the generating unit 232 analyzes the reason why the second content information is preferentially reproduced and outputted over the first content information based on the range information and meta information associated with the second content information (step S307). For example, the generating unit 232 can obtain, as an analysis result, that the second content information has a higher urgency than the first content information, that the second content information has a narrower geographical range than the first content information, and the like, through the analysis.

[0232] Next, the generating unit 232 generates information indicating the analysis result from the analysis in step S307 (the reason why the second content information was reproduced and output preferentially over the first content information) as information to be output (step S308).

[0233] So far, we have explained the flow of the generation process in each of the cases where the first content information is played and output and where the first content information is not played and output. The output unit 233 outputs the information to be output generated by the generation unit 232 so that it is provided to the first application (step S309).

[0234] [5-2-3. Summary] The information processing device 200 according to the second embodiment is an information processing device that reproduces and outputs content information acquired from an application capable of providing content information (application according to the embodiment) to a vehicle. The information processing device 200 acquires performance information regarding the reproduction and output of content information, and generates information to be output to the application based on the acquired performance information. According to the information processing device 200, it is possible to provide the application with useful feedback according to the performance regarding the reproduction and output in the vehicle of the content information provided from the application.

[0235] [6. Hardware Configuration] The information processing device 100 according to the first embodiment and the information processing device 200 according to the second embodiment described above are realized, for example, by a computer 1000 configured as shown in Fig. 14. The information processing device 100 will be described below as an example. Fig. 14 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, a HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0236] The CPU 1100 operates and controls each unit based on a program stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started up, programs that depend on the hardware of the computer 1000, and the like.

[0237] The HDD 1400 stores programs executed by the CPU 1100, data used by such programs, etc. The communication interface 1500 receives data from other devices via a predetermined communication network and sends it to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.

[0238] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.

[0239] The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0240] For example, when the computer 1000 functions as the information processing device 100 according to the first embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control unit 130. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from other devices via a predetermined communication network.

[0241] Furthermore, for example, when the computer 1000 functions as the information processing device 200 in the second embodiment, the CPU 1100 of the computer 1000 executes a program loaded onto the RAM 1200 to realize the functions of the control unit 230.

[0242] [7. Other] Furthermore, among the processes described in each of the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

[0243] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.

[0244] Furthermore, the above-described embodiments can be appropriately combined as long as the processing contents are not contradictory.

[0245] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be embodied in other forms that incorporate various modifications and improvements based on the knowledge of those skilled in the art, including the aspects described in the Disclosure of the Invention section.

[0246] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit", etc. For example, a decision unit can be read as a decision means or a decision circuit. [Explanation of symbols]

[0247] Sy Information Processing System 100 Information processing device 120 Storage section 121 Content Database 122 Driving Information Database 130 Control section 131 First acquisition part 132 Second Acquisition Department 133 Specific part 134 Prediction Department 135 Detection unit 136 Calculation Unit 137 Decision Section 138 Output control section 139 Information Control Department 200 Information processing device 220 Storage section 223 Performance Information Database 230 Control Unit 231 Performance Acquisition Department 232 Generation part 233 Output section 234 Selection Section 235 Proposal Department

Claims

1. a content information acquisition unit that acquires a plurality of pieces of content information from a plurality of applications each capable of providing content information; an output control unit that reproduces and outputs content information extracted from the plurality of pieces of content information acquired by the content information acquisition unit to a mobile object in accordance with a priority determined based on a predetermined condition; a generating unit that generates, as information to be output to the application that has provided the content information, information indicating whether the content information provided by the application has been extracted and played back or whether the content information provided by the application has not been extracted and has been discarded without being played back; 13. An information processing device comprising:

2. a performance information acquisition unit that acquires performance information regarding the reproduction output of the plurality of content information, The content information is associated with range information indicating a range to be reproduced and output, and the performance information acquisition unit acquires the performance information regarding the reproduction and output within the range indicated by the range information; The generating unit generates, based on the performance information, information indicating whether the content information has been reproduced and output within the range or whether the content information has been discarded without being reproduced and output within the range as the information to be output.

2. The information processing apparatus according to claim 1,

3. When the performance information indicates that the content information has been reproduced and output within the range, the generating unit generates, as the information to be output, information indicating a range within the range in which the content information has actually been reproduced and output.

3. The information processing apparatus according to claim 2.

4. When the performance information indicates that the content information has been discarded without being reproduced and output within the range, the generation unit specifies, based on the performance information corresponding to other content information different from the content information, content information that has been reproduced and output in preference to the content information within the range from among the other content information, and generates information indicating an output result related to the specified content information as the information to be output.

4. The information processing apparatus according to claim 2, wherein the information processing apparatus is a computer.

5. The generation unit generates, as the information indicating the output result, identification information capable of identifying an application that provided the specified content information and information indicating a range within the range in which the content information was actually reproduced and output, as the information to be output.

5. The information processing apparatus according to claim 4.

6. The generating unit generates, as the information to be output, information indicating an analysis result of a reason why the specified content information is reproduced and output in priority to the content information.

6. The information processing apparatus according to claim 4, wherein the information processing apparatus is a computer.

7. The generation unit obtains the analysis result by analyzing the range information and meta information associated with the specified content information.

7. The information processing apparatus according to claim 6,

8. a calculation unit that calculates an advertising effect resulting from the output of the content information based on behavioral information regarding a user of a mobile device that is an output destination to which the content information is reproduced and output; The generating unit generates the information to be output, the information including information on the advertising effect calculated by the calculating unit.

8. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

9. The calculation unit calculates the advertising effect for each piece of content information, The generating unit generates the information to be output, the information including comparison information that allows the advertising effectiveness to be compared between applications that provide the content information.

9. The information processing apparatus according to claim 8,

10. An information processing method executed by an information processing device, a content information acquisition step of acquiring a plurality of pieces of content information from a plurality of applications each capable of providing content information; an output control step of playing and outputting content information extracted from the plurality of pieces of content information acquired by the content information acquisition step, on a mobile object, in accordance with a priority determined based on a predetermined condition; a generating step of generating information indicating whether the content information provided by the application was extracted and played back as output information to be output to the application that provided the content information, or whether the content information provided by the application was not extracted and was discarded without being played back; 13. An information processing method comprising:

11. An information processing program executed by an information processing device, a content information acquisition step of acquiring a plurality of pieces of content information from a plurality of applications each capable of providing content information; an output control step of playing and outputting content information extracted from the plurality of pieces of content information acquired by the content information acquisition step, on a mobile object, in accordance with a priority determined based on a predetermined condition; a generating step of generating information indicating whether the content information provided by the application was extracted and played back as output information to be output to the application that provided the content information, or whether the content information provided by the application was not extracted and was discarded without being played back; An information processing program characterized by causing the program to function as follows.

Citation Information

Patent Citations

  • On-vehicle communication device and content list changing method

    JP2009100160A

  • Information providing apparatus, information providing method, and program

    JP2009176334A

  • In-vehicle information terminal

    JP2011165256A

  • Sound reproduction schedule device and method

    JP2013221837A

  • On-vehicle device, method for providing information, and program for providing information

    JP2017181271A