Information processing device, information processing method and information processing program

Abstract

To reproduce and output each content information, in which a geographical range to be reproduced / outputted is associated, from a vehicle in order without interfering with each other within the geographical range.SOLUTION: An information processing device 100 includes: an acquisition unit 132 for acquiring the area information which corresponds to each of a plurality of content information and indicating a geographical range in which the content information is to be reproduced and outputted; and a determination unit 137 which, based on the reproduction time of each of the plurality of content information and the area information, determines an output order when the plurality of content information is reproduced and outputted to a mobile body.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] BACKGROUND ART Conventionally, there is known a technique for outputting information such as warning information, route guidance information, road traffic information, tourist information, and advertisement information as audio information to a driver while the vehicle is traveling.

[0003] However, if the playback and output timing of these pieces of audio information overlaps, it may be difficult to hear or may interfere with driving. Therefore, a system has been proposed that schedules the playback and output timing of these pieces of audio information so that they do not interfere with each other. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-221837 Summary of the Invention [Problem to be solved by the invention]

[0005] However, one example of the problem with the above-mentioned conventional technology is that it may not be possible to play and output each piece of content information, which is associated with a geographical range to be played and output, from the vehicle in sequence without interfering with each other within the geographical range.

[0006] For example, the above-mentioned conventional technology calculates the degree of loss due to non-playback and delayed playback based on meta-information such as the importance of each piece of audio information, the length of the audio being played, and the allowable limit time for the delay in starting playback from the occurrence of an event, and selects the playback order for the combination of audio information with the smallest degree of loss.

[0007] As described above, in the conventional technology, each piece of content information is not associated with a geographical range in which it should be played back, and therefore there is no concept of playing back each piece of content information from a vehicle in sequence within a geographical range without interfering with each other.

[0008] Therefore, with the above-mentioned conventional technology, it is not necessarily possible to play back and output from the vehicle in sequence each piece of content information that is associated with a geographical range to be played back and output without interfering with each other within that geographical range.

[0009] The present invention has been made in consideration of the above, and aims to provide an information processing device, an information processing method, and an information processing program that can sequentially play and output from a vehicle content information, each of which is associated with a geographical range to be played and output, without interfering with each other within the geographical range. [Means for solving the problem]

[0010] The information processing device of claim 1 is characterized by having an acquisition unit that acquires a plurality of area information respectively corresponding to a plurality of content information, each area information indicating a geographical range in which the corresponding content information should be played and output, and a determination unit that determines an output order based on the playback time of each of the plurality of content information and the plurality of area information so that the plurality of content information is output in the corresponding plurality of geographical ranges when a mobile object passes through the plurality of geographical ranges.

[0011] The information processing method of claim 14 is characterized in that it includes an acquisition step in which an acquisition unit acquires a plurality of area information respectively corresponding to a plurality of content information, each area information indicating a geographical range in which the corresponding content information should be played back and output, and a determination step in which, based on the playback time of each of the plurality of content information and the plurality of area information, an output order is determined so that the plurality of content information when a mobile object passes through a plurality of geographical ranges is output in the plurality of corresponding geographical ranges.

[0012] The information processing program of claim 15 is an information processing program executed by an information processing device having a computer, characterized in that the computer is made to function as an acquisition means, which is an acquisition unit that acquires multiple pieces of area information respectively corresponding to multiple pieces of content information, each piece of area information indicating a geographical range in which the corresponding content information should be played and output, and a determination means that determines an output order based on the playback time of each of the multiple pieces of content information and the multiple pieces of area information so that the multiple pieces of content information when a mobile body passes through multiple geographical ranges are output in the multiple corresponding geographical ranges. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 is a diagram illustrating an example of a system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of the information matching process. [Figure 3] FIG. 3 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a content database according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of a travel information database according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of information processing according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating another example of information processing according to the embodiment. [Figure 8] FIG. 8 is a diagram showing modifications corresponding to the information processing according to the embodiment. [Figure 9] FIG. 9 is a flowchart showing an overview of an information processing procedure according to the embodiment. [Figure 10] FIG. 10 is a flowchart showing a decision processing procedure included in the information processing procedure according to the embodiment. [Figure 11]FIG. 11 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, a mode for carrying out the present invention (hereinafter referred to as an embodiment) will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.

[0015] In the following embodiments, a vehicle can be read as a moving body, a driving situation as a moving situation, and a driving speed as a moving speed. The expression "playback output in a vehicle" includes the meaning of "playback output to a terminal device moving with the vehicle." The expression "output control so that a vehicle plays back and outputs content information" includes the meaning of output control to a terminal device and provision (output) of content information to a user of the vehicle.

[0016] 1. Introduction Examples of terminal devices that travel with a vehicle include terminal devices installed in the vehicle (e.g., in-vehicle devices) and terminal devices such as smartphones owned by users (e.g., vehicle passengers, including the driver), and applications that provide various types of content to such terminal devices are known.

[0017] For example, there are applications that assist users in driving by providing content information that is tailored to the vehicle's driving status or the situation of the user driving the vehicle, or content information that provides route guidance according to various inputs (e.g., text input or voice input). There are also applications that assist users in driving more comfortably by providing various content information such as tourist guides, store guides, advertising information, and other useful information in accordance with the vehicle's driving.

[0018] Here, applications may be classified into specific types depending on the categories of content information they can provide. For example, an application related to ADAS (Advanced Driver-Assistance Systems) provides content information categorized as "warnings" or "cautions," and is therefore classified into a type such as "ADAS" or "safety support." On the other hand, an application related to various types of guidance (e.g., route guidance, tourist information, etc.) provides content information categorized as "guidance," and is therefore classified into a type such as "guidance support." Furthermore, an application related to store information (e.g., store advertisements) provides content information categorized as "advertisement," and is therefore classified into a type such as "advertising provision."

[0019] The application also passes content information it wishes to provide to the user to an information matching engine (more specifically, a computer equipped with the information matching engine), which will be described later, and plays back and outputs the content information via the information matching engine. At this time, the application assigns meta information to the content information, including range information indicating the range to be played back and output, category information indicating the category of the content information, and the length (playback time) of the content information.

[0020] The range information indicating the range in which the content information should be played back corresponds to condition information that specifies the geographical range in which the content information should be played back, the time range, the vehicle travel distance range, the vehicle passing area range, the vehicle speed range, etc., and conditions the content information to be played back so long as it is within that range. In the following embodiment, the description focuses on area information (an example of range information) indicating the geographical range in which the content information should be played back, but the information processing according to the embodiment can also be applied to ranges other than the geographical range, i.e., the time range, the vehicle travel distance range, the vehicle passing area range, and the vehicle speed range.

[0021] Furthermore, when each application sets a geographical range in this manner, some or all of the geographical ranges may overlap between the applications. This can result in a problem of interference between playback and output of content information corresponding to the overlapping geographical ranges. Furthermore, since the content information is configured as a voice message, taking into consideration that the intended user is a vehicle passenger, interference in playback and output may hinder driving. For this reason, a computer equipped with an information matching engine determines an appropriate output order and appropriate output timing under the control of the information matching engine. Furthermore, the computer predicts the driving conditions of a vehicle, which change from time to time, and prioritizes the content information to be played and output in order to optimize the content information to be played and output.

[0022] Furthermore, depending on the determined priority and output order, some content information may be discarded without being played back. For this reason, applications may attempt to dynamically control (output setting) the range in which their own content information is played back as efficiently as possible, but a computer equipped with an information matching engine can also support the application in setting the output by providing feedback to the application according to performance information regarding the playback output.

[0023] [2. About the system] Next, a system including the above-described application and a computer equipped with an information matching engine will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of a system according to an embodiment. Fig. 1 shows an information processing system Sy as an example of a system according to an embodiment. Information processing according to an embodiment, which will be described later, is realized by the information processing system Sy.

[0024] (Regarding terminal device 10) The terminal device 10 (edge ​​terminal) is an information processing terminal used by a user (a passenger in a vehicle). The terminal device 10 may be, for example, a stationary in-vehicle device installed in a vehicle, or a portable terminal device (for example, a smartphone, a tablet terminal, a notebook PC, a desktop PC, a PDA, etc.) owned by a user. In this embodiment, the terminal device 10 is assumed to be an in-vehicle device.

[0025] In the example of FIG. 1, the terminal device 10 is provided in a vehicle VE1 driven by a user U1, and reproduces and outputs content information in accordance with output control by a computer equipped with an information matching engine. For example, the terminal device 10 has a notification unit (output unit) and causes the content information to be output from the notification unit. For example, the notification unit may be a speaker or a display screen, and the terminal device 10 reproduces and outputs content information in the form of a voice message (audio content) via the speaker. Furthermore, the notification unit may be a display screen, and the terminal device 10 can display information supporting the details of the audio content on the display screen.

[0026] In addition, various applications such as an ADAS application, a navigation application, a music application, a delivery application, an insurance application, etc. may be installed in the terminal device 10 at the user's discretion, and such applications can transmit user information including, for example, account information and setting information set by the user to the cloud computer CCP2 described below.

[0027] The application introduced into the terminal device 10 may be an application for an edge terminal corresponding to an application that provides content information in the form of a voice message along with range information (hereinafter, sometimes referred to as the "application relating to the embodiment"), or it may be any application different from the application relating to the embodiment.

[0028] (About the ECP1 edge computer) The edge computer ECP1 is a computer that performs data processing (edge ​​processing) near the terminal device 10, and includes a situation assessment engine E30-1 and an information matching engine E100-1. According to the example of Fig. 1, the edge computer ECP1 is provided with an application AP1x (e.g., an application AP11, an application AP12, an application AP13, etc.) as an application according to the embodiment.

[0029] 1, the application AP1x is provided inside the edge computer ECP1, but the application AP1x may be independent from the edge computer ECP1. In such a case, for example, the information processing system Sy may further include a server device (application server) corresponding to the application AP1x, while the edge computer ECP1 may not have the application AP1x inside.

[0030] Furthermore, since the application AP1x is an application that provides content information of which output to the user is of a high urgency, it is incorporated into the edge computer ECP1 located near the terminal device 10. As a result, the content information provided by the application AP1x can be reproduced and output with a shorter time lag in accordance with the driving conditions of the vehicle VE1. For this reason, the application AP1x may be, for example, an application related to ADAS, and provides content information categorized as "warning" or "caution."

[0031] Furthermore, the edge computer ECP1 may further include a general-purpose proxy application as shown in FIG.

[0032] (About Cloud Computer CCP2) The cloud computer CCP2 is a computer that exists on the cloud side and provides various types of information, for example, in a push format, and has a situation assessment engine E30-2 and an information matching engine E100-2 built in. Also, according to the example of Fig. 1, the cloud computer CCP2 is provided with an application AP2x (for example, an application AP21, an application AP22, an application AP23, etc.) as an application according to the embodiment.

[0033] 1, the application AP2x is provided inside the cloud computer CCP2, but the application AP2x may be independent of the cloud computer CCP2. In such a case, for example, the information processing system Sy may further include a server device (application server) corresponding to the application AP2x, while the cloud computer CCP2 may not have the application AP2x inside.

[0034] The application AP2x may be an application that provides content information that does not require immediate output to the user. For this reason, the application AP2x is installed in a cloud computer CCP2 on the cloud side, which is separate from the terminal device 10. For this reason, the application AP2x may be an application related to guidance support or advertisement provision, for example, and provides content information categorized as "guidance" or "advertisement."

[0035] (Specific examples of information processing) Next, specific examples of processes performed by the application, the situation understanding engine, and the information matching engine according to the embodiment will be described. In the following, the content information will be described as audio content. The content information is not limited to audio content, but may also be, for example, video content.

[0036] First, a specific example of processing by an application according to the embodiment will be described. Since the processing content is the same for both applications AP1x and AP2x, the application AP1x will be used as an example for the description.

[0037] The application AP1x personalizes the voice content provided to each user based on the user's usage history. The application AP1x also determines the content of the voice message to respond to based on the content of the voice input by the user, so that the application AP1x can communicate with the user. The application AP1x can also determine the voice content to be provided to the user and the content of the voice message to respond to the user based on the user's situation.

[0038] The application AP1x also performs a generation process to generate audio content. For example, the application AP1x determines the category of audio content to be played back based on data received from the situation recognition engine E30-1 (or the situation recognition engine E30-2 in the case of the application AP2x), and generates audio content of the determined category.

[0039] For example, the application AP1x generates audio content according to the vehicle's traveling situation grasped by the situation grasp engine E30-1. Note that the audio content generated by the generation process may be, for example, text data that will be the basis for a voice message that will ultimately be notified to the user, and may define the content of the voice message that will be obtained by later converting it into voice data. In other words, the application AP1x is not limited to generating voice data as audio content, and may generate data in other formats that will be the basis for a voice message as audio content.

[0040] The application AP1x can also specify the timing for playing back and outputting the audio content. For example, the application AP1x can generate range information indicating the range within which the audio content is permitted to be played back and output, using a geographical range, a time range, a vehicle travel distance range, a vehicle passing area range, a vehicle speed range, or the like within which the audio content is to be played back and output. In this case, the application AP1x transmits the audio content to which meta information including the range information is attached to the information matching engine E100-1 (or the information matching engine E100-2 in the case of the application AP2x), thereby requesting (reserving) the terminal device 10 to play back and output the audio content under the conditions indicated by the range information.

[0041] Next, a specific example of processing by the situation recognition engine will be described. Since the processing content is the same for both the situation recognition engine E30-1 and E30-2, the situation recognition engine E30-1 will be used as an example.

[0042] The situation assessment engine E30-1 performs a situation assessment process, which is an analysis process for assessing the vehicle's driving situation. For example, the situation assessment engine E30-1 senses the vehicle's driving situation based on sensor information obtained from various sensors. Note that the sensors referred to here may be, for example, sensors provided in the vehicle or sensors included in the terminal device 10, such as an acceleration sensor, a gyro sensor, a magnetic sensor, a GPS, a camera, a microphone, etc.

[0043] For example, the situation awareness engine E30-1 can perform the following series of analysis processes. For example, the situation awareness engine E30-1 performs sensing based on sensor information acquired from the above sensors and performs base analysis by using the sensing results as core elements. In the base analysis, the situation awareness engine E30-1 extracts necessary data using the core elements as information sources and converts and processes the extracted data. Next, the situation awareness engine E30-1 performs high-level analysis using the converted and processed data. In the high-level analysis, the situation awareness engine E30-1 analyzes specific driving situations based on the converted and processed data. For example, the situation awareness engine E30-1 analyzes the driving situation of the vehicle, such as whether the vehicle is traveling on a straight road or a curve, the driving speed, the direction of travel, and the traffic congestion situation.

[0044] According to the example of FIG. 1, the situation grasping engine E30-2 may use statistical information obtained by statistical processing of logs relating to the driving situation and user operations for the situation grasping process.

[0045] Next, a specific example of processing by the information matching engine will be described. Since the processing content is the same for both information matching engines E100-1 and E100-2, the information matching engine E100-1 will be used as an example. As shown in Figures 2 and 3, the information matching engine E100-1 has a request manager function and a response manager function.

[0046] The request manager function accepts requests from application AP1x (application AP2x in the case of information matching engine E100-2) and performs queuing according to the accepted request. Note that the request here may be an output request requesting that the generated audio content be played back and output, and is transmitted, for example, including the audio content. The request manager function also queues the accepted audio content in the content buffer.

[0047] The response manager function performs output determination processing in accordance with rules. For example, the response manager function performs output determination processing according to an output determination algorithm. More specifically, the response manager function determines the priority and output order of audio content that has been reserved for output, based on driving information indicating the driving situation grasped by the situation grasp engine E30-1 (or the situation grasp engine E30-2 in the case of the information matching engine E100-2) and range information included in the request. The response manager function then controls the terminal device 10 to play and output the audio content in the output order according to the determined priority.

[0048] [3. Information processing flow] Next, the flow of information processing (information processing according to the embodiment) realized by the information processing system Sy will be described with reference to Fig. 1. Here, a situation is assumed in which audio content is reproduced and output to a user U1 driving a vehicle VE1 via a terminal device 10 corresponding to an in-vehicle device of the vehicle VE1. In this situation, the terminal device 10 transmits sensor information detected by a sensor possessed by the terminal device 10 to the edge computer ECP1 as needed.

[0049] In this state, the flow of information originating from the edge computer ECP1 is shown first. When the situation assessment engine E30-1 of the edge computer ECP1 acquires sensor information transmitted from the terminal device 10, it performs a situation assessment process to assess the traveling state of the vehicle VE1. For example, the situation assessment engine E30-1 performs a series of analysis processes, such as sensing using the sensor information, base analysis using the sensing results as core elements, and higher-level analysis using data obtained as a result of the base analysis, to perform a detailed situation assessment process.

[0050] Then, the situation awareness engine E30-1 transmits driving information indicating the driving situation grasped by the situation awareness processing to a user that uses the driving information. For example, the situation awareness engine E30-1 transmits the driving information to the information matching engine E100-1, the application AP1x, and the situation awareness engine E30-2. Note that the driving situation here may be, for example, the position, driving speed, and traveling direction of the vehicle VE1.

[0051] When the application AP1x acquires driving information from the situation assessment engine E30-1, it performs a generation process to generate audio content based on the acquired driving information. For example, the application AP1x generates audio content according to the driving situation of the vehicle VE1 based on the driving information acquired from the situation assessment engine E30-1. The application AP1x also generates range information indicating the range within which the audio content is permitted to be played back, using the geographical range, time range, driving distance range of the vehicle VE1, passing area range of the vehicle VE1, or vehicle speed range within which the audio content should be played back, and assigns meta information including the generated range information to the audio content. The application AP1x then inputs the audio content with the assigned meta information to the information matching engine E100-1.

[0052] When the situation awareness engine E30-2 acquires the driving information from the situation awareness engine E30-1, the situation awareness engine E30-2 performs a situation awareness process for understanding the driving state of the vehicle VE1 based on the acquired driving information. For example, the driving information acquired from the situation awareness engine E30-1 is accumulated in a predetermined database of the cloud computer CCP2. The database may also accumulate logs related to user operations, and the situation awareness engine E30-2 performs statistical processing on the accumulated driving information and operation logs, thereby performing the situation awareness process for understanding the driving state of the vehicle VE1 using statistical information indicating the results of the statistical processing and external data acquired from outside.

[0053] The external data referred to here is data that can be acquired because it exists in the cloud and is useful for understanding the driving situation. For example, the external data may include weather information indicating the weather conditions, traffic information indicating the traffic conditions, and road information indicating the road conditions. Of course, the external data is not limited to these examples.

[0054] Then, the situation recognition engine E30-2 transmits driving information indicating the driving situation recognized by the situation recognition process to a user that uses the driving information. For example, the situation recognition engine E30-2 transmits the driving information to the information matching engine E100-2 and the application AP2x. Note that the driving situation referred to here may be, for example, the position, driving speed, and traveling direction of the vehicle VE1.

[0055] Furthermore, in response to the situation assessment process being performed between the situation assessment engines E30-1 and E30-2 and the generation process being performed between the applications AP1x and AP2x, the information matching engines E100-2 to E100-1 perform information matching process. For example, the information matching engines E100-2 to E100-1 perform information matching process to match the optimal combination of audio content among the output candidate audio content generated by the generation process so that the audio content is output in the optimal order.

[0056] For example, area information (an example of range information) indicating the geographical range in which the audio content should be played back is associated as meta-information with each audio content generated by the generation process. Therefore, in the information consistency process, a playback output priority is calculated for each of the audio content items based on the driving information indicating the driving situation grasped by the situation grasping process. Furthermore, in the information consistency process, an output order for a combination of audio content items according to priority is determined based on the playback time, area information, and driving information of each of the audio content items. Then, output control is performed so that the audio content items included in this combination are played back in the determined output order so as not to interfere with each other.

[0057] In addition, area information indicating a geographical location or a geographical range where the playback output should be terminated may be associated with the audio content as meta information. In such a case, the information matching process may determine the output start timing for starting the playback output based on the playback time of each of the multiple audio contents and the area information.

[0058] An example of the information matching process and the output control process according to the result of the information matching process will be described below using the example of FIG.

[0059] First, the information matching engine E100-2 performs output determination processing in accordance with area information (rules) that correspond to each audio content input from the application AP2x and indicate the geographical range in which the audio content should be played back. For example, the response manager function of the information matching engine E100-2 performs output determination processing in accordance with an output determination algorithm.

[0060] More specifically, the response manager function determines the priority and output order of the audio contents to be output, taking into consideration the driving information indicating the driving situation grasped by the situation grasp engine E30-2 and the playback time of each audio content. For example, the response manager function determines the output order of a combination of audio contents according to the priority. Note that the response manager function may perform the output determination process by further using user information transmitted from an application inserted in the terminal device 10, as shown in FIG. 1.

[0061] Then, the information matching engine E100-2 outputs the information determined by the response manager function as information according to the output determination result to the edge computer ECP1. The information output to the edge computer ECP1 is input to the information matching engine E100-1 via the general-purpose proxy application of the edge computer ECP1.

[0062] The information matching engine E100-2 performs output determination processing in accordance with area information (rules) corresponding to the audio content input from the application AP1x and the audio content indicated by the combination input from the information matching engine E100-2 as the output determination result. For example, the response manager function of the information matching engine E100-1 performs output determination processing in accordance with an output determination algorithm.

[0063] More specifically, the response manager function determines the final priority and output order of the audio contents that have been scheduled for output, taking into consideration the driving information indicating the driving situation grasped by the situation grasping engine E30-1, the playback time of each audio content, and the information (priority, output order) determined by the information matching engine E100-2. For example, the response manager function determines the output order of a combination of audio contents according to priority.

[0064] Then, the information matching engine E100-2 performs output control on the terminal device 10 so that the audio contents are reproduced and output in the output order according to the determined priority. In accordance with the output control, the terminal device 10 reproduces and outputs the audio contents included in the combination according to the priority in order so as not to interfere with each other.

[0065] 1, the information matching engine E100-2 can also perform LED control on the terminal device 10 to cause the LED to emit light according to a category so that the user can recognize, for example, to which category the audio content currently being played and output belongs. Also, according to the example of Fig. 1, the information matching engine E100-2 can also perform display control on the terminal device 10 to display information supporting the details of the audio content on the display screen.

[0066] [4. Specific examples of information consistency processing] Next, the information matching process performed by the information matching engine will be described in more detail using a specific example. Figure 2 is a diagram showing an example of the information matching process. Figure 2 shows a scene in which the information matching process is performed by the information matching engine E100-1.

[0067] Figure 2 shows an example in which application AP11, an ADAS-related application residing on edge computer ECP1, generates audio content C111 (safety support information C111) with the message content "Watch out for vehicles jumping out into the road," and reserves (requests) playback output by sending an output request to information matching engine E100-1 requesting playback output of the generated audio content C111.

[0068] Figure 2 also shows an example in which application AP21, a guidance support-related application residing on cloud computer CCP2, generates audio content C211 (tourist information C211) with the message content "Turn right ahead," and reserves (requests) playback output by sending an output request to information matching engine E100-1 requesting playback output of the generated audio content C211.

[0069] Figure 2 also shows an example in which application AP22, an advertising provision-related application residing on cloud computer CCP2, generates audio content C221 (store advertisement C221) with the message content "Up ahead, there is a three-star restaurant..." and reserves (requests) playback output by sending an output request to information matching engine E100-1 requesting playback output of the generated audio content C221.

[0070] 2, the request manager function of the information matching engine E100-1 performs queuing in response to output requests received from the applications AP11, AP21, and AP22. For example, the request manager function queues, in the content buffer, audio contents C111, C211, and C221 received together with the output requests.

[0071] Furthermore, the response manager function of the information matching engine E100-1 performs output determination processing in accordance with rules. For example, the response manager function performs output determination processing according to an output determination algorithm. More specifically, the response manager function determines the priority and output order of each audio content to be output and in what order based on the driving information indicating the driving situation grasped by the situation recognition engine E30-1, the area information included in the output request, and the playback time of each audio content scheduled for output. The response manager function then determines the output order for the combination of audio content according to the determined priority. The response manager function also controls the terminal device 10 to play and output the audio content corresponding to the combination in the determined output order.

[0072] 5. Information Processing Device According to the Embodiment 1 shows an example in which information processing according to the embodiment is performed between an edge computer ECP1 and a cloud computer CCP2. Hereinafter, a computer having an information matching engine E100-1 or an information matching engine E100-2 will be described as an information processing device 100 according to the embodiment.

[0073] The information processing device 100 may be a server device corresponding to the edge computer ECP1 or a server device corresponding to the cloud computer CCP2. Furthermore, the information processing device 100 may be a single server device configured by integrating the functions of the edge computer ECP1 and the functions of the cloud computer CCP2.

[0074] For example, the information processing device 100 calculates the priority of playback output for each of the plurality of content information by using area information corresponding to each of the plurality of content information, which indicates a geographical area where the content information should be played back, the playback time of each of the plurality of content information, and further, driving information related to the driving conditions of the vehicle. Then, the information processing device 100 determines the output order when the plurality of content information is played back and output to the vehicle according to the calculated priority.

[0075] The information processing device 100 may also provide feedback to the application based on performance information regarding the reproduction and output of content information.

[0076] 6. Configuration of Information Processing Device First, the information processing device 100 will be described in more detail with reference to Fig. 3. Fig. 3 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Fig. 3, the information processing device 100 includes a communication unit 110, a storage unit 120, an application APx, and a control unit 130.

[0077] (Regarding the communication unit 110) The communication unit 110 is realized by, for example, a NIC etc. The communication unit 110 is connected to a network by wire or wirelessly, and transmits and receives information to and from the terminal device 10, for example.

[0078] (Regarding the storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk, an optical disk, etc. The storage unit 120 has a content database 121 (content buffer) and a driving information database 122.

[0079] (About Content Database 121) The content database 121 stores various types of information related to content information. An example of the content database 121 according to the embodiment is shown in Fig. 4. In the example of Fig. 4, the content database 121 has items such as "application ID," "content ID," "content data," "category," "meta information," and "range information."

[0080] "Application ID" indicates identification information for identifying an application (application capable of providing content information) according to an embodiment. "Content ID" indicates identification information for identifying content information (audio content) generated by the application indicated by the "Application ID."

[0081] "Content data" is content information generated by the application indicated by the "app ID." "Category" indicates the category to which the content information generated by the application indicated by the "app ID" belongs. "Categories" include warnings, cautions, guidance, advertisements, entertainment, etc.

[0082] The "meta information" is attached to the content information and includes range information indicating the range within which the content information should be played back, category information indicating the category of the content information, the length of the content information (playback time), etc.

[0083] The "range information" corresponds to condition information that conditions the range within which the content information should be played back (the allowable range within which the content information should be played back). For example, one example of the "range information" is area information that indicates the geographical range within which the content information should be played back. Other examples of the "range information" include the time range within which the content information should be played back, the vehicle's travel distance range, the vehicle's passing area range, the vehicle's speed range, etc. The "range information" may be set by the application according to the embodiment.

[0084] That is, the example in Figure 4 shows an example in which an application (application AP11) identified by the application ID "AP11" has generated content information (content information C111) identified by the content ID "C111" and consisting of data #111.

[0085] In addition, the example of FIG. 4 shows an example in which content information C111 is classified into the category "warning" based on the content indicated by data #111.

[0086] In addition, in the example of Figure 4, content information C111 is assigned meta information #111, and this meta information #111 includes area information indicating that the geographical range in which content information C111 should be played back is geographical range #111.

[0087] In the example of FIG. 4, conceptual symbols such as "#111" are used for ease of explanation, but in reality, valid information corresponding to each item is entered.

[0088] (About the driving information database 122) The travel information database 122 stores travel information related to the travel status of the vehicle. An example of the travel information database 122 according to the embodiment is shown in Fig. 5. In the example of Fig. 5, the travel information database 122 has items such as "vehicle ID," "number of passengers," "terminal ID," "time," and "travel information."

[0089] "Vehicle ID" indicates identification information for identifying a vehicle. "Number of passengers" indicates the number of passengers riding in the vehicle identified by the "Vehicle ID."

[0090] "Terminal ID" indicates identification information for identifying the terminal device 10 (on-vehicle device) installed in the vehicle identified by the "vehicle ID".

[0091] "Time" indicates the date and time when the "driving information" was acquired. "Driving information" indicates the driving status of the vehicle identified by the "vehicle ID" at the date and time indicated by "Time." Furthermore, the driving status indicates, for example, whether the vehicle is driving on a straight road or not, whether the vehicle is turning, the driving speed, the driving position, the direction of travel, and the traffic congestion status.

[0092] (About the application APx) Returning to FIG. 3, the application APx corresponds to the application AP1x or AP2x according to the embodiment described with reference to FIG.

[0093] (Regarding the control unit 130) The control unit 130 is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like executing various programs (for example, the information processing program according to the embodiment) stored in a storage device inside the information processing device 100 using RAM as a work area. The control unit 130 is also realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0094] As shown in Fig. 3, the control unit 130 is equipped with an information matching engine E100. The information matching engine E100 corresponds to the information matching engine E100-1 or E100-2 described in Fig. 1. The information matching engine E100 includes a request manager function E101 and a response manager function E102.

[0095] The request manager function E101 may include a request receiving unit and a queuing unit, which are not shown in Fig. 3. The response manager function E102 includes a first acquisition unit 131, a second acquisition unit 132, an identification unit 133, a prediction unit 134, a detection unit 135, a calculation unit 136, a determination unit 137, an output control unit 138, and an information control unit 139, as shown in Fig. 3.

[0096] (Regarding the first acquisition unit 131) The first acquisition unit 131 acquires driving information relating to the driving situation of the vehicle. For example, the first acquisition unit 131 acquires driving information indicating the driving situation of the vehicle grasped by the situation grasping process by the situation grasping engine E30-1 (E30-2).

[0097] (Regarding the second acquisition unit 132) The second acquisition unit 132 acquires area information corresponding to each of a plurality of pieces of content information, the area information indicating a geographical range in which the content information should be reproduced and output. For example, the second acquisition unit 132 acquires area information indicating a geographical range in which content information having a time range (playback time) should be reproduced and output from start to finish. For example, the area information is included in meta information and transmitted by the application APx together with the content information. Therefore, the second acquisition unit 132 can also acquire area information by acquiring content information input by the application APx.

[0098] (Regarding the identification unit 133) The identification unit 133 identifies a destination vehicle to which the content information is to be distributed, based on driving information related to the vehicle's driving status. The destination vehicle to which the content information is to be distributed refers to the destination terminal device 10 to which the content information is to be distributed. The driving information here may be driving information acquired by the first acquisition unit 131.

[0099] In addition, the identification unit 133 may identify a destination vehicle from among the vehicles traveling on the road to be processed based on the driving information of each vehicle traveling on the road to be processed, or may identify a destination vehicle based on statistical information (statistical driving conditions) obtained from the driving information corresponding to each vehicle that has traveled on the road to be processed in the past.

[0100] For example, the identification unit 133 extracts a vehicle traveling toward a destination point according to the content information (for example, a facility that is an advertisement target according to the content information) based on the travel information, and identifies the extracted vehicle as a delivery destination vehicle. In this regard, for example, the identification unit 133 can identify a vehicle that is predicted to reach a geographical range indicated by the area information in the future based on the travel information, and extract the identified vehicle as a vehicle traveling toward the destination point.

[0101] Furthermore, for example, the identification unit 133 may extract vehicles traveling in the lane on the side where the target point corresponding to the content information is located, based on the traveling information, and identify the extracted vehicles as vehicles to which the content information is to be distributed.

[0102] (Regarding the prediction unit 134) The prediction unit 134 predicts the vehicle's travel status within a geographical range based on the travel information. For example, the prediction unit 134 updates the prediction result by repeating the prediction of the vehicle's travel status within a geographical range, which is the travel status at a predetermined timing in the future, over time.

[0103] The driving information may include direction information indicating the direction of travel of the vehicle, and the prediction unit 134 updates the predicted result of the direction of travel by repeatedly predicting the direction of travel of the vehicle at a predetermined timing based on the direction information as time passes.

[0104] In addition, the driving information may include lane information indicating the lane in which the vehicle is traveling, and the prediction unit 134 updates the predicted result of the driving lane by repeating the prediction of the vehicle's driving lane at a predetermined timing based on the lane information over time.

[0105] In addition, the travel information may include speed information regarding the speed of the vehicle, and the prediction unit 134 updates the position prediction result by repeating the position prediction of the vehicle at a predetermined timing based on the speed information as time passes.

[0106] Furthermore, the travel information may include traffic congestion information related to the vehicle, and the prediction unit 134 updates the predicted position result by repeating the prediction of the vehicle's position at a predetermined timing based on the traffic congestion information as time passes.

[0107] The travel information may also include speed information related to the speed of the vehicle within a geographical range, and the prediction unit 134 may predict the travel speed of the vehicle at a predetermined timing as a travel status based on the speed information. Also, for example, the prediction unit 134 may predict the travel speed of the vehicle at a predetermined timing based on traffic congestion information.

[0108] (Regarding the detection unit 135) The detection unit 135 detects overlapping areas between the geographical ranges indicated by the pieces of area information acquired by the second acquisition unit. For example, the detection unit 135 detects the extent of overlap between areas by comparing the geographical ranges indicated by the pieces of area information.

[0109] (Regarding the calculation unit 136) The calculation unit 136 calculates the priority of reproduction output for each of the plurality of content information based on the prediction result by the prediction unit .

[0110] For example, the calculation unit 136 calculates the priority of reproduction output for each of the plurality of content information based on the latest prediction result among the prediction results obtained over time.

[0111] For example, in a situation where prediction of the traveling direction is repeated over time and the prediction result is updated, the calculation unit 136 calculates the priority of playback output for each of the plurality of content information based on the latest traveling direction. Also, for example, in a situation where prediction of the traveling lane is repeated over time and the prediction result is updated, the calculation unit 136 calculates the priority of playback output for each of the plurality of content information based on the latest traveling lane.

[0112] Furthermore, for example, in a situation where prediction of a traveling position is repeated over time and the prediction result is updated, the calculation unit 136 calculates the priority of playback output for each of the plurality of content information based on the latest traveling position. Furthermore, for example, in a situation where prediction of a traveling speed is repeated over time and the prediction result is updated, the calculation unit 136 calculates the priority of playback output for each of the plurality of content information based on the latest traveling speed.

[0113] The calculation unit 136 can calculate a higher priority for content information among the plurality of content information, the higher the relevance of the content information to the prediction result by the prediction unit 134. For example, assume that the prediction unit 134 predicts that a vehicle will turn right at a predetermined timing. In this case, the calculation unit 136 can calculate a higher priority for content information advertising a store located at the destination of the right turn.

[0114] (Regarding the decision unit 137) The determination unit 137 determines the output order when a plurality of pieces of content information are reproduced and output to the vehicle.

[0115] In one aspect, the determination unit 137 determines the output order when the plurality of pieces of content information are to be reproduced and output to the vehicle based on the reproduction time of each piece of content information and the area information. For example, the determination unit 137 determines the output order that allows the plurality of pieces of content information to be reproduced and output in order without interfering with each other when the predetermined timing arrives based on the driving conditions of the vehicle in a geographical area, which is the driving conditions at a predetermined timing in the future.

[0116] For example, when the detection unit 135 detects an overlap of areas, the determination unit 137 determines an output order in which the plurality of pieces of content information can be played back and output in order so as not to interfere with each other when a predetermined timing is reached, based on the relationship of the detected overlap and the playback time of each piece of content information corresponding to the geographical range including the overlap.

[0117] For example, when the detection unit 135 detects an overlap of areas, the determination unit 137 determines the output order by further using travel information related to the travel conditions of vehicles present in a geographical range including the detected overlap. For example, when the detection unit 135 detects an overlap of areas, the determination unit 137 calculates a distance traveled by the vehicle in accordance with the playback time of the content information based on the travel speed of the vehicle in the geographical range including the detected overlap, which is the travel speed at a predetermined timing predicted from the speed information, and the playback time of each piece of content information corresponding to the geographical range, and determines the output order based on the relationship between the calculated distance and the overlap. Also, for example, when the detection unit 135 detects an overlap of areas, the determination unit 137 calculates a distance traveled by the vehicle in accordance with the playback time of the content information based on the travel speed of the vehicle in the geographical range including the detected overlap, which is the travel speed at a predetermined timing predicted from traffic congestion information, and the playback time of each piece of content information corresponding to the geographical range, and determines the output order based on the relationship between the calculated distance and the overlap.

[0118] More specifically, the determination unit 137 extracts, from the plurality of pieces of content information, combinations that allow the plurality of pieces of content information to be reproduced and output in order without interfering with each other at a predetermined timing based on the distances and relationships, and determines the output order of the extracted combinations. For example, the determination unit 137 further uses priorities calculated from meta information assigned to each piece of content information to extract combinations from the plurality of pieces of content information, and determines the output order of the extracted combinations according to the priorities.

[0119] In another aspect, the determination unit 137 determines an output order when a plurality of pieces of content information are to be reproduced and output to a vehicle, based on the driving information and the area information. For example, the determination unit 137 uses a prediction result obtained by the prediction unit 134 based on the driving information to determine an output order in which the plurality of pieces of content information can be reproduced and output in order without interfering with each other when a predetermined timing arrives. For example, the determination unit 137 uses a driving speed predicted by the prediction unit 134 based on speed information and traffic congestion information to determine an output order in which the plurality of pieces of content information can be reproduced and output in order without interfering with each other when a predetermined timing arrives.

[0120] Then, when the detection unit 135 detects an overlap of areas, the determination unit 137 determines the output order based on the relationship of the detected overlap and the travel speed predicted by the prediction unit. For example, when the detection unit 135 detects an overlap of areas, the determination unit 137 determines the output order based on the travel speed of the vehicle in a geographical range including the detected overlap, among the travel speeds predicted by the prediction unit 134, and the relationship of the overlap.

[0121] More specifically, when the detection unit 135 detects an overlap of areas, the determination unit 137 calculates the distance the vehicle will travel in accordance with the playback time of the content information based on the driving speed in the geographical range including the overlap and the playback time of each piece of content information corresponding to the geographical range, and determines the output order based on the relationship between the calculated distance and the overlap.

[0122] As an example, the determination unit 137 extracts, from the plurality of pieces of content information, combinations that allow the plurality of pieces of content information to be played back and output in order without interfering with each other at a predetermined timing based on the distance and the relationship, and determines the output order of the extracted combinations. For example, the determination unit 137 further uses priorities calculated from meta information assigned to each piece of content information to extract combinations from the plurality of pieces of content information, and determines the output order of the extracted combinations according to the priorities.

[0123] In still another aspect, the determination unit 137 determines the output order when the plurality of pieces of content information are to be reproduced and output to the vehicle, according to the priority calculated by the calculation unit 136. For example, the determination unit 137 determines the output order in which the plurality of pieces of content information can be reproduced and output in order so as not to interfere with each other at a predetermined timing, according to the priority.

[0124] (Regarding output control unit 138) The output control unit 138 performs output control so that the content information to be output is reproduced and output in the vehicle in accordance with the priority and output order determined by the determination unit 137. For example, the output control unit 138 performs output control on the terminal device 10 so that the content information to be output is reproduced and output in the output order according to the priority determined by the determination unit 137. For example, the output control unit 138 distributes the content information to be output to a destination vehicle (specifically, a terminal device 10 provided in the destination vehicle, or a terminal device 10 owned by a user of the destination vehicle).

[0125] (Regarding the information control unit 139) When a combination that allows multiple pieces of content information to be played back and output in sequence without interfering with each other is extracted and there is content information excluded from the combination, the information control unit 139 estimates whether or not a margin area of ​​grace will remain in the geographical range corresponding to the excluded content information even when the playback and output of the content information included in the combination is completed, and if it estimates that a margin area will remain, it acquires content information controlled to a playback time according to the margin area as additional content information to be played back and output in the margin area.

[0126] 7. Specific Examples of Information Processing According to Embodiments From here, a specific example of information processing (decision processing) according to the embodiment will be shown using Fig. 6 and Fig. 7. Fig. 6 is a diagram showing an example of information processing according to the embodiment. Fig. 7 is a diagram showing another example of information processing according to the embodiment. Fig. 6 explains information processing according to the embodiment (pattern 1). Fig. 7 explains information processing according to the embodiment (patterns 2 and 3).

[0127] 6 and 7 also show a determination process for determining the output order when content information C111, C121, C211, and C221 are played back and output to a vehicle VE1 (from the MAP in FIG. 6) traveling on road RD1 toward a target point G1.

[0128] Also, according to the examples of Figures 6 and 7, vehicle VE1 is traveling on road RD1 at a speed of 60 km / h, and because a geographical range has been set for road RD1, content information C111, C121, C211, and C221 are candidate content information for output.

[0129] 6 and 7, the content information C111 has a playback time of 15 seconds, and a geographical range #111 on road RD1 is attached as meta information. In other words, the geographical range #111 in which the content information C111 should be played back exists on road RD1. Furthermore, the content information C121 has a playback time of 15 seconds, and a geographical range #121 on road RD1 is attached as meta information. In other words, the geographical range #121 in which the content information C121 should be played back exists on road RD1.

[0130] Furthermore, the content information C211 has a playback time of 30 seconds, and a geographical range #211 on road RD1 is attached as meta information. In other words, the geographical range #211 in which the content information C211 should be played back exists on road RD1. Furthermore, the content information C221 has a playback time of 30 seconds, and a geographical range #221 on road RD1 is attached as meta information. In other words, the geographical range #221 in which the content information C221 should be played back exists on road RD1.

[0131] Here, pattern 1 shows an example in which the output order is determined so that the content information C111, C121, C211, and C221 can be played back in order without interfering with each other, without taking into consideration the priority between the content information C111, C121, C211, and C221, based on the distance traveled by the vehicle VE1 according to the playback time of each piece of content information and the relationship between the overlapping areas between each geographical range.

[0132] The playback time of the content information C111 is "15 seconds", so the distance traveled by the vehicle VE1 traveling at "60 km / h" during this time is "250 m". Also, the playback time of the content information C121 is "15 seconds", so the distance traveled by the vehicle VE1 traveling at "60 km / h" during this time is "250 m".

[0133] Furthermore, since the playback time of the content information C211 is "30 seconds", the distance traveled by the vehicle VE1 traveling at "60 km / h" during this time is "500 m". Furthermore, since the playback time of the content information C221 is "30 seconds", the distance traveled by the vehicle VE1 traveling at "60 km / h" during this time is "500 m".

[0134] 6, the detection unit 135 detects overlapping areas by comparing the geographical ranges #111, #121, #211, and #221. As a result, the detection unit 135 detects four overlapping areas, namely, the geographical range #121-#221, the geographical range #121-#211-#221, the geographical range #211-#221, and the geographical range #111-#211, as shown by the dotted lines in FIG.

[0135] In this state, the determination unit 137 determines the output order in which the content information can be played back and output in order so as not to interfere with each other, based on the distance and overlap relationship, on the premise that, depending on the driving conditions of the vehicle VE1, content information C111 is played back and output within geographical range #111, content information C121 is played back and output within geographical range #121, content information C211 is played back and output within geographical range #211, and content information C221 is played back and output within geographical range #221.

[0136] As a result, according to the example of pattern 1 in FIG. 6, the determination unit 137 can determine the output order as follows: content information C221 (No. 1) → C121 (No. 2) → C111 (No. 3) → C211 (No. 4).

[0137] Furthermore, the determination unit 137 can determine, for each of the content information C111, C121, C211, and C221, which geographical range is to be actually reproduced and output.

[0138] Specifically, the determination unit 137 determines the range position within the geographical range #111 as the range position within which the content information C111 will actually be played back and output. According to the example of pattern 1 in Fig. 6, the determination unit 137 can determine range position #11-1, which does not overlap with the range positions of other content information, as the range position within which the content information C111 will actually be played back and output. Furthermore, the distance width indicating range position #11-1 may correspond to the distance "250 m" traveled by the vehicle VE1 at "60 km / h" in response to the playback time "15 seconds."

[0139] Furthermore, the determination unit 137 determines the range position within the geographical range #121 in which the content information C121 will actually be played back and output. According to the example of pattern 1 in Fig. 6, the determination unit 137 can determine range position #12-1, which does not overlap with the range positions of other content information, as the range position in which the content information C121 will actually be played back and output. Furthermore, the distance width indicating range position #12-1 may correspond to the distance "250 m" traveled by the vehicle VE1 at "60 km / h" in response to the playback time "15 seconds."

[0140] Furthermore, the determination unit 137 determines the range position within the geographical range #211 in which the content information C211 will actually be played back and output. According to the example of pattern 1 in Fig. 6, the determination unit 137 can determine range position #21-1, which does not overlap with the range positions of other content information, as the range position in which the content information C211 will actually be played back and output. Furthermore, the distance width indicating range position #21-1 may correspond to the distance "500 m" traveled by the vehicle VE1 at "60 km / h" in response to the playback time "30 seconds."

[0141] Furthermore, the determination unit 137 determines the range position within the geographical range #221 in which the content information C221 will actually be played back and output. According to the example of pattern 1 in Fig. 6, the determination unit 137 can determine range position #22-1, which does not overlap with the range positions of other content information, as the range position in which the content information C221 will actually be played back and output. Furthermore, the distance width indicating range position #22-1 may correspond to the distance "500 m" traveled by the vehicle VE1 at "60 km / h" in response to the playback time "30 seconds."

[0142] Next, pattern 2 will be described with reference to Fig. 7. In pattern 2, an example is shown in which the output order is determined so that the content information C111, C121, C211, and C221 can be reproduced and output in order without interfering with each other, taking into consideration the priority among the content information C111, C121, C211, and C221, based on the distance traveled by the vehicle VE1 according to the reproduction time of each piece of content information and the relationship of area overlap between each geographical range. Note that, except for taking into consideration the priority, the condition settings are the same as those of pattern 1, so a duplicated explanation will be omitted.

[0143] For example, the prediction unit 134 predicts the driving status of the vehicle VE1 at a predetermined timing in the future, which is the driving status within a geographical range consisting of geographical ranges #111, #121, #211, and #221, based on driving information indicating the current driving status (which may be statistical driving information obtained from the driving status history).The calculation unit 136 calculates the priority of playback output for each piece of content information based on the prediction result.

[0144] 7, it is assumed that the calculation unit 136 has at least calculated that the content information C121 has a higher priority than the content information C221. As in pattern 1, the determination unit 137 determines an output order in which the content information can be played back and output in order so as not to interfere with each other, based on the relationships of distance and overlap, on the premise that the content information C111 is played back and output within the geographical range #111, the content information C121 is played back and output within the geographical range #121, the content information C211 is played back and output within the geographical range #211, and the content information C221 is played back and output within the geographical range #221, in accordance with the travel of the vehicle VE1.

[0145] However, in this case, unlike the example of pattern 1, the determination unit 137 determines the overall output order so that the content information C121 is output earlier than the content information C221, as shown in Fig. 7. For example, the determination unit 137 can determine the output order as follows: content information C121 (No. 1) → C221 (No. 2) → C111 (No. 3) → C211 (No. 4).

[0146] Next, pattern 3 will be described with reference to Fig. 7. In pattern 3, an example is shown in which the output order is determined taking into consideration the priorities among the content information C111, C121, C211, and C221, but the priorities are different from those in the example of pattern 2.

[0147] 7, it is assumed that the calculation unit 136 has at least calculated that the content information C211 has a higher priority than the content information C111. As in pattern 1, the determination unit 137 determines an output order in which the content information can be played back and output in order so as not to interfere with each other, based on the relationships of distance and overlap, on the premise that the content information C111 is played back and output within the geographical range #111, the content information C121 is played back and output within the geographical range #121, the content information C211 is played back and output within the geographical range #211, and the content information C221 is played back and output within the geographical range #221, in accordance with the travel of the vehicle VE1.

[0148] However, in this case, unlike the example of pattern 1, the determination unit 137 determines the overall output order so that the content information C211 is output earlier than C111, as shown in Fig. 7. For example, the determination unit 137 can determine the output order as follows: content information C221 (No. 1) → C121 (No. 2) → C211 (No. 3) → C111 (No. 4).

[0149] 8. Modified Examples of Information Processing According to the Embodiment Next, the processing performed by the information control unit 139 will be described with reference to Fig. 8 as a modified example of the content described in Fig. 6. Fig. 8 is a diagram showing modifications corresponding to the information processing according to the embodiment. In the example of Fig. 8, for the convenience of explaining the processing performed by the information control unit 139, the geographical range #211 corresponding to the content information C211 is narrower than in Fig. 6.

[0150] For example, the determination unit 137 extracts a combination that allows the content information to be reproduced and output in order without interfering with each other, based on the relationship of overlapping areas between geographical ranges and the distance traveled by the vehicle VE1 according to the reproduction time of each piece of content information. Then, the determination unit 137 determines, from among the extracted combinations, a combination arranged in accordance with the priority calculated by the calculation unit 136 as the content information to be output, and determines the order of the combination as the output order. According to this determination process, some content information may be excluded from the combination, i.e., not extracted as the content information to be output.

[0151] 8 shows an example in which content information C211 is excluded from content information C111, C121, C211, and C221. In this example, content information C221, C121, and C111 are played back and output in this order, but it is estimated that a marginal area MAR will remain in the geographical range #211 corresponding to the excluded content information C211 when the playback and output of content information C111, which is last in the output order, is completed. When it is estimated that a marginal area MAR will remain, the information control unit 139 acquires content information controlled to a playback time according to the marginal area MAR as additional content information to be played back and output in the marginal area MAR.

[0152] For example, if a short version of the excluded content information C211 has the same content as the excluded content information C211 but a shorter playback time and is registered in advance in the storage unit, the information control unit 139 can acquire this short version of the content information C211 as additional content information to be played back and output in the margin area MAR. In this case, the output control unit 138 can play back and output the short version of the content information C211 when the playback and output of the content information C111 ends and the vehicle VE1 enters the margin area MAR.

[0153] If it is estimated that the blank area MAR will remain, the information control unit 139 may dynamically generate a short version of the content information C211 that is the same in content as the excluded content information C211 but has a shorter playback time. If it is estimated that the blank area MAR will remain, the information control unit 139 may control the playback times of the content information C111, C121, C211, and C221 to be shorter than the current playback times so that all of the content information C111, C121, C211, and C221 are played back and output. For example, the information control unit 139 may shorten the playback time of all of the content information C111, C121, C211, and C221, or may shorten the playback time of at least one of the content information C111, C121, C211, and C221.

[0154] [9. Overall Processing Procedure] Next, the procedure of information processing according to the embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an overview of the procedure of information processing according to the embodiment.

[0155] First, the second acquisition unit 132 recognizes which road is the target road from among a number of candidate roads (step S101). Using the example of Fig. 6, it is assumed that the second acquisition unit 132 recognizes road RD1 as the target road.

[0156] Next, the second acquisition unit 132 acquires area information for which a geographical range is set on the road RD1 recognized in step S101 from the area information input by each application (step S102). Similarly, using the example of Fig. 6, it is assumed that the second acquisition unit 132 has acquired, as the area information for which a geographical range is set on the road RD1, area information corresponding to the geographical range #111 set as meta information by the application AP11, area information corresponding to the geographical range #121 set as meta information by the application AP12, area information corresponding to the geographical range #211 set as meta information by the application AP21, and area information corresponding to the geographical range #221 set as meta information by the application AP22.

[0157] Furthermore, the second acquisition unit 132 acquires content information associated with each area information acquired in step S102 as content information of output candidates (step S103). According to the above example, the second acquisition unit 132 acquires content information C111, C121, C211, and C221 as content information of output candidates.

[0158] Furthermore, the first acquisition unit 131 acquires driving information relating to the driving situation of the vehicle (step S104). For example, the first acquisition unit 131 acquires driving information indicating the recognized driving situation in response to the driving situation being recognized at any time by the situation recognition engine E30-1 (E30-2). For example, the first acquisition unit 131 may acquire driving information indicating the driving situation of a vehicle currently traveling on road RD1, a vehicle currently traveling near road RD1, or a vehicle predicted to enter road RD1 in the future.

[0159] Next, the identification unit 133 identifies a destination vehicle to which the content information is to be distributed based on the travel information acquired in step S104 (step S105). For example, the identification unit 133 can extract vehicles traveling in the lane on the side where the destination point corresponding to each of the content information C111, C121, C211, and C221 is located based on the travel information, and identify the extracted vehicles as destination vehicles. Furthermore, the identification unit 133 can extract vehicles traveling in the lane on the side where the destination point corresponding to each of the content information C111, C121, C211, and C221 is located based on the travel information, and identify the extracted vehicles as destination vehicles. In the example of FIG. 6, the identification unit 133 identifies the vehicle VE1 as the destination vehicle based on the destination point G1. Of course, the identification unit 133 may identify multiple destination vehicles. However, for simplicity of explanation, it is assumed here that the identification unit 133 identifies one vehicle VE1.

[0160] In this state, the prediction unit 134 determines whether or not the vehicle VE1 has approached the geographical range indicated by the area information acquired in step S102 (step S106). For example, the prediction unit 134 determines whether or not the vehicle VE1 has approached the geographical range consisting of geographical ranges #111, #121, #211, and #221. While the prediction unit 134 determines that the vehicle VE1 has not approached the geographical range (step S106; No), the prediction unit 134 waits until it can determine that the vehicle VE1 has approached the geographical range.

[0161] On the other hand, if the prediction unit 134 determines that the vehicle VE1 has approached the geographical range (step S106; Yes), it sets a future timing for predicting the driving conditions of the vehicle VE1 (step S107). In other words, the prediction unit 134 determines at what future timing the driving conditions of the vehicle VE1 will be predicted. As an example, the prediction unit 134 may set a timing a predetermined time after the present time (for example, 30 seconds from now) as the future timing, and in this case, performs a prediction process to predict the driving conditions of the vehicle VE1 at this timing. Hereinafter, the timing set in step S107 will be referred to as the "set timing."

[0162] Next, the prediction unit 134 predicts the traveling state of the vehicle VE1 at the set timing based on the current traveling information by a loop, which will be described later (step S108).

[0163] Here, the prediction unit 134 repeats a prediction process of predicting the driving situation at the set timing as time passes, using a loop to be described later. Therefore, if the prediction unit 134 has already predicted the driving situation at the set timing from the driving information at that time before the current time, the prediction unit 134 updates the prediction result up to that point to the prediction result at the current time (the prediction result based on the prediction in step S108) (step S109).

[0164] Next, the detection unit 135 detects overlaps between the geographical ranges indicated by each piece of area information (step S110). Specifically, the detection unit 135 compares the geographical ranges #111, #121, #211, and #221 to detect the extent of overlap between the areas in the geographical ranges #111, #121, #211, and #221.

[0165] From here, the flow of processing when an area overlap is detected among the geographical ranges #111, #121, #211, and #221 (step S110; Yes) will be described.

[0166] The calculation unit 136 calculates the playback output priority for each of the output candidate content information (content information C111, C121, C211, C221) based on the current prediction result (latest prediction result) predicted in step S108 (step S111).

[0167] For example, the calculation unit 136 may calculate a higher priority for content information that advertises a facility (e.g., a store) in a direction closer to the traveling direction of the vehicle VE1 at the set timing. Furthermore, for example, the calculation unit 136 may calculate a higher priority for content information that advertises a facility that is located on the driving lane side of the vehicle VE1 at the set timing. Furthermore, for example, the calculation unit 136 may calculate a higher priority for content information that advertises a facility that is closer to the position of the vehicle VE1 at the set timing. Thus, the calculation unit 136 can calculate a higher priority for content information that is more highly relevant to the prediction result by the prediction unit 134, among the content information C111, C121, C211, and C221.

[0168] Next, the determination unit 137 determines an output order, in accordance with the priorities calculated in step S111, of the combinations of output candidate content information (content information C111, C121, C211, C221), indicating which combinations of content information should be played back and output in the vehicle in what order (step S112). For example, the determination unit 137 extracts combinations that allow the content information to be played back and output in order without interfering with each other, based on the relationship between the overlapping areas detected in step S111 and the distance traveled by the vehicle VE1 according to the playback time of each piece of content information. Then, the determination unit 137 determines, from the extracted combinations, a combination that corresponds to the order based on the priorities calculated by the calculation unit 136 as the content information to be output, and determines the order of the combination as the output order.

[0169] In step S112, the determination unit 137 may also determine, for each piece of content information to be output, the range position within the geographical range corresponding to the content information in question, in which the content information is to be actually reproduced and output.

[0170] Next, the output control unit 138 controls the output so that the content information included in the combination (content information to be output) is played back and output in the output order in step S112 when the set timing arrives (step S113). For example, the output control unit 138 controls the output of the terminal device 10 so that the content information to be output is played back and output in the output order according to the priority determined by the determination unit 137 and at the range position.

[0171] Here, the prediction unit 134 determines whether the set timing set in step S107 has passed (step S114). If the prediction unit 134 determines that the set timing has passed (step S114; Yes), the process returns to step S107, and the process from step S107 onwards is repeated by setting a new next timing.

[0172] On the other hand, if the prediction unit 134 determines that the set timing has not elapsed (step S114; No), the prediction unit 134 determines whether a predetermined time has elapsed since the prediction was made in step S108 (step S115). For example, the prediction unit 134 determines whether five seconds have elapsed since the prediction was made in step S108.

[0173] While the prediction unit 134 determines that the predetermined time has not elapsed since the prediction was made in step S108 (step S115; No), it waits until it can determine that the predetermined time has elapsed. On the other hand, when the prediction unit 134 determines that the predetermined time has elapsed (step S115; Yes), it returns to step S108.

[0174] Next, the flow of processing when no area overlap is detected among the geographical ranges #111, #121, #211, and #221 (step S110; No) will be described.

[0175] In this example, the determination unit 137 determines, for each of the content information items (content information items C111, C121, C211, C221) that are candidates for output, the range position within the geographical range corresponding to the content information item in which the content information item will actually be played back (step S116).

[0176] When the set timing arrives, the output control unit 138 controls the terminal device 10 to play back and output the content information of each output candidate at the range position in step S116 (step S117).

[0177] [10. Decision Processing Procedure] Next, focusing on the determination process performed in step S112 of Fig. 9, the procedure of this process will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the procedure of the determination process included in the information processing procedure according to the embodiment.

[0178] For example, the determining unit 137 acquires content information corresponding to the geographical range including the overlap detected in step S110 from among the content information of the output candidates (content information C111, C121, C211, C221) (step S201).

[0179] In addition, the determination unit 137 acquires the traveling speed of the vehicle VE1 at the set timing from among the traveling speeds (an example of traveling conditions) predicted by the prediction unit 134 in the geographical range including the overlap detected in step S110 (step S202).

[0180] Then, for each piece of content information of the output candidate, the determining unit 137 calculates the distance the vehicle will travel in accordance with the playback time based on the playback time of the content information and the traveling speed acquired in step S202 (step S203).

[0181] Next, the determination unit 137 extracts a combination that allows the content information of the output candidates to be played back and output in order without interfering with each other, based on the relationship and distance of the overlap detected in step S110 (step S204).

[0182] Then, the determining unit 137 determines the combination of the extracted combinations, arranged in the order according to the priority, as the content information to be output, and determines the order of the combination as the output order (step S205).

[0183] Furthermore, for each content to be output that is included in the combination extracted in step S204, the determination unit 137 determines the range position within the geographical range corresponding to the content information in which the content information is to be actually played back (step S206).

[0184] [11. Summary] The information processing device 100 according to the embodiment acquires area information corresponding to each of a plurality of pieces of content information, the area information indicating a geographical range in which the content information should be reproduced and output. Then, the information processing device 100 determines the output order of the plurality of pieces of content information when the plurality of pieces of content information is to be reproduced and output to a vehicle, based on the reproduction time of each piece of content information and the area information. According to the information processing device 100, each piece of content information associated with a geographical range in which the content information should be reproduced and output can be reproduced and output from the vehicle in order without interfering with each other within the geographical range.

[0185] Furthermore, the information processing device 100 according to the embodiment acquires driving information related to the driving conditions of the vehicle, and also acquires area information corresponding to each of a plurality of pieces of content information, which area information indicates a geographical range in which the content information should be played and output. Then, the information processing device 100 determines the output order for playing and outputting the plurality of pieces of content information from the vehicle based on the driving information and the area information. According to the information processing device 100, each piece of content information associated with a geographical range in which the content information should be played and output can be played and output from the vehicle in order without interfering with each other within the geographical range.

[0186] Furthermore, the information processing device 100 according to the embodiment acquires driving information related to the vehicle's driving conditions, and also acquires area information corresponding to each of a plurality of pieces of content information, which area information indicates a geographical range in which the content information should be played back. The information processing device 100 then predicts the vehicle's driving conditions within the geographical range based on the driving information, and calculates a playback output priority for each of the plurality of pieces of content information based on the prediction result. The information processing device 100 then determines the output order for playing back and outputting the plurality of pieces of content information to the vehicle, based on the calculated priority. According to this information processing device 100, the vehicle's driving conditions can be predicted in advance, thereby optimizing the playback output of the content information in response to changes in the driving conditions.

[0187] [12. Hardware Configuration] The information processing device 100 according to the embodiment described above is realized, for example, by a computer 1000 configured as shown in Fig. 11. Fig. 11 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, an HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0188] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 starts up, programs that depend on the hardware of the computer 1000, and the like.

[0189] The HDD 1400 stores programs executed by the CPU 1100, data used by such programs, etc. The communication interface 1500 receives data from other devices via a predetermined communication network and sends it to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.

[0190] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.

[0191] Media interface 1700 reads a program or data stored in recording medium 1800 and provides it to CPU 1100 via RAM 1200. CPU 1100 loads the program or data from recording medium 1800 onto RAM 1200 via media interface 1700 and executes the loaded program. Recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0192] For example, when the computer 1000 functions as the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control unit 130. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via a predetermined communication network.

[0193] [13. Other] Furthermore, among the processes described in each of the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0194] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0195] Furthermore, the above-described embodiments can be combined as appropriate within the scope of not causing any contradiction in the processing content.

[0196] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that include the aspects described in the Disclosure of the Invention section, as well as in various modifications and improvements based on the knowledge of those skilled in the art.

[0197] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, a decision unit can be read as a decision means or a decision circuit. [Explanation of symbols]

[0198] Sy Information Processing System 100 Information processing device 120 Storage section 121 Content Database 122 Driving Information Database 130 Control Unit 131 First acquisition part 132 Second acquisition part 133 Specific part 134 Prediction Department 135 Detector 136 Calculation Unit 137 Decision Section 138 Output control section 139 Information Control Department

Claims

1. an acquisition unit that acquires a plurality of area information corresponding to a plurality of pieces of content information, each piece of area information indicating a geographical range in which the corresponding piece of content information should be reproduced; a determination unit that determines an output order based on a playback time of each of the plurality of pieces of content information and the plurality of pieces of area information so that the plurality of pieces of content information are output in the corresponding plurality of geographical areas when a mobile object passes through the plurality of geographical areas; An information processing device comprising:

2. Each piece of area information indicates a geographical range in which the corresponding content information having a time range should be reproduced from start to finish.

2. The information processing apparatus according to claim 1, wherein:

3. The determination unit determines an output order that allows the plurality of pieces of content information to be reproduced and output in order without interfering with each other when the predetermined timing arrives, based on a movement status of the mobile body in the plurality of geographical ranges, which is a movement status at the predetermined timing in the future.

3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

4. a detection unit that detects an overlap of areas between the plurality of geographical ranges indicated by the plurality of area information acquired by the acquisition unit; When the detection unit detects an overlap of areas, the determination unit determines an output order in which the plurality of pieces of content information can be reproduced and output in order so as not to interfere with each other when the predetermined timing arrives, based on the relationship of the detected overlap and the reproduction times of the plurality of pieces of content information corresponding to the geographical range including the overlap.

4. The information processing apparatus according to claim 3,

5. When the detection unit detects an overlap of areas, the determination unit determines the output order by further using movement information related to movement statuses of the moving objects present in a geographical range including the detected overlap.

5. The information processing apparatus according to claim 4,

6. the movement information includes speed information relating to a speed of a moving object; When the detection unit detects an overlap of areas, the determination unit calculates a distance traveled by the moving object in accordance with a playback time of the content information based on the moving speed at the predetermined timing predicted from the speed information, which is a moving speed of the moving object in a geographical range including the detected overlap, and playback times of each of the plurality of content information corresponding to the geographical range, and determines the output order based on the calculated distance and the relationship.

6. The information processing apparatus according to claim 5,

7. The movement information includes congestion information regarding a traffic congestion situation of a mobile object, When the detection unit detects an overlap of areas, the determination unit calculates a distance traveled by the mobile object in accordance with a playback time of the content information based on the movement speed of the mobile object in a geographical range including the detected overlap, the movement speed at the predetermined timing predicted from the congestion information, and a playback time of each of the plurality of content information corresponding to the geographical range, and determines the output order based on the calculated distance and the relationship.

7. The information processing apparatus according to claim 5, wherein the information processing apparatus is a computer.

8. The determination unit extracts, from the plurality of pieces of content information, a combination that allows the plurality of pieces of content information to be reproduced and output in order so as not to interfere with each other when the predetermined timing arrives, based on the distance and the relationship, and determines the output order for the extracted combination.

8. The information processing device according to claim 6, wherein:

9. The determination unit further uses priorities calculated from meta information assigned to the plurality of pieces of content information to extract the combinations from among the plurality of pieces of content information, and determines an output order for the extracted combinations according to the priorities.

9. The information processing apparatus according to claim 8,

10. When there is content information excluded from the combination among the plurality of content information, the information control unit estimates whether or not a marginal area of ​​grace will remain in the geographical range corresponding to the excluded content information even when the playback output of the content information included in the combination has ended, and if it is estimated that a marginal area will remain, acquires content information controlled to a playback time according to the marginal area as additional content information to be played back and output in the marginal area.

10. The information processing device according to claim 8, wherein the information processing device is a computer.

11. The method further includes a specifying unit that specifies a mobile object to which the plurality of pieces of content information are to be distributed based on movement information relating to a movement status of the mobile object, The determination unit determines an output order when the plurality of pieces of content information are to be reproduced and output from the mobile object of the distribution destination that exists in the geographical area.

11. The information processing device according to claim 1.

12. The identification unit extracts a moving object having a destination point according to the content information as a traveling direction based on the movement information, and identifies the extracted moving object as the moving object of the distribution destination.

12. The information processing apparatus according to claim 11,

13. The identification unit extracts a mobile object traveling in a lane on the side where a target point according to the content information is located, based on the movement information, and identifies the extracted mobile object as the mobile object to be distributed.

13. The information processing device according to claim 11 or 12.

14. An information processing method executed by an information processing device, an acquisition step of acquiring a plurality of area information corresponding to the plurality of content information, each area information indicating a geographical range in which the corresponding content information should be reproduced; a determining step of determining an output order based on a playback time of each of the plurality of pieces of content information and the plurality of pieces of area information so that the plurality of pieces of content information are output in the corresponding plurality of geographical areas when a mobile object passes through the plurality of geographical areas; An information processing method comprising:

15. An information processing program executed by an information processing device having a computer, The computer an acquisition unit that acquires a plurality of area information corresponding to a plurality of pieces of content information, each piece of area information indicating a geographical range in which the corresponding piece of content information should be reproduced; a determination means for determining an output order based on a playback time of each of the plurality of pieces of content information and the plurality of pieces of area information so that the plurality of pieces of content information are output in the corresponding plurality of geographical areas when a mobile object passes through the plurality of geographical areas; An information processing program characterized by causing the program to function as:

Images