Information display device, information display method, and information display program

Abstract

This system helps users appropriately review content that was not output due to other content being prioritized for playback output, at their own discretion. [Solution] The information display device according to the present invention is an information display device that, when the timing for playing and outputting content overlaps, prioritizes playing and outputting one content according to the priority of each content, and has an assignment unit and a storage unit. The assignment unit assigns supplementary information indicating the attributes of the unoutputted content to the unoutputted content that was not played and output as a result of the playback output of content with a higher priority due to the timing overlap. The storage unit stores the assigned content with the supplementary information in a state that can be played and output at any time.

Description

Technical Field

[0001] The present invention relates to an information presentation device, an information presentation method, and an information presentation program.

Background Art

[0002] Conventionally, when there is a risk that the reproduction of a plurality of voice information may interfere, among each combination of the reproduction priorities of these voice information, the reproduction priority related to the combination with the minimum loss degree due to not being reproduced and the reproduction being delayed is selected, and a technique for performing reproduction has been proposed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] For example, in the above prior art, when voice information with a short allowable limit time for the delay in starting reproduction from the occurrence of an event related to the voice information overlaps, reproduction cannot be completed within the allowable limit time, and as a result, there may be voice information that is not reproduced and output. In this case, among the voice information that was not reproduced and output, there may be information that the user wants to know even later.

[0005] The present invention has been made in view of the above circumstances, and for example, an information presentation device, a system, an information presentation method, an information presentation program, and an information processing device that assist a user in appropriately checking, at an arbitrary timing, content that has not been output as a result of other content being preferentially reproduced and output are provided.

Means for Solving the Problems

[0006] The information display device according to claim 1 is an information display device that, when the timing for playing and outputting content overlaps, prioritizes playing and outputting one content according to the respective priority of the content, and comprises: an assignment unit that assigns an attribute indicating the attributes of the unoutput content to the unoutput content that was not played and output as a result of the playback of content with a higher priority due to the timing overlap; an storage unit that stores the assigned content with the ancillary information in a state that can be played and output at any time; and a control unit that, when an output request including information indicating the ancillary information is input by a user, controls the assigned content to be played and output from among the assigned content to which the ancillary information corresponding to the output request has been assigned, wherein the storage unit transmits the assigned content to an external device to store the assigned content in the external device, and the control unit, when an output request is input, acquires from the external device the assigned content to which the ancillary information corresponding to the output request has been assigned.

[0007] The information presentation method described in claim 5 is an information presentation method executed by an information presentation device that, when the timing for playback output of content overlaps, prioritizes playback output of one content according to the respective priority of the content, and includes: an assignment step of assigning an attached information indicating the attributes of the unoutput content to the unoutput content that was not played back due to the playback output of content with a higher priority because the timing overlapped; an accumulation step of accumulating the assigned content with the attached ancillary information in a state that can be played back at any time; and a control step of controlling the system so that, when an output request including information indicating the attached ancillary information is input by a user, the assigned content that has been assigned the attached ancillary information corresponding to the output request is played back, wherein the accumulation step involves transmitting the assigned content to an external device to store the assigned content, and the control step, when an output request is input, acquires the assigned content that has been assigned the attached ancillary information corresponding to the output request from the external device.

[0008] The information presentation program described in claim 6 is an information presentation program executed by an information presentation device that, when the timing for outputting content overlaps, prioritizes outputting one content according to the priority of each of the contents, and is characterized in that it causes the information presentation device to execute an assignment procedure for assigning ancillary information indicating the attributes of unoutputted content to unoutputted content that was not output as a result of the higher-priority content being output due to the timing overlap; an storage procedure for storing the assigned content with the ancillary information in a state that can be output at any time; and a control procedure for controlling the assigned content to be output if an output request including information indicating the ancillary information is input by a user, wherein the storage procedure causes the assigned content to be stored in the external device by transmitting the assigned content; and the control procedure, when an output request is input, obtains the assigned content from the external device that has the ancillary information corresponding to the output request. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 shows an example of a system according to an embodiment. [Figure 2] Figure 2 shows an example of the configuration of each device according to the embodiment. [Figure 3] Figure 3 shows an example of the data structure stored in the storage unit according to the embodiment. [Figure 4] Figure 4 is a flowchart showing the metadata assignment procedure. [Figure 5] Figure 5 is a flowchart (1) showing the presentation processing procedure according to the embodiment. [Figure 6] Figure 6 is a flowchart (2) showing the presentation processing procedure according to the embodiment. [Figure 7]Figure 7 is a hardware configuration diagram showing an example of a computer that implements the functions of the information display device 100. [Modes for carrying out the invention]

[0010] [Embodiment] Below, an example of an embodiment for implementing an information presentation device, system, information presentation method, information presentation program, and information processing device (hereinafter referred to as "embodiment") will be described in detail with reference to the drawings. Note that this embodiment does not limit the information presentation device, system, information presentation method, information presentation program, and information processing device. Furthermore, the same parts will be denoted by the same reference numerals in the following embodiments, and redundant explanations will be omitted.

[0011] <System Configuration> First, the configuration of the system according to the embodiment will be explained using Figure 1. Figure 1 is a diagram showing an example of the system according to the embodiment. In Figure 1, System 1 is shown as an example of the system according to the embodiment.

[0012] As shown in Figure 1, System 1 may include an information processing device 10, an information display device 100, and an agent device 300. The information processing device 10, the information display device 100, and the agent device 300 are connected to each other via a network N, either by wired or wireless communication.

[0013] The information processing device 10 is a portable terminal device (e.g., a smartphone, tablet, notebook PC, desktop PC, PDA, etc.) that is used on a daily basis by user Ux (referring to any user). For example, user Ux can transfer some or all of the functions of the information presentation device 100, described later, to the information processing device 10 by installing a predetermined application on the information processing device 10.

[0014] When the timings for playing and outputting contents overlap, the information presentation device 100 has a function of preferentially playing and outputting one content according to the respective priorities of the contents. Such a function may be realized by an information integration engine 131 described later.

[0015] Also, as shown in FIG. 1, the information presentation device 100 may be mounted on the vehicle VEx. That is, the information presentation device 100 may be an in-vehicle device.

[0016] For example, the information presentation device 100 may be a dedicated navigation device built in or mounted on the vehicle VEx. For example, the information presentation device 100 may be composed of a navigation device and a recording device. As an example of this, the information presentation device 100 may be a composite device in which a navigation device and a recording device independent of each other are communicably connected. As another example, the information presentation device 100 may be one device having a navigation function and a recording function.

[0017] Also, the information presentation device 100 may include various sensors. For example, the information presentation device 100 may include various sensors such as a camera, an acceleration sensor, a gyro sensor, a GPS sensor, and an air pressure sensor. As a result, the information presentation device 100 can perform conversations and information provision for assisting the driving of the user Ux based on the sensor information acquired by the various sensors.

[0018] Also, the information presentation device 100 has an agent function unit. For example, the information presentation device 100 may have a plurality of agent function units. The agent function unit is, for example, a function that performs various information provision and various device controls based on requests (commands) included in the utterance of the user Ux while interacting with the user Ux, or mediates network services.

[0019] For this reason, the agent function unit performs response processing in response to a voice request from the user Ux, but the actual response processing may be performed by the agent device 300 associated with the agent function unit.

[0020] For example, if the information processing device 10 and the information presentation device 100 are edge computers that perform edge processing near the user Ux, the agent device 300 may be a cloud computer that performs processing on the cloud side. That is, the agent device 300 may be a server device.

[0021] Here, as shown in FIG. 1, the system 1 may include an information presentation system Sy corresponding to each user Ux. The information presentation system Sy may be constructed for each user Ux. For example, the information presentation system Sy corresponding to the user U1 (an example of the user Ux) may be composed of an information processing device 10-1 (an example of the information processing device 10) and an information presentation device 100-1 (an example of the information presentation device 100). The same applies to other users Ux such as the user U2, the user U3, and so on.

[0022] In the following embodiments, the information processing device 10 may be referred to as the "portable device 10", and the information presentation device 100 may be referred to as the "in-vehicle device 100".

[0023] <Embodiment> Hereinafter, the presentation processing (presentation processing according to the embodiment) realized by the information presentation system Sy shown in FIG. 1 will be described.

[0024] 〔1. Functional Configuration of In-Vehicle Device〕 First, the in-vehicle device 100 according to the embodiment will be described with reference to FIG. 2. FIG. 2 is a diagram showing a configuration example of each device according to the embodiment.

[0025] The in-vehicle device 100 has an agent function unit that recognizes the voice of user Ux and provides services including a response based on the recognition result. As a result, user Ux can receive various driving assistance and useful information through interaction with the agent function unit.

[0026] As shown in Figure 2, the in-vehicle device 100 includes a microphone MC, a speaker SP, an application group 30, a communication unit 110, a storage unit 120, and a control unit 130.

[0027] (Regarding the microphone MC) The microphone MC collects sounds generated within the VEx vehicle. For example, the microphone MC collects speech sounds made by passengers in the VEx vehicle.

[0028] (Speaker SP) The speaker SP corresponds to an output means that outputs sound. For example, the speaker SP outputs a response sound corresponding to the utterance input via the microphone MC, in response to presentation control (output control) by the control unit 130.

[0029] (App group 30) The application group 30 is a group of applications that provide services related to driving assistance and useful information. The applications included in the application group 30 (hereinafter abbreviated as "apps") may each provide different types of services, or they may provide the same type of service but with different performance characteristics. In addition, each app included in the application group 30 has an agent function unit that acts as an intermediary for providing the service. Furthermore, each app (agent function unit) is associated with an agent device 300 that performs processing to realize the service corresponding to that app. This point will be explained in more detail using the example in Figure 2.

[0030] As shown in the example in Figure 2, the application group 30 includes an example where multiple applications AP30 are included, such as application AP31 and application AP32. For the sake of explanation, only applications AP31 and AP32 are shown in Figure 2.

[0031] In the example shown in Figure 2, application AP31 has an agent function unit 31 as a voice agent function, and agent device 300-1 (an example of agent device 300) is associated with the agent function unit 31. Also in the example shown in Figure 2, application AP32 has an agent function unit 32 as a voice agent function, and agent device 300-2 (an example of agent device 300) is associated with the agent function unit 32.

[0032] Furthermore, each application included in the application group 30 (application AP31, application AP32, etc.) passes the content it wants to provide to the user Ux to the information matching engine 131, which then plays and outputs the content. At this time, the application may add range information indicating the range to be played and output, category information indicating the category of the content, the length of the content (playback time), etc., to the content.

[0033] Range information, which indicates the range within which content should be played back, is equivalent to conditional information that specifies the geographical range, time range, vehicle VEx mileage range, vehicle VEx passing area range, vehicle speed range, etc., within which content playback should be permitted. For this reason, the application makes a reservation with the information matching engine 131 regarding content playback.

[0034] (Communications Department 110) The communication unit 110 is implemented, for example, by a NIC (Network Interface Card). The communication unit 110 is connected to the network N by wire or wireless connection and performs information transmission and reception, for example, with the portable device 10.

[0035] (Storage unit 120) The storage unit 120 is implemented by, for example, a semiconductor memory element such as RAM (Random Access Memory) or flash memory, or a storage device such as a hard disk or optical disc. The storage unit 120 may store, for example, data or programs related to the presentation process according to the embodiment.

[0036] (Control unit 130) The control unit 130 is implemented by a CPU (Central Processing Unit) or MPU (Micro Processing Unit), etc., which executes various programs (for example, an information presentation program according to the embodiment) stored in a memory device inside the in-vehicle device 100 using RAM as the working area. Alternatively, the control unit 130 can be implemented by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

[0037] As shown in Figure 2, the control unit 130 includes an information matching engine 131, an assignment unit 132, a storage unit 133, a request detection unit 134, and a repeat playback control unit 135, and realizes or executes the information processing functions and operations described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in Figure 2, and other configurations are also possible as long as they perform the information processing described later. Also, the connection relationships of the various processing units in the control unit 130 are not limited to the connection relationships shown in Figure 2, and other connection relationships are also possible.

[0038] (Information matching engine 131) As mentioned above, when an app sets condition information regarding playback output, some or all of the conditions may overlap between apps. In other words, the timing of playback output may overlap between different content.

[0039] For example, if each app sets a geographical range, some or all of the geographical ranges may overlap between apps. This can lead to interference in playback output between content corresponding to overlapping geographical ranges. Therefore, the information matching engine 131 determines the appropriate output order and timing among the content whose playback output is reserved.

[0040] For example, the information matching engine 131 predicts the driving status of the vehicle VEx from sensor information related to the vehicle VEx's movement, and calculates the playback output priority for each of the reserved content items based on the prediction result. Then, according to the calculated priority, the information matching engine 131 determines the output order in which to play the multiple content items to the vehicle VEx.

[0041] For example, if the information matching engine 131 detects an overlap in the range to be output, it determines the output order based on the driving status of the vehicle VEx in the range corresponding to the detected overlap. For example, if the information matching engine 131 detects an overlap, it calculates the distance the vehicle VEx travels according to the playback time of the content, based on the driving speed of the vehicle VEx in the range corresponding to the detected overlap, which is the driving speed at a predetermined timing predicted from the sensor information, and the playback time of each content to be output in the range corresponding to the detected overlap. The information matching engine 131 may then determine the output order based on the relationship between the calculated distance and the overlap.

[0042] More specifically, the information matching engine 131 extracts combinations from multiple content pieces of information that, based on distance and relationships, allow for sequential playback output of multiple content pieces without interference at a predetermined timing, and determines the output order for the extracted combinations. For example, the information matching engine 131 may further use the priority calculated for each of the multiple content pieces to extract an appropriate combination from the multiple content pieces, determine the output order for the extracted combinations according to their priority, and control the output from the speaker SP on the in-vehicle device 100 side, which is its own device, according to the output order. At this time, the information matching engine 131 may generate a voice tone corresponding to the application (agent function unit) that provides the content to be output. For example, if the provider of the content to be output is application AP31 (agent function unit 31), the voice that reads out the content may be a female voice V1, and if the provider of the content to be output is application AP32 (agent function unit 32), the voice that reads out the content may be a male voice V2. To this end, speech synthesis parameters for setting the tone of voice, which are associated with each application (agent function unit), may be stored in, for example, the memory unit 120, and the information matching engine 131 may obtain the speech synthesis parameters corresponding to the application (agent function unit) that provides the content to be output from the memory unit 120.

[0043] For example, the information matching engine 131 may determine the output order to play and output content with a higher priority. However, in this case, there may be instances where content with a higher priority is played and output, resulting in some content not being played and output. For instance, at a point where content introducing a store, such as "Turn right at the upcoming XX intersection and proceed 100m, and you will find XX Cafe, famous for its cheesecake," was supposed to be output, urgent traffic information such as "Due to an accident, section △△ of the □□ line is closed. Do you want to reset your route?" may interrupt, resulting in the traffic information content being output first and the store introduction content not being output.

[0044] Among the content that has not been output, there may be content that the user Ux may want to know about later. Therefore, the following processing unit implements a presentation process to help the user Ux appropriately check such unoutputted content at any time.

[0045] (Granting section 132) The assignment unit 132 assigns supplementary information indicating the attributes of un-outputted content to un-outputted content when the timing of playback output overlaps and content with a higher priority is played back. For example, if there is un-outputted content that was not played back because the output conditions were not met while content with a higher priority was being played back, the assignment unit 132 assigns supplementary information to the un-outputted content. The attributes of the un-outputted content may be, for example, the title of the un-outputted content, the category to which the un-outputted content belongs, the playback output priority calculated for the un-outputted content, or information indicating that it was not played back.

[0046] Furthermore, if the information matching engine 131 acquires unoutputted content by playing back content with a higher priority, it may transmit that unoutputted content to the assignment unit 132 each time it acquires it. In this way, when the assignment unit 132 receives unoutputted content from the information matching engine 131, it may add supplementary information to the received unoutputted content.

[0047] In the following, content that was not output or played back will be referred to as "unoutputted content." Additional information attached to unoutputted content will be referred to as "metadata." Content that has been attached to unoutputted content will be referred to as "attached content."

[0048] (Storage unit 133) The storage unit 133 stores the assigned content obtained by metadata assignment by the assignment unit 132 in a state that allows for playback output at any time. For example, the storage unit 133 may store the assigned content on the mobile device 10 by transmitting the assigned content to the mobile device 10, which is an external device from the perspective of the in-vehicle device 100, which is its own device. This point will be explained using user U1 as an example.

[0049] For example, suppose user U1 has registered information about the portable device 10-1 with the in-vehicle device 100-1 installed in their vehicle VE1. In this case, an information presentation system Sy is established between the in-vehicle device 100-1 and the portable device 10-1. That is, information can be sent and received between the in-vehicle device 100-1 and the portable device 10-1 via the network N. In this example, the storage unit 133 of the in-vehicle device 100-1 may transmit the assigned content to the portable device 10-1 via the network N, thereby allowing the portable device 10-1 to store the assigned content. When the portable device 10-1 obtains the assigned content from the in-vehicle device 100-1, it stores the obtained assigned content in, for example, its own storage unit 12.

[0050] Furthermore, an information presentation system Sy does not necessarily have to be established between the in-vehicle device 100 and the portable device 10. For example, user U1 may use the in-vehicle device 100-1 independently without linking it to the portable device 10-1. In such cases, the storage unit 133 of the in-vehicle device 100-1 may store the content already assigned to its own storage unit 120.

[0051] (Request detection unit 134) The request detection unit 134 receives an output request from the user Ux that includes metadata information. For example, the request detection unit 134 detects whether a voice request has been input, which is an output request that requests the playback output of assigned content and includes metadata information. If the request detection unit 134 detects that a voice request has been input, it may detect from the voice request a designation information that specifies which agent function unit of the in-vehicle device 100 is the target of the output request.

[0052] Here, the specified information may be a predetermined word set for each agent function unit of the in-vehicle device 100.

[0053] For example, in the example shown in Figure 2, the designation information defined for the agent function unit 31 may be a wake word indicating the name of the agent function unit 31. Figure 2 shows an example where the name of the agent function unit 31 is "NA1". Therefore, the designation information corresponding to the agent function unit 31 may be the wake word "NA1".

[0054] Similarly, the designation information defined for the agent function unit 32 may be a wake word indicating the name of the agent function unit 32. Figure 2 shows an example where the name of the agent function unit 32 is "NA2". Therefore, the designation information corresponding to the agent function unit 32 may be the wake word "NA2".

[0055] When the request detection unit 134 recognizes speech, it converts the recognized speech into text. Then, the request detection unit 134 determines whether or not the speech is a request by performing intent analysis based on the text obtained through the conversion. For example, the request detection unit 134 can determine that the recognized speech is a request if the text contains keywords indicating a predetermined command (e.g., "tell me," "search," "I want to hear") and keywords indicating the content of the request (e.g., "information not yet output"). In other words, the request detection unit 134 can detect that a voice request has been input.

[0056] Furthermore, when the request detection unit 134 detects a voice request input, it detects whether the voice request contains specification information that specifies the agent function unit to which the voice request is an output request. For example, the request detection unit 134 detects whether the converted text obtained from the voice contains the wake word "NA1" or the wake word "NA2".

[0057] For example, suppose a voice request is input saying, "Agent NA1, tell me the information that hasn't been output!" In this case, the request detection unit 134 can detect the input of the voice request based on the text indicating "Agent NA1, tell me the information that hasn't been output!" and recognize the content of the voice request as "searching for and providing unoutput content corresponding to Agent NA1 (Agent Function Unit 31)."

[0058] (Repeat playback control unit 135) When a user Ux inputs an output request (voice request) that includes metadata, the repeat playback control unit 135 controls the playback output of the assigned content that has metadata corresponding to the output request.

[0059] For example, suppose that the mobile device 10, which is connected to the information presentation system Sy, is storing assigned content in the storage unit 12 in accordance with the control of the storage unit 133. In this case, when an output request containing information indicating metadata is input to the repeat playback control unit 135, the assigned content that has metadata corresponding to the output request is attached to it is acquired from the assigned content by the mobile device 10. As an example, when the in-vehicle device 100 and the mobile device 10 are connected by short-range wireless communication, the repeat playback control unit 135 may acquire assigned content that has metadata corresponding to the output request is attached to it from the assigned content by the mobile device 10 when an output request is input. The repeat playback control unit 135 may also control the acquired assigned content so that it is output from the speaker SP on the in-vehicle device 100 side. At this time, similar to the information matching engine 131, the repeat playback control unit 135 may generate voice tones corresponding to the application (agent function unit) that is the provider of the content to be output. For example, if the source of the content to be output is application AP31 (agent function unit 31), the voice that reads out the content may be a female voice V1, and if the source of the content to be output is application AP32 (agent function unit 32), the voice that reads out the content may be a male voice V2. To this end, the repeat playback control unit 135 may obtain speech synthesis parameters corresponding to the application (agent function unit) that provides the content to be output from, for example, the storage unit 120.

[0060] As another example, suppose that no information presentation system Sy is established between the in-vehicle device 100 and the portable device 10, and the in-vehicle device 100 stores the assigned content in the storage unit 120 in accordance with the control of the storage unit 133. In this case, when the repeat playback control unit 135 receives an output request that includes information indicating metadata, it retrieves the assigned content from the storage unit 120 of its own device that has metadata corresponding to the output request. The repeat playback control unit 135 may also control the system so that the retrieved assigned content is output from the speaker SP of its own device.

[0061] [2. Functional configuration of portable devices] Next, we will describe the portable device 10 according to the embodiment using Figure 2.

[0062] As shown in Figure 2, the portable device 10 includes a microphone MC, a speaker SP, a communication unit 11, a storage unit 12, and a control unit 13.

[0063] (Regarding the microphone MC) The microphone MC collects sounds generated around the user Ux. For example, when used inside a vehicle VEx, the microphone MC collects speech sounds made by passengers.

[0064] (Speaker SP) The speaker SP corresponds to an output means that outputs sound. For example, the speaker SP outputs a response sound corresponding to the utterance input via the microphone MC, in response to presentation control (output control) by the control unit 13.

[0065] (Communications Section 11) The communication unit 11 is implemented by, for example, a NIC. The communication unit 11 is connected to the network N by wire or wireless connection and performs information transmission and reception with, for example, the in-vehicle device 100.

[0066] (Storage unit 12) The storage unit 12 is implemented by, for example, a semiconductor memory element such as RAM (Random Access Memory) or flash memory, or a storage device such as a hard disk or optical disc. The storage unit 120A may store, for example, data or programs related to the presentation process according to the embodiment.

[0067] (Control Unit 13) The control unit 13 is implemented by a CPU or MPU, etc., which executes various programs (for example, an information presentation program according to the embodiment) stored in the storage device inside the portable device 10 using RAM as a working area. Alternatively, the control unit 13 may be implemented by an integrated circuit such as an ASIC or FPGA.

[0068] As shown in Figure 2, the control unit 13 includes an acquisition unit 13a, a storage unit 13b, a request detection unit 13c, a repeat playback control unit 13d, and a display control unit 13e, and realizes or executes the information processing functions and operations described below. Note that the internal configuration of the control unit 13 is not limited to the configuration shown in Figure 2, and other configurations are also possible as long as they perform the information processing described later. Also, the connection relationships of the various processing units in the control unit 13 are not limited to the connection relationships shown in Figure 2, and other connection relationships are also possible.

[0069] (Acquisition part 13a) The acquisition unit 13a acquires unplayed content that was not output because the content with a higher priority was played out due to overlapping timings for content playback output, as well as supplementary information indicating the attributes of the unplayed content.

[0070] For example, it was explained that the storage unit 133 on the in-vehicle device 100 stores the assigned content on the portable device 10 by transmitting the assigned content obtained by the assignment unit 132 to the portable device 10. Therefore, the acquisition unit 13a may acquire the assigned content transmitted from the connected in-vehicle device 100.

[0071] For example, if information can be sent and received between the in-vehicle device 100-1 and the portable device 10-1 via the network N, the storage unit 133 transmits the assigned content to the portable device 10-1 via the network N. In this example, the acquisition unit 13a of the portable device 10-1 acquires the assigned content from the in-vehicle device 100-1.

[0072] (Storage section 13b) The storage unit 13b stores the assigned content acquired by the acquisition unit 13a in a state that allows it to be played back at any time. For example, the storage unit 13b stores the assigned content acquired by the acquisition unit 13a in the storage unit 12 of its own device.

[0073] (Request detection unit 13c) The request detection unit 13c may have the same function as the request detection unit 134 on the in-vehicle device 100 side.

[0074] For example, the request detection unit 13c receives an output request from the user Ux that includes metadata information. For example, the request detection unit 13c detects whether a voice request has been input, which is an output request that requests the playback output of assigned content and includes metadata information. Furthermore, if the request detection unit 13c detects that a voice request has been input, it may detect from the voice request designation information that specifies the agent function unit that the output request targets among the agent function units of the connected in-vehicle device 100. To this end, the request detection unit 13c may obtain a wake word that can be detected by the request detection unit 134 on the in-vehicle device 100 side as designation information that specifies the agent function unit, via communication over the network N.

[0075] (Repeat playback control unit 13d) The repeat playback control unit 13d may have the same function as the repeat playback control unit 135 on the in-vehicle device 100 side.

[0076] When a user Ux inputs an output request (voice request) containing metadata, the repeat playback control unit 13d controls the playback output of the assigned content that has metadata corresponding to the output request. At this time, similar to the repeat playback control unit 135 on the in-vehicle device 100 side, the repeat playback control unit 13d may generate a voice tone corresponding to the application (agent function unit) that is the provider of the content to be output. For example, if the provider of the content to be output is application AP31 (agent function unit 31), the voice that reads out the content may be a female voice V1, and if the provider of the content to be output is application AP32 (agent function unit 32), the voice that reads out the content may be a male voice V2. To this end, while communication between the mobile device 10 and the in-vehicle device 100 is established, the repeat playback control unit 13d may obtain voice synthesis parameters corresponding to the application (agent function unit) that is the provider of the content from the storage unit 120 on the in-vehicle device 100 side and store them in the storage unit 12 on its own side.

[0077] For example, user Ux may input a voice request to the mobile device 10 when the mobile device 10 and the in-vehicle device 100 are far apart and a short-range wireless communication connection has not been established. In such a case, the repeat playback control unit 13d can play back the assigned content acquired from the in-vehicle device 100 that has metadata corresponding to the output request. With the repeat playback control unit 13d, user Ux can check unoutputted content at any location, such as their home, regardless of location.

[0078] (Display control unit 13e) The display control unit 13e displays a list screen in which unoutput content is displayed with attribute information associated with it, based on metadata indicating the attributes of the unoutput content. For example, the display control unit 13e may display a list screen in which unoutput information indicating the attributes of the unoutput content is displayed, and which is controlled so that the corresponding unoutput content is played back in response to user operations. This point will be explained in more detail using the example in Figure 3.

[0079] According to the example in Figure 3, for example, the display control unit 13e generates a list screen G1 in which content information C11 containing unoutput information such as the title "TL11" and category "Traffic Information", content information C12 containing unoutput information such as the title "TL12" and category "Weather Forecast", and content information C13 containing unoutput information such as the title "TL13" and category "Tourist Information". The display control unit 13e then controls the generated list screen G1 to be displayed on the display screen of the portable device 10.

[0080] In addition, on the list screen G1, the content information C11, C12, and C13 may be arranged from top to bottom in order of scheduled output date and time, or in order of priority.

[0081] Furthermore, when the user requests the display of a list screen, the display control unit 13e may generate the list screen G1 as described above and display it on the display screen of the portable device 10. In addition, if the user selects content information C11 in this state, the unoutput content NOP-C11 is played back. If the user selects content information C12, the unoutput content NOP-C12 is played back, and if the user selects content information C13, the unoutput content NOP-C13 is played back.

[0082] [3. Memory Unit Configuration] Here, using Figure 3, the structure of data stored in the storage unit 120 of the in-vehicle device 100 and the storage unit 12 of the portable device 10 will be explained. The structure of the data stored in the storage unit 120 and the storage unit 12 may be a common structure. Figure 3 is a diagram showing an example of the structure of data stored in the storage unit according to the embodiment. In the example of Figure 3, the data stored in the storage unit 120 (12) includes items such as "User ID", "Target Agent Information", "Scheduled Output Date and Time", "Unoutput Content", and "Metadata". In addition, "Metadata" may include items such as "Title", "Category", and "Priority".

[0083] The "User ID" represents identification information that identifies the user who is building the information presentation system Sy by linking the in-vehicle device 100 and the portable device 10. The user indicated by the "User ID" can be rephrased as, for example, the owner of the vehicle VEx in which the in-vehicle device 100 is installed, or the owner of the portable device 10. Therefore, the "User ID" may be either identification information that identifies the in-vehicle device 100, or identification information that identifies the portable device 10.

[0084] "Target Agent Information" refers to information about the agent function unit (application) that initially requested the information matching engine 131 to play back content that is currently "unoutput content" within the range indicated by the output conditions. "Target Agent Information" may include various information such as the name (wake word) of the agent function unit and the type of application corresponding to the agent function unit.

[0085] "Scheduled output date and time" refers to the date and time when the "unoutputted content" was scheduled to be output.

[0086] "Unoutputted content" refers to data for content that was scheduled to be output for playback at the date and time indicated by the "Scheduled Output Date and Time," but was not output because the output conditions were not met while other content was being prioritized for playback at that time.

[0087] Figure 3 shows an example where the target agent information "31", the scheduled output date and time "DAY1", and the unoutput content "NOP-C11" are associated. This example shows that the agent function unit 31 requested the playback output of content information C11 using the output conditions, but it was not output and is managed as unoutput content NOP-C11. This example also shows that the unoutput content NOP-C11 was initially scheduled to be played back on "DAY1" based on the output conditions.

[0088] "Title" indicates the title of the "unoutputted content". "Category" indicates the category (genre) to which the "unoutputted content" belongs. "Priority" indicates the output priority calculated for the "unoutputted content". Figure 3 shows an example where the unoutputted content "NOP-C11", title "TL11", category "Traffic Information", and priority "#1" are associated. This example shows that the title "TL11", category "Traffic Information", and priority "#1" are assigned as metadata to the unoutputted content "NOP-C11".

[0089] [4. Granting Procedure] From here, we will explain the metadata assignment procedure performed by the assignment unit 132 using Figure 4. Figure 4 is a flowchart of the metadata assignment procedure.

[0090] First, the assignment unit 132 determines whether it is time to assign metadata (step S401). For example, the assignment unit 132 may determine whether it is time to assign metadata based on whether it has received unoutputted content from the information matching engine 131. For example, if the assignment unit 132 receives unoutputted content from the information matching engine 131, it may determine that it is time to assign metadata to that unoutputted content.

[0091] The assignment unit 132 waits until it can determine that it is not yet time to assign metadata (step S401; No), while it has determined that it is not yet time to assign metadata.

[0092] On the other hand, if the assignment unit 132 determines that it is time to assign metadata (step S401; Yes), it obtains information about the unoutput content to which the metadata will be assigned (step S402). For example, the assignment unit 132 may obtain attribute information indicating the attributes of the unoutput content as information about the unoutput content. For example, the assignment unit 132 may obtain the title, category, etc., of the unoutput content. For example, the assignment unit 132 may obtain attribute information from the information matching engine 131.

[0093] Next, the assignment unit 132 assigns attribute information as metadata to the unoutputted content (step S403).

[0094] Then, the storage unit 133 transmits the assigned content to the mobile device 10, which is connected to the information presentation system Sy, thereby storing the assigned content in the mobile device 10 (step S404).

[0095] Although not shown in Figure 4, the acquisition unit 13a of the portable device 10 acquires the assigned content with metadata attached from the in-vehicle device 100, and the storage unit 13b stores the acquired assigned content in the storage unit 12. The assigned content may include target agent information and the scheduled output date and time, and as a result, the portable device 10 can store data like that shown in Figure 3 in the storage unit 12.

[0096] Furthermore, if the information presentation system Sy has not been generated and the in-vehicle device 100 is being used independently, the storage unit 133 may store the assigned content in the storage unit 120 of its own device. As a result, the in-vehicle device 100 will be able to store data as shown in Figure 3 in the storage unit 120.

[0097] [5. Presentation Processing Procedure] Next, the procedure for the presentation process according to the embodiment will be described using Figures 5 and 6.

[0098] Figure 5 illustrates the presentation processing procedure using a scenario in which user U1 inputs a voice request into their portable device 10-1 with the aim of checking unoutputted content at home.

[0099] On the other hand, Figure 6 illustrates the presentation processing procedure using a scenario in which user U1, while riding in vehicle VE1, inputs a voice request to the in-vehicle device 100-1 for the purpose of checking for unoutputted content.

[0100] In the examples of Figures 5 and 6, the agent function unit of the in-vehicle device 100-1 is referred to by its name. For example, as shown in Figure 2, the in-vehicle device 100-1 may have an agent function unit 31, and the agent function unit 31 is referred to as "Agent N1".

[0101] [5-1. Presentation Processing Procedure (1)] First, let's explain Figure 5. Figure 5 is a flowchart (1) showing the presentation processing procedure according to the embodiment. In the example of Figure 5, in response to the operation of user U1, the in-vehicle device 100-1 and the portable device 10-1 can communicate in the information presentation system Sy. As a result, it is assumed that the portable device 10-1 already has assigned content according to the assignment procedure described in Figure 4. For example, the portable device 10-1 has assigned content for each agent in the storage unit 12. However, in the example of Figure 5, user U1 is at home, and the portable device 10-1 and the in-vehicle device 100-1 are far apart, and a communication connection has not been established between them.

[0102] In this situation, suppose user U1 speaks to the portable device 10-1 and says, "Agent NA1, tell me the information that hasn't been outputted!"

[0103] If the request detection unit 13c recognizes speech, it detects whether a voice request, which is an output request requesting the playback output of assigned content, has been input (step S501). If the request detection unit 13c detects that something has been spoken but is not a voice request input (step S501; No), it waits until it can detect a voice request input.

[0104] On the other hand, in the example shown in Figure 5, the request detection unit 13c can detect the wake word "NA1", the keyword "information not output" related to unoutput content, and the command "tell me" by converting the recognized voice into text. Therefore, in the example shown in Figure 5, the request detection unit 13c detects from the detection results that a voice request RQ11 requesting the playback output of the assigned content has been input (step S501; Yes), and proceeds to step S502.

[0105] The request detection unit 13c detects the agent targeted by the voice request RQ11 (output request) based on the wake word included in the voice request RQ11 (step S502). The request detection unit 13c acquires wake words that can be detected as designation information for specifying the agent function unit by the request detection unit 134 on the in-vehicle device 100 side while communication over the network N is established, and identifies the target agent by detecting that the acquired wake word is included in the utterance. In the example in Figure 5, the request detection unit 13c can detect agent NA1 as the agent function unit targeted by the output request based on the wake word "NA1".

[0106] Next, the repeat playback control unit 13d recognizes the assigned content associated with the target agent NA1 (target agent NA1) in the output request (step S503). For example, the repeat playback control unit 13d refers to the storage unit 12 and recognizes the assigned content associated with the target agent NA1. The assigned content associated with agent NA1 is content that agent NA1 requested playback output from the information matching engine 131 using output conditions, but which was not output and remained unoutput.

[0107] Next, the repeat playback control unit 13d controls the output of the number of recognized assigned content items and information based on the metadata assigned to the assigned content (step S504). The information based on the metadata assigned to the assigned content may be, for example, the title assigned as metadata to the assigned content.

[0108] Therefore, the repeat playback control unit 13d may generate a sentence consisting of the number of assigned content items and the title of each assigned content item, and may output the generated sentence in the voice of agent NA1.

[0109] For example, suppose the number of assigned content items corresponding to agent NA1 is "3", and using the example in Figure 3, the title of the first assigned content item is "TL1", the title of the second assigned content item is "TL2", etc. In such a case, the repeat playback control unit 13d may generate a response message AN11 that says, "There are 3 pieces of information that have not been output. The first is "TL1". The second is "TL2". ... Which item would you like to play?"

[0110] Furthermore, the repeat playback control unit 13d may synthesize an audio recording of the generated response sentence AN11 being read aloud in a female voice V1, which is set as the voice of agent NA1. The repeat playback control unit 13d may synthesize an audio recording of the response sentence AN11 being read aloud based on the speech synthesis parameters corresponding to agent NA1, which were acquired while communication via the network N was established. Then, as shown in Figure 5, the repeat playback control unit 13d outputs the synthesized audio from the speaker SP of its own portable device 10-1.

[0111] The repeat playback control unit 13d may also generate a sentence that further combines the categories of each assigned content, such as, "There are 3 pieces of information that have not yet been output. The first is tourist information 'TL1'. The second is weather forecast 'TL2'. ...Which piece would you like to play?", and output this audio.

[0112] In this situation, suppose user U1 says to the portable device 10-1, "Agent NA1, let me hear the second 'TL2'!"

[0113] If the request detection unit 13c recognizes speech, it may, for example, detect whether a voice request has been input that specifies the content to be output from among the assigned content (step S505).

[0114] If the request detection unit 13c detects that a spoken word is not a voice request input (step S505; No), it waits until it can detect a voice request input. Furthermore, if no voice request is input after waiting for a certain period, the request detection unit 13c may terminate the process.

[0115] On the other hand, in the example shown in Figure 5, the request detection unit 13c can detect the title "TL2" which is attached as metadata by converting the recognized audio into text. Therefore, in the example shown in Figure 5, the request detection unit 13c detects from the detection result that an audio request RQ12 specifying the content to be output from the attached content has been input (step S505; Yes), and proceeds to step S506.

[0116] The repeat playback control unit 13d extracts the assigned content specified by the metadata information (i.e., the title "TL2") included in the voice request RQ12 from the storage unit 12 as the content to be output (step S506). Using the example in Figure 3, the repeat playback control unit 13d can extract the assigned content NOP-C12 as the content to be output.

[0117] Then, the repeat playback control unit 13d controls the output so that the extracted assigned content NOP-C12 is output (step S507). For example, the repeat playback control unit 13d may control the output so that the assigned content NOP-C12 is output in the voice of agent NA1 based on text data indicating the assigned content NOP-C12. For example, the repeat playback control unit 13d may generate a response sentence AN12 indicating the content of the assigned content NOP-C12.

[0118] Furthermore, the repeat playback control unit 13d may synthesize a voice in which the generated response sentence AN12 is read aloud in a female voice V1. Then, as shown in Figure 5, the repeat playback control unit 13d outputs the synthesized voice from the speaker SP of its own portable device 10-1.

[0119] Up to this point, the procedure for the presentation process according to the embodiment has been explained using Figure 5. As shown in the example in Figure 5, user Ux can check unoutputted content anytime and anywhere, as long as they have the portable device 10, and even if the portable device 10 and the in-vehicle device 100 are not connected by short-range wireless communication.

[0120] [5-2. Presentation Processing Procedure (2)] Next, Figure 6 will be explained. Figure 6 is a flowchart (2) showing the presentation processing procedure according to the embodiment. In the example of Figure 6, the in-vehicle device 100-1 and the portable device 10-1 can communicate in the information presentation system Sy in response to the operation of user U1. The difference from Figure 5 is that in the example of Figure 6, user U1 is in vehicle VE1 with the portable device 10-1 in their possession and is trying to check unoutputted content inside the vehicle.

[0121] Thus, when the in-vehicle device 100-1 and the portable device 10-1 are within a certain distance of each other, the in-vehicle device 100-1 and the portable device 10-1 may be connected by short-range wireless communication. When each device is connected by short-range wireless communication in this manner, the response audio may be output primarily from the speaker SP on the in-vehicle device 100-1.

[0122] For example, suppose in this situation, user U1 speaks to the in-vehicle device 100-1 saying, "Agent NA1, tell me the information that hasn't been outputted!" Here, the processing procedure described in Figure 5 as being performed by the request detection unit 13c and the repeat playback control unit 13d of the portable device 10-1 is performed by the request detection unit 134 and the repeat playback control unit 135 in the example in Figure 6. Therefore, in Figure 6, detailed explanations are omitted, and the same step numbers as in Figure 5 are used.

[0123] However, after step S502, the repeat playback control unit 135 acquires the assigned content associated with the agent NA1 targeted by the output request from the connected portable device 10-1 via short-range wireless communication (step S603). The storage unit 133 may store the assigned content acquired from the portable device 10-1 in the storage unit 120.

[0124] Then, in step S504, the repeat playback control unit 135 controls the output of the number of acquired assigned content items and information based on the metadata attached to the assigned content. For example, the repeat playback control unit 135 may generate a response sentence AN11 and synthesize an audio recording of the generated response sentence AN11 being read aloud in a female voice V1. Then, as shown in Figure 6, the repeat playback control unit 135 outputs the synthesized audio from the speaker SP of the in-vehicle device 100-1, which is itself.

[0125] In step S505, if the request detection unit 134 has recognized speech, it may, for example, detect whether a voice request specifying the content to be output from the assigned content has been input. In the example in Figure 6, the request detection unit 134 detects that a voice request RQ12 specifying the content to be output from the assigned content has been input.

[0126] In step S506, the repeat playback control unit 135 extracts the assigned content specified by the metadata information (i.e., the title "TL2") included in the voice request RQ12 from the storage unit 120 as the content to be output. Using the example in Figure 3, the repeat playback control unit 135 can extract the assigned content NOP-C12 as the content to be output.

[0127] In step S507, the repeat playback control unit 135 controls the output of the extracted assigned content NOP-C12. For example, the repeat playback control unit 135 may generate a response message AN12 that indicates the content of the assigned content NOP-C12.

[0128] Furthermore, the repeat playback control unit 135 may synthesize a voice in which the generated response sentence AN12 is read aloud in a female voice V1. Then, as shown in Figure 6, the repeat playback control unit 135 outputs the synthesized voice from the speaker SP of its own in-vehicle device 100-1.

[0129] Up to this point, the procedure for the presentation process according to the embodiment has been explained using Figure 6. In the example of Figure 6, the user Ux can check the unoutput content stored in the portable device 10 via the speaker SP of the in-vehicle device 100 by operating on the in-vehicle device 100. Therefore, the user Ux can easily check the unoutput content even in situations such as when the portable device 10 is stored in a bag and cannot be taken out of the bag while driving.

[0130] [6. Restriction lifted] The information display device 100, which has been described as an in-vehicle device, may also be a portable terminal device that is used daily by the user Ux. Therefore, the portable device 10 described so far may also be implemented as the information display device 100. In such an example, one portable device 10 may be installed on the dashboard of the vehicle VEx as a substitute for a navigation device, etc., while the other portable device 10 is carried and used for its intended purpose.

[0131] Up to this point, we have described an example in which the information display device 100, due to overlapping playback output timings, plays back content with a higher priority, and as a result, adds metadata indicating the attributes of the unplayed content, stores it in the storage unit in a state where it can be played back at any time, and when the information display device 100 or the portable device 10 receives an output request from the user that includes information indicating metadata, it plays back the unplayed content with metadata corresponding to the output request from the storage unit. However, the content stored in the storage unit and played back in response to user input is not limited to unplayed content. For example, in addition to unplayed content, output content that has already been output by the information display device 100 may also be stored in the storage unit and played back in response to user input. In this case, the addition unit 132 of the information display device 100 will also add metadata indicating the attributes of the content to the output content, and the storage unit 133 of the information display device 100 or the storage unit 13b of the portable device 10 will store the output content with metadata added in the storage unit in a state where it can be played back at any time. Then, when a user inputs an output request that includes metadata, the repeat playback control unit 135 of the information display device 100, or the repeat playback control unit 13d of the portable device 10, should play back the output content from the storage unit to which the metadata corresponding to the output request has been added.

[0132] <Other> [1. Hardware Configuration] Furthermore, the information display device 100 and information processing device 10 described above are implemented by a computer 1000 having a configuration such as that shown in Figure 7. The following explanation will use the information display device 100 as an example. Figure 7 is a hardware configuration diagram showing an example of a computer that implements the functions of the information display device 100. The computer 1000 has a CPU 1100, RAM 1200, ROM 1300, HDD 1400, communication interface (I / F) 1500, input / output interface (I / F) 1600, and media interface (I / F) 1700.

[0133] The CPU 1100 operates based on programs stored in the ROM 1300 or HDD 1400, controlling various components. The ROM 1300 stores boot programs executed by the CPU 1100 when the computer 1000 starts up, as well as programs that depend on the computer 1000's hardware.

[0134] The HDD1400 stores programs executed by the CPU1100, as well as data used by such programs. The communication interface1500 receives data from other devices via a predetermined communication network and sends it to the CPU1100, and transmits data generated by the CPU1100 to other devices via the predetermined communication network.

[0135] The CPU 1100 controls output devices such as displays and input devices such as keyboards via the input / output interface 1600. The CPU 1100 acquires data from input devices via the input / output interface 1600. The CPU 1100 also outputs the generated data to output devices via the input / output interface 1600.

[0136] The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase Change Rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0137] For example, when the computer 1000 functions as an information display device 100 according to the embodiment, the CPU 1100 of the computer 1000 realizes the functions of the control unit 130 by executing a program loaded on the RAM 1200. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, these programs may be obtained from other devices via a predetermined communication network.

[0138] Furthermore, when the computer 1000 functions as an information processing device 10 according to the embodiment, the CPU 1100 of the computer 1000 realizes the functions of the control unit 13 by executing programs loaded on the RAM 1200. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, these programs may be obtained from other devices via a predetermined communication network.

[0139] [2. Others] Furthermore, among the processes described in each of the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, specific names, and information including various data and parameters shown in the above document and drawings can be changed at will unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown.

[0140] Furthermore, the components of each illustrated device are functionally conceptual and do not necessarily need to be physically configured as shown. In other words, the specific forms of distribution and integration of each device are not limited to those shown, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads and usage conditions.

[0141] Furthermore, the above embodiments can be combined as appropriate, provided that the processing content is not contradictory.

[0142] <Summary> Although some embodiments of the present invention have been described in detail above with reference to the drawings, these are illustrative examples, and the present invention can be implemented in various other forms with modifications and improvements based on the knowledge of those skilled in the art, starting with the embodiments described in the disclosure section of the invention. [Explanation of Symbols]

[0143] 1 System Sy Information Presentation System 10. Information Processing Devices (Portable Devices) 12 Storage section 13 Control Unit 13a Acquisition part 13b Storage section 13c Request Detection Unit 13d Repeat Playback Control Unit 13e Display Control Unit 100 Information presentation device (vehicle device) 130 Control Unit 131 Information Integrity Engine 132 Granting section 133 Storage section 134 Request Detection Unit 135 Repeat Playback Control Unit 300 Agent Devices

Claims

1. An information display device that, when the timing for playing and outputting content overlaps, prioritizes playing and outputting one piece of content according to the priority of each piece of content, The aforementioned timing overlap resulted in higher priority content being played and output, and as a result, the unplayed content was not output. This unit adds supplementary information indicating the attributes of the unplayed content. A storage unit that stores the attached content with the aforementioned supplementary information in a state that allows it to be played back at any time, When a user inputs an output request that includes the aforementioned supplementary information, a control unit controls the playback output of the supplementary content to which the supplementary information corresponding to the output request is attached from among the supplementary content. It has, The storage unit transmits the assigned content to an external device, thereby causing the external device to store the assigned content. When the output request is received, the control unit retrieves from the external device the assigned content to which the accompanying information corresponding to the output request has been added. An information display device characterized by the following features.

2. The aforementioned assignment unit, if there is any un-outputted content that was not played back because the output conditions were not met while higher-priority content was being played back, assigns the aforementioned supplementary information to the un-outputted content. The information display device according to feature 1.

3. The attribute assignment unit assigns the attribute information to indicate one of the following: the title of the content, the category to which the content belongs, or the playback output priority calculated for the content. The information display device according to feature 1.

4. The control unit controls the output means of the information display device so that the assigned content corresponding to the output request is output. The information display device according to feature 1.

5. An information presentation method executed by an information presentation device that, when the timing for playing and outputting content overlaps, prioritizes playing and outputting one piece of content according to the priority of each piece of content, The process involves adding supplementary information indicating the attributes of the unplayed content to the unplayed content that was not played due to the overlapping timings resulting in the playback of higher-priority content, and A storage step in which the content to which the aforementioned supplementary information is attached is stored in a state that can be played back at any time, When an output request including the aforementioned supplementary information is input by the user, a control step is taken to control the playback output of the supplementary content to which the supplementary information corresponding to the output request is attached from among the supplementary content. Includes, The storage step involves transmitting the assigned content to an external device, thereby causing the external device to store the assigned content. When the output request is received, the control step retrieves from the external device the assigned content to which the accompanying information corresponding to the output request has been added. A method for presenting information characterized by the following features.

6. An information presentation program executed by an information presentation device that, when the timing for playing and outputting content overlaps, prioritizes playing and outputting one piece of content according to the priority of each piece of content, A procedure for adding supplementary information indicating the attributes of the unplayed content to the unplayed content that was not played due to the overlapping timings resulting in the playback output of content with a higher priority, A storage procedure for storing the attached content, to which the aforementioned supplementary information has been added, in a state that allows it to be played back at any time; When a user inputs an output request that includes information indicating the aforementioned supplementary information, a control procedure is provided to control the playback output of the supplementary content among the supplementary content to which the supplementary information corresponding to the output request is attached. The information display device is made to perform the following: The storage procedure involves transmitting the assigned content to an external device, thereby causing the external device to store the assigned content. The control procedure, when the output request is received, retrieves from the external device the assigned content to which the accompanying information corresponding to the output request has been added. An information presentation program characterized by the following features.

Images