Information providing apparatus and information receiving apparatus

Abstract

To provide an information providing apparatus or the like capable of providing information that a user preferentially desires in a form that is easy for the user to understand.SOLUTION: An information providing apparatus according to the present disclosure comprises: an input information acquisition unit for acquiring input information input by a user; a providing structure construction unit for constructing a providing form suitable for a response form desired by a user with respect to multimedia information including at least one of a text, an image, and a sound; and a providing unit for providing, to the user, providing information created based on response candidates to the user that is prepared based on an analysis result of the input information and an analysis result of the multimedia information and the providing form that is constructed by the providing structure construction unit.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an information providing device and an information receiving device that provide multimedia information including at least one of text, image, and sound to an unspecified number of users. [Background technology]

[0002] As a conventional information providing device, for example, a technique has been disclosed in which video information is managed in segments, and parts of the information that interest the user are extracted and provided to the user (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2000-250944 A Summary of the Invention [Problem to be solved by the invention]

[0004] The technology in Patent Document 1 uses the user's preferences to display information that the user is interested in, but the format in which the information is displayed is the same for all users. Therefore, it cannot be said that the information that the user prefers is provided in a format that the user can easily understand.

[0005] The present disclosure has been made to solve such problems, and aims to provide an information providing device and an information receiving device that are capable of providing the information that a user preferentially desires in a format that is easy for the user to understand. [Means for solving the problem]

[0006] In order to solve the above problems, the information providing device according to the present disclosure includes an input information acquisition unit that acquires input information input by a user, a provision structure construction unit that constructs a provision form that matches the answer form desired by the user for multimedia information including at least one of text, image, and sound, and a provision unit that provides the user with provision information created based on answer candidates for the user prepared based on the analysis results of the input information and the analysis results of the multimedia information and the provision form constructed by the provision structure construction unit. Effect of the Invention

[0007] According to the present disclosure, it is possible to provide information that a user preferentially desires in a format that is easy for the user to understand.

[0008] The objects, features, aspects, and advantages of the present disclosure will become more apparent from the following detailed description and the accompanying drawings. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing an example of a configuration of an information providing device according to a first embodiment. [Diagram 2] 2 is a diagram illustrating an example of a hardware configuration of the information providing device according to the first embodiment. [Diagram 3] 5 is a flowchart showing an example of the operation of the information providing device according to the first embodiment. [Figure 4] FIG. 2 is a diagram showing an example of a provided structure according to the first embodiment. [Diagram 5] FIG. 2 is a diagram showing an example of a provided structure according to the first embodiment. [Figure 6] FIG. 2 is a diagram showing an example of a provided structure according to the first embodiment. [Figure 7] FIG. 2 is a diagram showing an example of a provided structure according to the first embodiment. [Figure 8] FIG. 2 is a diagram showing an example of a provided structure according to the first embodiment. [Figure 9] FIG. 2 is a diagram showing an example of a provided structure according to the first embodiment. [Figure 10] FIG. 2 is a diagram showing an example of a provided structure according to the first embodiment. [Figure 11] FIG. 2 is a diagram showing an example of a provided structure according to the first embodiment. [Figure 12] FIG. 11 is a block diagram showing an example of a configuration of an information providing device according to a second embodiment. [Figure 13] 10 is a flowchart showing an example of the operation of the information providing device according to the second embodiment. [Figure 14] FIG. 11 is a block diagram showing an example of a configuration of an information providing device according to a third embodiment. [Figure 15] 13 is a flowchart showing an example of the operation of the information providing device according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] The present disclosure can be implemented in many different forms, and the embodiments described below are not intended to limit the present disclosure.

[0011] <Embodiment 1> <1-1. Configuration> Fig. 1 is a block diagram showing an example of a configuration of an information providing device according to embodiment 1. As shown in Fig. 1, the information providing device according to embodiment 1 includes an input information acquiring unit 10, an input information database 20, a multimedia information database 30, an input information analyzing unit 40, a multimedia information analyzing unit 50, a similarity calculating unit 60, a user information database 70, a user preference determining unit 71, a provision structure constructing unit 72, a provision information creating unit 80, a providing unit 81, and a preference information receiving unit 90.

[0012] 1, for convenience of explanation, the input information database 20, the multimedia information database 30, and the user information database 70 are shown separately, but they may be physically or virtually divided into one or more. Also, since the multimedia information database 30 receives and records multimedia information, and the user information database 70 receives and records user information, the information providing device according to the first embodiment can also be said to be an information receiving device that receives information.

[0013] The input information acquisition unit 10 acquires input information input by a user. In the following description, the input information is assumed to be search information input by a user to search for desired multimedia information. The search information acquired by the input information acquisition unit 10 is linked to the user who input the search information and recorded in the input information database 20. The input information database 20 stores search information input by multiple users, linked to each user.

[0014] The multimedia information database 30 records a plurality of pieces of multimedia information to be provided to the user. The multimedia information includes at least one of text, image, and sound. The multimedia information may be recorded (registered) in advance in the multimedia information database 30, or may be added at any time.

[0015] The input information analysis unit 40 analyzes the input information recorded in the input information database 20. The multimedia information analysis unit 50 analyzes the multimedia information recorded in the multimedia information database 30.

[0016] The similarity calculation unit 60 calculates the similarity between the input information analyzed by the input information analysis unit 40 and the multimedia information analyzed by the multimedia information analysis unit 50 .

[0017] The user information database 70 records user information including the attributes and preferences of the user. The attributes and expertise that can be collected when the user registers for use may be registered in advance in the user information database 70. Examples of user attributes include gender, age, work history, occupation, and characteristics.

[0018] The user preference determination unit 71 determines the user's preference for multimedia information based on the user information recorded in the user information database 70 .

[0019] The provision structure construction unit 72 constructs a provision structure for providing multimedia information to the user, based on the user's preferences determined by the user preference determination unit 71. The provision information creation unit 80 creates provision information to be provided to the user, based on the similarity calculated by the similarity calculation unit 60 and the provision structure constructed by the provision structure construction unit 72.

[0020] The providing unit 81 provides the user with the provided information created by the provided information creating unit 80. The preference information receiving unit 90 receives user preference information for the provided information provided by the providing unit 81. The user preference information received by the preference information receiving unit 90 is information on the user's behavior with respect to the provided information provided by the providing unit 81, and is recorded in the user information database 70.

[0021] A general computer system can be used for each function of the information providing device shown in Fig. 1. Fig. 2 is a diagram showing an example of a hardware configuration of the computer system of the information providing device according to the first embodiment.

[0022] 2, the computer system includes an information input / output unit 300 and a calculation unit 400. The information input / output unit 300 and the calculation unit 400 may be connected via a communication network.

[0023] The information input / output unit 300 includes a display 200, a speaker 210, and a keyboard 220. The input information acquiring unit 10 acquires input information input by a user using the keyboard 220. The preference information receiving unit 90 acquires preference information input by a user using the keyboard 220. The display 200 and the speaker 210 correspond to the providing unit 81.

[0024] The calculation unit 400 includes a processor 230, a memory 240, and a hard disk drive (HDD) 250. The HDD 250 corresponds to the input information database 20, the multimedia information database 30, and the user information database .

[0025] The functions of the input information acquisition unit 10, the input information analysis unit 40, the multimedia information analysis unit 50, the similarity calculation unit 60, the user preference determination unit 71, the provision structure construction unit 72, the provision information creation unit 80, and the preference information reception unit 90 may be realized by a processing circuit (not shown). The processing circuit may be dedicated hardware, or may be a processor (also called a CPU, central processing unit, processing unit, arithmetic unit, microprocessor, microcomputer, or DSP (Digital Signal Processor)) that executes a program stored in a memory.

[0026] When the processing circuit is a dedicated hardware, the processing circuit may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination of these. Each function of the input information acquisition unit 10, the input information analysis unit 40, the multimedia information analysis unit 50, the similarity calculation unit 60, the user preference determination unit 71, the provision structure construction unit 72, the provision information creation unit 80, and the preference information reception unit 90 may be realized by a processing circuit, or each function may be realized together by one processing circuit.

[0027] When the processing circuit is the processor 230 shown in FIG. 2, the functions of the input information acquisition unit 10, the input information analysis unit 40, the multimedia information analysis unit 50, the similarity calculation unit 60, the user preference determination unit 71, the provision structure construction unit 72, the provision information creation unit 80, and the preference information reception unit 90 are realized by software, firmware, or a combination of software and firmware. The software or firmware is written as a program and stored in the memory 240 or the HDD 250. The processor 230 realizes each function by reading and executing the program recorded in the memory 240 or the HDD 250. Here, the memory may be, for example, a non-volatile or volatile semiconductor memory such as a random access memory (RAM), a read only memory (ROM), a flash memory, an erasable programmable read only memory (EPROM), an electrically erasable programmable read only memory (EEPROM), a magnetic disk, a flexible disk, an optical disk, a compact disk, a digital versatile disk (DVD), or any storage medium to be used in the future.

[0028] In addition, with regard to each function of the input information acquisition unit 10, the input information analysis unit 40, the multimedia information analysis unit 50, the similarity calculation unit 60, the user preference determination unit 71, the provision structure construction unit 72, the provision information creation unit 80, and the preference information receiving unit 90, some of the functions may be realized by dedicated hardware, and other functions may be realized by software or firmware.

[0029] Furthermore, the configuration of the computer system shown in Figure 2 is just one example, and as long as the configuration realizes the information providing device of embodiment 1, a Braille terminal, multiple processors, a solid-state drive, or a data input / output device may be substituted for or added to other components.

[0030] <1-2. Operation> FIG. 3 is a flowchart showing an example of the operation (information providing method) of the information providing device according to the first embodiment.

[0031] A user registers user information including his / her attributes and preferences (step S10). The user information registered by the user is recorded in a user information database 70.

[0032] The input information acquiring unit 10 acquires input information input by a user (step S20). In the following description, it is assumed that the input information is search information.

[0033] For example, a user may input a sentence (text sentence) or a word as search information using a computer keyboard, may input a sentence or an image as search information by transcribing the sentence or image using a mouse, or may input sound information as search information using a microphone. The search information acquired by the input information acquisition unit 10 is recorded in the input information database 20.

[0034] The multimedia information is recorded in the multimedia information database 30 (step S30).

[0035] The input information analysis unit 40 analyzes the search information recorded in the input information database 20 (step S40). When the search information is text information, the input information analysis unit 40 analyzes the text information by, for example, morphological analysis, syntactic analysis, part of speech analysis, anaphora analysis, or discourse analysis. When the search information is image information, the input information analysis unit 40 analyzes the image information by, for example, feature analysis, pattern recognition, image processing, image database, computer vision, or visualization. When the search information is sound information, the input information analysis unit 40 analyzes the sound information by, for example, frequency analysis, spectrogram analysis, acoustic analysis, or voice recognition. When the search information is video information, the input information analysis unit 40 analyzes the video information by, for example, feature analysis, pattern recognition, image processing, image database, computer vision, visualization, frequency analysis, spectrogram analysis, acoustic analysis, or voice recognition, which are the same analysis as image information or sound information, as well as time series data.

[0036] The input information analysis section 40 may analyze multimodal information, such as a combination of text information and image information, or a combination of image information and sound information, by appropriately combining a plurality of the above analysis methods.

[0037] In the above, the search information recorded in the input information database 20 is described as text information, image information, sound information, or video information, but is not limited thereto. The search information may be information other than these. In this case, the input information analysis unit 40 performs an analysis according to each piece of information.

[0038] In the following, an example will be described in which the search information is text information.

[0039] The input information analysis unit 40 performs a morphological analysis on the sentence input by the user as search information, and breaks the sentence into words (step S40).

[0040] Meanwhile, multimedia information including at least one of sentences (text), images, and sounds to be searched is recorded (stored) in advance in the multimedia information database 30 (step S30). The multimedia information analysis unit 50 performs an analysis of the multimedia information recorded in the multimedia information database 30 in the same manner as the input information analysis unit 40 does (step S50).

[0041] The similarity calculation unit 60 calculates the similarity between the search information and the multimedia information based on the analysis result of the input information analysis unit 40 and the analysis result of the multimedia information analysis unit 50 (step S60).

[0042] For example, the similarity calculation unit 60 compares the words broken down by the input information analysis unit 40 through morphological analysis with the analysis results of the multimedia information analysis unit 50, starting with the words that are most frequently repeated in the sentences that are the search information.

[0043] Weighting is applied to each word decomposed by the input information analysis unit 40 through morphological analysis. This weighting may be set arbitrarily, and for example, a weight expressed by the following formula (1) may be added to each word. In formula (1), the weight of word t is Xt, the number of occurrences of the word in the sentence is nt, and the sum of the number of occurrences of all words in the sentence is S. Xt = nt / S (1)

[0044] The weights added to words are not limited to those mentioned above, and may be changed based on user preference information (described later). In addition, a part-of-speech analysis may be performed to weight specific parts of speech or characteristic words, such as nouns, verbs, or numbers, while the other weights may be set to 0.

[0045] The similarity calculation unit 60 then determines that the more the same words (words that are the analysis results of the input information analysis unit 40) are included in a sentence (sentence included in the multimedia information), the higher the correlation (similarity) between the search information and the multimedia information. At this time, the similarity calculation unit 60 takes into consideration the weighting added to each word. The similarity calculation unit 60 also determines the multimedia information with a similarity equal to or greater than a predetermined threshold value as a candidate for information to be provided to the user (answer candidate).

[0046] The similarity calculation section 60 has a function of preparing answer candidates for the user, and it is desirable that the system be able to dynamically change the calculation algorithm based on the user's reaction to the answers.

[0047] After the similarity calculation unit 60 calculates the similarity, the user preference determination unit 71 determines the user's preference (the type of response desired by the user) based on the user information recorded in the user information database 70 (step S70). Note that the determination of the user's preference by the user preference determination unit 71 may be performed in parallel with the determination of the similarity by the similarity calculation unit 60, or may be performed prior to the determination of the similarity.

[0048] The provision structure constructing unit 72 constructs a provision structure (answer structure) that matches the user's preferences determined by the user preference determining unit 71 (step S70).

[0049] For example, if the user is engaged in a technical occupation, the provision structure construction unit 72 constructs a summary (seeds information) of a technical document as a provision structure as shown in Fig. 4. If the user is engaged in a sales-related occupation, the provision structure construction unit 72 constructs expert information as shown in Fig. 5 as a provision structure.

[0050] In addition, when information on the user's preferences is stored in the user information database 70, the provision structure may include information that was displayed frequently the last time the user used the service, with priority given to the information. For example, when information on the preferences of a user who is engaged in a music-related occupation that the user checks the musical note suggestions in detail is stored in the user information database 70, the provision structure construction unit 72 constructs staff information (musical score information) as shown in FIG. 6 as the provision structure. When information on the preferences of a user who is engaged in a music-related occupation that the user checks frequency information is stored in the user information database 70, the provision structure construction unit 72 constructs frequency analysis information (spectral information) as shown in FIG. 7 as the provision structure. In addition, when the user has a preference for outputting sound, the provision structure construction unit 72 constructs sound output as shown in FIG. 8 as the provision structure. When the user has a preference for checking lyrics, the provision structure construction unit 72 constructs lyrics information as shown in FIG. 9 as the provision structure.

[0051] In addition, when information regarding the preferences of a user engaged in a video-related occupation, such as the fact that the user is viewing video, is stored in the user information database 70, the presentation structure construction unit 72 constructs video information as shown in FIG. 10 or FIG. 11 as a presentation structure.

[0052] The provision information creation unit 80 selects multimedia information that fits the provision structure constructed by the provision structure construction unit 72 from among the multimedia information with high similarity calculated by the similarity calculation unit 60. Then, the provision information creation unit 80 creates provision information by inputting (applying) the selected multimedia information to the provision structure (step S80). This allows the provision information creation unit 80 to create provision information that matches the user's preferences.

[0053] The providing unit 81 presents the provided information created by the provided information creating unit 80 to the user (step S90).

[0054] The user is provided with a function to select information that matches the user's preferences from information provided by the providing unit 81 and information that does not match the user's preferences (step S100). When the user selects information that matches his / her preferences (information that matches the purpose of the search) (Yes in step S100), the providing unit 81 presents details of the selected information to the user (step S110). On the other hand, when the user selects information that does not match his / her preferences (No in step S100), the preference information receiving unit 90 receives the information that does not match the user's preferences. Then, the preference information receiving unit 90 records the information that does not match the user's preferences received by the preference information receiving unit in the user information database 70. Note that the preference information receiving unit 90 may record information that matches the user's preferences in the user information database 70.

[0055] <1-3.Effects> According to the information providing device of the first embodiment, it is possible to provide information that the user preferentially desires in a format that the user can easily understand. In addition, by accumulating user information over time, it is possible to provide information that matches the user's preferences even if the user's attributes or preferences change. By recording user information in advance, it is possible to provide information in a format that the user desires at the time of first use.

[0056] <Embodiment 2> <2-1. Configuration> Fig. 12 is a block diagram showing an example of the configuration of an information providing device according to embodiment 2. As shown in Fig. 12, the information providing device according to embodiment 2 is characterized in that the input information acquired by the input information acquiring unit 10 is recorded in a multimedia information database 30. Other configurations and operations are similar to those of embodiment 1, and therefore detailed description thereof will be omitted here.

[0057] The multimedia information database 30 records the input information (at least one of text, image, and sound) acquired by the input information acquisition unit 10.

[0058] <2-2. Operation> Fig. 13 is a flowchart showing an example of the operation of the information providing device according to embodiment 2. The operation shown in Fig. 13 is characterized by adding step S120 to the operation shown in Fig. 3. Note that steps S10 to S110 in Fig. 13 are similar to steps S10 to S110 in Fig. 3, and therefore detailed description thereof will be omitted here.

[0059] The input information acquiring unit 10 acquires input information input by the user (step S120), and records the acquired input information in the multimedia information database 30 (step S30).

[0060] The multimedia information analysis unit 50 performs an analysis similar to that performed by the input information analysis unit 40 on the multimedia information recorded in the multimedia information database 30 and the input information acquired by the input information acquisition unit 10 and recorded in the multimedia information database 30 (step S50).

[0061] The provision information creation unit 80 creates the provision information in the same manner as in the first embodiment (step S80). At this time, the provision information creation unit 80 may create the provision information by using the input information acquired by the input information acquisition unit 10 and recorded in the multimedia information database 30.

[0062] <2-3.Effects> According to the information providing device of embodiment 2, by providing information that includes not only multimedia information but also input information entered by the user, it is possible to increase the scope of the provided information and provide more appropriate information to the user.

[0063] <Embodiment 3> <3-1. Configuration> Fig. 14 is a block diagram showing an example of the configuration of an information providing device according to embodiment 3. As shown in Fig. 14, the information providing device according to embodiment 3 includes an information transmitting unit 100, an information confirmation recording unit 110, an information transmitting recording unit 111, a weighting processing unit 112, an extraction unit 120, and a notification unit 121. Since the other configurations are the same as those in embodiment 2, detailed description thereof will be omitted here.

[0064] The information transmission unit 100 transmits information (post-provision information) about the user after the provision unit 81 provides the provision information.

[0065] The information confirmation recording unit 110 records information indicating whether or not the user has confirmed the provided information.

[0066] The information transmission recording unit 111 records information (transmission presence / absence information) indicating whether the information transmission unit 100 has transmitted information about the user. Specifically, the information transmission recording unit 111 records information indicating whether the user has made an inquiry about the provided information.

[0067] The weighting processing unit 112 weights the provided information based on the information recorded in the information transmission recording unit 111. Specifically, the weighting processing unit 112 increases the weight for the provided information about which a user has inquired. The similarity calculation unit 60 calculates the similarity in the same manner as in the second embodiment, but at this time, the similarity is calculated taking into account the provided information weighted by the weighting processing unit 112.

[0068] The extraction unit 120 extracts a provider from the user information database based on the information transmitted by the information transmission unit 100. Here, a provider is a person who provides multimedia information to a user (a person who has registered the multimedia information on which the provided information is based in the multimedia information database 30). The user information database 70 records the information transmitted by the information transmission unit 100 (provided information related to an inquiry) in association with the provider of the information.

[0069] The notification unit 121 notifies the provider extracted by the extraction unit 120 that the multimedia information registered by that provider has been provided to the user.

[0070] <3-2. Operation> Fig. 15 is a flowchart showing an example of the operation of the information providing device according to embodiment 3. The operation shown in Fig. 15 is characterized by adding step S130 to the operation shown in Fig. 13. Note that steps S10 to S120 in Fig. 13 are similar to steps S10 to S120 in Fig. 3, and therefore detailed description thereof will be omitted here.

[0071] The information transmission unit 100 transmits information (post-provision information) about the user after the provision unit 81 provides the provided information (step S130). At this time, the information transmission recording unit 111 records information on whether or not the information was transmitted. In addition, the user information database 70 records the provided information in association with the provider of the provided information.

[0072] <3-3.Effects> According to the information providing device of the third embodiment, when a user makes an inquiry about the provided information, a weight is added to the provided information related to the inquiry. This makes it possible to present similar information included in the provided information the next time the information is used.

[0073] In addition, the provider is notified that the multimedia information they registered has been provided to the user. This promotes communication between the user and the provider, and is expected to result in the processing of information into something more desirable for both parties.

[0074] Within the scope of the present disclosure, the embodiments can be freely combined, and each embodiment can be modified or omitted as appropriate.

[0075] Although the present disclosure has been described in detail, the above description is illustrative in all respects and is not restrictive. It is understood that countless variations not illustrated can be envisioned. [Explanation of symbols]

[0076] 10 input information acquisition unit, 20 input information database, 30 multimedia information database, 40 input information analysis unit, 50 multimedia information analysis unit, 60 similarity calculation unit, 70 user information database, 71 user preference determination unit, 72 provision structure construction unit, 80 provision information creation unit, 81 provision unit, 90 preference information receiving unit, 100 information transmission unit, 110 information confirmation recording unit, 111 information transmission recording unit, 112 weighting processing unit, 120 extraction unit, 121 notification unit, 200 display, 210 speaker, 220 keyboard, 230 processor, 240 memory, 250 HDD, 300 information input / output unit, 400 calculation unit.

Claims

1. an input information acquisition unit that acquires input information input by a user; a provision structure construction unit for constructing a provision form that matches a response form desired by the user with respect to multimedia information including at least one of text, image, and sound; a provision unit that provides, to the user, answer candidates prepared for the user based on an analysis result of the input information and an analysis result of the multimedia information, and provision information created based on the provision form constructed by the provision structure construction unit; An information providing device comprising:

2. a provision information creation unit that selects the multimedia information that matches the provision form constructed by the provision structure construction unit from the answer candidates and creates the provision information by inputting the selected multimedia information into the provision form; The information providing device according to claim 1 , wherein the providing unit provides the information to be provided created by the information to be provided creating unit to the user.

3. The information providing device according to claim 1 , wherein the provision structure constructing unit constructs the structure of the provision form from information related to the user's preferences.

4. a preference information acquisition unit that acquires information about the user's preferences input by the user using a keyboard, The information providing device according to claim 3 , wherein the input information acquiring unit acquires the input information input by the user using the keyboard.

5. 3. The information providing device according to claim 1, wherein the provision structure constructing section constructs the provision form that includes, with priority, information regarding the user's use of the provided information.

6. The information providing device according to claim 5 , wherein the provision structure constructing section constructs the provision form that includes, on a priority basis, information that is frequently used by the user.

7. an input information acquisition unit that acquires input information input by a user; a provision structure construction unit for constructing a provision form that matches a response form desired by the user with respect to multimedia information including at least one of text, image, and sound; a provision unit that provides, to the user, answer candidates prepared for the user based on an analysis result of the input information and an analysis result of the multimedia information, and provision information created based on the provision form constructed by the provision structure construction unit; An information receiving device comprising:

Images