Information providing method, database generation method, and program
The integration of an intention-URL database in browsers simplifies user interactions by automatically providing relevant web pages based on voice or text inputs, addressing the complexity of accessing network services through URL inputs.
Patent Information
- Application Number
- JP2021091752
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-05-31
- Publication Date
- 2025-07-10
- Estimated Expiration
- 2041-05-31
AI Technical Summary
The increasing complexity of browser operations due to the expanding range of network services has led to a demand for simplifying user interactions, particularly in accessing desired web content through URL inputs.
An information provision method and system that utilizes an intention-URL database to associate user intents with URLs, allowing browsers to provide relevant web pages based on voice or text inputs without requiring direct URL entry, through a language processing server and user terminal integration.
Enables users to access web content corresponding to their intentions automatically, simplifying the operation of browsers by eliminating the need for manual URL input, thereby enhancing user experience and efficiency.
Smart Images

Figure 0007705739000001 
Figure 0007705739000002 
Figure 0007705739000003
Abstract
Description
Technical Field
[0001] The present disclosure relates to providing a URL to a browser.
Background Art
[0002] Conventionally, users have received services via a network using a browser. For example, Japanese Patent Application Laid-Open No. 2020-091907 (Patent Document 1) discloses a technique in which a browser presents web content about a product or service.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In recent years, due to the expanding range of services provided via the network, the opportunities for users to receive services using a browser have increased, and the user base for receiving services has also expanded. There is also an increasing demand to simplify the operations of the browser required for users to receive services.
[0005] The present disclosure has been conceived in view of such circumstances, and an object thereof is to provide a technique for simplifying the operation of a browser.
Means for Solving the Problems
[0006] According to an aspect of the present disclosure, an information Provide method implemented by a computer is provided. The information Provide method includes a step of obtaining an inquiry intention based on inquiry information input to a user terminal. The inquiry information includes at least one of voice and text. The informationProvide The method further comprises: obtaining a response URL corresponding to the inquiry intention according to the relationship between one or more URLs corresponding to each of one or more intentions defined in the intention-URL database; and providing the response URL to a browser installed on the user terminal.
[0007] According to another aspect of the present disclosure, a method for generating an intention-URL database implemented by a computer is provided. The generation method comprises: obtaining a URL having a placeholder; and obtaining two or more phrases. Each of the two or more phrases is associated with an intention and has a slot. The generation method further comprises: extracting, from the two or more phrases, a phrase having a slot corresponding to the placeholder of the URL; and generating an intention-URL database by associating the URL with the extracted phrase.
Advantages of the Invention
[0008] According to an aspect of the present disclosure, when inquiry information is input to a user terminal, a URL (response URL) corresponding to the intention (inquiry intention) of the inquiry information is provided to a browser installed on the user terminal. Thereby, the user can obtain a URL corresponding to the user's intention without directly inputting the URL intended by the user.
[0009] According to another aspect of the present disclosure, an intention-URL database is generated by associating an intention with a URL, where the URL is associated with a phrase having a slot corresponding to the placeholder of the URL. If the intention-URL database generated in this way is used, a URL associated with the intention can be provided according to the acquisition of the user's intention. Thereby, the user can obtain a URL corresponding to the user's intention without directly inputting the URL intended by the user.
Brief Description of the Drawings
[0010]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24
Figure 25
Figure 26
Figure 27
Figure 28
Figure 29
Figure 30
Figure 31
Figure 32
Figure 33
Figure 34
Figure 35
Figure 36
Figure 37
Figure 38
Figure 39
Mode for Carrying Out the Invention
[0011] Hereinafter, an embodiment of the information providing system will be described with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, these descriptions will not be repeated.
[0012] <First Embodiment>
[0013] [1. Configuration of Information Providing System]
[0014] FIG. 1 is a diagram showing an example of the configuration of the information providing system in the first embodiment. The information providing system 1 includes a language processing server 100, a user terminal 200, and web servers 900A and 900B. In this specification, when referring to the common properties of the web servers 900A and 900B, the term "web server 900" may be used.
[0015] In the information providing system 1, if a user inputs voice according to an intention in the user terminal 200, a service corresponding to the intention is provided from the web server 900.
[0016] More specifically, when a user inputs voice to the user terminal 200, the user terminal 200 transmits the voice to the language processing server 100. The language processing server 100 transmits a URL (Uniform Resource Locator) corresponding to the intention of the voice input from the user terminal 200 to the user terminal 200. The user terminal 200 accesses the web server 900 using the URL transmitted from the language processing server 100 and receives services from the web server 900.
[0017] [2. Hardware Configuration (Language Processing Server)]
[0018] FIG. 2 is a diagram showing an example of the hardware configuration of the language processing server 100. The language processing server 100 includes a CPU (Central Processing Unit) 101, a communication I / F (interface) 102, and a storage 103. The storage 103 includes a program area 1031 for storing various programs and a data area 1032 for storing various data.
[0019] The CPU 101 executes various operations by executing a program stored in the storage 103 or an external storage device.
[0020] The communication I / F 102 is realized by, for example, a network card, and enables the language processing server 100 to communicate with other devices in the information providing system 1.
[0021] [3. Hardware Configuration (User Terminal)]
[0022] FIG. 3 is a diagram showing an example of the hardware configuration of the user terminal 200. The user terminal 200 includes a CPU 201, a display 202, a microphone 203, a speaker 204, a camera 205, a communication I / F 206, and a storage 207. The storage 207 includes a program area 2071 for storing various programs and a data area 2072 for storing various data.
[0023] The CPU 201 executes various operations by executing a program stored in the storage 207 or an external storage device.
[0024] The display 202 displays the screen instructed by the CPU 201. The microphone 203 inputs the input voice to the CPU 201. The speaker 204 outputs the voice instructed by the CPU 201. The camera 205 inputs the captured image to the CPU 201.
[0025] The communication I / F 206 is realized by, for example, a network card, and enables the user terminal 200 to communicate with other devices in the information providing system 1.
[0026] [4. Outline of Processing]
[0027] With reference to FIGS. 4 to 8, an outline of an example of the process of providing a URL to the user terminal 200 in response to the input of information to the user terminal 200 in the information providing system 1 will be described.
[0028] (1) Functional Configuration of Each Element in the Information Providing System
[0029] FIG. 4 is a diagram showing an example of the functions of each element in the information providing system 1. The language processing server 100 includes a speech recognition unit 110 and a natural language understanding unit 120. The speech recognition unit 110 uses speech recognition technology to convert the input speech into text. In one example, the natural language understanding unit 120 is realized by the CPU 101 executing a given program.
[0030] The natural language understanding unit 120 includes an information processing unit 121, a grammar-intention database 122, and an intention-URL database 123. The information processing unit 121 identifies the intention corresponding to the input text and identifies the URL corresponding to the identified intention. In one example, the information processing unit 121 is realized by the CPU 101 executing a given program.
[0031] The grammar-intention database 122 is used to identify the intention corresponding to the text. The intention-URL database 123 is used to identify the URL corresponding to the intention. The grammar-intention database 122 and the intention-URL database 123 are stored, for example, in the storage 207.
[0032] The browser 290 installed in the language processing server 100 includes a browsing function 291 and an extension function 292. The browsing function 291 realizes the general functions of a browser application, including accessing the network using the input URL. The extension function 292 realizes an extended function for the browser application. The extension function 292 is realized, for example, as a plug-in program for the browser application.
[0033] (2) Outline of the process With reference to FIGS. 4 to 8, the outline of the process executed by the browser 290 to obtain a URL in response to an audio input from the user will be described.
[0034] (2-1) First stage
[0035] First, the browser 290 obtains URL(0). URL(0) may be input to the browser 290 by the user or may be preset in the browser 290. In response to the acquisition of URL(0), the browsing function 291 accesses the web server 900 using "URL(0)".
[0036] (2-2) Second stage
[0037] FIG. 5 is a diagram showing an example of the state next to the state shown in FIG. 4. As shown in FIG. 5, in response to an access using "URL(0)", the web server 900 transmits a web page corresponding to "URL(0)" to the browsing function 291. The web page to be transmitted is represented as "web page (0)" in FIG. 5. The browser 290 displays the screen of the web page (0) on the display 202. Note that the screen of the web page (0) may be registered in advance in the browsing function 291. That is, the browsing function 291 may display the screen of the web page (0) on the display 202 without accessing the web server 900.
[0038] (2-3) Third stage
[0039] FIG. 6 is a diagram showing an example of the state next to the state shown in FIG. 5. As shown in FIG. 6, voice is input to the extension function 292. The input voice is represented as "voice (1)" in FIG. 6. In response to the input of the voice (1), the extension function 292 transmits the voice (1) to the language processing server 100. The extension function 292 further transmits the URL (URL(0)) of the screen that was being displayed when the voice (1) was input to the language processing server 100. In the language processing server 100, the input voice (1) is processed by the voice recognition unit 110.
[0040] (2-4) Fourth stage
[0041] FIG. 7 is a diagram showing an example of the state next to the state shown in FIG. 6. As shown in FIG. 7, the voice recognition unit 110 obtains text corresponding to the voice (1) by processing the voice (1). The obtained text is represented as "text (1)". The voice recognition unit 110 transmits the text (1) to the natural language understanding unit 120.
[0042] In the natural language understanding unit 120, the information processing unit 121 identifies the intention of the text (1) by analyzing the text (1) according to natural language processing. In one example, the information processing unit 121 identifies the grammar that the text (1) conforms to and identifies the intention corresponding to the identified grammar, thereby identifying the intention of the text (1). In one example, a grammar-intention database is used for intention identification.
[0043] The information processing unit 121 identifies the URL corresponding to the identified intention. In FIG. 7, the identified URL is represented as "URL(1)". In one example, an intention-URL database is used for URL identification. Then, the information processing unit 121 sends the identified URL to the browser 290.
[0044] In the browser 290, the extension function 292 acquires the URL(1) sent from the language processing server 100 (information processing unit 121) and passes it to the browsing function 291.
[0045] (2-5) The fifth stage
[0046] FIG. 8 is a diagram showing an example of the state following the state shown in FIG. 7. As shown in FIG. 8, the browsing function 291 accesses the web server 900 using the URL(1) passed from the extension function 292. In response, the web server 900 sends a web page corresponding to the URL(1) as an example of providing the service corresponding to the URL(1). The sent web page is represented as "web page (1)".
[0047] The extension function 292 presents the service received from the web server 900 to the user. When the web page (1) is received, the extension function 292 displays the screen of the web page (1) on the display 202.
[0048] In the example described above with reference to FIGS. 4 to 8, the voice (1) is an example of "inquiry information". The intention obtained based on the voice (1) (the intention specified for the text (1)) is an example of an "inquiry intention". The grammar that the voice (1) (i.e., the text (1)) conforms to is an example of an "inquiry grammar". The URL (1) provided in response to the input of the voice (1) is an example of a "response URL". The URL (0) corresponding to the screen displayed when the voice (1) is input is an example of a "previous URL".
[0049] [5. Grammar-Intention Database]
[0050] FIG. 9 is a diagram showing an example of the data structure of the grammar-intention database 122. The example of FIG. 9 corresponds to the webmail service provided by the web server 900.
[0051] In FIG. 9, two or more grammars, two or more intentions, and two or more types are shown. In the grammar-intention database 122, one grammar is associated with one intention and one type.
[0052] Grammars are used for analysis in natural language processing. In FIG. 9, as specific examples of grammars, "Open webmail", "Open the main page", and "Open the webmail page" are shown. In the example of FIG. 9, these grammars are associated with the same intention, i.e., the intention "Open webmail".
[0053] The example of FIG. 9 includes "new" and "follow-up" as values of the type. "New" corresponds to an intention that does not depend on other text from the user. "Follow-up" corresponds to an intention that depends on other text from the user. The type will be described later with reference to FIG. 16 and the like. In the example of FIG. 9, a grammar including the character string "Among these" at the beginning of the sentence has "follow-up" as the value of the type. However, it is merely an example of the relationship between the character string included in the grammar and the value of the type.
[0054] A set ([*1], etc.) composed of the symbol "*" and numbers included in some grammars illustrated in FIG. 9 represents a slot. For example, in the grammar "Show the message from [*1]", [*1] represents a slot.
[0055] The intention corresponding to the grammar including a slot also includes a slot, similar to the grammar. For example, the intention corresponding to the grammar "Show the message from [*1]" is "Display the message received from [*1]", and it includes the same slot [*1] as that included in the grammar. This intention is to display the message received from the person who constitutes the value of the slot of [*1].
[0056] The example in FIG. 9 is merely an example of the association between grammar and intention. The specific manner of associating grammar with intention may be set and / or changed by any person such as the person receiving the service, the person providing the service, and / or the person managing the language processing server 100.
[0057] The type of service provided by the web server 900 is not limited to webmail. It may be any type of service such as a web search service, a service providing stock price information, a service providing a shopping site and / or a community site, etc.
[0058] [6. Intention - URL Database]
[0059] FIG. 10 is a diagram showing an example of the data structure of the intention - URL database 123. In the example of FIG. 10, two or more intentions associated with two or more grammars in the example of FIG. 9 are associated with two or more URLs.
[0060] For example, the intent "Open webmail" is associated with the URL "https: / / mail.AAA.com". Also, the intent "Display unread messages" is associated with the URL "https: / / mail.AAA.com / mail / u / 0 / #search / is%3Aunread". Furthermore, the intent "Display messages received from [*1]" is associated with the URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3A[*1]".
[0061] The URL associated with an intent containing a slot has a placeholder corresponding to the slot. For example, [*1] in the URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3A[*1]" represents a placeholder corresponding to the slot included in the intent. This placeholder is filled with a value corresponding to the value of the slot [*1] in the intent.
[0062] In the intent-URL database 123, each URL is associated with a type (new / follow-up) associated with its corresponding intent.
[0063] A URL having "follow-up" as the value of the type contains only a string added to other URLs. For example, the URL corresponding to the intent [[*3] Display messages received from] contains only the string "+from%3A[*3]" added to other URLs. Details regarding the generation of a new URL by adding a string to another URL will be described later with reference to FIG. 16 and the like.
[0064] In the example of FIG. 10, the string added to other URLs starts with the character "+". However, what character the added string starts with can be set for each provided service. In the webmail service as well, the added string may start with " / ", or may start with "&", in addition to "+".
[0065] The example shown in FIG. 10 is merely an example of a set of URLs that can be used in a webmail service. The combination of additional functions and the character strings added to the URLs is not limited to those shown in FIG. 10.
[0066] For example, in the example of FIG. 10, by comparing the URL “https: / / mail.AAA.com” with the URL “https: / / mail.AAA.com / mail / u / 0 / #search / is%3Aunread”, the portion “ / mail / u / 0 / #search / is%3Aunread” in the latter URL is understood to be the character string added to the former URL in order to implement the additional function of searching for unread messages among the messages. However, the set of URLs shown in FIG. 10 is merely an example.
[0067] [7. Flow of Processing]
[0068] FIG. 11 is a flowchart of the processing executed by the user terminal 200 to receive a web service corresponding to the voice in response to the input of the voice. On the left side of FIG. 11, User terminal 200 a flowchart of the processing on one side is shown. This processing can be realized, for example, by the CPU 201 functioning as the extension function 292 in the user terminal 200 executing a given program. On the right side of FIG. 11, Language processing server 100 a flowchart of the processing on the other side is shown. This processing can be realized, for example, by the CPU 101 functioning as the voice recognition unit 110 and the information processing unit 121 in the language processing server 100 executing a given program.
[0069] In step S200, the extension function 292 causes the browsing function 291 to display an icon for voice input on the display 202. The icon for voice input may be displayed within the currently displayed web page, or may be displayed in a location not directly related to the currently running application (for example, within the task bar).
[0070] FIG. 12 is a diagram showing an example of a screen of a web page displayed on the display 202. The screen 250 shown in FIG. 12 displays the received tray of webmail. The screen 250 includes an address bar 251, a microphone icon 252, and a message list 253. The microphone icon 252 is an example of an icon for voice input.
[0071] The address bar 251 displays the URL for displaying the screen 250. The microphone icon 252 is operated for the user to input voice to the user terminal 200. The message list 253 displays a list of messages in the folder selected in the webmail. In one example, when one message in the message list 253 is selected, the content of the message is displayed in a pop-up screen or the like.
[0072] Returning to FIG. 11, in step S202, the extension function 292 determines whether voice input has been activated. The operation for activating voice input may be a click on the microphone icon 252, an input of a wake phrase (such as "activate voice input") to the microphone 203, or an input of a specific gesture to the camera 205.
[0073] The extension function 292 repeats the control of step S202 until it determines that voice input has been activated (an operation for activation has been performed) (NO in step S202), and when it determines that it has been activated (YES in step S202), it advances the control to step S204.
[0074] In step S204, the extension function 292 transmits the input voice (voice (1)) and the URL (URL (0)) of the web page that the browsing function 291 was displaying at that time to the language processing server 100. In step S204, the extension function 292 may display a transcription of the input voice. Referring further to FIGS. 13 and 14, the voice input to the user terminal 200 (extension function 292) in voice input will be described.
[0075] FIG. 13 is a diagram showing a screen 250A that is displayed when the microphone icon 252 is clicked on the screen 250 of FIG. 12. The screen 250A includes a pop-up screen 260. The pop-up screen 260 includes an input field 261, a query button 262, a speak button 263, and a display field 264.
[0076] When an operation for activating voice input is performed, the extension function 292 accepts voice input until a given condition is satisfied. An example of the given condition is a pause (no voice input) for a certain period of time (for example, 3 seconds) or more.
[0077] The extension function 292 sends the input voice to the voice recognition unit 110. The voice recognition unit 110 returns a transcription of the input voice to the extension function 292. The extension function 292 displays the transcription sent from the voice recognition unit 110 in the display field 264.
[0078] FIG. 14 is a diagram showing a screen 250B in which the display of the transcription is added to the screen 250A of FIG. 13. In the screen 250B, the transcription "Show unread messages" is displayed in the display field 264.
[0079] The input field 261 accepts text input from the user. The query button 262 is operated to send the text input in the input field 261 to the language processing server 100. When the query button 262 is operated, the extension function 292 sends the text input in the input field 261 to the language processing server 100 instead of the voice (voice (1)) from the user in step S204.
[0080] The speak button 263 is operated to re-enter voice. If the transcription displayed in the display field 264 is not what the user intended, after operating the speak button 263, the user re-enters voice. In this case, the extension function 292 executes the control of step S204 again and sends the newly input voice to the language processing server 100 as "voice (1)".
[0081] Refer to FIG. 11 again. When the voice (1) and the URL (0) are acquired from the user terminal 200 (extension function 292), at step S100, the language processing server 100 acquires the text (text (1)) corresponding to the voice (1) by the function of the voice recognition unit 110. When the text thus acquired is transmitted to the user terminal 200, as described with reference to FIG. 14, on the user terminal 200, the text is displayed as a transcription. Note that in FIG. 11, the transmission of the text from the language processing server 100 to the user terminal 200 and the display of the text (transcription) on the user terminal 200 are omitted.
[0082] At step S102, the language processing server 100 specifies the grammar (grammar (1)) corresponding to the text acquired at step S100 as a function of the information processing unit 121.
[0083] At step S104, the language processing server 100 specifies the intention (intention (1)) corresponding to the grammar specified at step S102 as a function of the information processing unit 121. In one example, the control of step S104 includes specifying the intention associated with the grammar specified at step S102 in the grammar-intention database (FIG. 9).
[0084] At step S106, the language processing server 100 acquires the URL (URL (1)) corresponding to the intention specified at step S104 as a function of the information processing unit 121. In one example, the control of step S106 includes specifying the URL associated with the intention specified at step S104 in the intention-URL database (FIG. 10). The control of step S106 will be described later with reference to FIG. 16.
[0085] At step S108, the language processing server 100 transmits the URL acquired at step S106 to the user terminal 200 to end the processing of FIG. 11.
[0086] In step S206, when the extension function 292 receives a URL from the language processing server 100, it passes the URL to the browsing function 291 to end the process of FIG. 11.
[0087] When the browsing function 291 obtains a URL from the extension function 292, it accesses the web server 900 using the URL. The web server 900 sends a web page corresponding to the URL to the browsing function 291. The browsing function 291 displays the received web page on the display 202. As a result, the display on the display 202 is switched.
[0088] In the process described above with reference to FIG. 11, when voice is input to the extension function 292, the voice is converted into text, the grammar that the text conforms to is identified, and the intention corresponding to the identified grammar is identified. Note that an intention may be directly associated with the voice. That is, the conversion from voice to text and the identification of grammar may be omitted. Also, text may be input instead of voice. In this case, the grammar that the text conforms to is identified, and the intention corresponding to the identified grammar is identified. However, the text may be directly associated with the intention, and the identification of grammar may be omitted.
[0089] FIG. 15 is a diagram showing a screen 250C for displaying a web page of a URL corresponding to voice input from a user. When the user inputs a voice "Show unread messages" (FIG. 14), the browsing function 291 displays the screen 250C of FIG. 15 on the display 202. The message list 253 on the screen 250C displays only the unread messages among the messages displayed in the message list 253 (FIG. 14) on the screen 250B. Details of the content of the screen 250C will be described later.
[0090] Figure 16 is a flowchart of the subroutine of step S106 in FIG. 11. In step S1060, the language processing server 100 identifies the URL (URL(1)) associated with the intent (intent(1)) obtained in step S104 (FIG. 11) in the intent-URL database (FIG. 10).
[0091] In step S1062, the language processing server 100 determines whether the URL identified in step S1060 contains a placeholder. For example, in the example of FIG. 10, the URL "https: / / mail.AAA.com" does not contain a placeholder. On the other hand, the URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3A[*1]" contains a placeholder ([*1]). If the language processing server 100 determines that the above URL contains a placeholder (YES in step S1062), it proceeds to step S1064, otherwise (NO in step S1062), it proceeds to step S1066.
[0092] In step S1064, the language processing server 100 fills the placeholder of the URL identified in step S1060 with the corresponding value in the original voice and updates the URL. The value filling and URL update in step S1064 will be described later with reference to FIG. 18.
[0093] In step S1066, the language processing server 100 determines whether the type of the URL identified in step S1060 is a follow-up. If the language processing server 100 determines that the type of the above URL is a follow-up (YES in step S1066), it proceeds to step S1068, otherwise (NO in step S1066), it returns control to FIG. 11.
[0094] In step S1068, the language processing server 100 updates the URL specified in step S1060 (or the URL updated in step S1064) by combining it with the URL of the web page (URL(0)) displayed by the browsing function 291 when the voice was input. The update of the URL in step S1068 will be described later with reference to FIG. 19. Thereafter, the language processing server 100 returns control to FIG. 11.
[0095] [8. Specific Examples of Processing]
[0096] The processing flow described with reference to FIG. 16 will be described in more detail together with specific examples.
[0097] 8-1. Specific Example (1)
[0098] FIG. 17 is a diagram for explaining the first specific example of the processing in FIG. 16. In FIG. 17, annotations N11 and N12 are shown together with the flowchart of FIG. 16.
[0099] In the example of FIG. 17, with the screen 250 of FIG. 12 (list display of messages in the received tray) being displayed, the user inputs the voice "Show unread messages" as described in annotation N11. From this voice, the speech recognition unit 110 identifies the text "Show unread messages". From this text, the information processing unit 121 identifies the grammar "Show unread messages".
[0100] As shown in FIG. 9, the information processing unit 121 identifies the intention "Display unread messages" from the above grammar "Show unread messages". This intention is the "intention (1)" in step S1060.
[0101] As shown in FIG. 10, the information processing unit 121 identifies the URL "https: / / mail.AAA.com / mail / u / 0 / #search / is%3Aunread" from the intention of "displaying unread messages" (intention (1)). As described in annotation N12, this URL is the "URL (1)" in step S1060.
[0102] The URL "https: / / mail.AAA.com / mail / u / 0 / #search / is%3Aunread" does not contain a placeholder. Therefore, in the example of FIG. 17, the information processing unit 121 advances the control from step S1062 to step S1066.
[0103] The type value of the URL "https: / / mail.AAA.com / mail / u / 0 / #search / is%3Aunread" is "new" and not "follow-up". Therefore, in the example of FIG. 17, after step S1066, the information processing unit 121 returns the control to FIG. 11 without executing step S1068. Thus, according to the example of FIG. 17, in step S108 of FIG. 11, the information processing unit 121 transmits the URL "https: / / mail.AAA.com / mail / u / 0 / #search / is%3Aunread" specified in step S1060 to the user terminal 200 as the URL (1).
[0104] The URL "https: / / mail.AAA.com / mail / u / 0 / #search / is%3Aunread" is a URL for instructing the web server 900 to search for unread messages among the messages registered in the incoming tray of the webmail. When the browsing function 291 of the user terminal 200 accesses the web server 900 using this URL, the web server 900 executes the instructed search. Then, the web server 900 transmits a web page (screen) for displaying the search results to the browsing function 291. The browsing function 291 displays the web page (screen) transmitted from the web server 900.
[0105] The screen 250C (Fig. 15) displayed by the above URL "https: / / mail.AAA.com / mail / u / 0 / #search / is%3Aunread" is a screen that displays unread messages among the messages registered in the incoming tray of webmail.
[0106] 8-2. Specific Example (2)
[0107] Fig. 18 is a diagram for explaining the second specific example of the process in Fig. 16. In Fig. 18, together with the flowchart of Fig. 16, annotations N21, N22, and N23 are shown.
[0108] In the example of Fig. 18, with the screen 250 (incoming tray screen) of Fig. 12 being displayed, the user inputs the voice "Show me the message received from John" as described in annotation N21. From this voice, the voice recognition unit 110 identifies the text "Show me the message received from John". From this text, the information processing unit 121 identifies the grammar "[*1] received message show me". [*1] is a slot in this grammar. In the example of Fig. 18, the value of the slot is "John" (hereinafter, may also be expressed as "John").
[0109] As shown in Fig. 9, the information processing unit 121 identifies the intention "[*1] received message display" from the above grammar "[*1] received message show me". This intention is the "intention (1)" in step S1060. [*1] is the slot corresponding to the slot of the above grammar in this intention.
[0110] As shown in FIG. 10, the information processing unit 121 identifies the URL “https: / / mail.AAA.com / mail / u / 0 / #search / from%3A[*1]” from the intention “display the message received from [*1]” (intention (1)). As described in annotation N22, this URL is the “URL (1)” in step S1060. In this URL, [*1] is a placeholder corresponding to the slot of the above intention.
[0111] The URL “https: / / mail.AAA.com / mail / u / 0 / #search / from%3A[*1]” contains a placeholder. Therefore, in the example of FIG. 18, the information processing unit 121 advances the control from step S1062 to step S1064.
[0112] In step S1064, the information processing unit 121 fills the above placeholder with the value (“John”) of the slot within the above intention corresponding to the placeholder. As a result, URL (1) is updated to “https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn” as described in annotation N23.
[0113] The type value of the URL “https: / / mail.AAA.com / mail / u / 0 / #search / from%3A[*1]” is “new” and not “follow-up”. Therefore, in the example of FIG. 18, after step S1066, the information processing unit 121 returns the control to FIG. 11 without executing step S1068. According to the example of FIG. 18, in step S108 of FIG. 11, the information processing unit 121 transmits the URL “https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn” updated in step S1064 to the user terminal 200 as URL (1).
[0114] The URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn" is a URL for instructing the web server 900 to search for messages from the sender "John" among the messages registered in the incoming tray of the webmail. When the browsing function 291 of the user terminal 200 accesses the web server 900 using this URL, the web server 900 executes the instructed search. Then, the web server 900 sends a web page (screen) for displaying the search results to the browsing function 291. The browsing function 291 displays the web page (screen) sent from the web server 900.
[0115] 8-3. Specific Example (3)
[0116] FIG. 19 is a diagram for explaining the third specific example of the process of FIG. 16. In FIG. 19, annotations N31, N32, N33, and N34 are shown together with the flowchart of FIG. 16.
[0117] In the example of FIG. 19, with the screen of the web page corresponding to the URL (0) being displayed, the user inputs the voice "Show me the messages whose subject contains'meeting' among them."
[0118] As described in annotation N31, the URL (0) is "https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn". This URL is a URL for instructing to search for messages from the sender "John" among the messages registered in the incoming tray of the webmail, as described with reference to FIG. 18. Therefore, the screen of the web page corresponding to this URL is a screen for displaying the results of the said search.
[0119] In the example of FIG. 19, from the voice "Show me the messages whose subject contains'meeting' among them", the speech recognition unit 110 identifies the text "Show me the messages whose subject contains'meeting' among them". From this text, the information processing unit 121 identifies the grammar "[*4] Show me the messages whose subject contains [*4]". [*4] is a slot in this grammar. In the example of FIG. 19, the value of the slot is "meeting".
[0120] As shown in FIG. 9, the information processing unit 121 identifies the intention "Display the messages whose subject contains [*4]" from the grammar "[*4] Show me the messages whose subject contains [*4]". This intention is the "intention (1)" in step S1060. [*4] is a slot corresponding to the slot of the grammar in this intention.
[0121] As shown in FIG. 10, the information processing unit 121 identifies the URL "+subject%3A[*4]" from the intention "Display the messages whose subject contains [*4]" (intention (1)). This URL is the "URL (1)" in step S1060 as described in annotation N32. In this URL, [*4] is a placeholder corresponding to the slot of the above intention.
[0122] The URL "+subject%3A[*4]" contains a placeholder. Therefore, in the example of FIG. 19, the information processing unit 121 advances the control from step S1062 to step S1064.
[0123] In step S1064, the information processing unit 121 fills the above placeholder with the value ("meeting") of the slot corresponding to the placeholder in the above intention. As a result, the URL (1) is updated to "+subject%3Ameeting" as described in annotation N33.
[0124] The value of the type of the URL “+subject%3A[*4]” is “Follow-up”. Therefore, in the example of FIG. 19, after step S1066, the information processing unit 121 advances the control to step S1068.
[0125] In step S1068, the information processing unit 121 updates URL(1) by combining it with URL(0). As a result, “+subject%3Ameeting” is combined with “https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn” and updated to “https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn+subject%3Ameeting”.
[0126] Thereafter, the information processing unit 121 returns the control to FIG. 11. According to the example of FIG. 19, in step S108 of FIG. 11, the information processing unit 121 transmits the URL “https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn+subject%3Ameeting” updated in step S1068 to the user terminal 200 as URL(1).
[0127] The URL “https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn+subject%3Ameeting” is a URL for instructing the web server 900 to search for messages in the received tray of the webmail where the sender is “John” and the subject contains “meeting”. When the browsing function 291 of the user terminal 200 accesses the web server 900 using this URL, the web server 900 executes the instructed search. Then, the web server 900 transmits a web page (screen) for displaying the search results to the browsing function 291. The browsing function 291 displays the web page (screen) transmitted from the web server 900.
[0128] In step S1068 of the specific example (3), the information processing unit 121 updates it to URL(1) by combining it with URL(0).
[0129] In this regard, in the example of FIG. 10, each intention is associated with two URLs when it has "Follow-up" as the type value. Of the two URLs, one is not enclosed in parentheses and the other is enclosed in parentheses.
[0130] For example, for the intention "Display unread messages", the first URL is "+is%3Aunread" and the second URL is " / mail / u / 0 / #search / is%3Aunread". The first URL is used when the URL (URL(0)) combined in step S1068 contains the character string " / mail / u / 0 / #search / ". The second URL is used when the URL (URL(0)) combined in step S1068 does not contain the character string " / mail / u / 0 / #search / ". That is, in the example of FIG. 10, a plurality of URLs are associated with each intention having "Follow-up" as the type value. The information processing unit 121 can select the URL to be used from among the plurality of URLs according to the character string included in URL(0).
[0131] [9. Update of Database]
[0132] In the information providing system 1, the data structures of the grammar-intention database (FIG. 9) and / or the intention-URL database (FIG. 10) can be updated.
[0133] For example, a web server 900 newly joining the information providing system 1 may register, with the language processing server 100, information (update content) specifying how each of one or more URLs used in the web server 900 should be associated with each of one or more user intentions. When receiving such update content from the web server 900, the language processing server 100 updates the intention-URL database according to the update content. Note that the language processing server 100 may be directly input with the update content by an administrator of the information providing system 1.
[0134] FIG. 20 is a flowchart of a process executed to update the intention-URL database. The process of FIG. 20 can be implemented, for example, by a CPU 101 of the language processing server 100 executing a given program.
[0135] As shown in FIG. 20, the language processing server 100 determines, in step S190, whether update content has been acquired. The language processing server 100 continues control of step S190 until it determines that the update content has been acquired (NO in step S190). When it determines that the update content has been acquired (YES in step S190), the language processing server 100 updates the intention-URL database using the update content. (Step S192) 。
[0136] <Second Embodiment>
[0137] [1. Overview]
[0138] FIG. 21 is a diagram showing an example of the configuration of the information providing system according to the second embodiment. In the example of FIG. 21, a list of available URLs 124 is registered in the language processing server 100. The list of available URLs 124 defines whether to enable the extension function 292.
[0139] In the second embodiment, in order to allow a user to use the service provided by the web server 900 together with the extension function 292, the web server 900Provided by It is necessary to register the URL of the web page (URL(0) described later) in the available URL list 124. The administrator of the information providing system 1 can request a consideration such as payment of a usage fee from the administrator of the web server 900 in order to register the URL from the web server 900 in the available URL list 124.
[0140] [2. Available URL List]
[0141] FIG. 22 is a diagram showing an example of the data structure of the available URL list 124. The available URL list 124 is stored, for example, in the storage 103.
[0142] As shown in FIG. 22, the available URL list 124 includes a list of URLs. In the second embodiment, the browser 290 enables the extension function 292 if the URL of the displayed web page is included in the available URL list 124, and disables the extension function 292 if it is not included.
[0143] An example of switching the enable / disable of the extension function 292 is realized by switching the display / non-display of the microphone icon 252. The switching of the display / non-display of the microphone icon 252 will be described with reference to FIG. 21.
[0144] The browsing function 291 accesses the web server 900 using the URL(0). In response, the web server 900 transmits the web page (0) corresponding to the URL(0) to the browsing function 291.
[0145] On the other hand, the browsing function 291 sends the URL(0) to the extension function 292. The extension function 292 transmits the URL(0) to the language processing server 100.
[0146] The information processing unit 121 of the language processing server 100 determines whether the available URL list 124 includes URL(0). If the available URL list 124 includes URL(0), the information processing unit 121 sends a key (such as a password) for displaying the microphone icon 252 to the extension function 292. In response to receiving the key, the extension function 292 instructs the browsing function 291 to enable the microphone icon 252. In response to the instruction, the browsing function 291 displays the microphone icon 252 on the display 202 together with the screen of the web page (0).
[0147] On the other hand, if the available URL list 124 does not include URL(0), the information processing unit 121 does not send the above key to the extension function 292. If the key is not received, Extended function 292 does not Browsing function 291 instruct the activation of the microphone icon 252. In this case, the browsing function 291 displays the screen of the web page (0) without displaying the microphone icon 252. In this case, the user cannot use the extension function 292 to obtain the URL corresponding to the intention specified by voice input. Therefore, the user has to obtain the URL for obtaining the intended service by an existing method (for example, inputting the search conditions of the messages in the message list at a preset location on the screen according to the preset rules).
[0148] [3. Flow of processing]
[0149] FIG. 23 is a flowchart of a modified example of the processing shown in FIG. 11. Compared with the example of FIG. 11, the example of FIG. 23 further includes steps S200A, S 200B and steps S100A, S 100B.
[0150] More specifically, in step S200A, the extension function 292 sends the URL(0) received from the browsing function 291 to the language processing server 100.
[0151] In step S100A, as a function of the information processing unit 121, the language processing server 100 determines whether the URL(0) received from the extension function 292 is included in the available URL list 124. When the language processing server 100 determines that the URL(0) is included in the available URL list 124 (YES in step S100A), in step S100B, it sends the above-mentioned key to the extension function 292. When it determines that it is not included (NO in step S100A), it repeats the control of step S100A.
[0152] In step S200B, the extension function 292 determines whether it has received the above-mentioned key from the language processing server 100. It repeats the control of step S200B until it determines that it has received the above-mentioned key (NO in step S200B). When it determines that it has received the above-mentioned key (YES in step S200B), it advances the control to step S200.
[0153] In the second embodiment, the browsing function 291 simultaneously sends the URL(0) to the extension function 292 and displays the screen corresponding to the web page(0) on the display 202 without the microphone icon 252. Then, in response to the instruction (S200) from the extension function 292 to display the microphone icon 252, the microphone icon 252 may be added to the screen.
[0154] In the process of FIG. 23, if a new URL is received from the browsing function 291 while waiting for the key from the language processing server 100 in step S200B, the control may return to step S200A.
[0155] [4. Modification Example]
[0156] FIG. 24 is a diagram showing the configuration of a modification example of the second embodiment of the information providing system 1. In the example of FIG. 24, the available URL list 124 is stored in the browser 290 (user terminal 200).
[0157] FIG. 25 is a flowchart of a modified example that conforms to the example of FIG. 24 for the process shown in FIG. 11. The process of FIG. 25 further includes steps S200A, S 200C compared to the process shown in FIG. 11.
[0158] In the process of FIG. 25, in step S200A, the extension function 292 acquires URL(0) from the browsing function 291.
[0159] In step S200C, the extension function 292 determines whether URL(0) is included in the available URL list 124. If the extension function 292 determines that URL(0) is included in the available URL list 124 (YES in step S200C), the control proceeds to step S200; otherwise (NO in step S200C), the control returns to step S200A.
[0160] <Third Embodiment>
[0161] FIG. 26 is a diagram showing an example of the configuration of the information providing system in the third embodiment. In the third embodiment, the user inputs text to the browser 290 instead of voice. In one example, the input of text to the browser 290 is realized by inputting text to the input field 261 (FIG. 13) and clicking the query button 262 (FIG. 13). The extension function 292 transmits the text input to the browser 290 to the information processing unit 121.
[0162] The information processing unit 121 identifies the grammar that conforms to the text received from the extension function 292 instead of the text received from the speech recognition unit 110. That is, in the example of FIG. 26, the language processing server 100 does not need to have the speech recognition unit 110.
[0163] <Fourth Embodiment>
[0164] FIG. 27 is a diagram showing an example of the configuration of the information providing system according to the fourth embodiment. In the fourth embodiment, the intention-URL database 123 is stored as part of the extension function 292 in the user terminal 200.
[0165] In the example of FIG. 27, when the extension function 292 receives an input of voice from the user, it transmits the voice (voice (1)) to the language processing server 100. In the language processing server 100, the speech recognition unit 110 identifies the text (1) corresponding to the voice (1) and transmits it to the information processing unit 121.
[0166] The information processing unit 121 identifies the grammar (grammar (1)) to which the text (1) conforms, identifies the intention (intention (1)) corresponding to the identified grammar (1), and transmits the identified intention to the extension function 292.
[0167] The extension function 292 refers to the intention-URL database 123 to identify the URL (URL (1)) corresponding to the intention received from the information processing unit 121. Then, it passes the URL (1) to the browsing function 291. As a result, the browsing function 291 accesses the web server 900 using the URL (1).
[0168] The web server 900 transmits the web page (web page (1)) corresponding to the URL (1) to the browsing function 291. The browsing function 291 displays the screen corresponding to the web page (1) on the display 202.
[0169] <Fifth Embodiment>
[0170] FIG. 28 is a diagram showing an example of the configuration of the information providing system according to the fifth embodiment. In the example of FIG. 28, the natural language understanding unit 120 includes the intention-URL database 123A, and the extension function 292 includes the intention-URL database 123B. In the example of FIG. 28, among all the intentions, some intentions are associated with URLs in the intention-URL database 123B, and the remaining intentions are associated with URLs in the intention-URL database 123A.
[0171] More specifically, the information processing unit 121 identifies the grammar (1) to which the text (1) received from the speech recognition unit 110 conforms, and identifies the intention (1) corresponding to the grammar (1). Then, the information processing unit 121 determines whether the intention (1) is included in the above "partial intentions".
[0172] When the intention (1) is included in the above "partial intentions", the information processing unit 121 transmits the intention (1) to the extension function 292. In this case, the extension function 292 identifies the URL (1) corresponding to the intention (1) in the intention-URL database 123B.
[0173] On the other hand, when the intention (1) is not included in the above "partial intentions", the information processing unit 121 identifies the URL (1) corresponding to the intention (1) in the intention-URL database 123A and transmits the URL (1) to the extension function 292.
[0174] <Sixth Embodiment>
[0175] FIG. 29 is a diagram showing an example of the configuration of the information providing system according to the sixth embodiment. In the example of FIG. 29, the natural language understanding unit 120 further includes an information providing counter 125.
[0176] FIG. 30 is a diagram showing an example of the data structure of the intention-URL database 123 in the example of FIG. 29. The intention-URL database 123 associates each URL with a service provider. In the example of FIG. 30, all URLs are associated with the service provider "Company AAA".
[0177] FIG. 31 is a diagram showing an example of the data structure of the information providing counter 125. The information providing counter 125 stores the number of times the URL of each service provider has been provided to the browsing function 291 every month. The example of FIG. 31 represents, for example, that in January 2021, the URL of Company AAA was provided to the browsing function 291 205 times and the URL of Company BBB was provided to the browsing function 291 10 times.
[0178] In one implementation example, every time the information processing unit 121 transmits a URL to the extension function 292 in step S108 (FIG. 11), the information providing counter 125 increments and updates the count of the service provider associated with the URL by 1.
[0179] The administrator of the language processing server 100 may bill each service provider, for example, once a month, with a consideration corresponding to the monthly count value of the information providing counter 125.
[0180] Note that the information providing counter 125 may be included in the extension function 292 instead of the natural language understanding unit 120. In this case, every time the extension function 292 passes a URL to the browsing function 291, the extension function 292 may increment and update the count of the service provider associated with the passed URL by 1.
[0181] <Seventh Embodiment>
[0182] [1. Overview]
[0183] FIG. 32 is a diagram showing an example of the configuration of the information providing system according to the seventh embodiment. In the seventh embodiment, the conversation state is used for specifying the URL(1) instead of the URL(0). The conversation state represents the state of the browser 290 when the user inputs voice for specifying the URL(1). The conversation state may also be a state corresponding to the URL(0).
[0184] [2. Conversation State]
[0185] In one implementation example, the conversation state includes the intention used for obtaining the URL(0). When the intention includes slots, the conversation state further includes the values of the slots (the values filled in the placeholders) used for obtaining the URL(0).
[0186] For example, the URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn" is obtained when the intention "display messages received from [*1]" is identified as the intention corresponding to the voice input by the user. More specifically, it is obtained by filling the value "John" of the slot into the URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3A[*1]" associated with the above intention in the intention-URL database. In this case, the conversation state corresponding to the URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn" includes the intention "display messages received from [*1]" and the value "John".
[0187] [3. Outline of Processing]
[0188] Each of FIGS. 33 and 34 is a diagram showing an outline of the processing in the seventh embodiment. With reference to FIGS. 32 to 34, the outline of the processing in the seventh embodiment will be described.
[0189] In the example of FIG. 32, the extension function 292 acquires voice (0) and transmits the voice (0) to the language processing server 100. In the language processing server 100, the speech recognition unit 110 identifies the text (0) corresponding to the voice (0) and transmits it to the natural language understanding unit 120. In the natural language understanding unit 120, the information processing unit 121 identifies the grammar (0) to which the text (0) conforms, identifies the intention (0) corresponding to the grammar (0), and acquires the URL (0) corresponding to the intention (0). At this time, the information processing unit 121 generates a conversation state (state (0)) corresponding to the URL (0). The information processing unit 121 transmits the state (0) together with the URL (0) to the extension function 292.
[0190] The extension function 292 passes the URL (0) to the browsing function 291. The browsing function 291 accesses the web server 900 using the URL (0) to acquire the web page (0), and displays the screen of the web page (0) on the display 202.
[0191] In FIG. 33, with the screen of the web page (0) being displayed, voice (1) is input to the extension function 292. When the extension function 292 receives the input of voice (1), it transmits the voice (1) together with the conversation state (state (0)) at that time to the language processing server 100.
[0192] FIG. 34 shows the processing after the input of voice (1) and state (0) to the language processing server 100.
[0193] In the language processing server 100, the speech recognition unit 110 identifies the text (1) corresponding to the voice (1). Then, the speech recognition unit 110 transmits the text (1) and the state (0) to the natural language understanding unit 120.
[0194] In the natural language understanding unit 120, the information processing unit 121 identifies the grammar (grammar (1)) that matches the text (1), identifies the intention (intention (1)) corresponding to the grammar (1), and then acquires the URL (URL (1)) corresponding to the intention (1). The state (0) is used for acquiring the URL (1) as necessary. The usage mode of the state (0) will be described later with reference to FIG. 37 and the like.
[0195] Also, the information processing unit 121 uses the text (1) and the grammar (1) to generate a conversation state (state (1)) corresponding to the URL (1).
[0196] The information processing unit 121 transmits the URL (1) and the state (1) to the extension function 292. The extension function 292 passes the URL (1) to the browsing function 291.
[0197] When voice is input while the screen of the web page (1) corresponding to the URL (1) is being displayed, the extension function 292 may transmit the voice together with the state (1) to the language processing server 100.
[0198] [4. Grammar-Intention Database]
[0199] FIG. 35 is a diagram showing a modification example of the grammar-intention database 122. In the example of FIG. 35, the grammar-intention database 122 further includes the grammar "[What about [*8]]" having "Special Follow-up" as the value of the type. In the example of FIG. 35, the intention associated with the grammar "[What about [*8]]" is defined as an intention specified in the conversation state.
[0200] [5. Process Flow]
[0201] FIG. 36 is a flowchart of a modification example of the process shown in FIG. 11. The example of FIG. 36 includes step S205 instead of step S204, and includes steps S105 and S107 instead of steps S104 and S106.
[0202] In step S205, the extension function 292 transmits the input voice (voice (1)) and the conversation state (state (0)) at that time to the language processing server 100.
[0203] In step S105, the language processing server 100 identifies the intention (intention (1)) of the text (1) as a function of the information processing unit 121. When the value of the type of grammar to which the text (1) conforms is "Special Follow-up", the intention (intention (0)) specified in the state (0) is identified as the intention (1). That is, the intention (1) is the intention (0). In one example, the intention specified for the immediately preceding input voice is used as the intention of the currently input voice.
[0204] In step S107, the language processing server 100 acquires the URL (1) corresponding to the text (1) as a function of the information processing unit 121.
[0205] FIG. 37 is a flowchart of the subroutine of step S107. The process of FIG. 37 further includes steps S1070, S1072, and S1074 as compared with the process of FIG. 16.
[0206] In step S1070, the language processing server 100 determines whether the value of the type of grammar (1) is special follow-up. If the language processing server 100 determines that the value of the type of grammar (1) is special follow-up (YES in step S1070), it proceeds with the control to step S1072; otherwise (NO in step S1070), it proceeds with the control to step S1060.
[0207] In step S1072, the language processing server 100 identifies the URL (1) associated with the intention (1).
[0208] In step S1074, the language processing server 100 updates the URL (1) by filling the placeholder of the URL (1) identified in step S1072 with the value of the slot included in the text (1). Then, the language processing server 100 returns the control to FIG. 36.
[0209] [6. Specific Example]
[0210] A specific example of the update of the URL (1) in step S1074 will be described.
[0211] In this specific example, when the screen of the web page of the URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn" is being displayed, the voice "What about Sue?" is input. That is, the URL (0) is "https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn" and the voice (1) is "What about Sue?". In this case, the text (1) is the same as the voice (1), which is "What about Sue?".
[0212] · Web page (0)
[0213] The web page displayed by the URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn" is a web page that displays the search results of messages from the sender "John" in the inbox of the webmail.
[0214] · Status (0)
[0215] The conversation state (status (0)) when voice (1) is input corresponds to the URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn". And the conversation state (status (0)) of this URL, as described above, includes the intention "[*1] Display the messages received from" and the value "John".
[0216] · Intention (0)
[0217] The intention (0) specified by status (0) is the intention (0) included in status (0), which is the intention "[*1] Display the messages received from" as described above.
[0218] · Values of the slots included in Text (1)
[0219] The text "What about Sue?" conforms to the grammar "[*8] What about?". The value of slot [*8] is "Sue" (hereinafter, may also be denoted as "Sue"). This value is filled into URL (1) as the value corresponding to the placeholder of URL (1).
[0220] · Step S1070
[0221] The value of the type of the grammar "[*8] What about?" is "Special follow-up". Therefore, the control proceeds from step S1070 to step S1072.
[0222] · Step S1072
[0223] The URL specified in step S1072 is a URL associated with intention (1) (the intention of "displaying a message from [*1]"), that is, the URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3A[*1]".
[0224] · Step S1074
[0225] In step S1074, URL (1) is updated by filling the placeholder of the URL (1) with the value of the slot included in text (1). More specifically, when "Sue" is filled in [*1] of the URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3A[*1]", this URL is updated. The updated URL (1) is "https: / / mail.AAA.com / mail / u / 0 / #search / from%3ASue".
[0226] According to the specific examples described above, when the user inputs "Show me the messages from John" as voice (0), the screen of the web page of the URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3AJohn" is displayed. This screen is a screen that displays the results of searching for messages from John. When this screen is being displayed and the user inputs "What about Sue?" as voice (1), the screen of the web page of the URL "https: / / mail.AAA.com / mail / u / 0 / #search / from%3ASue" is displayed. This screen is a screen that displays the results of searching for messages from Sue.
[0227] [7. Variation Example]
[0228] The conversation state (state (0)) corresponding to URL(0) may be obtained based on URL(0). In this case, first, among the one or more URLs registered in the intent-URL database, the URL with the most common parts with URL(0) is selected. Then, the conversation state (state (0)) is specified to include the intent associated with the selected URL and the value filled in the placeholder of the selected URL at URL(0).
[0229] <Eighth Embodiment>
[0230] FIG. 38 is a diagram showing an example of the configuration of the information providing system according to the eighth embodiment. The example of FIG. 38 further includes an intent developer server 910 and a database developer server 920. The intent developer server 910 is managed by a person who provides a phrase to be used as a new intent using natural language processing technology. The database developer server 920 is managed by a database developer who constructs an intent-URL database.
[0231] FIG. 39 is a diagram for explaining the flow of constructing the intent-URL database in the example of FIG. 38.
[0232] As shown in FIG. 39, a web server 900 that provides a web page registers a URL for web page provision with the database developer server 920. The registered URL may include a placeholder associated with a specific use.
[0233] The intent developer server 910 registers a phrase to be used as a new intent with the database developer server 920. The registered phrase may include a slot associated with a specific use.
[0234] Based on the usage, the database developer server 920 constructs an intent-URL database by associating the URLs registered from the web server 900 with the phrases (intents) registered from the intent developer server 910. Then, the database developer server 920 provides the constructed intent-URL database to the language processing server 100.
[0235] For example, as an example of a URL, the web server 900 registers the URL (A) “http: / / url / price[*10]” with the database developer server 920. Among the URL (A), [*10] is a placeholder associated with the usage “company name for which stock price is searched”. “http: / / url / price” is the part that defines providing the stock price of a company in the URL (A).
[0236] On the other hand, as an example of a phrase for an intent, the intent developer server 910 registers the phrase (P) “display the stock price of [*11]” with the database developer server 920. Among the phrase (P), [*11] is a slot associated with the usage “company name for which stock price is searched”.
[0237] The usage of [*10] and the usage of [*11] are the same. Therefore, the database developer server 920 constructs an intent-URL database so as to associate the URL (A) with the intent specified by the phrase (P). The database developer server 920 may construct an intent-URL database by specifying a plurality of URLs with a plurality of intents in the same way. The database developer server 920 provides the constructed intent-URL database to the language processing server 100.
[0238] At this time, the intent developer server 910 may construct a grammar-intent database that associates the intent corresponding to the phrase registered with the database developer server 920 with the grammar, and provide it to the language processing server 100.
[0239] Each embodiment disclosed herein should be considered illustrative in all respects and not restrictive. The scope of the present invention is defined not by the above description but by the claims, and it is intended that all modifications within the meaning and scope equivalent to the claims be included. Also, the inventions described in the embodiments and each modification are intended to be implemented, as much as possible, either alone or in combination.
Explanation of Signs
[0240] 1 Information providing system, 100 Language processing server, 200 User terminal, 250, 250A, 250B, 250C Screens, 251 Address bar, 252 Microphone icon, 253 Message list, 260 Pop-up screen, 261 Input field, 262 Query button, 263 Speak button, 264 Display field, 290 Browser, 291 Browsing function, 292 Extension function, 900, 900A, 900B Web servers, 910 Intent developer server, 920 Database developer server.
Claims
1. A method implemented by a computer, comprising: obtaining an inquiry intention based on inquiry information input to a user terminal, the inquiry information including at least one of voice and text; obtaining a response URL corresponding to the inquiry intention according to the relationship with one or more URLs corresponding to each of one or more intentions defined in an intention-URL database; providing the response URL to a browser installed on the user terminal; further comprising obtaining a previous URL, the previous URL corresponding to a web page displayed by the browser when the inquiry information was input to the user terminal; The step of obtaining the response URL includes generating the response URL by combining the previous URL and a base URL associated with the inquiry intention in the intention-URL database. An information providing method.
2. The step of obtaining the inquiry intention includes identifying an inquiry grammar that conforms to the inquiry information, the inquiry intention is associated with the inquiry grammar in a grammar-intention database, the inquiry grammar includes slots, the response URL includes slots corresponding to the slots in the inquiry grammar, The step of obtaining the response URL includes filling a placeholder in the response URL with a value of the slot included in the inquiry information. The information providing method according to claim 1.
3. Generating the response URL is performed in response to the inquiry information including a request for narrowing down information shown on the web page. The information providing method according to claim 1 or claim 2.
4. The step of obtaining the inquiry intention is performed in response to the previous URL being a predetermined URL. The information providing method according to claim 1 or claim 2.
5. A method implemented by a computer, comprising: obtaining an inquiry intention based on inquiry information input to a user terminal, the inquiry information including at least one of voice and text; obtaining a response URL corresponding to the inquiry intention according to the relationship with one or more URLs corresponding to each of one or more intentions defined in an intention-URL database; providing the response URL to a browser installed on the user terminal; further comprising obtaining a conversation state using a previous URL, wherein the previous URL corresponds to a web page displayed by the browser when the inquiry information was input to the user terminal, and the conversation state includes a common intention that is an intention associated with a URL having the most common parts with the previous URL in the intention-URL database, and values filled in placeholders in the previous URL; the inquiry intention is the common intention; The step of obtaining the response URL includes filling at least a part of the inquiry information in a placeholder of a URL associated with the inquiry intention in the intention-URL database. An information providing method.
6. A step of obtaining update content; The information providing method according to any one of claims 1 to 5, further comprising updating the relationship in the intention-URL database using the update content.
7. A program that, when executed by one or more processors of a computer, causes the computer to implement the information providing method according to any one of claims 1 to 6.
8. A method for generating an intention-URL database realized by a computer, comprising: obtaining a URL having a placeholder; obtaining two or more phrases, each of the two or more phrases being associated with an intention and having a slot associated with a use; extracting, from the two or more phrases, a phrase having a slot associated with a use corresponding to the use of the placeholder of the URL; generating the intention-URL database by associating the URL with the extracted phrase. A method for generating an intention-URL database.
9. A program that, when executed by a processor of a computer, causes the computer to implement the method for generating an intention-URL database according to claim 8.
Citation Information
Patent Citations
Network system using fire wall dynamic control system
JP2000132473A
Site retrieval system and site retrieval method
JP2013109568A
Speech sentence collection device, method, and program
JP2015148910A
Natural language grammar adapted to interactive experience
JP2020091907A
Speech retrieval device, speech retrieval method, and display device
WO2015146017A1