METHOD FOR PROVIDING CONTEXT-BASED INTERACTIVE SERVICE AND USER TERMINAL

The context-based interactive service system addresses limitations in AI models by using viewport data to enhance chatbot responses with domain-specific knowledge, improving answer accuracy and knowledge processing.

JP7589905B2Active Publication Date: 2024-11-26INSWAVE SYSTEMS CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2024012334
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2023-04-10
Filing Date
2024-01-30
Publication Date
2024-11-26
Estimated Expiration
2044-01-30

AI Technical Summary

Technical Problem

Conventional AI models like ChatGPT lack sufficient domain-specific knowledge and are limited by context handling capacity, making it difficult to provide accurate answers in technical domains such as software development.

Method used

A context-based interactive service system and method that utilizes viewport information from user terminals to generate context information, including data before and after scrolling, to enhance chatbot responses by integrating domain-specific knowledge.

Benefits of technology

Improves answer accuracy in technical domains by leveraging relevant screen information as context, enabling efficient processing of knowledge across various domains.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007589905000001
    Figure 0007589905000001
  • Figure 0007589905000002
    Figure 0007589905000002
  • Figure 0007589905000003
    Figure 0007589905000003
Patent Text Reader

Abstract

To provide a context-based interactive service provision system and method.SOLUTION: A context-based interactive service provision method includes steps of: causing a chatbot execution unit to execute a chatbot in accordance with a user input during execution of a specific application on a user terminal to display a dialog box; causing a context information generation unit to generate context information based on viewport information of the user terminal; causing a message input unit to receive a dialog message through the dialog box; causing a terminal message transfer unit to transfer the dialog message and the context information, as an input message, to a chatbot server; and receiving an answer message corresponding to the input message from the chatbot server to display as an answer through the dialog box.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a context-based interactive service providing system, method, and user terminal. [Background technology]

[0002] In the past, when a user wanted to find a solution in a technical document, they had to first read and understand the document, and then search for a solution based on what they had understood.

[0003] ChatGPT, a representative general-purpose model of conversational artificial intelligence (AI), which has become an issue recently, has excellent natural language processing capabilities and can provide a certain level of answers to general user questions. However, it lacks knowledge of specific domains (e.g., specific software development methods), and is limited in that it cannot provide accurate answers to questions about those domains.

[0004] In addition, ChatGPT can only process a maximum of about 4,000 tokens, and there are limitations on adding context. [Prior art documents] [Patent documents]

[0005] Korean Patent Publication No. 10-2021-0134581 (Published on November 10, 2021) - Server and method for providing interactive services Summary of the Invention [Problem to be solved by the invention]

[0006] An object of the present invention is to provide a system and method for providing a context-based interactive service that can automatically use information (text, images, videos, etc.) about the viewport that a user is viewing through a terminal as context to interactively find appropriate answers.

[0007] Another object of the present invention is to provide a system, method, and user terminal for providing a context-based interactive service that can improve the answers of an interactive artificial intelligence model and process knowledge of various domains by using information in technical documents that is highly relevant to the current screen as context in situations where specific domain knowledge is required, such as software development.

[0008] Further objects of the present invention will become more apparent based on the preferred embodiments described below. [Means for solving the problem]

[0009] In order to achieve the above object, according to one aspect of the present invention, there is provided a method for providing a context-based interactive service performed in a user terminal, the method including: a step of executing a chatbot in response to a user input while a specific application is being executed on the user terminal by a chatbot execution unit and displaying a dialog box; a step of generating context information based on viewport information of the user terminal by a context information generation unit; a step of inputting a dialog message through the dialog box by a message input unit; a step of transferring the dialog message and the context information as an input message to a chatbot server by a terminal message forwarding unit; and a step of receiving an answer message corresponding to the input message from the chatbot server and displaying it as an answer through the dialog box.

[0010] The context information may be generated based on the data currently displayed through the viewport.

[0011] If the viewport was scrolled immediately before the user's input, the context information may be generated by additionally utilizing data that was lost depending on the direction of the scroll.

[0012] When the scroll direction is downward scroll, the top end data of the viewport may be additionally used, and when the scroll direction is upward scroll, the bottom end data of the viewport may be additionally used.

[0013] The range of the top end data and the bottom end data that are additionally utilized according to the scroll speed may be variable.

[0014] The viewport is a viewer, and at least one of a web address for accessing a document displayed via the viewer and a link contained within the document may be additionally utilized in generating the context information.

[0015] The viewport is a video player that plays video content, and upon user input, the context information can be generated by additionally utilizing at least one of the current playback position of the video content and content contents before and after a certain time based on the current playback position.

[0016] Meanwhile, according to another aspect of the present invention, there is provided a user terminal that is network-connected to a chatbot server to provide a context-based interactive service, the user terminal including: a chatbot execution unit that executes a chatbot in response to a user input while a specific application is being executed and displays a dialog box; a context information generation unit that generates context information based on viewport information of the user terminal; a message input unit that receives a dialog message from a user through the dialog box; and a terminal message forwarding unit that transmits the dialog message and the context information as an input message to the chatbot server, receives a response message corresponding to the input message from the chatbot server, and displays it as a response through the dialog box.

[0017] The specific application may be one of a viewer for displaying documents or images and a video player for playing video content, and specific buttons for the user's input may be displayed on the execution screen of the specific application.

[0018] When the dialog box is executed, the context information generation unit may generate the context information by utilizing at least one of data currently displayed in the viewport, data that was scrolled out immediately before the user's input, a web address for accessing the data currently displayed in the viewport, and a link included in the data.

[0019] When the dialog box is executed, the context information generating unit may generate the context information by additionally utilizing at least one of the current playback position of the video content played through the viewport and content contents before and after a certain time based on the current playback position.

[0020] Further aspects, features, and advantages will become apparent from the following drawings, claims, and detailed description of the invention. Effect of the Invention

[0021] According to an embodiment of the present invention, it is possible to automatically use information (text, images, videos, etc.) about the screen that a user is viewing via a terminal as context to interactively find an appropriate answer.

[0022] In addition, in situations that require specific domain knowledge, such as software development, the use of relevant information from technical documents in relation to the current screen as context can improve the answers of conversational AI models, enabling them to process knowledge from a variety of domains. [Brief description of the drawings]

[0023] [Figure 1] FIG. 1 is a block diagram of a context-based interactive service providing system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram of a user terminal according to an embodiment of the present invention. [Diagram 3] FIG. 3 is a block diagram of a chatbot server according to an embodiment of the present invention. [Figure 4] FIG. 4 is a flowchart of a method for providing a context-based interactive service according to an embodiment of the present invention. [Diagram 5] FIG. 5 is a first exemplary diagram illustrating a method for generating context information by utilizing a screen of a viewport executed on a user terminal. [Figure 6] FIG. 6 is a second exemplary diagram illustrating a method for generating context information by utilizing a screen before scrolling of a viewport executed on a user terminal. [Figure 7] FIG. 7 is a third exemplary diagram illustrating a method for generating context information by utilizing a screen before scrolling of a viewport executed on a user terminal. [Figure 8]FIG. 8 is a fourth exemplary diagram illustrating a method for generating context information by utilizing information of a video player executed on a user terminal. [Figure 9] FIG. 9 is a fifth exemplary diagram illustrating a method for generating context information by utilizing an address and link information of a viewport executed in a user terminal. [Figure 10] FIG. 10 is a diagram showing the configuration of a user terminal 100 and a chatbot server 200 according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] Since the present invention can be modified in various ways and has a plurality of embodiments, a specific embodiment will be illustrated in the drawings and described in detail, but it is not intended to limit the present invention to the specific embodiment, and it should be understood that the present invention includes all modifications, equivalents, and alternatives within the spirit and technical scope of the present invention.

[0025] When an element is referred to as being "coupled" or "connected" to another element, it should be understood that it may be directly coupled or connected to the other element, but that there may be other elements between them. On the other hand, when an element is referred to as being "directly coupled" or "directly connected" to another element, it should be understood that there are no other elements between them.

[0026] Terms such as first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only to distinguish one component from another.

[0027] The terms used in this application are merely used to describe certain embodiments and are not intended to limit the present invention. A singular expression includes a plural expression unless the context clearly indicates otherwise. In this application, the terms "include" or "have" are intended to specify the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, and are not intended to preclude the presence or additional possibility of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0028] In this specification, the term "unit" includes a unit implemented by hardware, a unit implemented by software, and a unit implemented by both. Also, one unit may be implemented by two or more pieces of hardware, and two or more units may be implemented by one piece of hardware. Meanwhile, the term "unit" is not limited to software or hardware, and the "unit" may be configured to reside on an addressable storage medium or to execute one or more processors. Thus, by way of example, the term "unit" includes components such as software components, object-oriented software components, class components, task components, processes, functions, attributes, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The components and functions provided in the "units" may be combined by fewer components and "units" or further separated into additional components and "units". Furthermore, the components and "units" may be embodied to execute one or more CPUs in a device.

[0029] Furthermore, it is to be understood that the components of the embodiments described with reference to each drawing are not limited to the applicable embodiment only, but may be embodied to be included in other embodiments within the scope of the technical idea of ​​the present invention, and that separate explanations may be omitted or multiple embodiments may be re-embodied as a single integrated embodiment.

[0030] In addition, when describing the present invention with reference to the accompanying drawings, the same or corresponding reference numerals are used for the same components regardless of the reference numerals, and duplicated descriptions thereof will be omitted. In describing the present invention, if a detailed description of related prior art is determined to unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

[0031] FIG. 1 is a block diagram of a context-based interactive service providing system according to one embodiment of the present invention, FIG. 2 is a block diagram of a user terminal according to one embodiment of the present invention, FIG. 3 is a block diagram of a chatbot server according to one embodiment of the present invention, and FIG. 4 is a flowchart of a context-based interactive service providing method according to one embodiment of the present invention.

[0032] Referring to FIG. 1 , a context-based interactive service providing system 1 according to the present embodiment may include a user terminal 100 and a chatbot server 200.

[0033] The user terminal 100 is provided with a chatbot service (a context-based interactive service in this embodiment) while exchanging data with the chatbot server 200 via a network.

[0034] The user terminal 100 is a computing device that is equipped with a chatbot service-related application or program (hereinafter referred to as an "application") or that can be downloaded and installed, and that is equipped with an operating system that can run the application, and may be, for example, a smartphone, a tablet PC, a laptop, a desktop PC, etc.

[0035] A chatbot refers to a computer program created to perform a specific task through dialogue with humans via voice or text. In this embodiment, the chatbot can be embodied so as to be executed on a specific application (e.g., a document viewer, an image viewer, a video player, etc.) for which an interactive service is to be provided.

[0036] A chatbot service refers to a service provided by a chatbot, such as providing a response to a question message received from a user terminal 100 or performing various requests (e.g., searches) received from a user terminal 100.

[0037] During execution of a particular application, the chatbot service may be provided in a manner that the chatbot server 200 and the user terminal 100 are engaged in a dialogue through a separate pop-up dialog box. That is, when a user inputs a question or request in the form of a request message on the dialog box, the chatbot server 200 may provide a chatbot service in a manner that the user receives a response to the question or request in the form of a response message. As a result, a user who receives the chatbot service can check desired information or receive required functions as if he or she were engaged in a dialogue with a consultant.

[0038] Providing a chatbot service through a pop-up dialog box is just one example, and it is clear that the chatbot service can be provided in various other forms.

[0039] The chatbot server 200 is a hardware device that installs and runs a chatbot to provide a chatbot service. A service provider can use the chatbot server 200 to provide a chatbot service to the user terminal 100.

[0040] In this embodiment, the user terminal 100 can execute a dialog box for a chatbot service in response to a user's input while a specific application is being executed. In this case, context data can be generated using information about a screen displayed through a specific application currently being executed, and can be transferred to the chatbot server 200 as an input message together with a dialogue message input by the user. The chatbot server 200 can find an optimal answer based on the context, rather than a simple answer to a question, and provide it as an answer message by analyzing and utilizing the context data as well as the dialogue message included in the input message.

[0041] 2, the user terminal 100 may include a chatbot execution unit 110, a context information generation unit 120, a message input unit 130, and a terminal message forwarding unit 140. The components shown in FIG. 2 are not essential for implementing the user terminal 100, so the user terminal 100 described in this specification may have more or less components than those listed above.

[0042] The chatbot execution unit 110 executes the chatbot (program) when there is an input from a user designated to receive the chatbot service (step S300). The input from the designated user may be a selection of a specific button (or icon) for executing the chatbot by touching (or clicking), or the like.

[0043] When the chatbot is executed, a dialog box may be displayed in a pop-up manner on the display of the user terminal 100. Just before the chatbot is executed, the user terminal 100 may execute a specific application, and therefore a viewport corresponding to the screen area of ​​the specific application may be displayed on the display. In this embodiment, the dialog box may be displayed overlapping the viewport. Alternatively, the display screen may be divided and displayed in parallel with the viewport, or may be displayed in an area other than the area occupied by the viewport.

[0044] When the chatbot is executed, the context information generator 120 analyzes the screen area (i.e., viewport) of a specific application currently displayed through the display of the user terminal 100, and generates context information based on the analysis results (step S305).

[0045] The context information can be generated in the following ways.

[0046] Basically, you can use the text in the viewport (see figure 5).

[0047] Alternatively, text in the viewport and text around the viewport (top and / or bottom) can be used.

[0048] Alternatively, if the viewport is scrolled down, the text in the top region that just disappeared from the viewport can be used (see figure 6).

[0049] Alternatively, if the viewport is scrolled up, the text in the bottom region that recently disappeared from the viewport can be used (see figure 7).

[0050] Alternatively, in the case of video content, the current playback position and surrounding previous and / or subsequent content can be used (see FIG. 8).

[0051] Alternatively, the web page address for the screen displayed in the viewport and any links contained within the screen can be used (see figure 9).

[0052] The message input unit 130 receives a dialogue message from the user (step S310). The form in which the dialogue message is input is not limited. For example, the dialogue message may include a voice utterance of the user inputted through a microphone of the user terminal 100, a text utterance of the user inputted by a typing means (keyboard, keypad, touch screen, mouse, etc.) of the user terminal 100, etc.

[0053] The terminal message forwarding unit 140 can forward the input message, which is an integration of the dialogue message and the context information input by the user, to the chatbot server 200 (step S315).

[0054] Then, the terminal message forwarding unit 140 can receive a response message from the chatbot server 200 in response to the input message, and display the response message in a dialog box so that the user can confirm it (step S320).

[0055] 3, the chatbot server 200 may include a server message forwarder 210, a context analyzer 220, a reply message generator 230, and a database 240. The components shown in FIG. 3 are not required to implement the chatbot server 200, so the chatbot server 200 described herein may have more or less components than those listed above.

[0056] The server message forwarding unit 210 receives an input message from the user terminal 100 on which the chatbot is running via the network. Then, it can forward a reply message including a reply to the input message as a response to the input message.

[0057] The context analyzer 220 may analyze an input message and classify it into a dialogue message and context information, and may analyze the context information extracted from the input message to clearly understand the meaning of the dialogue message.

[0058] The reply message generating unit 230 generates a reply message by finding a reply corresponding to the dialogue message from the database 240. In this case, it is possible to grasp the user's intention intended by the dialogue message based on the context information analyzed by the context analyzing unit 220, and find a reply that is most suitable for the user's intention.

[0059] A number of predicted messages predicted as dialogue messages and responses to each predicted message may be stored and managed in the database 240. The database 240 may be implemented, for example, as a Large Language Model (LLM), which is an artificial intelligence model trained based on a large amount of text.

[0060] The database 240 may be built within the chatbot server 200, or may be built separately externally and connected to the chatbot server 200 via a network.

[0061] Since it is obvious to a person skilled in the art how the chatbot server 200 finds and responds with an appropriate answer message using context information and a dialogue message, detailed description thereof will be omitted.

[0062] FIG. 5 is a first exemplary diagram illustrating a method for generating context information by utilizing a screen of a viewport executed on a user terminal.

[0063] 5, a viewport of a particular application running on a user terminal is shown, where the particular application may be a document viewer.

[0064] When a user selects (e.g., touches) a particular button within the viewport, a chatbot dialog box 310 may pop up.

[0065] When the chatbot dialog box 310 is executed, the data displayed in the viewport of a particular application is used as context information and communicated to the chatbot server 200 along with the user's dialog message so that the chatbot server 200 can use it as the basis for generating a response to the chat message.

[0066] Context information can be generated by assigning a pre-specified weight to a portion of the total text of a document displayed through the document viewer that is displayed in the viewport when the chatbot dialog box 310 is executed.

[0067] 6 and 7 are second and third exemplary diagrams illustrating a method for generating context information using a screen before scrolling of a viewport executed in a user terminal.

[0068] 6, a viewport of a particular application running on a user terminal is shown, where the particular application may be a document viewer.

[0069] This example relates to a case where the user scrolls downward immediately before the button touch operation.

[0070] When a user selects (e.g., touches) a particular button within the viewport, a chatbot dialog box 310 may pop up.

[0071] When the chatbot dialog box 310 is executed, the data currently displayed in the viewport of a particular application and the top data of the viewport that has disappeared from the current viewport due to downward scrolling are combined and used as context information, and transmitted to the chatbot server 200 together with the user's dialogue message, so that the chatbot server 200 can use it as basic data for generating a response to the dialogue message.

[0072] Context information can be generated by assigning a pre-specified weight to a portion of the text displayed in the viewport when the chatbot dialog box 310 is executed and to the text around the viewport (especially the top) out of the total text of the document displayed through the document viewer.

[0073] Figure 7 shows the case where the scroll direction is upwards instead of downwards, in which case the data currently displayed in the viewport and the bottom edge of the viewport data that is now removed from the viewport by the upward scroll can be used in combination as context information.

[0074] That is, the range of data that disappears due to scrolling but is used as context information may change depending on the direction of scrolling.

[0075] Furthermore, the range of data that disappears due to scrolling but is used as context information may change depending on the scrolling speed. If the scrolling speed is fast, the range of the top and / or bottom of the viewport used as context information may increase, and if the scrolling speed is slow, the range of the top and / or bottom of the viewport used as context information may decrease. That is, the range of the top and / or bottom of the viewport used as context information may be determined in proportion to the scrolling speed.

[0076] FIG. 8 is a fourth exemplary diagram illustrating a method for generating context information by utilizing information of a video player executed on a user terminal.

[0077] Referring to FIG. 8, the application executed on the user terminal may be a video player.

[0078] When the video player is playing and the user selects (e.g., touches) a particular button within the viewport, a chatbot dialog box 310 may pop up.

[0079] When the chatbot dialog box 310 is executed, the current playback position of the video content played by the video player and the content content before and after a certain time based on the current playback position can be used as context information.

[0080] FIG. 9 is a fifth exemplary diagram illustrating a method for generating context information by utilizing an address and link information of a viewport executed in a user terminal.

[0081] 9, a viewport of an application running on a user terminal is shown, where the particular application may be a document viewer.

[0082] An example of this would be where there is a web address for the document being displayed through the viewport, or a link within the document.

[0083] When a user selects (e.g., touches) a particular button within the viewport, a chatbot dialog box 310 may pop up.

[0084] When the chatbot dialog box 310 is executed, one or more of the data currently displayed in the viewport of a particular application (text and / or images), the web address to access the document, and / or links contained within the document may be combined and used as context information and communicated to the chatbot server 200 along with the user's dialog message to serve as the basis for the chatbot server 200 to generate a response to the chat message.

[0085] According to this embodiment, by executing a chatbot dialogue box and inputting a question while viewing content (e.g., a document) related to specific domain knowledge, an answer using the content of the content as an extended context is provided, thereby improving the accuracy of the answer to the user's question and providing the ability to process knowledge of various domains. This shortens the process of reading and understanding existing documents, and provides the user with faster and more accurate information.

[0086] FIG. 10 is a diagram showing the configuration of a user terminal 100 and a chatbot server 200 according to an embodiment of the present invention.

[0087] 10, the user terminal 100 and / or the chatbot server 200 includes a processor 410 and a memory 420. The memory 420 stores one or more instructions executable by the processor 410. The processor 410 executes one or more instructions stored in the memory 420. The processor 410 can perform one or more operations described above with reference to FIGS. 1 to 9 by executing the instructions. Furthermore, the configurations of the present invention described above with reference to FIGS. 2 and 3 may be configurations embodied by instructions executed by the processor 410.

[0088] The above-described method for providing a context-based interactive service may also be embodied in the form of a recording medium including computer-executable instructions, such as an application or program module executed by a computer. The computer-readable medium may be any solvable medium accessible by a computer, and includes both volatile and non-volatile media, and separate and non-separate media. Furthermore, the computer-readable medium may include a computer storage medium. The computer storage medium includes both volatile and non-volatile, separate and non-separate media embodied in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data.

[0089] The above-mentioned method for providing a context-based interactive service may be executed by an application (which may include a program included in a platform or operating system that is basically installed in the terminal) that is basically installed in the terminal, or may be executed by an application (i.e., a program) that is directly installed in the master terminal by the user via an application providing server such as an application store server, an application or a web server related to the service. In this sense, the above-mentioned method for providing a context-based interactive service may be embodied by an application (i.e., a program) that is basically installed in the terminal or directly installed by the user, and may be recorded in a computer-readable recording medium such as a terminal.

[0090] Although the present invention has been described above with reference to preferred embodiments, it will be understood by those skilled in the art that the present invention can be modified and changed in various ways without departing from the spirit and scope of the present invention as set forth in the following claims. [Explanation of symbols]

[0091] 1: Context-based interactive service system 100: User terminal 110: Chatbot Execution Department 120: Context information generation unit 130: Message input section 140: Terminal message transfer unit 200: Chatbot server 210: Server message transfer section 220: Context Analysis Unit 230: Reply message generation unit 240: Database

Claims

1. A method for providing a context-based interactive service performed in a user terminal, comprising: A step of executing the chatbot by a chatbot execution unit and displaying a dialog box in response to a user's input while a specific application is being executed on the user terminal; generating, by a context information generating unit, context information using viewport information of the user terminal; a step of inputting a dialogue message through the dialogue box by a message input unit; forwarding the dialogue message and the context information as an input message to a chatbot server by a terminal message forwarding unit; receiving a response message corresponding to the input message from the chatbot server, and displaying the response message through the dialog box; In the step of generating the context information, data currently displayed through a viewport is used as the context information; A method for providing a context-based interactive service, characterized in that, when the viewport is scrolled immediately before the user's input, the context information is generated by additionally using data that has disappeared depending on the direction of the scroll.

2. 2. The method for providing a context-based interactive service according to claim 1, wherein, when the scrolling direction is downward scrolling, the top end data of the viewport is additionally used, and when the scrolling direction is upward scrolling, the bottom end data of the viewport is additionally used.

3. 3. The method for providing a context-based interactive service according to claim 2, wherein a range of the top end data and the bottom end data that are additionally used is variable depending on the speed of the scroll.

4. The viewport is the viewer.

2. The method for providing a context-based interactive service according to claim 1, wherein at least one of a web address for accessing a document displayed through the viewer and a link contained in the document is additionally used as the context information.

5. A method for providing a context-based interactive service performed in a user terminal, comprising: A step of executing the chatbot by a chatbot execution unit and displaying a dialog box in response to a user's input while a specific application is being executed on the user terminal; generating, by a context information generating unit, context information using viewport information of the user terminal; a step of inputting a dialogue message through the dialogue box by a message input unit; forwarding the dialogue message and the context information as an input message to a chatbot server by a terminal message forwarding unit; receiving a response message corresponding to the input message from the chatbot server, and displaying the response message through the dialog box; In the step of generating the context information, data currently displayed through a viewport is used as the context information; The viewport is a video player that plays video content. A method for providing a context-based interactive service, characterized in that, when the user inputs, the content content at the current playback position of the video content and / or the content content within a certain period of time before or after the current playback position are added as the context information.

6. A user terminal that is networked with a chatbot server to provide a context-based interactive service, a chatbot execution unit that executes a chatbot and displays a dialog box in response to a user's input while a specific application is being executed; a context information generating unit that generates context information by using viewport information of the user terminal; a message input section for inputting a dialogue message from a user through the dialogue box; a terminal message forwarding unit for forwarding the dialogue message and the context information to a chatbot server as an input message, receiving a reply message corresponding to the input message from the chatbot server, and displaying the reply message through the dialogue box; the specific application is a viewer for displaying a document or an image, a specific button for the user's input is displayed on the execution screen of the specific application; The user terminal is characterized in that, when the dialog box is executed, the context information generation unit uses data currently displayed in a viewport and data that was scrolled out immediately before the user's input as the context information.

7. A user terminal that is networked with a chatbot server to provide a context-based interactive service, a chatbot execution unit that executes a chatbot and displays a dialog box in response to a user's input while a specific application is being executed; a context information generating unit that generates context information by using viewport information of the user terminal; a message input section for inputting a dialogue message from a user through the dialogue box; a terminal message forwarding unit for forwarding the dialogue message and the context information to a chatbot server as an input message, receiving a reply message corresponding to the input message from the chatbot server, and displaying the reply message through the dialogue box; The specific application is a video player that plays video content, a specific button for the user's input is displayed on the execution screen of the specific application; The context information generating unit is a user terminal characterized in that when the dialog box is executed, the context information generating unit adds both or either of the content content at the current playback position of the video content played through a viewport and the content content within a certain time period before or after the current playback position and uses them as the context information.

Citation Information

Patent Citations

  • Using context information to facilitate processing of commands in virtual assistant

    JP2013080476A

  • Intelligent automatic assistant for tv user interaction

    JP2017530567A

  • Information processing apparatus and information processing method

    JP2022047550A