Context-based interactive service providing method and user terminal
The context-based interactive service system addresses the limitations of conventional AI models by using viewport information to enhance answer accuracy and domain-specific knowledge, facilitating faster and more precise information retrieval.
Patent Information
- Application Number
- JP2024012335
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-29
- Filing Date
- 2024-01-30
- Publication Date
- 2025-01-20
- Estimated Expiration
- 2044-01-30
AI Technical Summary
Conventional AI models like ChatGPT lack sufficient domain-specific knowledge and are limited by context handling capacity, making it difficult to provide accurate answers in situations requiring specific knowledge, such as software development.
A context-based interactive service system that utilizes information from the user's viewport, including text, images, and videos, to generate context information relevant to the current screen, enhancing the chatbot's ability to provide accurate answers by integrating this information with user inputs.
Enables interactive AI models to improve answer accuracy by leveraging relevant context from the user's screen, facilitating faster and more precise information retrieval across various domains.
Smart Images

Figure 2025009757000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a method, system and user terminal for providing a context-based interactive service. [Background technology]
[0002] In the past, when a user wanted to find a solution in a technical document, they had to first read and understand the document, and then search for a solution based on what they had understood.
[0003] ChatGPT, a representative general-purpose model of conversational artificial intelligence (AI), which has become an issue recently, has excellent natural language processing capabilities and can provide a certain level of answers to general user questions. However, it lacks knowledge of specific domains (e.g., specific software development methods), and is limited in that it cannot provide accurate answers to questions about those domains.
[0004] In addition, ChatGPT can only process a maximum of about 4,000 tokens, and there are limitations on adding context. [Prior art documents] [Patent documents]
[0005] Korean Patent Publication No. 10-2021-0134581 (Published on November 10, 2021) - Server and method for providing interactive services Summary of the Invention [Problem to be solved by the invention]
[0006] An object of the present invention is to provide a method, system, and user terminal for providing a context-based interactive service that can automatically use information (text, images, videos, etc.) about the viewport that a user is viewing through a terminal as context to find appropriate answers interactively.
[0007] Another object of the present invention is to provide a method, system, and user terminal for providing a context-based interactive service that can improve the answers of an interactive artificial intelligence model and process knowledge of various domains by using information in technical documents that is highly relevant to the current screen as context in situations where specific domain knowledge is required, such as software development.
[0008] Further objects of the present invention will become more apparent based on the preferred embodiments described below. [Means for solving the problem]
[0009] In order to achieve the above object, according to one aspect of the present invention, there is provided a method for providing a context-based interactive service performed in a user terminal, comprising: a step of executing a chatbot in response to a user input while a specific application is being executed in the user terminal by a chatbot execution unit and displaying a dialog box; a step of generating context information based on viewport information of the user terminal by a context information generation unit; a step of inputting a dialog message through the dialog box by a message input unit; a step of transferring the dialog message and the context information as an input message to a chatbot server by a terminal message forwarding unit; and a step of receiving an answer message corresponding to the input message from the chatbot server and displaying it as an answer through the dialog box, wherein the context information is generated based on data currently displayed through a viewport, and the viewport is a video player that plays video content.
[0010] The step of generating the context information may utilize content content of the current playback position of the video content upon input by the user, and may additionally utilize at least one of content content before and after a certain time based on the current playback position to generate the context information.
[0011] In the step of generating the context information, a time range of the content to be additionally utilized can be made variable depending on a current playback speed of the video player.
[0012] The time range may be set proportional to the current playback speed.
[0013] In the step of generating the context information, if the current playback speed is a normal playback speed, content content of a basic time range set based on the current playback position can be additionally utilized, and if the current playback speed is a relatively slow or fast playback speed, content content of an adjusted time range reflecting the current playback speed in the basic time range based on the current playback position can be additionally utilized.
[0014] The adjustment time range may be determined by multiplying the basic time range by a playback speed ratio, which is a ratio of the current playback speed to the normal playback speed.
[0015] Meanwhile, according to another aspect of the present invention, there is provided a user terminal that is network-connected to a chatbot server to provide a context-based interactive service, the user terminal including: a chatbot execution unit that executes a chatbot in response to a user's input while a specific application is being executed and displays a dialog box; a context information generation unit that generates context information based on viewport information of the user terminal; a message input unit that receives a dialog message from a user through the dialog box; and a terminal message forwarding unit that transmits the dialog message and the context information as an input message to the chatbot server, receives a response message corresponding to the input message from the chatbot server, and displays it as a response through the dialog box, wherein the specific application is a video player that plays video content, and the context information generation unit generates the context information by utilizing content content of a current playback position of the video content played through the viewport when the dialog box is executed, and additionally utilizing at least one of content content before and after a certain time based on the current playback position.
[0016] The context information generating unit may vary a time range of the content to be additionally utilized according to a current playback speed of the video player.
[0017] The time range may be set proportional to the current playback speed.
[0018] The context information generating unit may additionally utilize content content of a basic time range that is set based on the current playback position when the current playback speed is a normal playback speed, and may additionally utilize content content of an adjusted time range that reflects the current playback speed in the basic time range based on the current playback position when the current playback speed is a relatively slow or fast playback speed.
[0019] Further aspects, features, and advantages will become apparent from the following drawings, claims, and detailed description of the invention. Effect of the Invention
[0020] According to an embodiment of the present invention, it is possible to automatically use information (text, images, videos, etc.) about the screen that the user is viewing via the terminal as context to interactively find an appropriate answer.
[0021] In addition, in situations that require specific domain knowledge, such as software development, the answers of interactive AI models can be improved by using information from technical documents that is highly relevant to the current screen as context, making it possible to process knowledge from a variety of domains. [Brief description of the drawings]
[0022] [Figure 1] FIG. 1 is a block diagram of a context-based interactive service providing system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram of a user terminal according to an embodiment of the present invention. [Diagram 3]FIG. 3 is a block diagram of a chatbot server according to an embodiment of the present invention. [Figure 4] FIG. 4 is a flowchart of a method for providing a context-based interactive service according to an embodiment of the present invention. [Diagram 5] FIG. 5 is a first exemplary diagram illustrating a method for generating context information by utilizing a screen of a viewport executed on a user terminal. [Figure 6] FIG. 6 is a second exemplary diagram illustrating a method for generating context information by utilizing a screen before scrolling of a viewport executed on a user terminal. [Figure 7] FIG. 7 is a third exemplary diagram illustrating a method for generating context information by utilizing a screen before scrolling of a viewport executed on a user terminal. [Figure 8] FIG. 8 is a fourth exemplary diagram illustrating how context information is generated by utilizing information of a video player executed on a user terminal. [Figure 9] FIG. 9 is a diagram showing an example of setting a time range according to a playback speed. [Figure 10] FIG. 10 is a fifth exemplary diagram illustrating a method for generating context information by utilizing an address and link information of a viewport executed in a user terminal. [Figure 11] FIG. 11 is a diagram showing the configuration of a user terminal and a chatbot server according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0023] Since the present invention can be modified in various ways and has a plurality of embodiments, a specific embodiment will be illustrated in the drawings and described in detail, but it is not intended to limit the present invention to the specific embodiment, and it should be understood that the present invention includes all modifications, equivalents, and alternatives within the spirit and technical scope of the present invention.
[0024] When an element is referred to as being "coupled" or "connected" to another element, it should be understood that it may be directly coupled or connected to the other element, but that there may be other elements between them. On the other hand, when an element is referred to as being "directly coupled" or "directly connected" to another element, it should be understood that there are no other elements between them.
[0025] Terms such as first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only to distinguish one component from another.
[0026] The terms used in this application are merely used to describe certain embodiments and are not intended to limit the present invention. A singular expression includes a plural expression unless the context clearly indicates otherwise. In this application, the terms "include" or "have" are intended to specify the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, and are not intended to preclude the presence or additional possibility of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.
[0027] In this specification, the term "unit" includes a unit implemented by hardware, a unit implemented by software, and a unit implemented by both. Also, one unit may be implemented by two or more pieces of hardware, and two or more units may be implemented by one piece of hardware. Meanwhile, the term "unit" is not limited to software or hardware, and the "unit" may be configured to reside on an addressable storage medium or to execute one or more processors. Thus, by way of example, the term "unit" includes components such as software components, object-oriented software components, class components, task components, processes, functions, attributes, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The components and functions provided in the "units" may be combined by fewer components and "units" or further separated into additional components and "units". Furthermore, the components and "units" may be embodied to execute one or more CPUs in a device.
[0028] Furthermore, it is to be understood that the components of the embodiments described with reference to each drawing are not limited to the applicable embodiment only, but may be embodied to be included in other embodiments within the scope of the technical idea of the present invention, and that separate explanations may be omitted or multiple embodiments may be re-embodied as a single integrated embodiment.
[0029] In addition, when describing the present invention with reference to the accompanying drawings, the same or corresponding reference numerals are used for the same components regardless of the reference numerals, and duplicated descriptions thereof will be omitted. In describing the present invention, if a detailed description of related prior art is determined to unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.
[0030] FIG. 1 is a block diagram of a context-based interactive service providing system according to one embodiment of the present invention, FIG. 2 is a block diagram of a user terminal according to one embodiment of the present invention, FIG. 3 is a block diagram of a chatbot server according to one embodiment of the present invention, and FIG. 4 is a flowchart of a context-based interactive service providing method according to one embodiment of the present invention.
[0031] Referring to FIG. 1 , a context-based interactive service providing system 1 according to the present embodiment may include a user terminal 100 and a chatbot server 200.
[0032] The user terminal 100 is provided with a chatbot service (a context-based interactive service in this embodiment) while exchanging data with the chatbot server 200 via a network.
[0033] The user terminal 100 is a computing device that is equipped with a chatbot service-related application or program (hereinafter referred to as an "application") or that can be downloaded and installed, and that is equipped with an operating system that can run the application, and may be, for example, a smartphone, a tablet PC, a laptop, a desktop PC, etc.
[0034] A chatbot refers to a computer program created to perform a specific task through dialogue with humans via voice or text. In this embodiment, the chatbot can be embodied so as to be executed on a specific application (e.g., a document viewer, an image viewer, a video player, etc.) for which an interactive service is to be provided.
[0035] A chatbot service refers to a service provided by a chatbot, such as providing a response to a question message received from a user terminal 100 or performing various requests (e.g., searches) received from a user terminal 100.
[0036] During execution of a particular application, the chatbot service may be provided in a manner that the chatbot server 200 and the user terminal 100 are engaged in a dialogue through a separate pop-up dialog box. That is, when a user inputs a question or request in the form of a request message on the dialog box, the chatbot server 200 may provide a chatbot service in a manner that the user receives a response to the question or request in the form of a response message. As a result, a user who receives the chatbot service can check desired information or receive required functions as if he or she were engaged in a dialogue with a consultant.
[0037] Providing a chatbot service through a pop-up dialog box is just one example, and it is clear that the chatbot service can be provided in various other forms.
[0038] The chatbot server 200 is a hardware device that installs and runs a chatbot to provide a chatbot service. A service provider can use the chatbot server 200 to provide a chatbot service to the user terminal 100.
[0039] In this embodiment, the user terminal 100 can execute a dialog box for a chatbot service in response to a user's input while a specific application is being executed. In this case, context data can be generated using information about a screen displayed through a specific application currently being executed, and can be transferred to the chatbot server 200 as an input message together with a dialogue message input by the user. The chatbot server 200 can find an optimal answer based on the context, rather than a simple answer to a question, and provide it as an answer message by analyzing and utilizing the context data as well as the dialogue message included in the input message.
[0040] 2, the user terminal 100 may include a chatbot execution unit 110, a context information generation unit 120, a message input unit 130, and a terminal message forwarding unit 140. The components shown in FIG. 2 are not essential for implementing the user terminal 100, so the user terminal 100 described in this specification may have more or less components than those listed above.
[0041] The chatbot execution unit 110 executes the chatbot (program) when there is an input from a user designated to receive the chatbot service (step S300). The input from the designated user may be a selection of a specific button (or icon) for executing the chatbot by touching (or clicking), or the like.
[0042] When the chatbot is executed, a dialog box may be displayed in a pop-up manner on the display of the user terminal 100. Just before the chatbot is executed, the user terminal 100 may execute a specific application, and therefore a viewport corresponding to the screen area of the specific application may be displayed on the display. In this embodiment, the dialog box may be displayed overlapping the viewport. Alternatively, the display screen may be divided and displayed in parallel with the viewport, or may be displayed in an area other than the area occupied by the viewport.
[0043] When the chatbot is executed, the context information generator 120 analyzes the screen area (i.e., viewport) of a specific application currently displayed through the display of the user terminal 100, and generates context information based on the analysis results (step S305).
[0044] The context information can be generated in the following ways.
[0045] Basically, you can use the text in the viewport (see figure 5).
[0046] Alternatively, text in the viewport and text around the viewport (top and / or bottom) can be used.
[0047] Alternatively, if the viewport is scrolled down, the text in the top region that just disappeared from the viewport can be used (see figure 6).
[0048] Alternatively, if the viewport is scrolled up, the text in the bottom region that recently disappeared from the viewport can be used (see figure 7).
[0049] Alternatively, in the case of video content, the current playback position and surrounding previous and / or subsequent content can be used (see FIG. 8). Additionally, the video playback speed can also be used.
[0050] Alternatively, the web page address for the screen displayed in the viewport and any links contained within the screen can be used (see figure 9).
[0051] The message input unit 130 receives a dialogue message from the user (step S310). The form in which the dialogue message is input is not limited. For example, the dialogue message may include a voice utterance of the user inputted through a microphone of the user terminal 100, a text utterance of the user inputted by a typing means (keyboard, keypad, touch screen, mouse, etc.) of the user terminal 100, etc.
[0052] The terminal message forwarding unit 140 can forward the input message, which is an integration of the dialogue message and the context information input by the user, to the chatbot server 200 (step S315).
[0053] Then, the terminal message forwarding unit 140 can receive a response message from the chatbot server 200 in response to the input message, and display the response message in a dialog box so that the user can confirm it (step S320).
[0054] 3, the chatbot server 200 may include a server message forwarder 210, a context analyzer 220, a reply message generator 230, and a database 240. The components shown in FIG. 3 are not required to implement the chatbot server 200, so the chatbot server 200 described herein may have more or less components than those listed above.
[0055] The server message forwarding unit 210 receives an input message from the user terminal 100 on which the chatbot is running via the network. Then, it can forward a reply message including a reply to the input message as a response to the input message.
[0056] The context analyzer 220 may analyze an input message and classify it into a dialogue message and context information, and may analyze the context information extracted from the input message to clearly understand the meaning of the dialogue message.
[0057] The reply message generating unit 230 generates a reply message by finding a reply corresponding to the dialogue message from the database 240. In this case, it is possible to grasp the user's intention intended by the dialogue message based on the context information analyzed by the context analyzing unit 220, and find a reply that is most suitable for the user's intention.
[0058] A number of predicted messages predicted as dialogue messages and responses to each predicted message may be stored and managed in the database 240. The database 240 may be implemented, for example, as a Large Language Model (LLM), which is an artificial intelligence model trained based on a large amount of text.
[0059] The database 240 may be built within the chatbot server 200, or may be built separately externally and connected to the chatbot server 200 via a network.
[0060] Since it is obvious to a person skilled in the art how the chatbot server 200 finds and responds with an appropriate answer message using context information and a dialogue message, detailed description thereof will be omitted.
[0061] FIG. 5 is a first exemplary diagram illustrating a method for generating context information by utilizing a screen of a viewport executed on a user terminal.
[0062] 5, a viewport of a particular application running on a user terminal is shown, where the particular application may be a document viewer.
[0063] When a user selects (e.g., touches) a particular button within the viewport, a chatbot dialog box 310 may pop up.
[0064] When the chatbot dialog box 310 is executed, the data displayed in the viewport of a particular application is used as context information and communicated to the chatbot server 200 along with the user's dialog message, so that the chatbot server 200 can use it as the basis for generating a response to the chat message.
[0065] Context information can be generated by assigning a pre-specified weight to a portion of the text of the document displayed in the viewport when the chatbot dialog box 310 is executed, out of the total text of the document displayed through the document viewer.
[0066] 6 and 7 are second and third exemplary diagrams illustrating a method for generating context information using a screen before scrolling of a viewport executed in a user terminal.
[0067] 6, a viewport of a particular application running on a user terminal is shown, where the particular application may be a document viewer.
[0068] This example relates to a case where the user scrolls downward immediately before the button touch operation.
[0069] When a user selects (e.g., touches) a particular button within the viewport, a chatbot dialog box 310 may pop up.
[0070] When the chatbot dialog box 310 is executed, the data currently displayed in the viewport of a particular application and the top data of the viewport that has disappeared from the current viewport due to downward scrolling are combined and used as context information, and transmitted to the chatbot server 200 together with the user's dialogue message, so that the chatbot server 200 can use it as basic data for generating a response to the dialogue message.
[0071] Context information can be generated by assigning a pre-specified weight to a portion of the text displayed in the viewport when the chatbot dialog box 310 is executed and to the text around the viewport (especially the top) out of the total text of the document displayed through the document viewer.
[0072] Figure 7 shows the case where the scroll direction is upwards instead of downwards, in which case the data currently displayed in the viewport and the bottom edge of the viewport that is now scrolled out of the viewport due to the upward scroll can be used in combination as context information.
[0073] That is, the range of data that disappears due to scrolling but is used as context information may change depending on the direction of scrolling.
[0074] Furthermore, the range of data that disappears due to scrolling but is used as context information may change depending on the scrolling speed. If the scrolling speed is fast, the range of the top and / or bottom of the viewport used as context information may increase, and if the scrolling speed is slow, the range of the top and / or bottom of the viewport used as context information may decrease. That is, the range of the top and / or bottom of the viewport used as context information may be determined in proportion to the scrolling speed.
[0075] FIG. 8 is a fourth example diagram illustrating how context information is generated by utilizing information of a video player executed on a user terminal, and FIG. 9 is a diagram illustrating an example of setting a time range according to a playback speed.
[0076] Referring to FIG. 8, the application executed on the user terminal may be a video player.
[0077] When the video player is playing and the user selects (e.g., touches) a particular button within the viewport, a chatbot dialog box 310 may pop up.
[0078] When the chatbot dialog box 310 is executed, the current playback position of the video content played by the video player and the content content before and after a certain time based on the current playback position can be used as context information.
[0079] If the video player allows the playback speed of the video content to be set, the playback speed of the currently played video content can be used as a parameter for setting the additional context information.
[0080] This is because the range of the content area belonging to the user's interest range may be changed based on the current playback position under the same time condition according to the current playback speed.
[0081] Therefore, the range (time range) of the content used as context information can be adjusted according to the current playback speed, for example, the time range can be set proportional to the playback speed.
[0082] Referring to FIG. 9, a conceptual diagram is shown in which video content is represented in chronological order by a single bar.
[0083] As shown in FIG. 9(a), when the current playback speed is normal playback speed (x1), the content of the basic time range (e.g., 1 minute before / after) based on the current playback position can be additionally used as context information (see "Basic Time Range").
[0084] If the current playback speed is relatively slow or fast, the content of the adjusted time range that reflects the current playback speed in the basic time range based on the current playback position can be additionally used as context information.
[0085] Referring to FIG. 9(b), when the current playback speed is a relatively slow playback speed (x0.5), the content of the first time range (e.g., 0.5 minutes before / after) multiplied by the playback speed ratio (the current playback speed relative to the normal playback speed) in the set time range when viewed based on the current playback position can be used as context information.
[0086] Referring to FIG. 9(c), when the current playback speed is a relatively fast playback speed (x2), when viewed from the current playback position, the content of a second time range (e.g., 2 minutes before / after) obtained by multiplying the playback speed ratio by the basic time range can be used as context information.
[0087] FIG. 10 is a fifth exemplary diagram illustrating a method for generating context information by utilizing an address and link information of a viewport executed in a user terminal.
[0088] 10, a viewport of an application running on a user terminal is shown, where the particular application may be a document viewer.
[0089] An example of this would be where there is a web address for the document being displayed through the viewport, or a link within the document.
[0090] When a user selects (e.g., touches) a particular button within the viewport, a chatbot dialog box 310 may pop up.
[0091] When the chatbot dialog box 310 is executed, one or more of the data currently displayed in the viewport of a particular application (text and / or images), the web address to access the document, and / or links contained within the document may be combined and used as context information and communicated to the chatbot server 200 along with the user's dialog message to serve as the basis for the chatbot server 200 to generate a response to the chat message.
[0092] According to this embodiment, by executing a chatbot dialogue box and inputting a question while viewing content (e.g., a document) related to specific domain knowledge, an answer using the content of the content as an extended context is provided, thereby improving the accuracy of the answer to the user's question and providing the ability to process knowledge of various domains. This shortens the process of reading and understanding existing documents, and provides the user with faster and more accurate information.
[0093] FIG. 11 is a diagram showing the configuration of a user terminal 100 and a chatbot server 200 according to an embodiment of the present invention.
[0094] 11, the user terminal 100 and / or the chatbot server 200 includes a processor 410 and a memory 420. The memory 420 stores one or more instructions executable by the processor 410. The processor 410 executes one or more instructions stored in the memory 420. The processor 410 can execute one or more of the operations described above with respect to FIGS. 1 to 10 by executing the instructions. Furthermore, the configurations of the present invention described above with reference to FIGS. 2 and 3 may be configurations embodied by instructions executed by the processor 410.
[0095] The above-mentioned method for providing a text-based interactive service may also be embodied in the form of a recording medium including computer-executable instructions, such as an application or program module executed by a computer. A computer-readable medium may be any solvable medium accessible by a computer, and includes both volatile and non-volatile media, and separate and non-separate media. Furthermore, a computer-readable medium may include a computer storage medium. A computer storage medium includes both volatile and non-volatile, separate and non-separate media embodied in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data.
[0096] The above-mentioned method for providing a context-based interactive service may be executed by an application (which may include a program included in a platform or operating system that is basically installed in the terminal) that is basically installed in the terminal, or by an application (i.e., a program) that is directly installed in the master terminal by the user via an application providing server such as an application store server, an application or a web server related to the service. In this sense, the above-mentioned method for providing a context-based interactive service may be embodied in an application (i.e., a program) that is basically installed in the terminal or that is directly installed by the user, and may be recorded in a computer-readable recording medium such as a terminal.
[0097] Although the present invention has been described above with reference to preferred embodiments, it will be understood by those skilled in the art that the present invention can be modified and changed in various ways without departing from the spirit and scope of the present invention as set forth in the following claims. [Explanation of symbols]
[0098] 1: Context-based interactive service system 100: User terminal 110: Chatbot Execution Department 120: Context information generation unit 130: Message input section 140: Terminal message transfer unit 200: Chatbot server 210: Server message transfer section 220: Context Analysis Unit 230: Reply message generation unit 240: Database
Claims
1. A method for providing a context-based interactive service performed in a user terminal, comprising: A step of executing the chatbot by a chatbot execution unit and displaying a dialog box in response to a user's input while a specific application is being executed on the user terminal; generating, by a context information generating unit, context information based on viewport information of the user terminal; a step of inputting a dialogue message through the dialogue box by a message input unit; forwarding the dialogue message and the context information as an input message to a chatbot server by a terminal message forwarding unit; receiving a response message corresponding to the input message from the chatbot server, and displaying the response message through the dialog box; The context information is generated based on the data currently displayed through the viewport, The viewport is a video player that plays video content, The step of generating the context information uses content of a current playback position of the video content at the time of the user's input, and additionally uses at least one of content before and after a certain time based on the current playback position to generate the context information; A method for providing a context-based interactive service, characterized in that in the step of generating the context information, the time range of the content to be additionally utilized is made variable depending on the current playback speed of the video player.
2. The method of claim 1 , wherein the time range is set in proportion to the current playback speed.
3. In the step of generating the context information, if the current playback speed is a normal playback speed, additionally utilizing content content of a basic time range set based on the current playback position; The method for providing a context-based interactive service according to claim 1, further comprising: if the current playback speed is relatively slow or fast, adding content of an adjusted time range reflecting the current playback speed to the basic time range based on the current playback position.
4. The method for providing a context-based interactive service according to claim 3, wherein the adjustment time range is determined by multiplying the basic time range by a playback speed ratio, which is a ratio of the current playback speed to the normal playback speed.
5. A user terminal that is networked with a chatbot server to provide a context-based interactive service, a chatbot execution unit that executes a chatbot and displays a dialog box in response to a user's input while a specific application is being executed; a context information generating unit that generates context information based on viewport information of the user terminal; a message input section for inputting a dialogue message from a user through the dialogue box; a terminal message forwarding unit for forwarding the dialogue message and the context information to a chatbot server as an input message, receiving a reply message corresponding to the input message from the chatbot server, and displaying the reply message through the dialogue box; the specific application is a video player that plays video content, the context information generating unit, when the dialog box is executed, uses content at a current playback position of the video content played through the viewport, and additionally uses at least one of content before and after a certain time based on the current playback position to generate the context information; The user terminal, wherein the context information generating unit varies a time range of the content to be additionally utilized according to a current playback speed of the video player.
6. 6. The user terminal of claim 5, wherein the time range is set proportional to the current playback speed.
7. 6. The user terminal of claim 5, wherein the context information generating unit additionally utilizes content content of a basic time range set based on the current playback position when the current playback speed is a normal playback speed, and additionally utilizes content content of an adjusted time range reflecting the current playback speed to the basic time range based on the current playback position when the current playback speed is a relatively slow or fast playback speed.
Citation Information
Patent Citations
Using context information to facilitate processing of commands in virtual assistant
JP2013080476A
Intelligent automatic assistant for tv user interaction
JP2017530567A
Information processing apparatus and information processing method
JP2022047550A