Interaction-based information providing method and system

Abstract

To provide an interaction-based information providing method and system.SOLUTION: An information providing method according to one embodiment includes the steps of: providing a search interface for providing search results based on an input search term; and providing, if the search term input to the search interface includes a preset interaction search term corresponding to a given subject, an interaction function for providing information related to the subject through interaction with a user, as a response to the interaction search term.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The following relates to an interaction-based information providing method and system. [Background technology]

[0002] A search service is an interactive or dialogue service provided over a communication network that provides the ability to access information stored in a database center. As an example, the search service provides search results for search terms entered by a user. As a more specific example, the search service provides a user with a search result page that includes search results from multiple databases in response to the entered search terms. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Korean Patent Publication No. 10-2022-0108611 Summary of the Invention [Problem to be solved by the invention]

[0004] An information providing method and system are provided that provide an interaction function for a particular subject in response to a preset interaction search term corresponding to the subject, and provide information on the subject in accordance with the interaction with a user. [Means for solving the problem]

[0005] Provided is an information provision method for a computer device including at least one processor, the information provision method including a step of providing, by the at least one processor, a search interface for providing search results based on an input search term, and a step of providing, by the at least one processor, an interaction function for providing information related to a subject by interaction with a user in response to the interaction search term when the search term input to the search interface includes a preset interaction search term corresponding to a given subject.

[0006] According to one aspect, providing the interaction function may include displaying an object related to the subject using a viewer included in the interaction function.

[0007] According to another aspect, the providing of the interaction function may further include controlling a view of the object displayed in the viewer or a motion of the object through interaction with the user.

[0008] According to another aspect, the controlling step may include providing a function for adjusting a playback speed for a motion of the object.

[0009] According to another aspect, the controlling step may include providing an AR (Augmented Reality) function for reproducing the motion of the object against a background of an image input in real time to a camera included in the computer device.

[0010] According to another aspect, providing the interaction function may further include providing sub-motion information for each of a plurality of sub-motions obtained by separating a motion of the object.

[0011] According to another aspect, the step of providing the submotion information may include a step of providing a submotion selection interface for selecting one submotion from the plurality of submotions, and a step of playing the submotion selected from the submotion selection interface using the viewer.

[0012] According to another aspect, the sub-motion information may include video information, audio information, and text information relating to a corresponding sub-motion, and the step of playing the selected sub-motion may include outputting at least one of the audio information and the text information while playing the selected sub-motion in the video information.

[0013] According to another aspect, the sub-motion selection interface may include a plurality of sub-motion buttons for the plurality of sub-motions, and the step of playing the selected sub-motion may include playing a sub-motion corresponding to a sub-motion button selected from the plurality of sub-motion buttons.

[0014] According to another aspect, the plurality of sub-motion buttons may be arranged in order, and a display position of the plurality of sub-motion buttons may be changed by a drag gesture input on the plurality of sub-motion buttons, and the step of playing the selected sub-motion may include playing a sub-motion corresponding to a sub-motion button at a preset display position among the plurality of sub-motion buttons, and determining a playback direction and a playback speed of the sub-motion being played based on a direction and a speed of the drag gesture.

[0015] According to another aspect, the step of playing the selected submotion may include a step of displaying an annotation button at a position of a specific point of the object to provide detailed information related to the specific point, a step of moving a display position of the annotation button as the position of the specific point of the object moves by playing the selected submotion, and a step of changing the selected submotion to provide the detailed information when the annotation button is selected.

[0016] According to another aspect, the step of playing the selected sub-motion may include a step of displaying an annotation guide including at least two points on the object and a link connecting the two points.

[0017] According to another aspect, the object may include a three-dimensional human body model, and the at least two points may correspond to joint positions of the three-dimensional human body model.

[0018] According to another aspect, providing the interaction function may include providing the viewer through a search result page generated using the interaction search term.

[0019] According to another aspect, the step of providing the interaction function may include providing a link for accessing a page providing sub-motion information for each of a plurality of sub-motions obtained by separating a motion of the object through the search result page or the viewer.

[0020] According to another aspect, providing the interaction functionality may include providing a question and answer interface for inputting a voice or text based query of the user and providing a response to the query that is related to the subject matter.

[0021] According to yet another aspect, the response may include one of a plurality of submotions separated from the motion of the object, or may include a result generated by analyzing the contents of documents searched based on the query using artificial intelligence.

[0022] A computer program is provided for causing a computer device to carry out the method.

[0023] A computer-readable recording medium is provided on which a program for causing a computer device to execute the method is recorded.

[0024] A computer device is provided, comprising at least one processor implemented to execute instructions readable by a computer device, the at least one processor receiving a search term from a user's terminal, and if the received search term includes a preset interaction search term corresponding to an arbitrary subject, generating a search result page including search results corresponding to the interaction search term and an interaction function that provides information related to the subject through interaction with the user, and providing the generated search result page to the user's terminal. Effect of the Invention

[0025] A subject interaction function may be provided in response to a preset interaction search term corresponding to a particular subject, and information about the subject may be provided through interaction with the user. [Brief description of the drawings]

[0026] [Figure 1] FIG. 1 illustrates an example of a network environment in accordance with an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram illustrating an example of a computing device in accordance with an embodiment of the present invention. [Diagram 3] 1 is a diagram illustrating an overview of an information providing system according to an embodiment of the present invention. [Figure 4] FIG. 13 is a diagram showing an example of a page providing sub-motion information in accordance with an embodiment of the present invention. [Diagram 5] 11A to 11C are diagrams illustrating an example of a process of playing a motion according to an embodiment of the present invention. [Figure 6] 11A to 11C are diagrams illustrating an example of a process of playing a motion according to an embodiment of the present invention. [Figure 7] FIG. 13 is a diagram showing an example of a case where the playback of a motion is stopped in one embodiment of the present invention. [Figure 8] FIG. 13 is a diagram showing an example of a case where the playback of a motion is stopped in one embodiment of the present invention. [Figure 9] FIG. 13 is a diagram showing an example of a case where the playback of a motion is stopped in one embodiment of the present invention. [Figure 10] 11A and 11B are diagrams showing examples of user interfaces for controlling the display state of lesson point graphics in one embodiment of the present invention. [Figure 11] FIG. 13 illustrates an example of displaying a lesson point graphic for a particular submotion in accordance with an embodiment of the present invention. [Figure 12] 11A and 11B are diagrams showing examples of annotation buttons in one embodiment of the present invention. [Figure 13] FIG. 13 illustrates an example of providing a list of all submotions in accordance with an embodiment of the present invention. [Figure 14] FIG. 13 illustrates an example of a viewer extension in accordance with an embodiment of the present invention. [Figure 15] 1 is a flowchart showing an example of an information providing method of a user terminal in an embodiment of the present invention. [Figure 16] 10 is a flowchart showing an example of an information providing method of a server in an embodiment of the present invention. [Figure 17] FIG. 13 illustrates an example of using the interaction feature to provide topic-related information corresponding to an interaction search term in one embodiment of the present invention. [Figure 18] FIG. 13 illustrates an example of using the interaction feature to provide topic-related information corresponding to an interaction search term in one embodiment of the present invention. [Figure 19] FIG. 13 illustrates an example of using the interaction feature to provide topic-related information corresponding to an interaction search term in one embodiment of the present invention. [Figure 20] FIG. 2 illustrates an example of providing a response to a query in accordance with an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings.

[0028] The information providing system according to the embodiment of the present invention may be realized by at least one computer device. In this case, a computer program according to an embodiment of the present invention may be installed and executed in the computer device, and the computer device may execute the information providing method according to the embodiment of the present invention according to the control of the executed computer program. The above-mentioned computer program may be recorded in a computer-readable recording medium in combination with the computer device to cause the computer to execute the information providing method.

[0029] Fig. 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment in Fig. 1 shows an example including a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170. Fig. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited to those shown in Fig. 1.

[0030] The electronic devices 110, 120, 130, and 140 may be fixed terminals or mobile terminals realized by computer systems. Examples of the electronic devices 110, 120, 130, and 140 include smartphones, mobile phones, navigation systems, personal computers (PCs), notebook PCs, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), tablets, game consoles, wearable devices, internet of things (IoT) devices, virtual reality (VR) devices, and augmented reality (AR) devices. As an example, FIG. 1 shows a smartphone as an example of the electronic device 110, but in the embodiment of the present invention, the electronic device 110 may mean one of various physical computer systems that can communicate with other electronic devices 120, 130, and 140 and / or servers 150 and 160 via a network 170 using a substantially wireless or wired communication method.

[0031] The communication method is not limited, and may include not only a communication method using a communication network (for example, a mobile communication network, a wired Internet, a wireless Internet, a broadcasting network) that the network 170 can include, but also short-range wireless communication between devices. For example, the network 170 may include any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, and the like. Furthermore, the network 170 may include any one or more of a network topology including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or hierarchical network, and the like.

[0032] Each of the servers 150 and 160 may be realized by one or more computer devices that communicate with the multiple electronic devices 110, 120, 130, and 140 via the network 170 to provide instructions, codes, files, content, services, and the like. For example, the server 150 may be a system that provides a first service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170, and the server 160 may also be a system that provides a second service to the multiple electronic devices 110, 120, 130, and 140 connected via the network 170. As a more specific example, the server 150 may provide the multiple electronic devices 110, 120, 130, and 140 with a service targeted by the application as a first service through an application that is a computer program installed and executed in the multiple electronic devices 110, 120, 130, and 140. As another example, the server 160 may provide, as a second service, a service of distributing files for installing and executing the above-mentioned applications to the multiple electronic devices 110, 120, 130, and 140.

[0033] 2 is a block diagram showing an example of a computer device according to an embodiment of the present invention. Each of the electronic devices 110, 120, 130, and 140 and the servers 150 and 160 described above may be realized by a computer device 200 shown in FIG.

[0034] Such a computer device 200 may include a memory 210, a processor 220, a communication interface 230, and an input / output interface 240, as shown in FIG. 2. The memory 210 is a computer-readable recording medium and may include a random access memory (RAM), a read only memory (ROM), and a permanent mass storage device such as a disk drive. Here, a permanent mass storage device such as a ROM or a disk drive may be included in the computer device 200 as a separate permanent storage device separate from the memory 210. The memory 210 may also store an operating system and at least one program code. Such software components may be loaded into the memory 210 from a computer-readable recording medium separate from the memory 210. Such separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, etc. In another embodiment, the software components may be loaded into the memory 210 through a communication interface 230 that is not a computer-readable recording medium. For example, the software components may be loaded into the memory 210 of the computing device 200 based on a computer program installed by a file received over the network 170 .

[0035] The processor 220 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processor 220 by the memory 210 or the communication interface 230. For example, the processor 220 may be configured to execute instructions received according to program code stored in a storage device, such as the memory 210.

[0036] The communication interface 230 may provide a function for the computer device 200 to communicate with other devices (for example, the above-mentioned recording device) via the network 170. For example, requests, instructions, data, files, etc. generated by the processor 220 of the computer device 200 according to program codes recorded in a recording device such as the memory 210 may be transmitted to other devices via the network 170 under the control of the communication interface 230. Conversely, signals, instructions, data, files, etc. from other devices may be received by the computer device 200 via the communication interface 230 of the computer device 200 via the network 170. The signals, instructions, data, etc. received via the communication interface 230 may be transmitted to the processor 220 or the memory 210, and the files, etc. may be recorded on a recording medium (the above-mentioned permanent recording device) that the computer device 200 may further include.

[0037] The input / output interface 240 may be a means for interfacing with the input / output device 250. For example, the input device may include a device such as a microphone, a keyboard, or a mouse, and the output device may include a device such as a display and a speaker. As another example, the input / output interface 240 may be a means for interfacing with a device in which functions for input and output are integrated into one, such as a touch screen. The input / output device 250 may be configured as a single device together with the computer device 200.

[0038] Also, in other embodiments, computing device 200 may include fewer or more components than those of Figure 2. However, most prior art components need not be explicitly illustrated. For example, computing device 200 may be implemented to include at least some of the input / output devices 250 described above, and may further include other components such as a transceiver, a database, etc.

[0039] Fig. 3 is a diagram illustrating an overview of an information providing system according to an embodiment of the present invention. The information providing system according to this embodiment may include a server 310 and a user terminal 320. Although there may be multiple user terminals, Fig. 3 illustrates one user terminal 320.

[0040] The user terminal 320 may access the server 310 via a network (for example, the network 170 in FIG. 1 and FIG. 2) according to the control of an application installed in the user terminal 320, and may receive a service from the server 310. In this embodiment, it is assumed that the server 310 provides a search service to the user terminal 320. When a user of the user terminal 320 inputs a search term into a search interface provided by an application installed and executed in the user terminal 320, the user terminal 320 may transmit the input search term to the server 310, and the server may generate a search result page for the input search term and provide it to the user terminal 320. In practice, the server 310 provides the user terminal 320 with information for rendering and displaying the search result page in the user terminal 320, but the following description will be given assuming that the server 310 provides the search result page to the user terminal 320.

[0041] In this case, if the search term includes a preset interaction search term corresponding to a given subject, the server 310 may provide an interaction function that provides information related to the subject through an interaction with the user. FIG. 3 shows an interaction function area 330 of a page including such an interaction function. Depending on the embodiment, the interaction function area 330 may be included in a search result page and provided to the user terminal 320, or may be included in a separate response page for the interaction search term (for example, a page providing submotion information described below) and provided to the user terminal 320. When a search result page is provided, the server 310 may generate a search result page including search results corresponding to the interaction search term and the above-mentioned interaction function, and provide the search result page to the user terminal 320.

[0042] At this time, the interaction function area 330 may include a viewer for displaying an object related to a subject, as shown in a first dotted frame 340. In this case, the user terminal 320 may control the view of the object or the motion of the object displayed in the viewer according to an interaction with the user. In this embodiment, an example is shown in which "golf" is used as an interaction search term to provide an object motion of "iron full swing". In this embodiment, the object may include a three-dimensional human body model, and the "iron full swing" motion of such a three-dimensional human body model may be reproduced by the viewer. As described above, the interaction search term may be preset corresponding to any subject, and the object may also be preset in association with such a subject. In other words, when a user inputs an interaction search term, a view and / or motion of the object according to the subject of the interaction search term is reproduced by the viewer. In this case, the display of the view and / or motion of the object may be controlled according to an interaction with the user.

[0043] In addition to the viewer, the interaction function area 330 may further include basic information related to an interaction search term and / or an object's motion, as shown in a second dotted frame 350.

[0044] In addition, the search result page, the interaction function area 330, and / or the viewer may include a link to a page providing submotion information for each of a plurality of submotions obtained by separating the motion of the object. In the embodiment of FIG. 3, as shown in the third dotted frame 360, an example is shown in which the viewer includes a link to a page providing submotion information.

[0045] 4 is a diagram showing an example of a page providing sub-motion information according to an embodiment of the present invention. The user terminal 320 may display a page 410 providing sub-motion information on a screen, and may display a view and / or motion of an object using a viewer appearing in a first dotted frame 420 of the page 410.

[0046] Also, as described above, the motion of the object may be separated into a plurality of sub-motions. In this case, the user terminal 320 may provide sub-motion information for each individual sub-motion through the page 410. In the embodiment of FIG. 4, an example is shown in which the motion "iron full swing" is separated into eight sub-motions, namely, an "address" sub-motion (P1), a "take back" sub-motion (P2), a "half back swing" sub-motion (P3), a "top of swing" sub-motion (P4), a "down swing" sub-motion (P5), an "impact" sub-motion (P6), a "follow through" sub-motion (P7), and a "finish" sub-motion (P8). In this case, the user terminal 320 may provide eight sub-motion buttons for the eight sub-motions through the page 410. Although FIG. 4 shows an example in which one motion is separated into eight sub-motions, it is also possible for the same motion to be separated into more or fewer sub-motions. For example, the "iron full swing" motion may be separated into ten sub-motions depending on how the motions are divided.

[0047] In the embodiment of FIG. 4, the second dotted frame 430 shows an example in which a sub-motion button for the "address" sub-motion (P1) and a sub-motion button for the "take back" sub-motion (P2) are displayed among the eight sub-motion buttons. Although not shown in FIG. 4, the eight sub-motion buttons may be arranged in order, and the display position can be changed by a drag gesture of the user. As an example, when the user drags the area of ​​the second dotted frame 430 to the left, the user terminal 320 may control the sub-motion button for the "address" sub-motion (P1) to disappear to the left, and at the same time, control the display of the sub-motion button for the "half back swing" sub-motion (P3) to appear from the right side. If the user continues to drag the area of ​​the second dotted frame 430 to the left, the user terminal 320 may control the display so that sub-motion buttons for each of the “top of swing” sub-motion (P4), the “downswing” sub-motion (P5), the “impact” sub-motion (P6), the “follow-through” sub-motion (P7), and the “finish” sub-motion (P8) appear in sequence in the area of ​​the second dotted frame 430.

[0048] When the user selects a particular sub-motion button (for example, by touching an area where the sub-motion button is displayed using a finger or a touch tool in a touch screen environment), the user terminal 320 may play the sub-motion corresponding to the selected sub-motion button using the viewer in the first dotted frame 420. Therefore, the user can control the playback of the motion for each sub-motion of the motion.

[0049] Furthermore, the user terminal 320 may play a submotion corresponding to a submotion button located at a preset display position among the multiple submotion buttons. At this time, when a user's drag gesture is input in the area of ​​the second dotted frame 430, the user terminal 320 may determine the playback direction and playback speed of the submotion being played based on the direction and speed of the input drag gesture. For example, in FIG. 4, when the user drags the submotion button for the "address" submotion (P1) to the left, the user terminal 320 may play the "address" submotion (P1) in the forward direction. Conversely, when the user drags the submotion button for the "address" submotion (P1) to the right, the user terminal 320 may play the "address" submotion (P1) in the reverse direction. At this time, the playback speed may be determined by the user's dragging speed.

[0050] The page 410 may also include a user interface 440 for controlling the display state of the lesson point graphic and a user interface 450 for navigating to an AR service. Such user interfaces 440, 450 are described in more detail below.

[0051] The play button 460 may be a user interface for playing the entire motion of the object (the "iron full swing" motion in the embodiment of FIG. 4) for each sub-motion stage. When the user selects the play button 460, the user terminal 320 may play the "iron full swing" motion by playing eight sub-motions, namely, the "address" sub-motion (P1), the "take back" sub-motion (P2), the "half back swing" sub-motion (P3), the "top of swing" sub-motion (P4), the "down swing" sub-motion (P5), the "impact" sub-motion (P6), the "follow through" sub-motion (P7), and the "finish" sub-motion (P8), in order through the viewer of the first dotted frame 420.

[0052] 5 and 6 are diagrams illustrating an example of a process of playing a motion in an embodiment of the present invention. The page 510 of FIG. 5 may be provided when the user selects the play button 460 on the page 410 of FIG. 4. In the embodiment of FIG. 5, an example is illustrated in which the user terminal 320 provides a play speed adjustment function for adjusting the play speed in a stopped state of the motion play and a play refresh function together with a first dotted frame 520 by selecting the play button 460. As an example, the user may use the play speed adjustment function to control the play speed of the motion, and may use the refresh function to control the motion to be played from the beginning.

[0053] The submotion button of the currently playing submotion may be highlighted differently from other buttons. In the embodiment of FIG. 5, an example is shown in which the frame of the submotion button 530 for the "address" submotion (P1) is highlighted. It can be easily understood that the button may be highlighted in a more diverse manner. For example, a specific button may be highlighted by filling the inside of the button with a color different from other buttons.

[0054] Meanwhile, information on each submotion (submotion information) may further include text information and / or audio information in addition to video information on the submotion played by the viewer. In the embodiment of FIG. 5, an example is shown in which text information corresponding to the "Address" submotion (P1) is displayed in the area of ​​the second dotted frame 540 during playback of the "Address" submotion (P1). The text information may be a certain unit (word, line, phrase, etc.) to reduce the constraint due to the length of the text, and may be displayed or removed in the area of ​​the second dotted frame 540. In addition, the page 510 may provide a function 550 for controlling the provision of audio information. The audio information may include audio information obtained by converting the content of the text information by a Text-To-Speech (TTS) function, and the user terminal 320 may output the audio information from the speaker by activating the function 550.

[0055] Furthermore, the user terminal 320 may display an annotation button 560 for providing detailed information related to a specific point of the object while playing the submotion using the viewer of the page 510. The user terminal 320 may display the annotation button 560 at the position of the specific point of the object, and may move the display position of the annotation button 560 to the position of the specific point as the position of the specific point of the object moves due to the playing of the submotion. In this case, when the user selects the annotation button 560, the user terminal 320 may change the submotion and provide detailed information. At least one annotation button may be preset for each submotion.

[0056] In the embodiment of FIG. 6, the user terminal 320 shows an example of playing the "iron full swing" motion on page 610 at a default playback speed or a playback speed selected by the playback speed adjustment function for each submotion. At this time, the embodiment of FIG. 6 shows an example of displaying an annotation button 620 set for the "follow through" submotion (P7) while playing the "follow through" submotion (P7). Also, the play button 630 on page 610 has a different form from the play button 460 on page 410, and indicates that the motion is currently being played. At this time, the position of the submotion button may be changed so that the submotion button of the currently played submotion is located at a specific position. FIG. 6 shows an example where the specific position is the position next to the right of the play button 630 in FIG. 6.

[0057] 7 to 9 are diagrams showing examples of flicks in one embodiment of the present invention. FIG. 7 shows an example in which a user flicks (for example, touches and drags with a finger) a specific sub-motion button while a motion is being played. In this case, the user terminal 320 may pause the playback of the existing motion. FIG. 7 shows the state of a stop button 710 for pausing. As described above, the playback direction and playback speed of the corresponding sub-motion can be adjusted depending on the direction and speed of the flick (drag).

[0058] FIG. 8 shows an example in which the user selects a specific sub-motion button. In this case, the user terminal 320 may highlight the selected sub-motion button and output sub-motion information of the selected sub-motion button. As described above, playing the sub-motion information of the sub-motion button may include at least playing the corresponding sub-motion by a viewer, and may further include outputting text information and / or audio information. When the user flicks the specific sub-motion button again, the sub-motion may be played in a state in which the playback direction and playback speed of the corresponding sub-motion are adjusted according to the direction and speed of the flick, as in FIG. 7.

[0059] 9 shows an example in which a playback speed adjustment function and a refresh function are provided when a user presses a stop button 910. In this case, the motion paused in FIG. 7 may be played back in sequence from the section where it was stopped.

[0060] Fig. 10 is a diagram showing an example of a user interface for controlling display of a lesson point graphic in an embodiment of the present invention. Fig. 10 shows an example in which a skeleton is displayed on an object in a second dotted frame 1020 by a user selecting a user interface in a first dotted frame 1010 during playback of a motion. The skeleton may be a type of annotation guide including at least two points on an object and a link connecting the two points. In this case, playback of the motion may be paused, and when the user interface in the first dotted frame 1010 is selected again, the motion may be played.

[0061] 11 is a diagram showing an example of displaying a lesson point graphic for a specific submotion in an embodiment of the present invention. When a specific submotion is being played, the user terminal 320 may display an annotation guide that is a lesson point graphic preset for the submotion.

[0062] FIG. 12 is a diagram showing an example of an annotation button in an embodiment of the present invention. As described above, an annotation button may be set for each of a plurality of submotions. Such an annotation button may be used to provide detailed information about the corresponding submotion. In the embodiment of FIG. 12, when a user selects the annotation button in the first dotted frame 1210, the user terminal 320 provides detailed information about the submotion together with the second dotted frame 1220. The annotation button may be displayed in association with a specific point of an object, and the detailed information may be detailed information related to the specific point. The button in the third dotted frame 1230 may be a user interface for returning to a process before the annotation button was selected. For example, when the back button is selected, the user terminal 320 may play the continuation of the submotion that was being played before the annotation button was selected.

[0063] Fig. 13 is a diagram showing an example of providing a list of all submotions in an embodiment of the present invention. In the embodiment of Fig. 13, an example is shown in which a submotion list is provided as shown in a second dotted line frame 1320 by the user touching an area of ​​a first dotted line frame 1310 and dragging it upward. At this time, when the user selects a specific submotion from the submotion list as shown in a third dotted line frame 1330, the user terminal 320 may play the selected submotion.

[0064] Fig. 14 is a diagram showing an example of viewer expansion in an embodiment of the present invention. Fig. 14 shows an example in which the viewer is expanded to the area of ​​the second dotted frame 1420 by the user selecting the area of ​​the first dotted frame 1410. If the user selects the area of ​​the second dotted frame 1420, the viewer is reduced to the area of ​​the first dotted frame 1410. The motion being played and / or the audio guide being output may be played and / or output as is.

[0065] FIG. 15 is a flowchart showing an example of a method for providing information by a server in an embodiment of the present invention. The method for providing information according to this embodiment may be executed by a computer device 200 that realizes the server 310. In this case, the processor 220 of the computer device 200 may be realized to execute control instructions according to the code of an operating system and the code of at least one computer program included in the memory 210. Here, the processor 220 may control the computer device 200 so that the computer device 200 executes steps 1510 to 1540 included in the method of FIG. 15 according to the control instructions provided by the code recorded in the computer device 200.

[0066] In step 1510, the computer device 200 may receive a search term from a user's terminal, where the user's terminal may correspond to the above-mentioned user terminal 320. As described above, the server 310 may provide a search service to the user terminal 320, and the user terminal 320 may use such a search service to transmit the search term to the server 310.

[0067] In step 1520, if the received search term includes an interaction search term preset corresponding to a given subject, the computer device 200 may generate a search result page including search results corresponding to the interaction search term and an interaction function for providing information related to the subject through interaction with the user. As an example, the computer device 200 may generate a search result page as a search service by including not only an area in which search results for the search term from the user are displayed, but also an area for providing an interaction function.

[0068] In step 1530, the computer device 200 may provide the generated search result page to the user's terminal. The user's terminal may use the interaction function included in such search result page to provide the user with information on the subject corresponding to the interaction search term through the user's interaction.

[0069] In step 1540, the computer device 200 may provide a separate page for the interaction function to the user terminal according to a search result page or a request using the interaction function from the user terminal. As an example, an example of providing a link to a page for providing sub-motion information has been described with reference to the third dotted frame 360 ​​of FIG. 3. The user terminal may play detailed object motions for each sub-motion through the page for providing sub-motion information and output information on each sub-motion. According to an embodiment, the separate page for the interaction function may be a page that provides various information through an interaction with the user. As an example, the separate page for providing the interaction function may include a question and answer interface for receiving a query based on a user's voice and / or text and providing a response related to the subject of the query. In this case, the response may include one of a plurality of sub-motions obtained by separating the motion of the object, or may include a result generated by analyzing the contents of the document searched based on the query using artificial intelligence. An example of providing a result of analyzing search results using artificial intelligence will be described in more detail with reference to FIGS. 17 to 20.

[0070] 16 is a flowchart showing an example of an information providing method of a user terminal according to an embodiment of the present invention. The information providing method according to this embodiment may be executed by a computer device 200 realizing a user terminal 320. In this case, the processor 220 of the computer device 200 may be implemented to execute control instructions according to the operating system code and at least one computer program code included in the memory 210. Here, the processor 220 may control the computer device 200 to execute steps 1610 and 1620 included in the method of FIG. 16 according to the control instructions provided by the code recorded in the computer device 200.

[0071] In step 1610, the computer device 200 may provide a search interface for providing search results based on the input search terms. As an example, the computer device 200 may provide the search interface through an application installed and executed on the computer device 200. As an example, such an application may be a computer program that cooperates with the services provided by the server 310.

[0072] In step 1620, the computer device 200 may provide an interaction function that provides information related to the subject through an interaction with a user in response to the interaction search term when the search term entered in the search interface includes an interaction search term that is preset corresponding to a given subject. Depending on the embodiment, the interaction function may be provided by being included in a search result page corresponding to the interaction search term, or may be provided by being included in a separate page for the interaction function.

[0073] Depending on the embodiment, such step 1620 may include steps 1621 and 1622 as shown in FIG.

[0074] In operation 1621, the computer device 200 may display an object related to the subject using a viewer included in the interaction function. For example, the motion of the object may be generated by capturing the motion in the case of a motion of an object that exists, such as a human, and may be generated by 3D modeling in the case of a non-existent object or an object for which motion capture is difficult. In this case, sub-motions and detailed information of each sub-motion may be generated in advance for each motion. Information on each generated motion may be provided to the computer device 200 via a server.

[0075] In operation 1622, the computer device 200 may control a view of an object displayed in the viewer or a motion of the object according to an interaction with a user. As an embodiment, the computer device 200 may control a view by rotating an object according to a user's input for an object displayed in the viewer, or may control the motion of the object using the sub-motion selection interface described above. As a more specific example for controlling the motion of an object, the computer device 200 may provide sub-motion information for each of a plurality of sub-motions obtained by separating the motion of the object. In this case, an interface for selecting a sub-motion such as a sub-motion button may be provided to the user, and the computer device 200 may play a sub-motion corresponding to a sub-motion button selected from a plurality of sub-motion buttons using the viewer. As another example, the computer device 200 may control the motion of the object by receiving a query based on a user's voice or text and playing a specific motion of the object (for example, one of a plurality of sub-motions) corresponding to the query.

[0076] The submotion information may include video information, audio information, and text information related to the corresponding submotion, in which case the computer device 200 may output the audio information and / or the text information while playing the submotion selected by the video information.

[0077] Also, depending on the embodiment, the sub-motion buttons may be arranged in order, and the display positions may be changed according to a drag gesture input to the sub-motion buttons. In this case, the computer device 200 plays a sub-motion corresponding to a sub-motion button at a preset display position among the sub-motion buttons, and may determine the playback direction and playback speed of the sub-motion being played based on the direction and speed of the drag gesture.

[0078] According to an embodiment, the computer device 200 may display an annotation button for providing detailed information related to a specific point of an object at the position of the specific point. In this case, the computer device 200 may move the display position of the annotation button according to the movement of the position of the specific point of the object as the submotion is played. When the annotation button is selected, the computer device 200 may change the submotion to provide detailed information.

[0079] Also, according to an embodiment, the computer device 200 may display an annotation guide including at least two points on the object and a link connecting the two points. According to an embodiment, the object may include a 3D human body model, and the at least two points may correspond to joint positions of the 3D human body model.

[0080] According to an embodiment, the computer device 200 may provide a function for adjusting a playback speed of the motion of an object. Also, the computer device 200 may provide an augmented reality (AR) function for playing back the motion of an object against a background of an image input in real time to a camera included in the computer device 200.

[0081] Further, according to an embodiment, the computer device 200 may provide a question and answer interface for receiving a user's voice and / or text-based query input through an interaction function and providing a response related to the subject of the query. In this case, the response may include one of a plurality of sub-motions obtained by separating an object's motion, or may include a result generated by analyzing the contents of a document searched based on the query using artificial intelligence. An embodiment for providing a result generated by analyzing using artificial intelligence will be described in more detail with reference to FIGS. 17 to 20.

[0082] In the above embodiment, the motion of a human playing golf is taken as an example, but the motion may be various and the object may be various. For example, to provide information on the theme "dinosaurs," it is possible to provide information related to dinosaurs through user interaction with a dinosaur object.

[0083] 17 to 19 are diagrams illustrating an example of using the interaction function to provide information related to a subject corresponding to an interaction search term, according to an embodiment of the present invention.

[0084] 17 shows a search result page 1710. For example, based on the motion search term "Tyrannosaurus" transmitted from the user terminal 320, the server 310 may generate a search result page 1710 including a search result for the motion search term "Tyrannosaurus" and a viewer for playing the motion of the dinosaur object, and transmit the search result page 1710 to the user terminal 320. The viewer is shown in a first dotted frame 1720. In addition, the search result page 1710 and / or the viewer may include links 1730, 1740, 1750 to pages for providing an interaction function.

[0085] FIG. 18 illustrates an example of a page 1810 for providing an interaction function provided by selecting a link 1730 on a search result page 1710. In this case, the page 1810 may include a viewer for displaying an object, as shown in a first dotted frame 1820. Using the viewer, a view or motion of the object may be controlled by a user's interaction. The page 1810 may also include a user interface 1820 for inputting a voice- and / or text-based query by a user, as shown in a second dotted frame 1830. For example, when a user selects the area of ​​the second dotted frame 1830, the user terminal 320 may provide a keypad to the user, and the user may input a text-based query using the provided keypad. The user terminal 320 may also include a text display area, as shown in a third dotted frame 1840. A sample query may be displayed in the text display area, and the user may select a query from the displayed sample queries. In addition, the text display area may further display text information related to the voice information, reference materials, search, and reply history, etc. Meanwhile, the size of the text displayed in the text display area may be automatically adjusted depending on the amount of information displayed in the text display area. In other words, the user terminal 320 may automatically adjust the size of the text depending on the amount of information displayed in the text display area.

[0086] FIG. 19 shows an example of a response presented by selecting link 1740 in FIG. 17, inputting the query "run" in the area of ​​the second dotted line frame 1830 in FIG. 18, or selecting the query "run" from the area of ​​the third dotted line frame 1840 in FIG. 18. A page 1910 in FIG. 19 may include a viewer for playing a motion or submotion of an object as shown in a first dotted line frame 1920. In this case, the viewer may play a submotion corresponding to the query "run". Also, text information and / or audio information corresponding to such a submotion may be output. A second dotted line frame 1930 shows an example of the text information being output. Also, a third dotted line frame 1940 shows an example of the query "run" that has already been used being highlighted and displayed.

[0087] In this manner, the user terminal 320 may provide a submotion selection interface as an interface for selecting a submotion corresponding to a user's voice and / or text-based query input from among a plurality of submotions as a response.

[0088] In this case, since queries are extremely diverse, if there is no submotion corresponding to the input query, the user terminal 320 may output information regarding the absence of the corresponding submotion. For example, if there is no submotion of the dinosaur object corresponding to the query "jump", information regarding the impossibility of this submotion or response may be output, such as "You can't jump", "That's a difficult question for me", or "I can't show you the jump".

[0089] Meanwhile, the size, position, motion, view angle, etc. of the object may be changed according to a query from the user, and the submotion of the object may be played. For example, in the above-mentioned golf motion example, a user interface for the user to input a query is provided. In this case, the size, position, motion, view angle, etc. of the 3D human object may be changed according to such a query from the user, and the motion may be played.

[0090] Also, responses to user queries may be obtained through searches related to the relevant objects.

[0091] FIG. 20 is a diagram showing an example of providing a response to a query in an embodiment of the present invention. The first screen 2010 of FIG. 20 shows an example of providing a response to the query "time of extinction of dinosaurs". In this case, when a response to the query is obtained by searching, the response may provide information about the reference material as shown in the first dotted frame 2011. FIG. 20 shows an example of providing information about the reference material as shown in the second dotted frame 2021 of the second screen 2020 by the user selecting the area of ​​the first dotted frame 2011. In this case, the information about the reference material may include a link to a source document of the information as shown in the third dotted frame 2022. When the user selects the area of ​​the third dotted frame 2022, the source document of the link address may be provided as shown in the third screen 2030.

[0092] In this manner, according to an embodiment of the present invention, an interaction function related to the subject is provided in response to a preset interaction search term corresponding to a particular subject, and information related to the subject can be provided through interaction with a user.

[0093] The above-mentioned devices may be realized by hardware components or a combination of hardware and software components. For example, the devices and components described in the embodiments may be realized using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications that run on the OS. The processing device may also respond to the execution of the software to access, record, manipulate, process, and generate data. For convenience of understanding, a single processing device may be described as being used, but one skilled in the art will understand that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0094] The software may include computer programs, codes, instructions, or a combination of one or more of these, and may configure a processing device to operate as desired or instruct the processing device, either independently or collectively. The software and / or data may be embodied in any type of machine, component, physical device, virtual device, computer storage medium, or device to be interpreted based on the processing device or to provide instructions or data to the processing device. The software may be distributed and stored or executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable storage media.

[0095] The method according to the embodiment may be realized in the form of program instructions executable by various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The medium may be one that continuously records a computer-executable program, or one that temporarily records it for execution or download. The medium may be one that is a variety of recording or storage means in the form of a single or multiple hardware devices combined, and may be distributed over a network without being limited to a medium directly connected to a certain computer system. Examples of the medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and ROMs, RAMs, flash memories, and the like, which are configured to record program instructions. Other examples of the medium include recording media or storage media managed by application stores that distribute applications, or other sites that supply or distribute various software, servers, and the like. Examples of the program instructions include not only machine language codes such as those generated by compilers, but also high-level language codes that are executed by a computer using an interpreter or the like.

[0096] Although the embodiments have been described based on the limited embodiments and drawings, those skilled in the art will appreciate that various modifications and variations can be made from the above description. For example, the described techniques may be performed in a different order than described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different manner than described, or may be counterbalanced or substituted with other components or equivalents, and still achieve suitable results.

[0097] Therefore, different embodiments are within the scope of the appended claims provided they are equivalent to the claims. [Explanation of symbols]

[0098] 110, 120, 130, 140: Electronic equipment 150, 160: Server 170: Network

Claims

1. A computer program for causing a computer device to execute an information providing method, The information providing method includes: providing a search interface for providing search results based on entered search terms; and providing an interaction function for providing information related to a given subject through an interaction with a user in response to the interaction search term when the search term inputted into the search interface includes an interaction search term preset corresponding to the given subject; and providing the interaction function comprises: The computer program further comprises displaying an object related to the subject using a viewer included in the interaction function, and providing submotion information for each of a plurality of submotions obtained by dividing a motion of the object.

2. The step of providing an interaction function includes: controlling a view of the object displayed on the viewer or a motion of the object according to an interaction with the user.

2. The computer program of claim 1, further comprising:

3. The controlling step includes: providing a function for adjusting a playback speed of the motion of the object; 3. A computer program according to claim 2, comprising:

4. The controlling step includes: providing an AR (Augmented Reality) function for reproducing the motion of the object against a background of an image input in real time to a camera included in the computer device; 3. A computer program according to claim 2, comprising:

5. The step of providing the sub-motion information includes: providing a submotion selection interface for selecting a submotion from the plurality of submotions; and playing the sub-motion selected in the sub-motion selection interface using the viewer; 2. A computer program according to claim 1, comprising:

6. The submotion information includes video information, audio information, and text information related to the corresponding submotion; The step of playing the selected sub-motion includes:

6. The computer program according to claim 5, further comprising: outputting at least one of the audio information and the text information while reproducing the selected sub-motion based on the video information.

7. the sub-motion selection interface includes a plurality of sub-motion buttons for the plurality of sub-motions; The step of playing the selected sub-motion includes:

6. The computer program according to claim 5, further comprising: reproducing a submotion corresponding to a submotion button selected from the plurality of submotion buttons.

8. the plurality of sub-motion buttons are arranged in order, and display positions of the plurality of sub-motion buttons are changed according to a drag gesture input to the plurality of sub-motion buttons; The step of playing the selected sub-motion includes: The computer program product according to claim 7, characterized in that a submotion corresponding to a submotion button at a preset display position among the plurality of submotion buttons is played, and a playback direction and a playback speed of the submotion being played are determined based on a direction and a speed of the drag gesture.

9. The step of playing the selected sub-motion includes: displaying an annotation button at a position of a specific point of the object to provide detailed information related to the specific point; moving a display position of the annotation button by moving a position of a specific point of the object by playing the selected sub-motion; and and modifying the selected submotion to provide the detailed information if the annotation button is selected.

8. A computer program according to claim 7, comprising:

10. The step of playing the selected sub-motion includes: displaying an annotation guide including at least two points on the object and a link connecting the at least two points; 8. A computer program according to claim 7, comprising:

11. The object includes a three-dimensional human body model, The computer program product of claim 10 , wherein the at least two points correspond to joint positions of the three-dimensional human model.

12. The step of providing an interaction function includes: providing the viewer with a search result page generated using the interaction search term; 2. A computer program according to claim 1, comprising:

13. The step of providing an interaction function includes: providing a link for accessing a page providing sub-motion information for each of a plurality of sub-motions obtained by dividing the motion of the object through the search result page or the viewer; 13. A computer program according to claim 12, comprising:

14. The step of providing an interaction function includes: providing a question and answer interface for receiving a voice or text-based query from the user and providing responses to the query that are relevant to the subject matter; 2. A computer program according to claim 1, comprising:

15. 15. The computer program product of claim 14, wherein the response includes one of a plurality of submotions obtained by dividing a motion of an object related to the subject, or includes a result generated by analyzing the contents of a document searched based on the query using artificial intelligence.

16. 1. A method for providing information in a computer device including at least one processor, comprising: the at least one processor providing a search interface for providing search results based on entered search terms; and providing an interaction function that provides information related to a given subject through an interaction with a user in response to the interaction search term when the search term entered into the search interface includes an interaction search term that is preset corresponding to the given subject; and providing the interaction function comprises: The information providing method further includes displaying an object related to the subject using a viewer included in the interaction function, and providing submotion information for each of a plurality of submotions obtained by dividing a motion of the object.

17. at least one processor implemented to execute computer readable instructions; by said at least one processor, receiving a search term from a user's device; If the received search term includes a preset interaction search term corresponding to a given subject, generate a search result page including a search result corresponding to the interaction search term and an interaction function for providing information related to the subject through an interaction with the user; providing the generated search result page to the user's terminal; The generated search result page includes: The computer device further comprising: a viewer including an interaction function that displays an object related to the subject; and provides submotion information for each of a plurality of submotions obtained by dividing a motion of the object.

Images