Method And Apparatus for Providing Feedback

Abstract

A feedback providing device and method are disclosed. According to one aspect of the present disclosure, a feedback providing device is provided comprising: a receiving unit for receiving training content and training information from an external device; an action recording unit for recording, respectively, a step being performed by a trainee, at least one action performed by the trainee in the step, a valid action among the actions, and the time taken to perform each action in the step based on the training content and training information; a propensity analysis unit for classifying the trainee's propensity using the number of valid actions among the performed actions and the time taken to perform the actions, and determining whether the trainee already knows the step; a feedback judgment unit for determining whether to provide feedback to the trainee using the propensity; and a feedback providing unit for providing feedback to the trainee based on the judgment of the feedback judgment unit.

Description

Technology Field

[0001] The present disclosure relates to a feedback providing device and method. More specifically, it relates to a feedback providing device and method based on a trainee's disposition. Background Technology

[0002] The following description merely provides background information related to the present embodiment and does not constitute prior art.

[0003] Methods for performing various training using virtual reality content have been proposed. When training is conducted using virtual reality content, objects, backgrounds, and tools can be virtualized, allowing for their free arrangement or provision. Consequently, training costs can be reduced, and the constraints required for training are minimized. Furthermore, training scenarios created once can be repeatedly reproduced, and training for emergency situations can be freely provided.

[0004] When performing training using virtual reality content (hereinafter referred to as 'virtual training'), there is an instructor who supervises the trainee. The instructor provides feedback on the trainee's actions. By providing feedback, the instructor enhances the effectiveness of the training. However, when multiple trainees are performing virtual training, it is difficult for a single instructor to supervise all of them.

[0005] Therefore, methods for providing feedback without human intervention have been proposed. For example, there is a method of providing feedback if a step is not completed within a set time. However, the time required for each step may vary depending on the trainee's disposition and other factors. The problem to be solved

[0006] One objective of the present disclosure is to provide an automatic feedback providing device and method that take into account the trainee's disposition.

[0007] The problems that the present invention aims to solve are not limited to those mentioned above, and other unmentioned problems will be clearly understood by a person skilled in the art from the description below. means of solving the problem

[0008] According to one aspect of the present disclosure, a feedback providing device is provided comprising: a receiving unit for receiving training content and training information from an external device; an action recording unit for recording, respectively, a step being performed by a trainee, at least one action performed by the trainee in the step, a valid action among the actions, and the time taken to perform each action in the step based on the training content and training information; a propensity analysis unit for classifying the trainee's propensity using the number of valid actions among the performed actions and the time taken to perform the actions, and determining whether the trainee already knows the step; a feedback judgment unit for determining whether to provide feedback to the trainee using the propensity; and a feedback providing unit for providing feedback to the trainee based on the judgment of the feedback judgment unit.

[0009] According to another aspect of the present disclosure, a method for providing feedback to a trainee performing virtual training, wherein a feedback providing device provides feedback, comprises: receiving training content and training information from an external device; recording, based on the training content and training information, a step being performed by the trainee, at least one action performed by the trainee in the step, a valid action among the actions, and the time taken to perform each action in the step; classifying the trainee's disposition using the number of valid actions among the actions performed and the time taken to perform the actions; determining whether the trainee already knows the step; a feedback judgment process for determining whether to provide feedback to the trainee using the disposition; and providing feedback to the trainee based on the judgment of the feedback judgment unit. Effects of the invention

[0010] According to an embodiment of the present disclosure, an automatic feedback providing device and method that consider the trainee's tendencies can be provided by changing the priority of conditions for providing feedback based on the trainee's tendencies.

[0011] The effects of the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by a person skilled in the art from the description below. Brief explanation of the drawing

[0012] FIG. 1 is a drawing illustrating a virtual training system according to one embodiment of the present disclosure. FIG. 2 is a block diagram schematically illustrating a feedback providing device according to one embodiment of the present disclosure. FIG. 3 is a flowchart illustrating a feedback providing method according to one embodiment of the present disclosure. Specific details for implementing the invention

[0013] Some embodiments of the present disclosure are described in detail below with reference to exemplary drawings. It should be noted that in assigning reference numerals to the components of each drawing, the same components are given the same reference numeral whenever possible, even if they are shown in different drawings. Furthermore, in describing the present disclosure, if it is determined that a detailed description of related known components or functions could obscure the essence of the present disclosure, such detailed description is omitted.

[0014] In describing the components of the embodiments according to the present disclosure, symbols such as first, second, i), ii), a), b), etc., may be used. These symbols are intended only to distinguish the components from other components, and the essence, order, or sequence of the components is not limited by the symbols. When a part in the specification is described as 'comprising' or 'having' a component, this means that, unless explicitly stated otherwise, it does not exclude other components but may include additional components.

[0015] The detailed description set forth below, together with the accompanying drawings, is intended to describe exemplary embodiments of the present disclosure and is not intended to represent the only embodiment in which the present disclosure can be practiced.

[0016] The singular terms used below may include the plural form unless otherwise specified.

[0017] FIG. 1 is a drawing illustrating a virtual training system according to one embodiment of the present disclosure.

[0018] Referring to FIG. 1, the virtual training system includes a feedback provision apparatus (10), a trainee (12), a server (14), and an object (16). The trainee (12) performs virtual training using a VR device (Virtual Reality device, not shown). The object (16) is a virtual object and does not actually exist. The trainee (12) can perform virtual interaction (hereinafter 'interaction') with the object (16) using the VR device.

[0019] The server (14) transmits training content to the trainee (12) and the feedback providing device (10). The server (14) receives actions performed by the trainee (12) and checks whether the necessary actions for each stage of training have been completed.

[0020] Training content includes at least one training process. A single training process includes at least one step. A single step includes at least one effective action. Here, an effective action is an action designated to be performed at each step. The effective actions differ for each step.

[0021] A trainee (12) wears a VR device and performs training. Here, the VR device is a device that provides virtual objects and / or virtual backgrounds for training to the trainee (120). The VR device transmits the content of the actions performed by the trainee (12) (hereinafter referred to as 'training information') to a server (14) and a feedback providing device (10).

[0022] The feedback providing device (10) records the actions performed by the trainee (12) and identifies the trainee's (12) behavioral tendencies (hereinafter referred to as 'tendencies', traits) based on the actions. The feedback providing device (10) determines conditions for providing feedback based on the trainee's (12) tendencies. When the conditions are satisfied, the feedback providing device (10) provides feedback to the trainee (12). For example, the conditions may be the number of valid actions or the time required. Here, feedback is the act of informing the trainee (12) of information regarding the valid actions that must be performed at each stage of training.

[0023] FIG. 2 is a block diagram schematically illustrating a feedback providing device according to one embodiment of the present disclosure. Meanwhile, the components illustrated in FIG. 2 represent functionally distinct elements, and at least one of the components may be implemented in a form that is integrated with one another in an actual physical environment.

[0024] Referring to FIG. 2, the feedback providing device (10) includes, in whole or in part, a receiving unit (100), an action log unit (110), a propensity analysis unit (120), a feedback decision unit (130), and a feedback provision unit (140).

[0025] The receiving unit (100) may include a communications unit (not shown) for communicating with an external device and an input unit (not shown) for receiving information from the outside. The receiving unit (100) receives information from an external device. The external device includes a server (14), a VR device, a camera, a computer, etc.

[0026] The receiving unit (100) receives training content from the server (14). The training content includes information on at least one step, information on valid actions, location information of an object, rotation information of an object, size information of an object, and shape information of an object. Valid actions include actions of grabbing, releasing, or moving an object, or actions of colliding with an object.

[0027] The receiver (100) receives training information from the VR device. Here, the training information includes location information of the VR device, rotation information of the VR device and button click information of the VR device, the type of action performed by the trainer (12), whether there is interaction between the object (16) and the trainer (12), and the object with which the trainer (12) interacts.

[0028] The action recorder (110) receives training content and training information from the receiver (100). The action recorder (110) records the stage currently being performed by the trainer (12). The action recorder (110) records the actions performed by the trainer (12) in the current stage. The action recorder (110) records valid actions among the actions performed by the trainer (12). Here, valid actions refer to valid actions of the stage currently being performed by the trainer (12). The action recorder (110) records the number of valid actions. For each stage, the action recorder (110) can record the stage being performed by the trainer (12), the actions performed in that stage, the valid actions performed in that stage, and the number of valid actions.

[0029] The action recorder (110) records the time the trainer (12) performs each action. The action recorder (110) records the time the trainer (12) performs an action at each stage. The action recorder (110) records the time the trainer (12) performs a valid action for each valid action. The action recorder (110) increases the number of valid actions if the trainer (12) holds an object for a predefined amount of time. The action recorder (110) can calculate the time the object is held based on the time the object is held and the time the object is released. Here, the predefined time can be input from outside the feedback providing device (10).

[0030] The action recorder (110) selects an effective object at each step. An effective object refers to an object that must be interacted with to perform an effective action at each step. For example, the action recorder (110) selects an effective object based on the object's location information, size information, and shape information.

[0031] The action recorder (110) can obtain answer data for each step. Here, the answer data includes the minimum value of the number of valid actions required for each step and the minimum value of the time required. In other words, the answer data is the number of valid actions and the time required when each step is performed most quickly and accurately. The answer data may be predefined data. The answer data may be input from outside the feedback providing device (10). According to one embodiment of the present disclosure, the answer data is information included in the training content.

[0032] The tendency analysis unit (120) calculates the average time per effective action. For example, the tendency analysis unit (120) can calculate this by dividing the number of effective actions recorded by the action record unit (110) by the time the trainer (12) performed the action. The tendency analysis unit (120) can calculate the average time per effective action for each stage.

[0033] The propensity analysis unit (120) classifies the propensity of the trainee (12) using the average time per effective act. For example, if the average time per effective act is longer than a predefined threshold time, the propensity analysis unit (120) classifies the trainee (12) as a passive trainee. Conversely, if the average time per effective act is shorter than the threshold time, the propensity analysis unit (120) classifies the trainee (12) as an active trainee.

[0034] The propensity analysis unit (120) determines whether the trainee (12) already knows each step by using the time taken for the trainee (12) to perform a valid action. If the time taken from the start of the step to the first valid action performed, or the time taken from the first valid action performed to the second valid action performed, is shorter than the average time per valid action, the propensity analysis unit (120) determines that the trainee (12) already knows the step. Conversely, if the time taken from the start of the step to the first valid action, or the time taken from the first valid action to the second valid action, is longer than the average time per valid action, the propensity analysis unit (120) determines that the trainee (12) does not yet know the step. Here, the phrase "the trainee (12) already knows the step" means that the trainee (12) knows what valid action to perform in the step.

[0035] The feedback judgment unit (130) receives information from the receiving unit (100), the behavior record unit (110), and the tendency analysis unit (120).

[0036] The feedback judgment unit (130) determines the maximum number of valid actions and the maximum time required for each step based on the correct answer data for each step received from the action record unit (110). Here, the maximum number of valid actions and the maximum time required are criteria for determining whether to provide feedback to the trainee (12).

[0037] For example, the feedback judgment unit (130) determines three times the correct answer data for each step as the maximum number of effective actions and the maximum time required. Here, three times is merely a figure for illustrative purposes, and the maximum number of effective actions and the maximum time required are not necessarily limited to three times the correct answer data and can have various values.

[0038] The feedback judgment unit (130) adjusts the maximum number of effective actions and the maximum time required based on whether the trainee (12) knows each step. For example, if the trainee (12) does not know the current step, the feedback judgment unit (130) increases the determined maximum number of effective actions and the maximum time required. Conversely, if the trainee (12) already knows the current step, the feedback judgment unit (130) maintains the maximum number of effective actions and the maximum time required.

[0039] The feedback judgment unit (130) determines whether to provide feedback to the trainee (12) using the maximum number of valid actions or the maximum time required. The feedback judgment unit (130) receives from the action record unit (110) the number of valid actions performed by the trainee (12) and the time required from the start of the stage to the present. If the trainee (12) has not performed all the valid actions required by each stage up to the maximum number of valid actions or the maximum time required, the feedback judgment unit (130) determines that feedback must be provided to the trainee (12).

[0040] The feedback judgment unit (130) determines the priority between the maximum number of effective actions and the maximum time required based on the tendency of the trainee (12) received from the tendency analysis unit (120). If the trainee (12) is a passive trainee, the feedback judgment unit (130) determines whether to provide feedback using the maximum time required. In contrast, if the trainee (12) is an active trainee, the feedback judgment unit (130) determines whether to provide feedback using the maximum number of effective actions.

[0041] The feedback providing unit (140) provides feedback to the trainee (12) when the feedback judgment unit (130) determines that feedback should be provided. According to one embodiment of the present disclosure, the feedback providing unit (140) includes a memory (not shown) for storing feedback information. The feedback information includes information regarding valid actions to be performed at each step and the location of objects to be interacted with at each step. For example, the feedback information includes the type of valid action, valid objects to be interacted with for each valid action, and the location of the valid objects. The feedback providing unit (140) selects feedback corresponding to the valid action to be performed from the feedback information and provides it to the trainee (12).

[0042] The feedback providing unit (140) can provide feedback based on the situation of the trainer (12). The feedback providing unit (140) receives from the action record unit (110) whether the trainer (12) is currently interacting with a valid object. The feedback providing unit (140) provides different feedback depending on whether the trainer (12) is interacting with a valid object. For example, if the trainer (12) is interacting with a valid object, the feedback providing unit (140) can provide clues about the valid action to be performed. If the trainer (12) is not interacting with a valid object, the feedback providing unit (140) can provide the location of the valid object.

[0043] FIG. 3 is a flowchart illustrating a feedback providing method according to one embodiment of the present disclosure.

[0044] Referring to FIG. 3, the receiver (100) receives information (S300). Here, the information includes training content and training information.

[0045] The action recorder (110) records the actions of the trainer (12) (S310). The action recorder (110) records the stage currently being performed by the trainer (12). The action recorder (110) records the number of valid actions among the actions of the trainer (12). Here, valid actions refer to valid actions of the stage currently being performed by the trainer (12). The action recorder (110) records the time taken for the trainer (12) to perform each action. The action recorder (110) records the time from the start of the stage currently being performed until the present.

[0046] The propensity analysis unit (120) calculates the average time per valid act. The propensity analysis unit (120) classifies the propensity of the trainee (12) using the average time per valid act. The propensity analysis unit (120) determines whether the trainee (12) knows the current stage using the time from the start of the stage to the first valid act, the time from the first valid act to the second valid act, and the average time per valid act.

[0047] The feedback judgment unit (130) determines whether to provide feedback (S320). The feedback judgment unit (130) determines whether to provide feedback based on the correct answer data, the trainee's (12) disposition, and whether the trainee (12) knows the current stage.

[0048] The feedback providing unit (140) provides feedback (S330). The feedback providing unit (140) provides feedback based on the judgment of the feedback judgment unit (130). The feedback providing unit (140) provides feedback based on the situation of the trainee (12).

[0049] At least some of the components described in the exemplary embodiments of the present disclosure may be implemented as hardware elements including at least one of a Digital Signal Processor (DSP), a processor, a controller, an Application-Specific IC (ASIC), a programmable logic device (such as an FPGA), or other electronic devices, or a combination thereof. Additionally, at least some of the functions or processes described in the exemplary embodiments may be implemented in software, and the software may be stored on a recording medium. At least some of the components, functions, and processes described in the exemplary embodiments of the present disclosure may be implemented as a combination of hardware and software.

[0050] The method according to exemplary embodiments of the present disclosure may be written as a program executable on a computer and may also be implemented on various recording media such as magnetic storage media, optical reading media, and digital storage media.

[0051] Implementations of the various technologies described herein may be implemented as digital electronic circuits, or as computer hardware, firmware, software, or combinations thereof. Implementations may be implemented as computer program products, i.e., computer programs tangibly embodied in information carriers, such as machine-readable storage devices (computer-readable media) or radio signals, for processing by the operation of data processing devices, e.g., programmable processors, computers, or multiple computers, or for controlling such operation. Computer programs such as the computer program(s) described above may be written in any form of programming language, including compiled or interpreted languages, and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. Computer programs may be deployed to be processed on one computer or multiple computers at one site, or distributed across multiple sites and interconnected by a communication network.

[0052] Processors suitable for processing computer programs include, for example, both general-purpose and special-purpose microprocessors, and any one or more processors of any type of digital computer. Generally, the processor will receive instructions and data from read-only memory or random access memory, or both. The elements of the computer may include at least one processor that executes instructions and one or more memory devices that store instructions and data. Generally, the computer may include one or more mass storage devices that store data, for example, magnetic, magneto-optical disks, or optical disks, or may be combined to receive data from these, transmit data to these, or both. Information carriers suitable for embodying computer program instructions and data include, for example, semiconductor memory devices, magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs (Compact Disk Read Only Memory) and DVDs (Digital Video Disks); magneto-optical media such as floptical disks; ROMs (Read Only Memory); RAMs (Random Access Memory); flash memory; EPROMs (Erasable Programmable ROM); EEPROMs (Electrically Erasable Programmable ROM); etc. Processors and memory may be supplemented by or included in special-purpose logic circuit organizations.

[0053] The processor may execute an operating system and software applications executed on said operating system. Additionally, the processor device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, the processor device may be described as being used as a single unit; however, those skilled in the art will understand that the processor device may include multiple processing elements and / or multiple types of processing elements. For example, the processor device may include multiple processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are also possible.

[0054] Additionally, non-transitory computer-readable media may be any available medium accessible by a computer and may include both computer storage media and transmission media.

[0055] Although this specification contains details of a number of specific embodiments, they should not be understood as limiting the scope of any invention or claimables, but rather as descriptions of features that may be characteristic of a specific embodiment of a specific invention. Specific features described in this specification in the context of individual embodiments may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in multiple embodiments individually or in any appropriate sub-combination. Furthermore, while features may operate in a specific combination and be described as initially claimed, one or more features from the claimed combination may be excluded from the combination in some cases, and the claimed combination may be changed to a sub-combination or a variation of the sub-combination.

[0056] Likewise, although operations are depicted in the drawings in a specific order, this should not be understood as requiring that such operations be performed in that specific or sequential order depicted to obtain a desirable result, or that all depicted operations must be performed. In certain cases, multitasking and parallel processing may be advantageous. Furthermore, the separation of the various device components of the embodiments described above should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and devices can generally be integrated together into a single software product or packaged into multiple software products.

[0057] Meanwhile, the embodiments of the present invention disclosed in this specification and drawings are merely specific examples provided to aid understanding and are not intended to limit the scope of the present invention. It is obvious to those skilled in the art that other variations based on the technical concept of the present invention are possible in addition to the embodiments disclosed herein.

[0058] The scope of protection of this embodiment shall be interpreted by the claims below, and all technical ideas within an equivalent scope shall be interpreted as being included within the scope of rights of this embodiment. Explanation of the symbols

[0059] 100: Receiver 110: Act Recorder 120: Tendency Analysis Department 130: Feedback Judgment Department 140: Providing Feedback

Claims

Claim 1 A feedback providing device comprising: a receiving unit for receiving training content and training information from an external device; an action recording unit for recording, respectively, a step currently being performed by a trainee, at least one action performed by the trainee in the step, a valid action among the actions, and the time taken to perform each action in the step; a propensity analysis unit for classifying the trainee's propensity using the number of valid actions among the actions and the time taken to perform the actions, and determining whether the trainee knows the step; a feedback judgment unit for determining whether to provide feedback to the trainee using the propensity; and a feedback providing unit for providing feedback to the trainee based on the judgment of the feedback judgment unit. Claim 2 A feedback providing device according to claim 1, wherein the propensity analysis unit calculates the time per valid act based on the number of valid acts and the time taken to perform the acts, and if the time per valid act is longer than a predefined threshold time, determines the trainer as a passive trainer. Claim 3 In claim 2, the propensity analysis unit determines the trainer as an active trainer if the time per valid act is shorter than the threshold time, a feedback providing device. Claim 4 In claim 2, the tendency analysis unit determines that the trainer does not know the step if the time taken from the start of the step to the first valid act, or the time taken from the first valid act to the second valid act, is longer than the time per valid act, wherein the first valid act and the second valid act are the valid act performed first and the valid act performed second by the trainer, respectively, of the feedback providing device. Claim 5 A feedback providing device according to claim 1, wherein the feedback judgment unit determines the maximum number of valid actions and the maximum time required based on the correct answer data included in the training content, and the correct answer data includes the minimum value of the number of valid actions and the minimum value of the time required to complete the step. Claim 6 In claim 5, the feedback judgment unit determines whether to provide the feedback using the number of maximum effective actions if the trainer is an active trainer, a feedback providing device. Claim 7 In claim 5, the feedback judgment unit determines whether to provide the feedback based on the maximum required time if the trainer is a passive trainer, a feedback providing device. Claim 8 In claim 5, the feedback judgment unit increases the maximum number of effective actions and the maximum time required if the trainer does not know the step, and the propensity analysis unit does not increase the maximum number of effective actions and the maximum time required if the trainer knows the step. Claim 9 A feedback providing device according to claim 1, wherein the action recorder selects at least one valid object among at least one object included in the training content and records whether the trainer interacts with the valid object, and wherein the training content includes information regarding the location of the object, the size of the object, and the shape of the object. Claim 10 In claim 9, the feedback providing unit provides as feedback a valid action to be performed when the trainer is interacting with the valid object, and provides as feedback the location of the valid object when the trainer is not interacting with the valid object. Claim 11 A method for providing feedback to a trainer performing virtual training, comprising: receiving training content and training information from an external device; recording, based on the training content and training information, at least one of the following: a step currently being performed by the trainer, at least one action performed by the trainer in the step, a valid action among the actions, and the time taken to perform each action in the step; classifying the trainer's disposition using the number of valid actions among the actions and the time taken to perform the actions; determining whether the trainer knows the step; a feedback judgment process for determining whether to provide feedback to the trainer using the disposition; and providing feedback to the trainer based on the feedback judgment process. Claim 12 In claim 11, the classifying process comprises: a process of calculating the time per valid act based on the number of valid acts and the time taken to perform the acts; and a process of determining the trainer as a passive trainer if the time per valid act is longer than a predefined threshold time. Claim 13 In claim 12, the method further includes a process of determining the trainer as an active trainer if the time per valid act is shorter than the threshold time. Claim 14 In claim 12, the above-mentioned judgment process includes a process of determining that the trainee does not know the above-mentioned step if the time taken from the start of the above-mentioned step to the first valid act, or the time taken from the first valid act to the second valid act, is longer than the time per valid act, wherein the first valid act and the second valid act are respectively the first valid act and the second valid act performed by the trainee in the above-mentioned step. Claim 15 In claim 11, the feedback judgment process includes a process of determining the maximum number of valid actions and the maximum time required based on correct answer data included in the training content, wherein the correct answer data includes the minimum value of the number of valid actions and the minimum value of the time required to complete the step. Claim 16 In claim 15, the feedback judgment process includes a process of determining whether to provide the feedback using the number of maximum effective actions if the trainer is an active trainer. Claim 17 In claim 15, the method further comprises a process of determining whether to provide the feedback based on the maximum required time if the trainer is a passive trainer. Claim 18 In claim 15, the feedback judgment process comprises: a process of increasing the maximum number of effective actions and the maximum time required if the trainer does not know the step; and a process of not increasing the maximum number of effective actions and the maximum time required if the trainer knows the step. Claim 19 In claim 11, the recording process includes selecting at least one valid object among at least one object included in the training content and recording whether the trainee interacts with the valid object, wherein the training content includes information regarding the location of the object, the size of the object, and the shape of the object. Claim 20 In claim 19, the process of providing comprises: a process of providing as feedback a valid action to be performed when the trainer is interacting with the valid object; and a process of providing as feedback the location of the valid object when the trainer is not interacting with the valid object.

Images