Augmented reality training server

Abstract

Disclosed is an augmented reality training server that generates and displays data for augmented reality training in order to perform training similar to actual conditions. The augmented reality training server includes: a preprocessing unit that receives a graphic resource from an external database and generates template data by converting the received graphic resource; a content creation unit for creating content to be used in an extended reality (XR) training by using the template data; and an interaction unit that displays augmented reality training data to a user using the template data and the content, the template data including data in which the graphic resource is converted into data that can be used to generate the content. The content may include at least one of a map for the augmented reality training and a scene corresponding to the map.

Description

Technical Field

[0001] The present invention relates to an extended reality (XR) training server.

[0002] More specifically, the present invention relates to an extended reality training server that generates and displays extended reality training data for performing training similar to actual situations. Background Art

[0003] Virtual reality (VR) technology provides only computer graphic (CG) images of objects or backgrounds in the real world, augmented reality (AR) technology provides computer graphic images virtually created on actual object images, and mixed reality (MR) technology is a computer graphic technology that combines virtual objects with the real world. Virtual reality refers to a technology for experiencing a new reality based on 360-degree images, and augmented reality displays information and content on actual objects through computer graphics. Although augmented reality and virtual reality are different from each other, these two technologies are evolving while complementing each other's disadvantages. However, there are obvious differences at the current stage. Virtual reality requires a head-mounted display (HMD) that covers the entire eyes, and augmented reality can be represented by glasses such as Google Glass.

[0004] In this case, an augmented reality technology application device three-dimensionally recognizes the real space and real objects through a camera and displays the real space and virtual objects on a screen. However, the prior art can only move virtual objects based on user touches recognized on the above screen.

[0005] Furthermore, virtual reality is basically based on providing visual and auditory stimuli to users and is limited to stimulating the remaining senses. In training and entertainment scenarios, although the need for olfactory and gustatory stimuli may not be frequent, the need for tactile stimuli occurs frequently. For example, in virtual reality, when simulating an object or structure based on vision, the user may want to grab the corresponding object with their hand or lean on the corresponding structure. However, since the corresponding object or structure does not exist in the actual environment, accidents such as confusion or falling may occur. In particular, when performing training through virtual reality, the interaction with surrounding structures can occupy the main part of the training. For example, when performing anti-terrorism training using virtual reality, most of the training content can be that the trainer leans on the back of a structure such as a wall and uses the structure as a concealment tool or a defensive tool. In this case, if only audio-visual stimuli are used to provide virtual reality, the trainer cannot interact with the structure, so the training completion rate will inevitably decrease.

[0006] Extended Reality (XR) is a term that encompasses the above-mentioned virtual reality technology, augmented reality technology, and mixed reality technology.

[0007] Extended reality can freely select the individual application or combined application of virtual reality technology and augmented reality technology to create extended reality. Although the HoloLens developed by Microsoft (MS) is a device in the form of glasses, since it displays optimized three-dimensional holograms by grasping real-space and object information, it can also be regarded as a form of extended reality. With the development of extended reality technology, when augmented reality is needed, information can usually be displayed on the glasses of transparent glasses. When virtual reality is needed, as the glasses become opaque, information can be fully displayed through the entire field of view.

[0008] In addition to the education field, extended reality is applicable to various fields such as healthcare and manufacturing. To achieve extended reality, high-performance computing capabilities and graphics processing capabilities for displaying a large number of real-time three-dimensional images are particularly important. Not only the development of display technology is required, but also technologies such as fifth-generation (5G) mobile communications that can efficiently transmit a large amount of data with ultra-low latency are prerequisite conditions.

[0009] Like this, currently, it is still necessary to try to apply extended reality training data to various industries. Summary of the Invention

[0010] Technical Problem

[0011] The purpose of the present invention is to provide an extended reality training server that can perform virtual training using extended reality training data.

[0012] Moreover, another object of the present invention is to provide an extended reality training server that can generate extended reality training data in order to obtain the same training effect as the actual one.

[0013] The object of the present invention is not limited to the above-mentioned objects. Other objects and advantages not mentioned in the present invention can be understood through the following description and can be further clarified through the embodiments of the present invention. Moreover, it should be understood that the objects and advantages of the present invention can be easily achieved by the means and combinations thereof recorded in the claims of the invention.

[0014] Technical Solution

[0015] The extended reality training server according to multiple embodiments of the present invention may include: a preprocessing unit that receives graphic resources from an external database and generates template data by converting the received graphic resources; a content production unit that uses the template data to produce content for extended reality (XR, Extended Reality) training; and an interaction unit that displays extended reality training data to a user by using the template data and the content. The template data includes the graphic resources converted into data that can be used to generate the content, and the content may include at least one of a map for the extended reality training and a scene corresponding to the map.

[0016] Moreover, the preprocessing unit generates a converted graphic by performing at least one of standardization, format conversion, and size transformation of the graphic resources, and may assign attribute information to the converted graphic to generate the template data.

[0017] Moreover, the template data may include at least one of an object template, an avatar template, a weapon template, and a moving tool template. The object template is related to the objects constituting the map, the avatar template is related to the avatar whose actions are controlled by a user wearing an extended reality training device, the weapon template is related to the weapon carried by the avatar, and the moving tool template is related to the moving tool that the avatar can ride on.

[0018] Moreover, when generating at least one of the object template, the avatar template, the weapon template, and the moving tool template, the preprocessing unit may assign at least one of collision information, fire information, sound information, animation information, size information, assembly position information, effect information, model information, and riding information as the attribute information.

[0019] Moreover, the content production unit may include: a map production module that generates the map by using the template data; and a scene production module that generates the scene by using the template data.

[0020] Further, the above map production module can generate the above map implemented in three dimensions by configuring the above template data in a predetermined space.

[0021] Further, the above scenario production module can generate the above scenario by taking at least one task that can be performed by an avatar controlled by a user wearing an extended reality training device and at least one event occurring within the above map.

[0022] Further, the above task includes at least one of a state condition, a time condition, and an action condition that are conditions for the above avatar to achieve in order to complete the above task. The above state condition includes conditions related to the state of the above avatar, conditions related to the state of non-player characters (NPCs) existing within the above map, and conditions related to the state of objects constituting the above map. The above time condition includes conditions related to the total time for executing the above task. The above action condition may include conditions related to actions that the above avatar needs to perform before completing the above task.

[0023] Further, the above event may include at least one of a triggering condition for triggering the above event and a termination condition for terminating the above event.

[0024] Further, the above interaction unit includes an extended reality training device that a user can wear, and can apply a user operation signal received through the above extended reality training device to the above template data and the above content to reflect the actual actions of the above user in the above extended reality training data.

[0025] Effects of the Invention

[0026] The extended reality training server according to multiple embodiments of the present invention has the following effects. That is, since the same extended reality training data as in reality is used, various training effects can be obtained within a limited environment and space.

[0027] Further, the extended reality training server according to multiple embodiments of the present invention generates various extended reality training data. As the generated extended reality training data is used, various data of users in various environments and conditions can be collected.

[0028] The effects that can be obtained by the present invention are not limited to the above-mentioned effects. Those of ordinary skill in the technical field to which the present invention pertains can clearly understand other effects not mentioned through the following description. Brief Description of the Drawings

[0029] Figure 1 It is a block diagram of an extended reality training server according to multiple embodiments of the present invention.

[0030] Figure 2It is a conceptual diagram for illustratively explaining the operation of a preprocessing unit according to multiple embodiments of the present invention.

[0031] Figure 3 It is a diagram for explaining the types of template data according to multiple embodiments of the present invention.

[0032] Figures 4a to 4f It is an illustrative diagram of template data according to multiple embodiments of the present invention.

[0033] Figure 5 It is a partial block diagram of an internal production unit according to multiple embodiments of the present invention.

[0034] Figure 6 It is a map produced by a map production module according to multiple embodiments of the present invention.

[0035] Figure 7a And Figure 7b It is a diagram for explaining the tasks and events included in a scenario according to multiple embodiments of the present invention.

[0036] Figure 8a It is a plurality of illustrative diagrams of an extended reality training device Figure 8b It is a plurality of illustrative diagrams of data for extended reality training. Detailed Description of the Invention

[0037] In this specification and the scope of the invention claimed, the terms or words used should not be construed as being limited to their ordinary meanings or dictionary definitions. Based on the principle that the inventor can define the concept of a term or word in order to best explain his own invention, it should be interpreted based on the meanings and concepts that conform to the technical idea of the present invention. Also, in the embodiments and drawings described in this specification, the structures shown are only for implementing one embodiment of the present invention and do not represent all the technical ideas of the present invention. Therefore, it should be understood that at the time of filing this application, there may be various equivalent technical solutions, deformations, and application examples that can replace it.

[0038] In this specification and the scope of the invention claimed, the terms "first", "second", "A", "B", etc. can be used to describe various structural elements, but the above structural elements are not limited to the above terms. The above terms are only used to distinguish one structural element from other structural elements. For example, without departing from the scope of the invention claimed, the first structural element can be named the second structural element, and similarly, the second structural element can also be named the first structural element. The term "and / or" includes combinations of multiple related recited items or a certain item among multiple related recited items.

[0039] In this specification and the scope of the invention claimed, the terms used are for the purpose of describing specific embodiments only and do not limit the present invention. Unless clearly indicated otherwise in the context, singular expressions include plural expressions. In this specification, terms such as "including" or "having" should not be construed as precluding the existence or additional possibility of features, numbers, steps, operations, structural elements, components, or combinations thereof described in the specification.

[0040] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by those of ordinary skill in the technical field to which the present invention pertains.

[0041] Terms defined in commonly used dictionaries should be construed to have the same meaning as the context of the related art, and should not be construed as having an idealized or overly formal meaning unless clearly defined in this specification.

[0042] Moreover, various structures, processes, procedures, methods, etc. included in each embodiment of the present invention can be shared within the scope where they do not interfere with each other technically.

[0043] Hereinafter, with reference to Figures 1 to 8b an extended reality training server according to multiple embodiments of the present invention will be described.

[0044] Figure 1 is a block diagram of an extended reality training server according to multiple embodiments of the present invention.

[0045] With reference to Figure 1 , the extended reality training server 1 may include a preprocessing unit 100, a content production unit 200, and an interaction unit 300.

[0046] The preprocessor 100 refers to a tool for generating a template, and the above template is used to generate content required for extended reality training.

[0047] As multiple examples, the preprocessing unit 100 receives graphic resources (hereinafter referred to as "GR") received from an external database, and may generate template data (hereinafter referred to as "TD") based on the received image resources GR. In other words, the preprocessing unit 100 can receive (import) graphic resources GR from an external database and convert them into data usable by the content production unit 200.

[0048] Hereinafter, with reference to Figure 2 the operation of the preprocessing unit 100 according to multiple embodiments of the present invention will be described in further detail.

[0049] Figure 2 is a conceptual diagram for illustratively explaining the operation of the preprocessing unit according to multiple embodiments of the present invention.

[0050] Refer to Figure 2 , the preprocessing unit 100 can convert the graphic resource GR into template data TD. The graphic resource GR can include images (2D images, 3D images), videos, panoramas, etc. However, the embodiments of the present invention are not limited thereto.

[0051] As multiple examples, the preprocessing unit 100 performs standardization, format conversion, size transformation, etc. on the received graphic resource GR, and can assign attribute information (hereinafter referred to as "ATT") to the graphic resource GR to generate template data TD.

[0052] Specifically, the preprocessing unit 100 preferentially performs preprocessing work on the graphic resource GR, and can perform standardization on the graphic resource GR, convert the format of the graphic resource GR, and transform the size of the graphic resource GR to generate a changed graphic (hereinafter referred to as "CG"). In other words, the changed graphic CG can be the result of performing at least one of standardization, format conversion, and size transformation on the graphic resource GR. In this case, the changed graphic CG can be stored in the library format.

[0053] Next, the preprocessing unit 100 can apply an animation to the movable area of the changed graphic CG by using a guide model (hereinafter referred to as "GM"). In other words, the preprocessing unit 100 can give an animation effect to the movable part of the object included in the changed graphic CG (for example, the arm or leg of an avatar, the wheel of a vehicle). If there is no movable part (area) of the object included in the changed graphic CG (for example, the ground, the wall), the preprocessing unit 100 may not apply the animation effect. In this case, the guide model GM can include well-known models, such as Biped, CAT (Character Animation Toolkit), Rigify, Advanced Skeleton, Human IK, The Setup Machine, etc. However, the embodiments of the present invention are not limited thereto.

[0054] Subsequently, the preprocessing unit 100 may assign attribute information ATT to the generated conversion graphic CG. For example, the preprocessor 100 may specify at least one piece of attribute information according to the data type of the conversion graphic CG and store it in the corresponding conversion graphic CG. The data type of the conversion graphic CG may depend on the object included in the corresponding conversion graphic CG. For example, the data type of the conversion graphic CG may include objects constituting a map, avatars controlled by a user wearing an extended reality training device, weapons carried by the avatars, mobile tools that the avatars can ride on, etc. However, the embodiments of the present invention are not limited thereto. In this case, the attribute information of each conversion graphic CG specified by the preprocessing unit 100 may become different as the data type of the conversion graphic CG changes. For example, the attribute information assigned to the object template related to the object and the attribute information assigned to the avatar template related to the avatar may be partially different or completely different. However, this is only for convenience of explanation, and the embodiments of the present invention are not limited thereto.

[0055] The preprocessing unit 100 may determine the result of applying the animation of the guiding model GM to the conversion graphic CG and / or completing the assignment of the attribute information ATT as the template data TD. The determined template data TD may be stored in a library format.

[0056] Hereinafter, with reference to Figure 3 a specific example of the template data TD of the present invention will be described in detail.

[0057] Figure 3 FIG. for explaining the types of template data according to multiple embodiments of the present invention. Figures 4a to 4f FIG. for illustrating the template data according to multiple embodiments of the present invention.

[0058] With reference to Figure 3 , the template data TD may include an object template TD1, an avatar template TD2, a weapon template TD3, a mobile tool template TD4, etc. However, the embodiments of the present invention are not limited thereto, and one or more of the object template TD1, the avatar template TD2, the weapon template TD3, and the mobile tool template TD4 may be omitted, and, as shown in the example of Figure 3 , the template data TD may also include other additional templates.

[0059] With reference to Figures 3 to 4f , the object template TD1 may include a template related to an object constituting a virtual training map (map).

[0060] Specifically, the object template TD1 may include a wall template TD1-1, an item template TD1-2, and a ground template TD1-3.

[0061] With reference to Figure 4aFor example, in the case of the wall formwork TD1-1, it may include the conversion graphic CG1-1 representing the wall shape and the attribute information ATT1-1 given to the corresponding conversion graphic CG1-1. The attribute information ATT1-1 of the wall formwork TD1-1 may include collision information and fire information. In this case, the collision information may include relevant information such as the collision reference point position and the collision size. And the fire information, as the relevant attribute when the corresponding wall catches fire, may include relevant information such as whether it burns, the ignition point, the burning time, the maximum temperature, and the type of combustion (the maximum flame size, the smoke color, the amount of smoke).

[0062] Refer to Figure 4b For example, in the case of the item formwork TD1-2, it may include the conversion graphic CG1-2 representing the item shape and the attribute information ATT1-2 given to the corresponding conversion graphic CG1-2. The attribute information ATT1-2 of the item formwork TD1-2 may include collision information and fire information. In this case, the collision information may include relevant information such as the collision reference point position and the collision size. And the fire information, as the relevant attribute when the corresponding item catches fire, may include relevant information such as whether it burns, the ignition point, the burning time, the maximum temperature, and the type of combustion (the maximum flame size, the smoke color, the amount of smoke).

[0063] Refer to Figure 4c For example, in the case of the ground formwork TD1-3, it may include the conversion graphic CG1-3 representing the ground shape and the attribute information ATT1-3 given to the corresponding conversion graphic CG1-3. The attribute information ATT1-3 of the ground formwork TD1-3 may include fire information and sound information. In this case, the fire information, as the relevant attribute when the corresponding item catches fire, may include relevant information such as whether it burns, the ignition point, the burning time, the maximum temperature, and the type of combustion (the maximum flame size, the smoke color, the amount of smoke). And the sound information, as the relevant attribute of what sound is output when the virtual character touches the corresponding ground, may include relevant information such as the type of sound and the sound volume.

[0064] The virtual character formwork TD2 is configured on the map and may include the formwork related to the virtual character whose actions are controlled by the user wearing the extended reality training device.

[0065] Refer to Figure 4dFor example, in the case of the avatar template TD2, it may include the conversion graphic CG2 representing the avatar shape and the attribute information ATT2 assigned to the corresponding conversion graphic CG2. The attribute information ATT2 of the avatar template TD2 may include animation information and collision information. In this case, when the user moves the avatar through actions while wearing the extended reality training device, the animation information may include information related to the movable parts of the avatar (e.g., arms or legs) (e.g., movement radius, movement angle). And the collision information may include information related to the collision reference point position, collision size, etc.

[0066] The weapon template TD3 may include a template related to the weapon that the avatar can hold or carry (e.g., gun, knife, etc.).

[0067] Refer to Figure 4e For example, in the case of the weapon template TD3, it may include the conversion graphic CG3 representing the weapon shape and the attribute information ATT3 assigned to the corresponding conversion graphic CG3. The attribute information ATT3 of the weapon template TD3 may include size information, assembly position information, sound information, effect information, etc. The size information may include information related to the size of the corresponding weapon. The assembly position information may include information related to the position where the corresponding weapon is assembled in the avatar slot. The sound information, as an attribute related to the sound emitted when the avatar uses the corresponding weapon, may include information such as sound type, sound volume, etc. The effect information, as an attribute related to the use effect of the corresponding weapon, may include applied effect information, effect position information, etc.

[0068] The moving tool template TD4 is configured on the map and may include a template related to the moving tool that the avatar can ride on (e.g., car, motorcycle, etc.).

[0069] Refer to Figure 4f For example, in the case of the moving tool template TD4, it may include the conversion graphic CG4 representing the moving tool shape and the attribute information ATT4 assigned to the corresponding conversion graphic CG4. The attribute information ATT4 of the moving tool template TD4 may include collision information, animation information, model information, etc. The collision information may include information related to the collision reference point position, collision size, etc. When the user moves the avatar through actions while wearing the extended reality training device, the animation information may include information related to the movable parts (e.g., arms or legs) inside the moving tool (e.g., movement radius, movement angle). The model information, as an attribute related to the model of the corresponding moving tool, may include information related to the external vehicle version, the information of the passengers that can be carried, the information related to the avatar's sitting position, the information related to the types and positions of the switches set, etc.

[0070] In this case, each template data TD is customized and can be stored separately for each user. In other words, the template data TD can be separately stored by separating according to the nationality of the registered user and / or the training participating user, the results of previous training participation, gender, purpose, and / or age. As an example, when the nationality of the registered user and / or the training participating user is a specific country, the template data TD for the corresponding user's extended reality training can be modified based on the data related to the corresponding user's inherent nationality and / or the data related to the competing nationality that has a competitive or adversarial relationship with the corresponding inherent nationality. For example, the template data TD can be modified and stored based on the images related to the inherent nationality (such as national flags, firearms, military uniforms, building exteriors, etc.), the images related to the competing nationality (such as national flags, firearms, military uniforms, building exteriors, etc.), and other data related to the competing nationality (such as the average body data of soldiers, firearms, and the performance of ordnance (such as fighter jets, trams, etc.)). As another example, the template data TD for the corresponding user's extended reality training can be modified based on the previous training results of the registered user. For example, when the corresponding user obtains a specific result or above during the previous training process, additional parameters (such as reaction speed, expansion range adjustment, detection range expansion, cooperation through the mutual relationship with other objects, etc.) can be additionally stored in the object data for the corresponding user's training based on this.

[0071] Referring again to Figure 1 , the preprocessing unit 100 can transmit the generated template data TD to the content production unit 200 and the interaction unit 300.

[0072] The content production unit 200 refers to a tool for generating content (hereinafter referred to as "CT"), and the above content is used for extended reality training.

[0073] As multiple examples, the content production unit 200 can generate content CT by using the template data TD received from the preprocessing unit 100. In other words, if the preprocessing unit 100 converts the image resource GR into the template data TD, the content production unit 200 can use the corresponding template data TD to generate the content CT for extended reality training.

[0074] Hereinafter, referring to Figure 5 The operation of the content production unit 200 of multiple embodiments of the present invention will be further described in detail.

[0075] Figure 5 It is a partial block diagram of the internal production unit of multiple embodiments of the present invention.

[0076] Referring to Figure 5, the content production department 200 may include a map production module 210 and a scene production module 220. The content production department 200 may output the map MAP generated by the map production module 210 and the scene (scenario, hereinafter referred to as "SCN") generated by the scene production module 220 as the content CT.

[0077] The map production module 210 may generate a map MAP for augmented reality training based on the template data TD.

[0078] As multiple examples, the map production module 210 may configure multiple template data TDs in a predetermined space to generate a map MAP. In this case, the generated map MAP can be realized three-dimensionally.

[0079] Hereinafter, with reference to Figure 6 The operation of the map production module 210 of multiple embodiments of the present invention will be further described in detail.

[0080] Figure 6 To show the map produced by the map production module of multiple embodiments of the present invention. Figure 6 of <a1>Shows an example of a three-dimensionally generated map MAP, Figure 6 of <a2>A top view showing the two-dimensional form of the generated map MAP is presented.

[0081] Referring to Figure 6 , the map generation module 210 can generate the map MAP by arranging a plurality of template data TD within a predetermined space.

[0082] As multiple examples, the map generation module 210 arranges an object template in the template data TD within a predetermined space (referring to TD1 in Figures 3 to 4c ), and can determine the arranged result as the map MAP. In this case, the object template can include the above-mentioned wall template, object template, floor template, etc., however, the embodiments of the present invention are not limited thereto. In other words, the map generation module 210 can arrange a wall template, an object template, a floor template, etc. within a predetermined space to generate the map MAP.

[0083] In this case, the map generation module 210 can automatically correct the arrangement position so that the template data TD matches the map grid. For example, the map generation module 210 arranges the template data TD in one of a plurality of grids, or can arrange the template data TD through a plurality of grids.

[0084] Next, the map generation module 210 can change the attributes of each arranged template data TD. In this case, the attributes of the template data TD can include the size (width, height, etc.) and direction of the template data, however, the embodiments of the present invention are not limited thereto.

[0085] Subsequently, the map MAP generated in the above manner can become a training space for the virtual avatar controlled by the user wearing the extended reality training device. In other words, the user wearing the extended reality training device can move or work with their corresponding virtual avatar within the map MAP to perform extended reality training.

[0086] Referring again to Figure 5 , the scenario generation module 220 can generate a scenario (hereinafter referred to as "SCN") corresponding to the map MAP using the template data TD. In this case, the scenario SCN refers to the overall process of performing extended reality training.

[0087] As multiple examples, the scenario generation module 220 can generate the scenario SCN by using tasks and events for extended reality training, etc.

[0088] In this case, a task refers to an intermediate step that needs to be passed through in order to advance the scenario. And an event refers to an individual event that occurs during the process of advancing the scenario.

[0089] As an example, the scenario creation module 220 may generate at least one task. In this case, each task included in the scenario may be uncorrelated, and specific correlated tasks need to be executed to proceed to the next task. That is, each task included in the scenario may be configured in a manner related to the time series, or may be configured as an independent parallel structure. When the tasks are configured as a parallel structure, each task may have an independent occurrence condition. If the occurrence condition is to be satisfied, multiple tasks may also occur simultaneously, regardless of the execution order of each task. When the scenario includes multiple tasks, the success or failure of the scenario may depend on whether all tasks are completed.

[0090] As another example, the scenario creation module 220 may generate at least one event. An event refers to various phenomena that occur during the extended reality training process. It refers to all occurrence situations, whether related or unrelated to the training process. For example, the appearance of a non-player character (NPC), the partial destruction of the map, etc. In this case, the event occurs through the interaction between the virtual avatar and the map MAP, or may occur independently of the interaction between the virtual avatar and the map MAP. When differentiating the types of events, the events may be classified into independent events or subordinate events according to whether they belong to tasks, and may also be classified into object events executed through the mutual relationship with an object or area events executed in a specific area.

[0091] Hereinafter, with reference to Figure 7a and Figure 7b the tasks and events included in the scenario SCN of multiple embodiments of the present invention will be further described in detail.

[0092] Figure 7a and Figure 7b are diagrams for illustrating the tasks and events included in the scenarios of multiple embodiments of the present invention.

[0093] With reference to Figure 7a and Figure 7b , the scenario SCN may include at least one task (mission, hereinafter referred to as "MIS") and at least one event (event, hereinafter referred to as "EVE").

[0094] The task MIS refers to an intermediate step that needs to be passed in order to advance the scenario SCN.

[0095] Each task (MIS1 to MIS3) included in the scenario SCN is either uncorrelated or correlated. Therefore, a specific task needs to be executed to proceed to the next task. That is, the scenario SCN includes multiple tasks (MIS1 to MIS3) configured in a time-series related manner, or can also be configured as an independent parallel structure. When each task (MIS1 to MIS3) is configured as a parallel structure, each task (MIS1 to MIS3) can have independent occurrence conditions. If the occurrence conditions are to be satisfied, multiple tasks can also occur simultaneously, regardless of the execution order of each task (MIS1 to MIS3). When the scenario SCN includes multiple tasks (MIS1 to MIS3), the success or failure of the scenario can depend on whether all tasks (MIS1 to MIS3) are completed.

[0096] The task MIS can include more than one condition. In this case, for each task MIS, if all the included conditions are satisfied, it can be determined that the corresponding task MIS has been successfully completed. In this case, the conditions can include status conditions, time conditions, and action conditions.

[0097] The status condition refers to a condition related to the status that needs to be achieved to determine whether each task MIS has been successfully completed. As an example, the status condition can include conditions related to the status of the avatar (e.g., physical strength, etc.), conditions related to the status of non-player characters existing in the map, and conditions related to the status of the objects constituting the map (e.g., whether the structure is damaged), etc.

[0098] The time condition can include conditions related to the total time for executing the task MIS. In other words, the time condition can include the limited time required to complete the corresponding task MIS, etc. However, the embodiments of the present invention are not limited thereto.

[0099] The action condition can include conditions related to the actions that the avatar needs to perform before completing the task MIS. In other words, each task MIS needs to determine that the avatar performs a specific behavior or action corresponding to the action condition to be determined as successful.

[0100] In this case, each task MIS can be determined to be successful only when all the constituted conditions are satisfied. For example, in the case of the status condition, if the target specific status is reached, it is determined to be successful, and at the time point when the target status cannot be reached, it can be immediately determined to be a failure. Also, in the case of the time condition, if the target is achieved within the limited time, it is determined to be successful, and in the case of exceeding the limited time, it can be immediately determined to be a failure. Also, in the case of the action condition, if the predetermined action is performed, it is determined to be successful, and at the time point when the predetermined action cannot be performed, it can be immediately determined to be a failure.

[0101] Event EVE refers to individual events or phenomena that occur during the advancement of scenario SCN.

[0102] Event EVE refers to all occurrences, whether related or unrelated to the training process. For example, the appearance of non-player characters, partial destruction of the map, etc. In this case, the event occurs through the interaction between the avatar and the map MAP, or it can occur independently of the interaction between the avatar and the map MAP.

[0103] As an example, events EVE can be classified into independent events (Independent Event, hereinafter referred to as "EVE_ID") or dependent events (Dependent Event, hereinafter referred to as "EVE_DE") according to whether they belong to task MIS. In other words, independent event EVE_I refers to a state that occurs independently of the progress of each task (MIS1 to MIS3), and dependent event EVE_DE belongs to each task (MIS1 to MIS3) and refers to various situations that occur during the execution of each task (MIS1 to MIS3).

[0104] In this case, independent event EVE_ID and dependent event EVE_DE can be further divided into object events and area events respectively. In other words, independent event EVE_ID can include at least one of object events and area events, and dependent event EVE_DE can also include at least one of object events and area events. Object events refer to phenomena set for specific objects (for example, destruction, burning, etc. of specific objects), and area events refer to phenomena set for specific areas (for example, appearance of non-player characters in specific areas).

[0105] Event EVE can include triggering conditions and termination conditions.

[0106] The triggering condition refers to the condition used to trigger the corresponding event EVE. Similar to task MIS, the triggering condition can be set by various state values. In other words, during the extended reality training process, if the set specific state (triggering condition) is satisfied, event EVE can be triggered. The triggering condition can include triggering conditions related to time (for example, if a specific time has passed, then burn the object, etc.), triggering conditions related to the actions of the avatar (for example, if the avatar enters a specific area, then a new non-player character appears), etc. However, the embodiments of the present invention are not limited thereto.

[0107] The termination condition refers to the condition used to terminate the corresponding event EVE. In other words, when the object or area state set by event EVE changes with the termination condition, each event EVE can be terminated. For example, the termination condition can include a series of processes that the avatar needs to execute to terminate the corresponding event EVE. However, the embodiments of the present invention are not limited thereto.

[0108] Referring again to Figure 1 , the content production department 200 can transmit the generated content CT to the interaction department 300. In other words, the content production department 200 can transmit maps and scenes to the interaction department 300.

[0109] The interaction department 300 can output extended reality training data (XR Training Data, hereinafter referred to as "XRTD") based on the template data TD, the content CT, and the user operation signal (User Signal, hereinafter referred to as "US").

[0110] Hereinafter, referring to Figure 8a and Figure 8b The operation of the interaction department 300 of multiple embodiments of the present invention will be further described in detail.

[0111] Figure 8a Are multiple illustrative diagrams of the extended reality training device, Figure 8b Are multiple illustrative diagrams of the extended reality training data.

[0112] Referring to Figure 1 , Figure 8a and Figure 8b , the interaction department 300 can output extended reality training data (XR Training Data, hereinafter referred to as "XRTD") based on the template data TD, the content CT, and the user operation signal US.

[0113] First, the interaction department 300 can include various extended reality training devices (XR Training Device, hereinafter referred to as "DEV") that the user USER can gaze at or wear, and the interaction department 300 can receive the user operation signal US corresponding to the actual actions of the user USER through the corresponding extended reality training device DEV.

[0114] In this case, the extended reality training device DEV can include a head-mounted display (HMD, Head Mounted Display), gloves (Glove, hereinafter referred to as "GL"), a body suit (Body Suit, hereinafter referred to as "BS"), an active marker (Active Marker, hereinafter referred to as "AM"), a backpack host (Backpack PC, hereinafter referred to as "BPC"), a weapon device (Weapon Device, hereinafter referred to as "WD"), etc.

[0115] A head-mounted display can be used to track the user's position or display extended reality training data XRTD to the user. The glove GL can be used to track the user's finger movements, etc. The bodysuit BS can be used to physically transmit simulated impacts to the trainer. The active marker AM can include an active marker for the trainer (attached to the chest, back, wrist, etc., for tracking the trainer's movements) and an active marker for the weapon (for tracking the position of the weapon device, the muzzle direction, etc.). The backpack host BPC can include a host for running simulation software. The weapon device WD can include a device for performing simulations.

[0116] Next, the interaction unit 300 can apply the user operation signal US received through the corresponding extended reality training device DEV to the template data TD and the content CT to generate and display the extended reality training data XRTD.

[0117] Hereinafter, the display process of the extended reality training data XRTD will be specifically described.

[0118] a) First, in the case of triggering extended reality training, the interaction unit 300 can display a map, avatars (oneself, friendly forces, enemy forces), weapons, mobile tools, etc. on the user's head-mounted display or the like. In this case, the interaction unit 300 can configure an avatar corresponding to the respective user USER on the map according to the actual position of the user USER. In this case, the avatars, weapons, mobile tools, etc. configured on the map can be images based on the template data TD.

[0119] b) Next, the interaction unit 300 can receive the user operation signal US from at least one user USER. That is, the interaction unit 300 can receive the actual actions of the user USER as the user operation signal US through the extended reality training device DEV, and can modify the extended reality training data XRTD according to the received user operation signal US. In other words, the interaction unit 300 can cause the actual actions of each user USER to be reflected in the extended reality training data XRTD.

[0120] c) Subsequently, the interaction unit 300 outputs graphic objects related to the scenario (task, event) to the user USER, and can determine whether to execute the scenario of the respective user USER based on the user operation signal US received from the user USER. In other words, the interaction unit 300 can determine and output (for example, task success, task failure, etc.) whether each user USER has successfully executed the scenario generated by the content production unit 200.

[0121] The above description is only an illustrative description of the technical idea of the present invention. Those of ordinary skill in the technical field to which the present invention pertains can make various modifications and deformations without departing from the essential features of the present invention. Therefore, this embodiment is only for illustration and does not limit the technical idea of the present invention. The scope of the technical idea of the present invention is not limited to such an embodiment. The protection scope of the present invention should be interpreted based on the scope of the invention claimed, and all technical ideas within the equivalent scope thereof belong to the scope of the invention claimed.

Claims

1. An extended reality training server, characterized in that: It includes: A preprocessing unit that receives graphic resources from an external database and generates template data by converting the received graphic resources; A content production unit that uses the template data to produce content for extended reality training; and An interaction unit that displays extended reality training data to a user using the template data and the content, The template data includes the graphic resources converted into data that can be used to generate the content, The content includes at least one of a map for the extended reality training and a scene corresponding to the map.

2. The extended reality training server according to claim 1, characterized in that: The preprocessing unit generates a converted graphic by performing at least one of standardization, format conversion, and size transformation of the graphic resources, And assigns attribute information to the converted graphic to generate the template data.

3. The extended reality training server according to claim 2, wherein The template data includes at least one of an object template, an avatar template, a weapon template, and a mobile tool template. The object template is related to the objects constituting the map. The avatar template is related to the avatar whose actions are controlled by a user wearing an extended reality training device. The weapon template is related to the weapon carried by the avatar. The mobile tool template is related to the mobile tool that the avatar can ride on.

4. The extended reality training server according to claim 3, wherein When generating at least one of the object template, the avatar template, the weapon template, and the mobile tool template, the preprocessing unit assigns at least one of collision information, fire information, sound information, animation information, size information, assembly position information, effect information, model information, and riding information as the attribute information.

5. The extended reality training server according to claim 1, wherein, The content production unit includes: A map production module that generates the map using the template data; and A scene production module that generates the scene using the template data.

6. The extended reality training server according to claim 5, wherein The map production module generates the map realized in three dimensions by arranging the template data in a predetermined space.

7. The extended reality training server according to claim 5, wherein The scene production module generates at least one task that can be performed by an avatar whose actions are controlled by a user wearing an extended reality training device and at least one event occurring in the map as the scene.

8. The extended reality training server according to claim 7, characterized in that: The task includes at least one of a state condition, a time condition, and an action condition that are conditions for the avatar to achieve in order to complete the task. The state condition includes conditions related to the state of the avatar, conditions related to the state of non-player characters existing in the map, and conditions related to the state of the objects constituting the map. The time condition includes conditions related to the total time for performing the task. The action condition includes conditions related to the behaviors that the avatar needs to perform before completing the task.

9. The extended reality training server according to claim 7, wherein The event includes at least one of a triggering condition for triggering the event and a termination condition for terminating the event.

10. The extended reality training server according to claim 1, characterized in that: The above interaction unit includes an extended reality training device that can be worn by a user, applying the user operation signal received through the above extended reality training device to the above template data and the above content to reflect the actual actions of the above user in the above extended reality training data.

Images