XR Training Server

Abstract

To provide an XR training server for generating and displaying data for XR training for the same training as a real situation.SOLUTION: An extended reality (XR) training server comprising: a preprocessor configured to receive a graphic resource from an external database and convert the received graphic resource to generate template data; a content producer configured to produce content for XR training by using the template data; and an interaction part configured to display XR training data to a user by using the template data and the content, wherein the template data includes data obtained from the graphic resource that is converted to be usable for generating the content, and wherein the content includes at least one of a map for XR training and a scenario corresponding to the map.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an XR (extended reality) training server.

[0002] More specifically, the present invention relates to an XR training server for generating and displaying XR training data for training in the same situation as the actual situation.

Background Art

[0003] Virtual Reality (VR) technology provides objects and backgrounds in the real world only by means of CG (Computer Graphic) images, Augmented Reality (AR) technology provides both real object images and virtual CG images created on top of them, and Mixed Reality (MR) technology is a computer graphics technology that mixes and combines virtual objects into the real world. If VR is a technology that enables experiencing a new reality based on 360-degree images, AR displays information and content using computer graphics on top of real objects. Although AR and VR are different technologies, they complement each other's drawbacks and evolve together. However, at present, the difference between them is clear. VR requires a head-mounted display (HMD) that covers the entire eyes, and AR can be represented by glasses such as Google Glass.

[0004] At this time, a device to the prior art, the virtual object could only be moved based on the user touch recognized on the screen.

[0005] Furthermore, VR is fundamentally based on providing visual and auditory stimuli to the user, and has limitations in stimulating other senses. While olfactory and gustatory stimuli may not be frequently required in the context of training and entertainment, tactile stimuli are relatively more common. For example, if an object or structure is visually simulated in VR, the user may try to grasp the object or lean against the structure, but since the object or structure does not exist in the actual environment, accidents such as confusion or falls may occur. In particular, when training is conducted via VR, interacting with surrounding structures is a major part of the training. For example, when conducting counter-terrorism training using VR, it is a significant part of the training for trainees to lean against structures such as walls and use them as means of concealment or defense. In such cases, if VR is provided only through audiovisual stimuli, trainees will not be able to interact with the structures, and the effectiveness of the training will be reduced.

[0006] Extended Reality (XR) is a term that encompasses the aforementioned VR, AR, and MR technologies.

[0007] XR creates augmented reality by freely choosing to use VR and AR technologies individually or in combination. Microsoft's HoloLens, a glasses-type device, can be seen as one form of XR because it grasps real-world space and object information to display optimized 3D holograms. As XR technology evolves, the glasses may normally be transparent, but when AR is needed, information will be displayed on top of the glasses. When VR is needed, the glasses will become opaque, allowing information to be displayed through the entire field of view.

[0008] XR is expected to have applications in various fields, including education, healthcare, and manufacturing. To realize XR, high-performance computing power and graphics processing capabilities are essential for displaying large amounts of real-time 3D images. Advances in display technology are also necessary, as are technologies for efficiently transmitting large amounts of data with ultra-low latency, such as 5G mobile communication.

[0009] Thus, attempts are currently underway to apply XR training data to a wide range of industries. [Overview of the project] [Problems that the invention aims to solve]

[0010] The objective of this invention is to provide an XR training server capable of performing virtual training using XR training data.

[0011] Furthermore, an object of the present invention is to provide an XR training server that can generate XR training data to obtain the same training effect as in reality.

[0012] The objects of the present invention are not limited to those mentioned above, and other objects and advantages of the present invention not mentioned can be understood from the following description and more clearly from the embodiments of the present invention. Furthermore, it will be readily apparent that the objects and advantages of the present invention can be realized by the means and combinations thereof as described in the claims. [Means for solving the problem]

[0013] An XR training server according to some embodiments of the present invention includes a pre-processing unit that receives graphic resources from an external database and converts the received graphic resources to generate template data, a content creation unit that uses the template data to create content for XR (Extended Reality) training, and an interaction unit that uses the template data and the content to display XR training data to the user, wherein the template data includes data converted so that the graphic resources are used to generate the content, and the content may include at least one of a map for the XR training and a scenario corresponding to the map.

[0014] Furthermore, the preprocessing unit may generate a converted graphic by performing at least one of the following: standardization, format conversion, and size conversion of the graphic resource, and generate the template data by adding attribute information to the converted graphic.

[0015] Furthermore, the template data may include at least one of the following: an object template relating to objects constituting the map; an avatar template relating to an avatar whose actions are controlled by a user wearing XR training equipment; a weapon template relating to a weapon carried by the avatar; and a means of transport template relating to a means of transport that the avatar can ride.

[0016] Furthermore, when the preprocessing unit generates at least one of the object template, avatar template, weapon template, and means of transport template, it may assign at least one of the following as attribute information: collision information, ignition information, sound information, animation information, size information, mounting position information, effect information, model information, and riding information.

[0017] Furthermore, the content creation unit may include a map creation module that generates the map using the template data, and a scenario creation module that generates the scenario using the template data.

[0018] Furthermore, the map creation module can generate the map by arranging the template data within a predefined space to realize it in three dimensions.

[0019] Furthermore, the scenario creation module can generate as a scenario at least one mission that can be performed by an avatar whose actions are controlled by a user wearing XR training equipment, and at least one event that occurs within the map.

[0020] Furthermore, the mission includes at least one of the following conditions that the avatar must achieve in order to complete the mission: the state condition includes conditions relating to the state of the avatar, conditions relating to the state of NPCs (Non-Player Characters) present in the map, and conditions relating to the state of objects constituting the map; the time condition includes conditions relating to the total time required to execute the mission; and the action condition may include conditions relating to actions that the avatar must perform before completing the mission.

[0021] Furthermore, the event may include at least one of the conditions for the event to occur and the conditions for the event to end.

[0022] Furthermore, the interaction unit includes XR training equipment that the user can wear, and by applying user operation signals received through the XR training equipment to the template data and the content, the user's actual movements can be reflected in the XR training data. [Effects of the Invention]

[0023] According to some embodiments of the present invention, the XR training server can obtain various training effects in a limited environment and space by using XR training data similar to the real world.

[0024] In addition, according to some embodiments of the present invention, the XR training server can generate various XR training data and collect various data according to the respective environments and conditions of users by training using the generated XR training data.

[0025] The effects obtained by the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those with ordinary knowledge in the technical field to which the present invention belongs from the following description.

Brief Description of Drawings

[0026] [Figure 1] It is a block diagram of an XR training server according to some embodiments of the present invention. [Figure 2] It is a conceptual diagram for exemplarily explaining the operation of a preprocessing unit according to some embodiments of the present invention. [Figure 3] It is a diagram for explaining the types of template data according to some embodiments of the present invention. [Figure 4a] It is a diagram for explaining an exemplification of template data according to some embodiments of the present invention. [Figure 4b] It is a diagram for explaining an exemplification of template data according to some embodiments of the present invention. [Figure 4c] It is a diagram for explaining an exemplification of template data according to some embodiments of the present invention. [Figure 4d] It is a diagram for explaining an exemplification of template data according to some embodiments of the present invention. [Figure 4e] It is a diagram for explaining an exemplification of template data according to some embodiments of the present invention. [Figure 4f] This figure illustrates examples of template data according to several embodiments of the present invention. [Figure 5] This is a detailed block diagram of a content creation unit according to several embodiments of the present invention. [Figure 6] This figure shows a map created by a map creation module according to several embodiments of the present invention. [Figure 7a] This figure illustrates the missions and events included in scenarios according to several embodiments of the present invention. [Figure 7b] This figure illustrates the missions and events included in scenarios according to several embodiments of the present invention. [Figure 8a] This figure shows some examples of XR training equipment. [Figure 8b] This figure shows some examples of XR training data. [Modes for carrying out the invention]

[0027] The terms and words used herein and in the claims should not be interpreted in a manner limited to their general or dictionary meanings. They should be interpreted in a manner consistent with the technical idea of ​​the present invention, in accordance with the principle that inventors may define the concepts of terms or words in order to best describe their invention. Furthermore, it should be understood that the embodiments described herein and the configurations shown in the drawings represent only one embodiment of the present invention and do not represent the entire technical idea of ​​the present invention; therefore, at the time of filing, there may be a variety of equivalents, variations, and applicable examples that can substitute for them.

[0028] The terms first, second, A, B, etc., as used herein and in the claims, may be used to describe a variety of components, but such components should not be limited by such terms. The terms are used solely for the purpose of distinguishing one component from another. For example, as long as it does not deviate from the scope of the present invention, the first component may be named the second component, and similarly, the second component may be named the first component. The terms "and / or" include a combination of multiple related descriptions or any of multiple related descriptions.

[0029] The terms used herein and in the claims are used solely to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. Terms such as “includes” or “having” in this application should be understood not to preemptively exclude the possibility of the presence or addition of features, figures, stages, operations, components, parts, or combinations thereof as described in the specification.

[0030] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as those generally understood by a person with ordinary skill in the art to which this invention pertains.

[0031] Terms as defined in commonly used dictionaries should be interpreted to have meanings consistent with their meanings in the context of the relevant technology, and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this application.

[0032] Furthermore, the various configurations, processes, steps, or methods included in each embodiment of the present invention can be shared to the extent that they are not technically contradictory to one another.

[0033] Below, we will describe in detail some embodiments of the present invention that serve as XR training servers, with reference to Figures 1 through 8b.

[0034] Figure 1 is a block diagram of an XR training server according to several embodiments of the present invention.

[0035] Referring to Figure 1, the XR training server 1 may include a pre-processing unit 100, a content creation unit 200, and an interaction unit 300.

[0036] The preprocessing unit 100 is a tool that generates templates for generating content used in XR training.

[0037] For example, the preprocessing unit 100 can receive graphic resources (GR) from an external database and generate template data (TD) based on the received graphic resources GR. In other words, the preprocessing unit 100 can import graphic resources GR from an external database and convert them into data usable by the content creation unit 200.

[0038] The operation of the pre-processing unit 100 according to several embodiments of the present invention will be described below with further reference to Figure 2.

[0039] Figure 2 is a conceptual diagram illustrating the operation of the preprocessing unit according to several embodiments of the present invention.

[0040] Referring to Figure 2, the preprocessing unit 100 can convert the graphic resource GR into template data TD. The graphic resource GR may include images (2D images, 3D images), video, panoramas, etc., but embodiments of the present invention are not limited thereto.

[0041] As one example, the preprocessor 100 can perform normalization, format conversion, and size conversion on the received graphic resource GR, and generate template data TD by adding attribute information (hereinafter referred to as "ATT") to the graphic resource GR.

[0042] To explain in more detail, the preprocessing unit 100 can first perform preprocessing operations on the graphic resource GR by standardizing the graphic resource GR, converting its format, and converting its size to generate a changed graphic (hereinafter referred to as "CG"). In other words, the changed graphic CG may be the result of at least one of the following processes performed on the graphic resource GR: standardization, format conversion, and size conversion. At this time, the changed graphic CG can be saved in library format.

[0043] Next, the preprocessing unit 100 can apply animation to movable areas in the transformed graphic CG using a guide model (hereinafter referred to as "GM"). In other words, the preprocessing unit 100 can apply animation effects to movable parts of objects included in the transformed graphic CG (e.g., arms or legs of an avatar, wheels of a vehicle). If there are no movable parts (areas) in the objects included in the transformed graphic CG (e.g., floor, wall), the preprocessing unit 100 does not need to apply animation effects. In this case, the guide model GM may include known models such as Biped, CAT (Character Animation Toolkit), Rigify, Advanced Skeleton, HumanIK, The Setup Machine, etc., but it goes without saying that embodiments of the present invention are not limited thereto.

[0044] Next, the preprocessing unit 100 assigns attribute information ATT to the generated transformed graphic CG. For example, the preprocessing unit 100 can specify and save at least one attribute piece of information to the transformed graphic CG depending on its data type. The data type of the transformed graphic CG can be determined according to the objects contained within the transformed graphic CG. For example, the data type of the transformed graphic CG may include objects that make up a map, avatars whose actions are controlled by a user wearing XR training equipment, weapons carried by avatars, means of transportation that avatars can ride, etc., but embodiments of the present invention are not limited thereto. In this case, the attribute information for each transformed graphic CG specified by the preprocessing unit 100 may differ from each other depending on the data type of the transformed graphic CG. To illustrate with an example, the attribute information assigned to an object template relating to an object may differ in part or in whole from the attribute information assigned to an avatar template relating to an avatar. However, this is for the convenience of explanation, and it goes without saying that embodiments of the present invention are not limited thereto.

[0045] The preprocessing unit 100 can determine the result of applying animation using the guide model GM and / or assigning attribute information ATT to the converted graphic CG as template data TD. The determined template data TD can be saved in library format.

[0046] Hereinafter, with reference to Figure 3, a specific example of the template data TD of the present invention will be described.

[0047] Figure 3 is a diagram illustrating the types of template data according to some embodiments of the present invention. Figures 4a to 4f are diagrams illustrating examples of template data according to some embodiments of the present invention.

[0048] Referring to Figure 3, the template data TD may include object template TD1, avatar template TD2, weapon template TD3, means of transport template TD4, etc. However, embodiments of the present invention are not limited thereto, and one or more of object template TD1, avatar template TD2, weapon template TD3, and means of transport template TD4 may be omitted, and the template data TD may include templates other than those illustrated in Figure 3.

[0049] Referring to Figures 3 through 4f, the object template TD1 may contain templates for objects that make up a map for virtual training.

[0050] Specifically, object template TD1 may include wall template TD1-1, item template TD1-2, and floor template TD1-3.

[0051] To illustrate with an example using Figure 4a, in the case of wall template TD1-1, it may include a transformation graphic CG1-1 representing the shape of the wall and attribute information ATT1-1 attached to the transformation graphic CG1-1. The attribute information ATT1-1 of wall template TD1-1 can include collision information and ignition information. In this case, the collision information can include information about the position of the collision reference point, the magnitude of the collision, etc. Furthermore, the ignition information can include information about flammability, ignition point, burning time, maximum temperature, and type of combustion (maximum flame size, smoke color, smoke volume, etc.) as attributes related to when the wall ignites.

[0052] To illustrate with an example using Figure 4b, in the case of item template TD1-2, it can include a transformation graphic CG1-2 representing the shape of the item, and attribute information ATT1-2 assigned to the transformation graphic CG1-2. The attribute information ATT1-2 of item template TD1-2 can include collision information and ignition information. In this case, the collision information can include information such as the position of the collision reference point and the magnitude of the collision. The ignition information can include information such as flammability, ignition point, burning time, maximum temperature, and type of combustion (maximum flame size, smoke color, smoke volume) as attributes related to when the item ignites.

[0053] To illustrate with an example using Figure 4c, in the case of floor template TD1-3, it can include a transformation graphic CG1-3 representing the shape of the floor, and attribute information ATT1-3 attached to the transformation graphic CG1-3. The attribute information ATT1-3 of floor template TD1-3 can include ignition information and sound information. In this case, the ignition information can include information related to the attributes when the item in question ignites, such as whether it is combustible, the ignition point, the burning time, the maximum temperature, and the type of combustion (maximum flame size, smoke color, smoke volume). The sound information can also include information related to the type of sound and the volume of the sound, such as the type of sound and the volume of the sound, as attributes related to what kind of sound is emitted when the avatar comes into contact with the floor in question.

[0054] Avatar Template TD2 may include templates for avatars that are placed on a map and whose actions are controlled by users wearing XR training equipment.

[0055] To illustrate with an example using Figure 4d, in the case of avatar template TD2, it can include a transformation graphic CG2 representing the shape of the avatar and attribute information ATT2 attached to the transformation graphic CG2. The attribute information ATT2 of avatar template TD2 can include animation information and collision information. In this case, the animation information can include information about the movable parts of the avatar (e.g., arms, legs) (e.g., movement radius, movement angle) when the avatar is moved by the user performing an action while wearing XR training equipment. The collision information can also include information about the position of the collision reference point, the magnitude of the collision, etc.

[0056] Weapon Template TD3 may include templates related to weapons (e.g., guns, swords, etc.) that an avatar can possess or carry.

[0057] To illustrate with an example from Figure 4e, in the case of weapon template TD3, it can include a transformation graphic CG3 representing the shape of the weapon and attribute information ATT3 attached to the transformation graphic CG3. The attribute information ATT3 of weapon template TD3 can include size information, mounting position information, sound information, effect information, etc. Size information can include information about the size of the weapon. Mounting position information can include information about the position where the weapon is mounted in the avatar's socket. Sound information can include information about the type of sound, volume, etc., as attributes related to the sound produced when the avatar uses the weapon. Effect information can include information about the applied effect, effect position information, etc., as attributes related to the effect used by the weapon.

[0058] The transportation template TD4 may include templates for modes of transportation (e.g., cars, motorcycles, etc.) that can be placed on the map and avatars can ride.

[0059] To illustrate with an example from Figure 4f, in the case of a means of transport template TD4, it can include a transformation graphic CG4 representing the shape of the means of transport and attribute information ATT4 attached to the transformation graphic CG4. The attribute information ATT4 of the means of transport template TD4 can include collision information, animation information, model information, etc. Collision information can include information about the position of the collision reference point, the magnitude of the collision, etc. Animation information can include information about the movable parts of the means of transport (e.g., arms, legs) (e.g., movement radius, movement angle) when the avatar moves the means of transport by performing an action while the user is wearing XR training equipment. Model information can include information about the model of the means of transport and its associated attributes, such as information about the vehicle version of the external shape, information about the number of people that can ride, information about the position where the avatar sits, and information about the type and position of installed switches.

[0060] In this case, each template data TD can be customized and saved separately for each user. In other words, template data TDs can be saved separately according to the nationality of registered users and / or users participating in training, their results from previous training, gender, purpose, and / or age. For example, if a registered user and / or user participating in training is from a specific country, the template data TD used for that user's XR training can be modified based on data related to the user's specific nationality and / or data related to a competitor country that is in a competitive or adversarial relationship with that specific nationality. For example, template data TDs can be modified and saved based on images related to the specific nationality (e.g., national flag, firearms, military uniforms, building exteriors, etc.), images related to a competitor country (e.g., national flag, firearms, military uniforms, building exteriors, etc.), and other data related to a competitor country (e.g., average physical data of military personnel, performance of firearms and weapons (e.g., fighter jets, tanks, etc.)). As another example, the template data TD used for a registered user's XR training can be modified based on the registered user's existing training results. For example, if a user achieves a certain level of performance in existing training, additional parameters (such as reaction speed, collision range adjustment, detection range expansion, and cooperation through interaction with other objects) can be added to the data of the objects used for training that user and saved based on this.

[0061] Referring again to Figure 1, the preprocessing unit 100 can transmit the generated template data TD to the content creation unit 200 and the interaction unit 300.

[0062] Content Production Unit 200 is a tool that generates content (hereinafter referred to as "CT") used in XR training.

[0063] For example, the content creation unit 200 can generate content CT using template data TD received from the preprocessing unit 100. In other words, once the preprocessing unit 100 converts graphic resources GR into template data TD, the content creation unit 200 can generate content CT for XR training using the corresponding template data TD.

[0064] The operation of the content creation unit 200 according to several embodiments of the present invention will be described below with further reference to Figure 5.

[0065] Figure 5 is a detailed block diagram of a content creation unit according to several embodiments of the present invention.

[0066] Referring to Figure 5, the content creation unit 200 may include a map creation module 210 and a scenario creation module 220. The content creation unit 200 can output the map MAP generated by the map creation module 210 and the scenario (scenario, hereinafter referred to as "SCN") generated by the scenario creation module 220 as content CT.

[0067] The map creation module 210 can generate a map for XR training based on template data TD.

[0068] As one example, the map creation module 210 can generate a map by arranging multiple template data TDs within a predefined space. In this case, the generated map can be realized in three dimensions.

[0069] The operation of the map creation module 210 according to several embodiments of the present invention will be described below with further reference to Figure 6.

[0070] Figure 6 shows a map created by a map creation module according to several embodiments of the present invention. <a1>This is a diagram showing an example of a 3D generated map, as shown in Figure 6. <a2>This is a diagram showing the generated map in a two-dimensional planar form.

[0071] Referring to Figure 6, the map creation module 210 can generate a map by arranging multiple template data TDs within a predefined space.

[0072] As one example, the map creation module 210 can place object templates (see TD1 in Figures 3 to 4c) from the template data TD within a predefined space and determine the result of the placement as a map MAP. In this case, the object templates may include wall templates, object templates, floor templates, etc., as described above, but the embodiments of the present invention are not limited thereto. In other words, the map creation module 210 can generate a map MAP by placing wall templates, object templates, floor templates, etc., within a predefined space.

[0073] In this case, the map creation module 210 can automatically correct the position of the template data TD to match the map grid and place it. For example, the map creation module 210 can place the template data TD in one of several grids or place the template data TD across multiple grids.

[0074] Subsequently, the map creation module 210 can change the attributes of each placed template data TD. At this time, the attributes of the template data TD may include the size (width, height, etc.) and orientation of the template data, but the embodiments of the present invention are not limited thereto.

[0075] The map generated in this way becomes a training space for avatars, which will then be controlled by users wearing XR training equipment. In other words, users wearing XR training equipment can perform XR training by moving or working with avatars corresponding to each user within the map.

[0076] Referring again to Figure 5, the scenario creation module 220 can generate a scenario (SCN) corresponding to the map MAP using the template data TD. In this case, the scenario SCN represents the entire process of performing XR training.

[0077] As one example, the scenario creation module 220 can generate missions and events for XR training as scenario SCNs.

[0078] In this context, a "mission" refers to an intermediate stage that must be completed to advance the scenario. An "event," on the other hand, refers to an individual incident that occurs during the progression of the scenario.

[0079] As an example, the scenario creation module 220 can generate at least one mission. In this case, each mission included in the scenario may be unrelated to each other, or it may be related, and the next mission cannot be advanced until a specific mission is completed. That is, each mission included in the scenario can be structured in a chronologically related manner, or in a parallel structure where each mission is independent of the others. If the missions are structured in a parallel manner, each mission can have independent trigger conditions, and multiple missions may occur simultaneously as long as the trigger conditions are met, regardless of the execution order of each mission. If a scenario includes multiple missions, the success or failure of the scenario can be determined by whether or not all missions are successfully completed.

[0080] As another example, the scenario creation module 220 can generate at least one event. An event refers to various phenomena that occur during XR training. For example, it refers to any situation that occurs, whether related to the training process or not, such as the appearance of an NPC (Non-Player Character) or the destruction of part of the map. In this case, an event can occur through interaction between the avatar and the map, or it can occur independently of interaction between the avatar and the map. In terms of event types, events can be classified as independent events or dependent events depending on whether they are subordinate to a mission, and they can also be classified as object events that occur due to interactions with objects or area events that occur in a specific area.

[0081] The missions and events included in Scenario SCN according to some embodiments of the present invention will be described in more detail below with reference to Figures 7a and 7b.

[0082] Figures 7a and 7b are diagrams illustrating missions and events included in scenarios according to several embodiments of the present invention.

[0083] Referring to Figures 7a and 7b, Scenario SCN may include at least one mission (hereinafter referred to as "MIS") and at least one event (hereinafter referred to as "EVE").

[0084] Mission MIS refers to an intermediate stage that must be taken in order to progress in Scenario SCN.

[0085] Each mission (MIS1 to MIS3) included in Scenario SCN may be unrelated to each other, or it may be related, and the next mission cannot be advanced until a specific mission is completed. In other words, each mission (MIS1 to MIS3) included in Scenario SCN can be configured in a chronologically related manner, or in a parallel structure independent of each other. If each mission (MIS1 to MIS3) is configured in a parallel structure, each mission (MIS1 to MIS3) can have independent trigger conditions, and multiple missions may occur simultaneously as long as the trigger conditions are met, regardless of the execution order of each mission (MIS1 to MIS3). If Scenario SCN includes multiple missions (MIS1 to MIS3), the success or failure of the scenario can be determined by whether or not all missions (MIS1 to MIS3) are successfully completed.

[0086] A Mission MIS may include one or more conditions. In this case, a Mission MIS can be judged as successful if all of its included conditions are satisfied. The conditions may include state conditions, time conditions, and action conditions.

[0087] Status conditions refer to the conditions that must be met for each Mission MIS to be considered successful. For example, status conditions may include conditions related to the avatar's status (e.g., health), the status of NPCs present in the map, and the status of objects that make up the map (e.g., whether structures are damaged or not).

[0088] Time conditions may include conditions relating to the total time required to perform the Mission MIS. In other words, time conditions may include, but are not limited to, the time limit required to complete the Mission MIS in question.

[0089] Action conditions may include conditions regarding actions that the avatar must perform before completing the Mission MIS. In other words, each Mission MIS can only be considered successful if the avatar performs specific actions or behaviors that correspond to the action conditions.

[0090] In this case, each Mission-Specific Operation (MIS) can only be judged as successful if all of its constituent conditions are met. For example, in the case of a state condition, success is judged when the target specific state is reached, and failure can be judged immediately when it becomes impossible to reach the target state. Similarly, in the case of a time condition, success is judged when the goal is achieved within the time limit, and failure can be judged immediately when the time limit is exceeded. Furthermore, in the case of an action condition, success is judged when the specified action is performed, and failure can be judged immediately when it becomes impossible to perform the specified action.

[0091] An Event EVE refers to an individual event or phenomenon that occurs during the progression of a Scenario SCN.

[0092] For example, an event (EVE) refers to any situation that occurs, whether related to the training process or not, such as the appearance of an NPC or the destruction of part of the map. In this case, an event can occur through interaction between the avatar and the map, or it can occur independently of such interaction.

[0093] For example, an event EVE can be classified into an independent event (hereinafter referred to as "EVE_ID") and a dependent event (hereinafter referred to as "EVE_DE") depending on whether or not it is subordinate to a mission MIS. In other words, an independent event EVE_ID refers to a situation that occurs regardless of the progress of each mission (MIS1 to MIS3), while a dependent event EVE_DE refers to a situation that is subordinate to each mission (MIS1 to MIS3) and occurs during the process of executing each mission (MIS1 to MIS3).

[0094] In this case, the independent event EVE_ID and the dependent event EVE_DE can be further subdivided into object events and area events, respectively. In other words, the independent event EVE_ID may contain at least one of either an object event or an area event, and the dependent event EVE_DE may also contain at least one of either an object event or an area event. An object event refers to a phenomenon set for a specific object (e.g., destruction or burning of a specific object), and an area event refers to a phenomenon set for a specific area (e.g., appearance of an NPC in a specific area).

[0095] An event (EVE) may include conditions for occurrence and conditions for termination.

[0096] The occurrence conditions refer to the conditions under which the event EVE occurs. These conditions can be set using various state values, similar to Mission MIS. In other words, an event EVE may occur when a specific state (occurrence condition) set during XR training is met. Occurrence conditions may include time-related conditions (e.g., an object burns after a certain amount of time has elapsed) and avatar-related conditions (e.g., a new NPC appears when the avatar enters a specific area), but the embodiments of this invention are not limited to these.

[0097] The termination condition refers to the conditions under which the event EVE ends. In other words, each event EVE can end when the state of the object or region on which the event EVE is set changes according to the termination condition. For example, the termination condition may include a series of steps that an avatar must take to end the event EVE, but embodiments of the present invention are not limited thereto.

[0098] Referring again to Figure 1, the content creation unit 200 transmits the generated content CT to the interaction unit 300. In other words, the content creation unit 200 can transmit maps and scenarios to the interaction unit 300.

[0099] The interaction unit 300 can output XR training data (XRTD) based on template data TD, content CT, and user operation signals (User Signal, hereinafter referred to as "US").

[0100] The operation of the interaction unit 300 according to several embodiments of the present invention will be described in more detail below with reference to Figures 8a and 8b.

[0101] Figure 8a shows some examples of XR training equipment, and Figure 8b shows some examples of XR training data.

[0102] Referring to Figures 1, 8a, and 8b, the interaction unit 300 can output XR training data (XRTD) based on template data TD, content CT, and user operation signal US.

[0103] First, the interaction unit 300 may include various XR training devices (hereinafter referred to as "DEVs") that the user can gaze at or wear, and the interaction unit 300 can receive user operation signals US corresponding to the user's actual movements via the XR training device DEV.

[0104] In this case, the XR training equipment DEV may include an HMD (Head Mounted Display), gloves (GL), body suit (BS), active marker (AM), backpack PC (BPC), weapon device (WD), etc.

[0105] The HMD is used to track the user's position or to display XR training data (XRTD) to the user. The glove GL is used to track the user's finger movements, etc. The bodysuit BS is used to physically transmit simulated impacts to the trainee. Active markers AM may include trainee active markers (attached to the chest, back, wrists, etc. to track the trainee's motion) and weapon active markers (tracking the position of weapon devices, muzzle direction, etc.). The backpack PC (BPC) may include a PC for running simulation software. The weapon device WD may include devices for running the simulation.

[0106] Next, the interaction unit 300 can apply the user operation signal US received via the XR training equipment DEV to the template data TD and content CT to generate and display XR training data XRTD.

[0107] To explain the process of displaying XRTD data for XR training in detail, a) First, when XR training begins, the interaction unit 300 displays the map, avatars (user, allies, enemy forces), weapons, means of transportation, etc. on the user's HMD or similar device. At this time, the interaction unit 300 can place an avatar corresponding to the user on the map according to the user's actual location. The avatars, weapons, means of transportation, etc. placed on the map at this time may be shaped based on template data TD. b) Next, the interaction unit 300 receives a user operation signal US from at least one user USER. That is, the interaction unit 300 receives the actual movements of the user USER as a user operation signal US via the XR training equipment DEV, and can modify the XR training data XRTD to match the received user operation signal US. In other words, the interaction unit 300 can ensure that the actual movements of each user USER are reflected in the XR training data XRTD. c) Next, the interaction unit 300 outputs graphic objects related to the scenario (mission, event) to the user USER and determines whether the user USER executed the scenario based on the user operation signal US received from the user USER. In other words, the interaction unit 300 can determine and output whether each user USER successfully executed the scenario generated by the content creation unit 200 (e.g., mission successful, mission failed).

[0108] The above description is merely illustrative of the technical concept of this embodiment, and a person with ordinary skill in the art to which this embodiment belongs can make various modifications and variations without departing from the essential characteristics of this embodiment. Therefore, this embodiment is for illustrative purposes only, not to limit, the technical concept of this embodiment, and the scope of the technical concept of this embodiment is not limited by such embodiments. The scope of protection of this embodiment should be interpreted in accordance with the following claims, and all technical concepts within an equivalent scope should be interpreted as being included in the scope of rights of this embodiment.

Claims

1. A preprocessor that receives graphic resources from an external database and converts the received graphic resources to generate template data; Content creation department that produces content for XR (Extended Reality) training using the aforementioned template data; A map creation module that generates a three-dimensional (3D) map by arranging the aforementioned template data in a predetermined space; A scenario creation module for generating missions and events for the aforementioned XR training; and The system includes an interaction unit that displays XR training data to the user using the template data and the content, The template data includes data that has been transformed so that the graphic resources are used to generate the content. The content includes a map for the XR training and at least one of the scenarios corresponding to the map. The preprocessing unit generates a converted graphic by performing at least one of the following: standardization, format conversion, and size conversion of the graphic resource. Based on the data type of the converted graphic, attribute information is added to the converted graphic to generate the template data. The data types of the conversion graphics include objects that make up the map, an avatar whose actions are controlled by a user wearing XR training equipment, a weapon template relating to a weapon carried by the avatar, and a means of transportation that the avatar can ride. The template data includes an object template relating to the object, an avatar template relating to the avatar, a weapon template relating to the weapon, and a means of transport template relating to the means of transport. The attribute information includes collision information, ignition information, sound information, animation information, size information, mounting position information, effect information, model information, and riding information. The preprocessing unit generates the object template by assigning at least one of the collision information, ignition information, and sound information to the object; generates the avatar template by assigning the animation information and collision information to the avatar; generates the weapon template by assigning the size information, mounting position information, sound information, and effect information to the weapon; and generates the movement means template by assigning the collision information, animation information, and model information to the movement means. The interaction unit applies user operation signals received via XR training equipment that the user can wear to the template data and the content, thereby reflecting the user's actual movements in the XR training data, and determines whether the user has successfully executed the scenario based on the user operation signals. XR training server.

2. The aforementioned map creation module is The XR training server according to claim 1, which generates the map that embodies the template data in three dimensions by arranging the template data in a predefined space.

3. The aforementioned scenario creation module is The XR training server according to claim 1, which generates a scenario consisting of at least one mission that can be performed by an avatar whose actions are controlled by a user wearing XR training equipment, and at least one event that occurs within the map.

4. The aforementioned mission is The aforementioned avatar includes at least one of the state conditions, time conditions, and action conditions that must be achieved in order to complete the aforementioned mission, The aforementioned state conditions include conditions relating to the state of the avatar, conditions relating to the state of NPCs (Non-Player Characters) present in the map, and conditions relating to the state of objects constituting the map. The aforementioned time conditions include conditions relating to the total time required to perform the mission, The XR training server according to claim 3, wherein the action conditions include conditions relating to actions that the avatar should perform before completing the mission.

5. The aforementioned event was, The XR training server according to claim 3, comprising at least one of the conditions for an event to occur and the conditions for an event to end.

Images