Realistic mixed-reality education and collaborative solution support system, and method therefor
The mixed reality education and collaboration solution addresses the need for immersive and safe training environments by using a metaverse server and mixed reality headsets to create interactive, shared virtual spaces for training with 3D virtual models, enhancing educational effectiveness and safety.
Patent Information
- Application Number
- PCT/KR2023/020849
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-13
- Filing Date
- 2023-12-18
- Publication Date
- 2025-06-19
AI Technical Summary
Existing education and training systems lack the capability to provide realistic, immersive, and safe environments for training, especially in high-risk fields such as manufacturing and medicine, where hands-on practice is essential but poses safety risks.
A mixed reality education and collaboration solution that utilizes a metaverse server and mixed reality headsets to create immersive, shared virtual spaces where users can interact with 3D virtual models of industrial equipment, collaborate in real-time, and receive training through scenario-based guides.
Enables simultaneous multi-person training in a safe and realistic virtual environment, reducing the risk of accidents and enhancing educational effectiveness by allowing hands-on practice with virtual equipment.
Smart Images

Figure KR2023020849_19062025_PF_FP_ABST
Abstract
Description
A system and method for supporting realistic mixed reality education and collaboration solutions.
[0001] The present invention relates to a realistic mixed reality education and collaboration solution support system and method thereof, and more particularly, to a realistic mixed reality education and collaboration solution support system and method thereof for enabling multiple users to create avatars through a metaverse space, participate in a shared virtual space, and conduct simultaneous multi-person training in the same space (mixed reality) through collaboration.
[0002] Extended reality (XR) is attracting attention as a key technology in the era of the Fourth Industrial Revolution. Based on hyper-realistic content production technology, it is creating a new educational environment by merging real and virtual environments, drastically reducing time and costs and contributing greatly to accident prevention.
[0003] Extended reality (XR) significantly contributes to accident prevention, leading to a growing need for training and education systems leveraging XR in diverse fields such as education, defense, healthcare, and manufacturing. Furthermore, XR can create more advanced virtual worlds by blending and merging real and virtual information over a real-world setting. By integrating the real and virtual worlds, it can provide virtual objects that interact with the real world.
[0004] While existing virtual reality (VR) and augmented reality (AR) rely entirely on vision, extended reality (XR) can virtually integrate information related to various human senses, such as hearing and touch, in addition to vision, allowing for a more vivid and immersive virtual world experience in reality.
[0005] Meanwhile, the demand for virtual maintenance training environments to address the high risk of accidents associated with handling high-risk equipment is increasing, and manufacturing workers need training solutions that enable easy access and repetitive proficiency training in a safer environment.
[0006] <Prior Art Literature>
[0007] (Patent Document 1) Republic of Korea Patent No. 10-2592521 (October 18, 2023)
[0008] The purpose of the present invention is to solve the problems described above.
[0009] The purpose is to provide a realistic mixed reality education and collaboration solution support system and method to provide a realistic education environment to trainees in various industries without limitations of time and space, and to provide a sufficient education curriculum for fields where acquisition and performance in existing environments are difficult or where the risk of accidents is high.
[0010] The purposes of the present invention are not limited to the purposes mentioned above, and other purposes not mentioned will be clearly understood by those skilled in the art from the description below.
[0011] In order to achieve the above purpose, the realistic mixed reality education and collaboration solution support system according to the present invention includes a mixed reality headset for supporting a user to access a metaverse space via the Internet and experience XR content provided by a metaverse server, and a metaverse server for creating a metaverse space in a space where a wearer of the mixed reality headset is located so that the user can experience the content through the actual user's appearance or the user's avatar, and allowing multiple users to access the created metaverse space simultaneously.
[0012] In addition, the metaverse server is characterized by including a metaverse space creation unit that creates a metaverse space dedicated to the mixed reality headset, a metaverse avatar creation unit that creates an avatar of a mixed reality headset wearer in the metaverse space created through the metaverse space construction unit, a 3D virtual model unit that implements equipment of various industries including manufacturing and medicine as hologram objects in the metaverse space, and an interaction unit that supports real-time mutual interaction between multiple users and hologram objects within the metaverse space.
[0013] In addition, the metaverse server is characterized by further including a voice chat support unit that supports voice chat within the metaverse space.
[0014] In addition, the metaverse server is characterized by further including a real-time mirroring unit for sharing the same screen as the viewpoint of a terminal including a computer or a smartphone and a wearer of the mixed reality headset.
[0015] In addition, the terminal is characterized in that it can monitor through screen sharing mirrored through the real-time mirroring unit, and can give voice commands to the wearer of the mixed reality headset through a voice input device including a microphone.
[0016] In addition, the metaverse server is characterized by further including an education and training support unit that provides a description function for an augmented hologram object through the 3D virtual model unit.
[0017] In addition, the above-mentioned education and training support unit is characterized by visually providing a scenario-based education guide including manipulation, practice, and collaboration for the above-mentioned holographic object to a mixed reality headset wearer through 2D, 3D, and XR animation.
[0018] In addition, the metaverse server is characterized by further including a user interface support unit that provides a user interface when a user wearing the mixed reality headset looks at the user's palm.
[0019] In addition, the user interface is characterized by including a 3D drawing function that allows users to draw pictures or text anywhere in the metaverse space and share them with other users, a viewer function that allows users to view images or PDF files stored in a mixed reality headset, a voice chat on / off function, a metaverse space exit function, and a user interface exit function.
[0020] In addition, the user interface support unit is characterized in that the user interface panel is configured to follow the user's gaze when the user calls the user interface, and supports the user to hold the user interface panel with his or her hand and fix it at a desired location.
[0021] Meanwhile, a method for supporting a realistic mixed reality education and collaboration solution according to another aspect of the present invention includes a space recognition step in which a user wears a mixed reality headset and the mixed reality headset recognizes the space in which the user is located, a login step in which the user logs in to access a metaverse server after running an app, a metaverse space access step in which the metaverse server creates a metaverse space according to the user's operation or accesses the metaverse space created by the user, an avatar creation step in which the metaverse server creates an avatar to be used in the metaverse space according to the user's operation, an anchor setting step in which the metaverse server sets an anchor for designating the location of metaverse content according to the user's operation, a 3D virtual model implementation step in which the metaverse server implements a 3D virtual model through a hologram in the metaverse space, and a content support step in which the metaverse server supports content including product design, prototype production, collaboration, education, and a remote community with the outside.
[0022] In addition, the above avatar selection step is characterized in that avatar selection is possible when the distance between users of the mixed reality headset is far.
[0023] In addition, the anchor setting step is characterized in that personal anchor information must be set for mixed reality headset users who are not in the same space.
[0024] In addition, the content support step includes an interaction support step that supports real-time interaction between multiple users and holographic 3D virtual models within the metaverse space, a voice chat support step that supports voice chat within the metaverse space, a real-time mirroring support step for sharing the same screen as the viewpoint of a terminal including a computer or a smartphone and a mixed reality headset wearer, an education and training support step that provides an explanation function for an augmented holographic 3D virtual model, and a user interface support step that provides a user interface when a mixed reality headset wearer looks at the palm of the user's hand.
[0025] In addition, the real-time mirroring support step is characterized by supporting voice commands to a mixed reality headset wearer through a voice input device including a microphone connected to the terminal.
[0026] In addition, the above-mentioned training support step is characterized by visually providing a scenario-based training guide including manipulation, practice, and collaboration on the holographic 3D virtual model to a mixed reality headset wearer through 2D, 3D, and XR animation.
[0027] In addition, the user interface support step is characterized in that the user interface panel is configured to follow the user's gaze when the user calls the user interface, and the user interface panel is supported to be held by hand and fixed at a desired location by the user.
[0028] In addition, the user interface is characterized by including a 3D drawing function that allows users to draw pictures or text anywhere in the metaverse space and share them with other users, a viewer function that allows users to view images or PDF files stored in a mixed reality headset, a voice chat on / off function, a metaverse space exit function, and a user interface exit function.
[0029] The realistic mixed reality education and collaboration solution support system and method according to the present invention have the effect of providing a three-dimensional education environment through multi-person simultaneous training in the same space by applying mixed reality in an individual education and training method that relies on limited field information.
[0030] Additionally, in the manufacturing and education fields, hazardous facilities and expensive equipment are not easily accessible, and it is effective in providing a safe educational environment in terms of risks such as economic loss and personal injury that may occur due to careless and unskilled use.
[0031] Additionally, it has the effect of maximizing the educational effect by providing a specialized educational environment where students can actually see, touch, and share a display model of a realistic environment that combines the actual site and a 3D virtual model.
[0032] Figure 1 is a configuration diagram showing a realistic mixed reality education and collaboration solution support system according to the present invention.
[0033] FIG. 2 is a diagram showing a metaverse server that constitutes a realistic mixed reality education and collaboration solution support system according to the present invention.
[0034] FIG. 3 is an exemplary diagram illustrating an avatar generation unit for a metaverse that constitutes a metaverse server according to the present invention.
[0035] FIG. 4 is an exemplary diagram illustrating a 3D virtual model section constituting a metaverse server according to the present invention.
[0036] FIG. 5 and FIG. 6 are exemplary diagrams for explaining a user interface support unit that constitutes a metaverse server according to the present invention.
[0037] Figure 7 is a flowchart illustrating a method for supporting a realistic mixed reality education and collaboration solution according to another aspect of the present invention.
[0038] <Explanation of symbols>
[0039] 100: Mixed Reality Headset
[0040] 200: Metaverse Server
[0041] 210: Metaverse Space Creation Department
[0042] 220: Avatar Creation for the Metaverse
[0043] 230: 3D Virtual Model Section
[0044] 240: Interaction section
[0045] 250: Voice Chat Support
[0046] 260: Real-time mirroring section
[0047] 270: Education and Training Support Department
[0048] 280: User Interface Support Department
[0049] 300: Terminal
[0050] The advantages and features of the present invention, and the methods for achieving them, will become clearer with reference to the embodiments described in detail below together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms. These embodiments are provided solely to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the invention, and the present invention is defined solely by the scope of the claims.
[0051] The specific details for implementing the present invention will be described in detail with reference to the attached drawings. Regardless of the drawings, the same reference numerals refer to the same components, and "and / or" includes each and every combination of one or more of the mentioned items.
[0052] The terminology used herein is for the purpose of describing embodiments and is not intended to limit the present invention. In this specification, singular forms also include plural forms, unless specifically stated otherwise. As used herein, the terms "comprises" and / or "comprising" do not exclude the presence or addition of one or more other components in addition to the components mentioned.
[0053] Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used in their common sense to those of ordinary skill in the art to which the present invention pertains. Furthermore, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise.
[0054] Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the attached drawings.
[0055] Figure 1 is a configuration diagram showing a realistic mixed reality education and collaboration solution support system according to the present invention.
[0056] Referring to FIG. 1, the realistic mixed reality education and collaboration solution support system according to the present invention largely includes a mixed reality headset (100), a metaverse server (200), and a terminal (300).
[0057] First, the mixed reality headset (100) is a device that allows a user to access the metaverse space via the Internet and experience XR content provided by the metaverse server. It can be worn on the user's head to show the extended reality (XR) world to the user's eyes. In other words, the mixed reality headset (100) plays a role in displaying a 3D hologram in real space.
[0058] The above mixed reality headset (100) may be made of, for example, a carbon fiber-based material, and is configured to recognize various gestures of the wearer.
[0059] Next, the metaverse server (200) creates a metaverse space in the space where the wearer of the mixed reality headset (100) is located so that the content can be experienced through the actual user's appearance or the user's avatar, and is configured so that multiple users can access the created metaverse space simultaneously.
[0060] Accordingly, users wearing the mixed reality headset (100) can experience prepared content with other users by accessing the metaverse server (200) through their own account.
[0061] FIG. 2 is a diagram showing a metaverse server that constitutes a realistic mixed reality education and collaboration solution support system according to the present invention.
[0062] Referring to FIG. 2, to describe the metaverse server (200) in more detail, the metaverse server (200) largely includes a metaverse space creation unit (210), a metaverse avatar creation unit (220), a 3D virtual model unit (230), and an interaction unit (240), and may be configured to additionally include at least one of a voice chat support unit (250), a real-time mirroring unit (260), an education and training support unit (270), and a user interface support unit (280).
[0063] The above metaverse space creation unit (210) is configured to create a metaverse space exclusively for the mixed reality headset (100). At this time, the wearer recognizes the location real space through the mixed reality headset (100) and creates a metaverse space in the recognized real space.
[0064] The above metaverse avatar creation unit (220) is configured to create an avatar of a mixed reality headset (100) wearer in the metaverse space created through the metaverse space construction unit (210).
[0065] FIG. 3 is an exemplary diagram illustrating an avatar generation unit for a metaverse that constitutes a metaverse server according to the present invention.
[0066] Referring to FIG. 3, the avatar generation unit (220) for the metaverse can be interpreted as generating an avatar to enable users to experience metaverse content in the same space through their avatars when the distance between users is far.
[0067] That is, in the case of users wearing a mixed reality headset (100) in a close space, they can experience content based on the appearance of the actual wearers of the mixed reality headset (100), and in the case of users who are far away, they can experience content in the same space through an avatar, so that users wearing the mixed reality headset (100) can access the metaverse server (200) and proceed with a single content process together.
[0068] The above 3D virtual model unit (230) is configured to implement (augment) various industrial equipment, including manufacturing and medical equipment, as holographic objects in the metaverse space. Here, the various industrial equipment may include, but is not limited to, manufacturing equipment, medical equipment, and expensive equipment.
[0069] FIG. 4 is an exemplary diagram illustrating a 3D virtual model section constituting a metaverse server according to the present invention.
[0070] Referring to FIGS. 3 and 4, the 3D virtual model unit (230) can implement medical equipment including, for example, an operating table, medical tools, and a surgical monitor as holographic objects in the case of medical education content, and not only equipment but also human (patient) objects can be implemented as holographic objects.
[0071] The above interaction unit (240) is configured to support real-time interaction between multiple users and hologram objects within the metaverse space.
[0072] Referring to FIG. 3, for example, it can mean that multiple users can visually observe the inside and outside of a holographic human body through the interaction unit (240), and interact with each other by touching and giving each other the size of holographic human body organs and parts directly through hand movements.
[0073] Therefore, all participants can share and manipulate all hologram objects through the interaction section (240).
[0074] The above voice chat support unit (250) is configured to support voice chat within the metaverse space, so that users currently connected to the same space can communicate with each other through voice chat.
[0075] The above voice chat support unit (250) can be configured to display an icon with a nickname above the location of each user, for example, if voice chat is being used.
[0076] The above real-time mirroring unit (260) is configured to share in real time the same screen as the viewpoint of a terminal (300) including a computer or a smartphone and a wearer of the mixed reality headset (100).
[0077] The above education and training support unit (270) is configured to provide a description function for an augmented hologram object through the above 3D virtual model unit (230).
[0078] The above-described training support unit (270) may be configured to visually display or provide audible explanations of holographic objects, but is not limited thereto. For example, it may be configured to visually provide a scenario-based training guide, including manipulation, practice, and collaboration with or for holographic objects, to a wearer of a mixed reality headset (100) through 2D, 3D, and XR animations.
[0079] The above user interface support unit (280) is configured to provide a user interface when a wearer of the mixed reality headset (100) looks at the user's palm.
[0080] FIG. 5 and FIG. 6 are exemplary diagrams for explaining a user interface support unit that constitutes a metaverse server according to the present invention.
[0081] Referring to (a) of FIG. 5, the user interface may be configured to be called, for example, when the user has the palm of the right hand facing the user, but is not limited to the palm.
[0082] In addition, referring to (b) of FIG. 5, the user interface may be configured so that, for example, the user interface panel follows the user's gaze, and may be configured so that the user can hold the user interface panel with his or her hand and fix it at a desired location.
[0083] Meanwhile, the user interface may include, but is not limited to, a 3D drawing function that allows drawing pictures or text anywhere in the metaverse space and sharing them with other users, a viewer function that allows viewing images or PDF files stored in a mixed reality headset, a voice chat on / off function, a metaverse space exit function, and a user interface exit function.
[0084] The above 3D drawing function allows users to draw pictures or text anywhere in the metaverse space, and can be configured to allow users to draw what they want by hand and convey it to other users.
[0085] For example, the color provides 8 colors as the initial setting value, and if additional colors are needed, the user can select a custom color and configure it so that the user can select the desired color by directly adjusting the RGB value.
[0086] Additionally, it supports a function to adjust the thickness of the line drawn by the user, and the thickness of the line can be adjusted by adjusting the slider value. After adjusting the desired color and thickness, the user can select the button to draw using hand gestures.
[0087] The above viewer function is a function that allows viewing of image files (JPG or PNG) and PDF files stored in the mixed reality headset (100). When the button is selected, a file explorer can be configured to appear. When an image or PDF file to be viewed is selected, a viewer window can be displayed within the current metaverse space, so that it can be configured to be shown to other users who are currently connected.
[0088] Meanwhile, the metaverse server (200) may further include an account management unit (not shown) for creating a user account and supporting the login process, etc., and an individual room creation unit (not shown) having a room (channel) creation and connection concept including a number of people limiting the room for the user to access and a participation password. This configuration is a commonly known and commonly used technology, so a detailed description thereof will be omitted.
[0089] Next, the terminal (300) is a device for monitoring by connecting to the metaverse server (200) and sharing the same screen as the viewpoint of the wearer of the mixed reality headset (100), and may refer to, for example, a smartphone, tablet PC, or computer, but is not limited thereto.
[0090] The above terminal (300) can be configured to be connected to the metaverse server (200) through a dedicated application that supports the content mirroring function.
[0091] Additionally, the terminal (300) is connected to a voice input device including a microphone through the dedicated application, allowing the user to issue voice commands to the wearer of the mixed reality headset (100) through the voice input device. This can enhance educational convenience.
[0092] The above terminal (300) refers to any type of hardware device including at least one processor, and may also be understood to encompass software components operating on the hardware device, depending on the embodiment. For example, the terminal may be understood to encompass, but is not limited to, all user clients and applications running on smartphones, tablet PCs, laptops, and desktops.
[0093] Accordingly, the realistic mixed reality education and collaboration solution support system according to the present invention allows multiple users wearing the mixed reality headset (100) to simultaneously access the metaverse server (200), and experience various contents (manufacturing, prototype production, education, etc.) prepared in the metaverse server (200) through various interactions such as touching, moving, and adjusting the size of virtual objects together in real space.
[0094] Below, a method for supporting a realistic mixed reality education and collaboration solution according to another aspect of the present invention will be described.
[0095] Figure 7 is a flowchart illustrating a method for supporting a realistic mixed reality education and collaboration solution according to another aspect of the present invention.
[0096] Referring to FIG. 7, a method for supporting a realistic mixed reality education and collaboration solution according to another aspect of the present invention is a method for supporting a realistic mixed reality education and collaboration solution using the realistic mixed reality education and collaboration solution support system. First, after a user wears a mixed reality headset (100), a space recognition step (S100) is performed in which the mixed reality headset (100) recognizes the space in which the user is located.
[0097] Afterwards, the user performs a login step (S200) to log in to access the metaverse server (200) after running the dedicated app.
[0098] At this time, if you do not have an existing account, you can complete the membership registration process to register as a new member.
[0099] Thereafter, the metaverse server (200) creates a metaverse space according to the user's operation, or performs a metaverse space connection step (S300) in which the user connects to the created metaverse space.
[0100] More specifically, the metaverse space access step (S300) enables the metaverse server (200) to access the lobby through the user's account and provides the user with information about existing rooms. The room information may include, but is not limited to, the room title, room creator, and number of participants.
[0101] In addition, the metaverse server (200) may be performed including steps for providing functions such as room creation function and user member information modification.
[0102] Thereafter, the metaverse server (200) performs an avatar creation step (S400) in which an avatar to be used in the metaverse space is created according to the user's operation.
[0103] The above avatar creation step (S400) may be performed to enable avatar selection when the actual distance between users of the mixed reality headset (100) participating in the same room is far, but is not limited thereto. For example, when the distance is close, the actual appearance of the wearer may be displayed through the mixed reality headset (100).
[0104] Thereafter, the metaverse server (200) performs an anchor setting step (S500) to set an anchor for specifying the location of metaverse content according to the user's operation.
[0105] More specifically, the anchor setting step (S500) can be performed so that the user who first accessed the room sets and shares the anchor, and if a user who is not in the same space as the user who first accessed the room cannot use the shared anchor information because the actual space is different, a step for setting personal anchor information can be performed.
[0106] The above anchor setting can be configured to set the augmented holographic object for anchor setting by, for example, holding it by hand and positioning it where the content is desired to be performed.
[0107] Thereafter, the metaverse server (200) performs a 3D virtual model implementation step (S600) of implementing a 3D virtual model through a hologram in the metaverse space.
[0108] Thereafter, the metaverse server (S200) performs a content support step (S700) that supports content including product design, prototype production, collaboration, education, and remote communities with external parties.
[0109] More specifically, the content support step (S700) may include an interaction support step that supports real-time interaction between multiple users and holographic 3D virtual models within the metaverse space, a voice chat support step that supports voice chat within the metaverse space, a real-time mirroring support step for sharing the same screen as the viewpoint of a terminal including a computer or a smartphone and a mixed reality headset wearer, an education and training support step that provides an explanation function for an augmented holographic 3D virtual model, and a user interface support step that provides a user interface when a mixed reality headset wearer looks at the palm of the user's hand, and the metaverse server (200) may perform any one of the support steps according to a user operation or a specific event.
[0110] Meanwhile, the above real-time mirroring support step is performed to enable voice commands to be given to a mixed reality headset wearer through a voice input device including a microphone connected to the terminal (300).
[0111] In addition, the above-mentioned education and training support step is performed to visually provide a scenario-based education guide including manipulation, practice, and collaboration on the above-mentioned holographic 3D virtual model to a wearer of a mixed reality headset (100) through 2D, 3D, and XR animation.
[0112] Meanwhile, the user interface support step may be configured so that the user interface panel follows the user's gaze when the user calls the user interface, and may be performed so that the user can hold the user interface panel with his or her hand and fix it at a desired location.
[0113] At this time, the user interface includes a 3D drawing function that allows drawing pictures or text anywhere in the metaverse space and sharing them with other users, a viewer function that allows viewing images or PDF files stored in a mixed reality headset, a voice chat on / off function, a metaverse space exit function, and a user interface exit function, and the user interface support step can perform an action to perform any one of the functions.
[0114] Therefore, the realistic mixed reality education and collaboration solution support system and method according to the present invention having the configuration described above can enable multi-party simultaneous training in the same space through mixed reality (XR), and can provide a 3D virtual model service of an actual site in addition to reinforcing non-face-to-face education.
[0115] In addition, it is possible to provide an extended reality-based education and training service that allows for a more vivid and realistic virtual world experience than existing virtual reality (VR), such as real-time interaction and manipulation and hands-on collaboration through 3D virtual models.
[0116] Although the embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art will appreciate that the present invention can be implemented in other specific forms without altering the technical concept or essential features thereof. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive.
Claims
1. A mixed reality headset to support users to access the metaverse space via the Internet and experience XR content provided by the metaverse server; and A realistic mixed reality education and collaboration solution support system including a metaverse server that creates a metaverse space in a space where a mixed reality headset wearer is located so that content can be experienced through the actual user's appearance or the user's avatar, and allows multiple users to access the created metaverse space simultaneously.
2. In paragraph 1, The above metaverse server, A metaverse space creation unit that creates a metaverse space dedicated to the above mixed reality headset, and A metaverse avatar creation unit that creates an avatar of a mixed reality headset wearer in a metaverse space created through the above metaverse space construction unit, and A 3D virtual model section that implements equipment from various industries, including manufacturing and medical, as holographic objects in the above metaverse space, and A realistic mixed reality education and collaboration solution support system, characterized by including an interaction section that supports real-time interaction between multiple users and holographic objects within the metaverse space.
3. In paragraph 2, The above metaverse server, A realistic mixed reality education and collaboration solution support system further comprising a voice chat support unit that supports voice chat within the metaverse space.
4. In paragraph 3, The above metaverse server, A realistic mixed reality education and collaboration solution support system further comprising a real-time mirroring unit for sharing the same screen as the viewpoint of a terminal including a computer or a smartphone and a wearer of the mixed reality headset.
5. In paragraph 4, The above terminal, A realistic mixed reality education and collaboration solution support system characterized in that it is possible to monitor through screen sharing mirrored through the above real-time mirroring unit and to give voice commands to the wearer of the mixed reality headset through a voice input device including a microphone.
6. In paragraph 2, The above metaverse server, A realistic mixed reality education and collaboration solution support system further comprising an education and training support section that provides an explanation function for an augmented hologram object through the above 3D virtual model section.
7. In paragraph 6, The above education and training support department, A realistic mixed reality education and collaboration solution support system characterized by visually providing scenario-based training guides including manipulation, practice, and collaboration on the above holographic objects to mixed reality headset wearers through 2D, 3D, and XR animations.
8. In paragraph 2, The above metaverse server, A realistic mixed reality education and collaboration solution support system further comprising a user interface support unit that provides a user interface when a user of the mixed reality headset looks at the palm of the user's hand.
9. In paragraph 8, The above user interface is, A realistic mixed reality education and collaboration solution support system featuring a 3D drawing function that allows you to draw pictures or text anywhere in the metaverse space and share them with other users, a viewer function that allows you to view images or PDF files stored in a mixed reality headset, a voice chat on / off function, a metaverse space exit function, and a user interface exit function.
10. In paragraph 9, The above user interface support unit is, A realistic mixed reality education and collaboration solution support system characterized in that the user interface panel is configured to follow the user's gaze when the user calls the user interface, and supports the user to hold the user interface panel with the hand and fix it at a desired location.
11. A method for supporting a realistic mixed reality education and collaboration solution using a realistic mixed reality education and collaboration solution support system, A space recognition step in which the mixed reality headset recognizes the space in which the user is located after the user puts on the mixed reality headset; A login step where the user logs in to access the metaverse server after running the app; The metaverse space connection step where the metaverse server creates a metaverse space according to the user's operation or where the user connects to the created metaverse space; An avatar creation step in which the metaverse server creates an avatar to be used in the metaverse space according to the user's operation; An anchor setting step in which the metaverse server sets an anchor to designate the location of metaverse content according to the user's operation; A 3D virtual model implementation step in which the above metaverse server implements a 3D virtual model through a hologram in the metaverse space; and A method for supporting a realistic mixed reality education and collaboration solution, comprising a content support step in which the above metaverse server supports content including product design, prototype production, collaboration, education, and remote communities with external parties.
12. In paragraph 11, The above avatar selection step is, A method for supporting a realistic mixed reality education and collaboration solution, characterized by enabling avatar selection when the distance between users of the mixed reality headset is far.
13. In paragraph 11, The above anchor setting step is, A method for supporting an immersive mixed reality training and collaboration solution, characterized by requiring personal anchor information to be set for mixed reality headset users who are not in the same space.
14. In paragraph 11, The above content support steps are: An interaction support stage that supports real-time interaction between multiple users and holographic 3D virtual models within the metaverse space, A voice chat support stage that supports voice chat within the metaverse space, A real-time mirroring support step for sharing the same screen as the point of view of a terminal including a computer or smartphone and a mixed reality headset wearer, An educational and training support stage that provides explanation functions for augmented holographic 3D virtual models, A method for supporting a realistic mixed reality education and collaboration solution, characterized by including a user interface support step of providing a user interface when a mixed reality headset wearer looks at the palm of the user's hand.
15. In paragraph 14, The above real-time mirroring support steps are: A method for supporting a realistic mixed reality education and collaboration solution, characterized in that it supports voice commands to a mixed reality headset wearer through a voice input device including a microphone connected to the terminal.
16. In paragraph 14, The above education and training support stage is: A method for supporting a realistic mixed reality education and collaboration solution, characterized by visually providing a scenario-based education guide including manipulation, practice, and collaboration on the above holographic 3D virtual model to a mixed reality headset wearer through 2D, 3D, and XR animations.
17. In paragraph 14, The above user interface support steps are: A method for supporting a realistic mixed reality education and collaboration solution, characterized in that when a user calls a user interface, a user interface panel is configured to follow the user's gaze and support the user to hold the user interface panel with a hand and fix it at a desired location.
18. In paragraph 14 or paragraph 17, The above user interface is, A method for supporting a realistic mixed reality education and collaboration solution, characterized by including a 3D drawing function that allows drawing pictures or text anywhere in the metaverse space and sharing them with other users, a viewer function that allows viewing images or PDF files stored in a mixed reality headset, a voice chat on / off function, a metaverse space exit function, and a user interface exit function.
Citation Information
Patent Citations
A visual-haptic fusion augmented reality simulator for dental surgery skill training
JP2022532269A
Hologram anchoring and dynamic positioning
KR1020160012139A
Construction method of fiam tunnel using centrifugal casting ultra-high-strength square beam as superstructure and fiam tunnel constructed by the same
KR102374003B1
Method and apparatus for providing metaverse service
KR102376390B1
Object detection system that interworks with radar-based IP web cameras
KR102485191B1