Educational metaverse interaction platform for interaction management

Abstract

This provides an educational metaverse interaction platform for interaction management that effectively manages interaction activities within virtual scenes. [Solution] The platform includes a processing module, an image projection device, a platform database, and a physical operation device. In a scene image corresponding to scene information, one user is granted administrative privileges as a scene administrator, and through these administrative privileges, at least one of the following is performed for managed users: group association, location association, permission management, and state determination. Group association is used to specify groups among managed users; location association is used to specify that managed users move to specific coordinates in the corresponding scene; permission management is used to control the operability of specific abilities of managed users in the corresponding scene; and state determination is used to make determinations about the state of interest of managed users.

Description

Technical Field

[0001] The present invention relates to an interaction platform, and particularly to an educational metaverse interaction platform for interaction management.

Background Art

[0002] With the development of science and technology advancing day by day, technologies such as various software, hardware, systems, and platforms for realizing the metaverse virtual world have already been proposed, practiced, and are becoming increasingly mature. Also, related research has shown that by conducting corresponding activities in the metaverse scene, the sense of participation and concentration of users can be effectively improved compared to simple video calls (meetings, education, conversations). However, such interaction platforms may be too single or incomplete in function. For example, if the interactivity during user activities is not good, it will affect the progress of the activities and the experience of other users. In view of this, there is a need to improve the conventional interaction platform.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In order to solve the above problems, an object of the present invention is to provide an educational metaverse interaction platform that can smoothly carry out various activities.

Means for Solving the Problems

[0005] Throughout the specification of this invention, the counter words "one" or "one" used with respect to parts or components are used for convenience and to give a common meaning to the scope included in this invention, and should be interpreted as one or at least one in this invention, and unless explicitly stated otherwise, the concept of one also includes cases of multiple.

[0006] In the entirety of the specification of this invention, "coupling connection" refers to a state in which energy can be transmitted between two objects. For example, it is understandable to a person with ordinary skill in the art to which this invention belongs that two circuits electrically connected through a metal wire can transmit an electric current signal, or that optical information can be transmitted when connected by an optical fiber.

[0007] The components described in the full specification of this invention, such as "system," "device," "unit," "database," and "module," may, in whole or individually, include at least one "processor." A processor, as used herein, refers to various data processing devices equipped with specific functions and implemented by hardware or a combination of hardware and software, which process and analyze information and / or generate corresponding control information. It may further include corresponding data receiving / transmitting units for receiving or transmitting necessary data, as well as corresponding databases or storage units (particularly non-temporary storage units) for reading and storing corresponding data. In particular, unless explicitly excluded or contradictory, the processor may be a collection of multiple processors based on a distributed system architecture, and may include or represent the process, mechanism, and results of information stream processing among multiple processors. In particular, in the full specification of this invention, the functions of the above processors are collectively referred to as "processing modules."

[0008] The mechanisms for sending and receiving signals between components such as "systems," "devices," "units," "databases," and "modules" described in the full text of the specification of this invention are based on configurations for realizing IoT (Internet of Things) or information / data exchange, assuming that each component is provided with corresponding hardware and compatible software systems. These technologies are of ordinary knowledge understandable to those skilled in the art.

[0009] The educational metaverse interaction platform of the present invention comprises a processing module including at least one processor, an image projection device coupled to the processing module that receives control commands from the processing module and generates corresponding images, a platform database coupled to the processing module, the platform database including a character database, a scene database and an object database, which provide character information, scene information and object information respectively, and is used by the image projection device to generate images of corresponding virtual characters, scene images and virtual objects respectively, and a physical operation device coupled to the processing module for a user to input corresponding commands or actions, the processing module, after receiving the commands or actions, the corresponding control commands A physical manipulation device that generates and controls the video projection device and brings about a change corresponding to at least one of the video of a corresponding virtual character, a scene video, and a video of a virtual object, wherein in the scene video corresponding to the scene information, one user is granted administrative privileges as the scene administrator, and other users are defined as managed users, and the scene administrator performs at least one of the following with respect to the managed users via the administrative privileges: group association, location association, permission management, and state determination, the group association is used to specify a group among managed users, the location association is used to specify that the managed user moves to a specific coordinate in the corresponding scene, the permission management is used to control the operability of a specific ability of the managed user in the corresponding scene, and the state determination is used to make a determination on the state of interest of the managed user.

[0010] The educational metaverse interaction platform of the present invention can adjust the state of managed users by granting the scene administrator the management authority, and furthermore, it can achieve the effect of smoothly conducting various activities, especially educational activities.

[0011] The scene administrator performs the group association and groups managed users who have not selected a group using a specific method, which may be random assignment, average assignment based on a specific attribute, or extreme assignment based on a specific attribute. In this way, the effect of quickly grouping managed users can be achieved.

[0012] If the managed users are already grouped, the scene administrator specifies that the managed users should be associated with their corresponding seats according to their grouping status, and that the seats of managed users in the same group should be adjacent to each other. In this way, the effect of quickly separating and seating managed users in the same group can be achieved.

[0013] The scene administrator performs the location association and specifies that at least one managed user should be associated with a corresponding seat, so that the location of the specified managed user is moved to the associated seat. In this way, the effect of restricting the location of the specified managed user can be achieved, and in particular, it is possible to prevent users who move around freely from disrupting the progress of educational activities.

[0014] The scene administrator executes the audio switch control in the access control, specifying the start or end of the audio function corresponding to at least one managed user. If the control of the corresponding audio function is started, the voice emitted by the specified managed user is transmitted in the scene. If the control of the corresponding audio function is ended, the voice emitted by the specified managed user is muted in the scene. In this way, the effect of starting or ending the voice of a specified managed user can be achieved, and in particular, it is possible to prevent users who speak without permission from disrupting the progress of educational activities.

[0015] The scene administrator performs the operation sequence determination in the state determination, and records and sequences the point in time when each managed user completes their corresponding operation. In this way, the effect of determining and recording the point in time when each managed user completes their corresponding operation can be achieved, and it can be applied in particular to the progress of a buzzer quiz activity.

[0016] The platform database further includes a user database that stores user-specific data, the educational metaverse interaction platform further includes an authentication device that detects individual user biometric information, and an external platform, the external platform including an external processing module and an external user database including an external authentication information set and an external dedicated dataset, the external authentication information set is an external authentication information set that stores authentication data for users to log in to the external platform, the authentication data includes individual user biometric information, and the external dedicated dataset includes individual user dedicated data, the external processing module, the authentication device, the external user database and the user database are coupled to each other, and when a user detects their biometric information via the authentication device, the external processing module receives the biometric information detected by the authentication device and determines whether it matches the biometric information in the external authentication information set, and if the external processing module determines that it matches, the external processing module transmits a corresponding control command and transmits the corresponding user's dedicated data in the external dedicated dataset to the user database in the educational metaverse interaction platform for storage. In this way, through the collaboration of the authentication device, the interaction platform, and the external platform, it is possible to achieve the effect that a user can use dedicated objects acquired on other external platforms within the interaction platform of the present invention.

[0017] Furthermore, the educational metaverse interaction platform of the present invention further includes a platform module, the platform module is coupled with the processing module, the platform module includes a scene module, the scene module is coupled with the platform database to generate a corresponding scene image, the scene module includes an interaction scene, the interface arrangement of the interaction scene defines a public area and a restricted area, the restricted area is located within the public area, when the user's virtual character is located in the public area, the information transmitted by the user in the public area is made public, and when the user's virtual character is located in the restricted area, the information transmitted by the user in the restricted area is limited to other users whose corresponding virtual characters are located in the restricted area at the same time. In this way, by arranging the restricted area within the public area in the interface arrangement of the interaction scene, when a user needs to engage in more private interaction, the user can directly enter the restricted area from the public area, achieving the effect of quickly switching between public and private interaction functions.

[0018] Furthermore, the educational metaverse interaction platform of the present invention further includes a virtual-real integration system, the virtual-real integration system being coupled with the processing module, the virtual-real integration system including a physical module and a virtual module, the physical module including a physical device which is a device in the real world, and a physical controller coupled with the physical device which controls the operation of the physical device, the virtual module being coupled with the physical module which includes a virtual controller for the user to generate input operation signals in a virtual scene, the physical controller receiving the input operation signals and controlling the physical device based on the input operation signals to generate corresponding operations. In this way, the arrangement of the virtual-real integration system makes it possible to achieve the effect that control performed in a virtual scene drives the operation of an actual device in the real world.

[0019] The physical module further includes a physical sensor and basic information, the physical sensor being provided in at least one of the physical controller, the physical device, and the actual environment, and detecting information of interest in the physical controller, the physical device, or the actual environment; the basic information recording demand information and / or limit information in the actual environment to which the physical device applies; the demand information being resource information required for the physical device to perform a single operation; and the limit information being limit information that the physical device must not exceed when performing an operation; the processing module or the virtual controller calculating a limit value of the operable numerical value corresponding to the physical device based on the relationship between the information of interest and the basic information, and enabling the user to input a corresponding operation input signal within the range of the limit value of the operable numerical value. In this way, the limit value of the operable numerical value makes it possible to achieve the effect of enabling the user to conveniently perform appropriate operations. [Brief explanation of the drawing]

[0020] [Figure 1]System block diagram of a preferred embodiment of the educational metaverse interaction platform of the present invention. [Figure 2] Schematic plan view of the interface layout in the communication scene of the present invention. [Figure 3] Schematic plan view of the interface layout in the classroom scene of the present invention. [Figure 4] Schematic plan view of the interface layout in the live broadcast scene of the present invention. [Figure 5] Schematic plan view of the interface layout in the activity scene of the present invention. [Figure 6] Schematic plan view of the interface layout in the user scene of the present invention. [Figure 7] Schematic diagram of the cooperation relationship between components when the educational metaverse interaction platform of the present invention loads dedicated data on an external platform. [Figure 8] System block diagram of a preferred embodiment in which the educational metaverse interaction platform of the present invention further includes a virtual-real integration system.

Best Mode for Carrying Out the Invention

[0021] In order to make the above objects, other objects and advantages of the present invention easier to understand, embodiments of the present invention are given as follows, and will be described in detail with reference to the drawings. Also, in different drawings, those denoted by the same reference numerals are regarded as the same and their descriptions are omitted.

[0022] As shown in Figure 1, a preferred embodiment of the Educational Metaverse Interaction Platform EMIP of the present invention is used to provide a user with a visual image screen, in particular, to provide the user with an immersive visual image, and to enable the user to enter a Metaverse / Cyber-physical Integration / Virtual Reality (VR) scene. The Educational Metaverse Interaction Platform EMIP includes a processing module 1, an image projection device 2, a physical manipulation device 3, a platform database 4, an optional platform module 5, an optional authentication device 6, and an optional external platform 7. The processing module 1 is coupled with the image projection device 2, the physical manipulation device 3, the platform database 4, the optional platform module 5, the optional authentication device 6, and the optional external platform 7, respectively.

[0023] The processing module 1 includes at least one processor, which may include, for example, a central processing unit CPU and / or graphics processing unit GPU, common in computer or server systems, and is used for receiving, transmitting, calculating, and / or outputting adaptive control commands to the corresponding coupling unit for information between coupled units. The units coupled to the processing module 1 include one or more of the image projection device 2, the physical operation device 3, the platform database 4, the platform module 5 as an option, the authentication device 6 as an option, and the external platform 7 as an option.

[0024] The image projection device 2 is a display, coupled with the processing module 1, and is used to receive control commands from the processing module 1 and generate corresponding images. The generated images include at least one of a virtual character image, a scene image, and a virtual object image. More specifically, the display is used to generate two-dimensional (planar) images or three-dimensional (stereoscopic) images, and is particularly used to generate three-dimensional images in virtual reality applications. The contents of the image projection device 2 can be realized by applying known technologies, and their details are omitted here.

[0025] The physical control device 3 is coupled with the processing module 1 and is used by the user to input corresponding commands or actions. In particular, after receiving the command or action, the processing module 1 generates a corresponding control command to control the image projection device 2, bringing about a change corresponding to at least one of the images of the corresponding virtual character, scene, and virtual object. For example, the physical control device 3 may include one or more information input units such as a keyboard, mouse, voice input device (such as a microphone as an input unit for voice commands), and motion state sensing unit. The motion state sensing unit is, for example, a sensing circuit implemented based on the gyroscope principle, for detecting changes in the user's position, orientation, velocity, and / or acceleration. Selectively, the motion state sensing unit may further include a depth camera or infrared sensor to obtain real-time detailed information about the user's posture.

[0026] In particular, the physical operation device 3 can be, for example, a head-mounted VR goggle and can support at least commercially available VR goggles such as the Oculus / Meta Quest series and the HTC Vive series. However, the present invention is not limited to the above-mentioned VR goggles and can also include VR goggles from other manufacturers or models (for example, the Galaxy Gear series (Galaxy is a registered trademark), the PlayStation VR series (PlayStation is a registered trademark), and the Apple Vision Pro series). In this case, the image projection device 2 can be integrated with the physical operation device 3. Optionally, the physical operation device 3 can be, for example, a control handle, for example, a control handle that can be combined with the aforementioned commercially available VR goggles, or the control handle can be used independently of the VR goggles. Optionally, the physical operation device 3 can be an image recognition device that detects changes in the user's movements within a specific area (for example, the technology used in Nintendo's Wii® game console). Selectively, the physical manipulation device 3 may be attached to the user's limbs and detect changes in the posture of the user's limbs (including one or more of each finger, palm, arm, foot, and leg). The details of the physical manipulation device 3 can be realized by applying known technologies, and therefore their details are omitted.

[0027] The platform database 4 is coupled with the processing module 1 and is used to provide various data formats as the basis for the images generated by the image projection device 2. In particular, the platform database 4 includes at least one of the following: character database 41 (providing character information), scene database 42 (providing scene information), object database 43 (providing object information), video / audio database 44 (providing video / audio information), and image / document database 45 (providing image / document information). Each of these can be used by the image projection device 2 to generate corresponding information for images of virtual characters, scene images, virtual object images, videos and / or audio, and image and / or document content.

[0028] The character database 41 includes multiple pre-constructed character information entries, and different character information entries have different appearances when displayed in a visual image (for example, height, body type, facial features, clothing size, and relative positional relationships between them), and the image projection device 2 can generate images of the corresponding virtual characters.

[0029] The scene database 42 includes multiple pre-constructed scene information, which can be understood as spatial information and includes detailed spatial shape, dimensions (length, width, and height) of the corresponding spatial shape, color scheme, and corresponding coordinate values, and the corresponding scene image can be generated by the image projection device 2. Preferably, point cloud technology can be used to generate pre-constructed scene information that closely resembles a real scene.

[0030] The object database 43 includes a plurality of pre-constructed object information, which includes detailed object shapes, dimensions (length, width, and height) of the corresponding object shapes, color schemes, and corresponding coordinate values. The image projection device 2 can generate images of the corresponding virtual objects (especially 3D images adjustable in each direction), and is used particularly to display the virtual appearance of the corresponding objects. The images (virtual objects) formed by the object information may include images corresponding to living or non-living objects in the real world, and may also include images of uniquely defined objects (for example, anime or manga objects).

[0031] The aforementioned video and audio database 44 includes various pre-constructed pure video data (e.g., video files without sound), pure audio data, and / or combined video and audio data (i.e., video files that generally have sound).

[0032] The aforementioned image / document database 45 includes various pre-constructed document files or image files. The contents of the platform database 4 can be realized by applying known technologies, and therefore their detailed contents are omitted.

[0033] Preferably, the platform database 4 may further include a user database 46 for storing user-specific data, the user database 46 including an authentication information database 460, a favorite settings record 461, and a related favorite data set 462. The authentication information database 460 is used to store authentication data for individual users to log in to the educational metaverse interaction platform EMIP, and the authentication data includes, but is not limited to, user-defined accounts and passwords or personally identifiable biometric information (e.g., fingerprints, iris, or facial features). The favorite settings record 461 is used to store initial favorite information, which records individual users' selections from at least one of the character database 41, the scene database 42, the object database 43, and the selective related favorite data set 462 of the platform database 4, and can be set as the default or preferred favorite setting. The related favorite data set 462 may be used to store external favorite character data or external favorite object data specific to individual users, and the external favorite character data or external favorite object data is loaded from the external user database 72 of the external platform 7. The aforementioned external-only character data and object data are used to provide users with external-only virtual characters and virtual objects that can be selected and used by the user in the scenes / virtual worlds of the educational metaverse interaction platform EMP of the present invention, unlike the built-in character database 41 and object database 43.

[0034] The aforementioned "external exclusivity" refers to ownership or usage rights that a single user has with respect to external data on a corresponding interaction platform, and can be understood in the technical field of the present invention as "binding" or "pairing," and in particular refers to the sole association between data composed of electronic signals and unique identification data corresponding to an individual user (corresponding to an actual user). Generally, the external exclusivity character data or external exclusivity object data is usually a virtual character or virtual object that can only be acquired by fulfilling certain conditions, and can bring a sense of accomplishment or memories to the user as a symbol of the effort invested or the ability possessed by the user. The technical details of how the associated exclusive dataset 462 loads the corresponding data from the external platform 7 will be described in detail later.

[0035] Selectively, the platform module 5 can be coupled with the processing module 1 and includes at least one of a login module A, a character module B, and a scene module C. The login module A has a window interface that can be displayed by the video projection device 2 and includes at least two fields, an account and a password, and is used by the user to enter the corresponding account and password via the physical operation device 3 and complete / pass the corresponding login process. The contents of the window interface can be realized by applying known technologies, and their details are omitted.

[0036] The character module B has a character selection interface and is coupled directly or indirectly to the character database 41. The image projection device 2 displays the plurality of pre-constructed virtual characters, and the user selects one of the plurality of pre-constructed virtual characters via the physical operation device 3 to generate a virtual character controlled by the user. The contents of the character selection interface can be realized by applying known technologies, and their details are omitted.

[0037] The scene module C is directly or indirectly coupled to the scene database 42 in the platform database 4, and selectively further coupled to at least one of the character database 41, the object database 43, the video / audio database 44, and the image / document database 45, and is used to generate a corresponding scene video. The video projection device 2 can display the corresponding scene video alone, or display the user's virtual character located in the corresponding scene video together with it. When the video projection device 2 displays the user's virtual character located in the corresponding scene video together with it, the processing module 1 synchronously moves the user's virtual character located in the corresponding scene video or executes initial functions in the corresponding scene information based on commands or actions performed by the user operating the physical operation device 3. More specifically, in the process of generating the motion, the processing module 1 calculates in real time the changes in the dimensions and coordinate positional relationship between the user's virtual character and the scene information corresponding to the scene video, so that the video projection device 2 can display a first-person view video to the user. However, the effect of the visual display is not limited to a first-person view.

[0038] The present invention's educational metaverse interaction platform, EMP, enables users to immerse themselves in a virtual world (corresponding scene images) by transforming into a corresponding virtual character, and to synchronize the user's commands or actions in the real world with the virtual world, thereby achieving the effect of virtual-real integration. In particular, when the applied scene information is generated using point cloud technology, users can perceive and experience the corresponding scenery (scene) in the real world within the virtual world. The generation of scene images with corresponding arrangements and the display of the virtual character in accordance with the corresponding scene images can be realized by applying known technologies, and the details thereof are omitted.

[0039] The aforementioned scene module C includes one or more of several different scenes, such as interaction scene C1, class scene C2, live streaming scene C3, activity scene C4, and user scene C5. Each different scene has a different interface layout and functionality, allowing the user to engage in different activities in different scenes, enabling the user to psychologically immerse themselves more in the atmosphere, activities, or events of the scene in question.

[0040] As shown in Figure 2, this is a schematic diagram of an example of interface arrangement in the planar configuration (similar to a plan view) of the interaction scene C1, and is intended to explain the interface arrangement of the interaction scene C1. In the interaction scene C1, the entire interaction scene C1 is basically a public area C10. Triangular shapes are used to indicate virtual characters U of different users (located at different positions in the public area C10), rectangular areas are used to indicate restricted areas C11 located in the public area C10, and elliptical areas are used to indicate passages Px leading to other scenes. These shapes and areas, having different shapes, quantities, and positions, are used to conveniently explain that they have different characteristics and to make the content of the present invention easier to understand, and the present invention is not limited thereto.

[0041] More specifically, the public area C10 of the interaction scene C1 is open to all users to provide a scene for normal interaction (similar to a public square in the real world), and is used to allow users to feel comfortable and open. In other words, when a user's virtual character U is located in the public area C10, the information transmitted by the user in the public area C10 (spoken voice, actions performed, or data presented) is made public and can be obtained by other users. At least one restricted area C11 is provided within the public area C10. The user-controlled virtual character U can basically move freely between the public area C10 and the restricted area C11. When a user's virtual character U is located in the restricted area C11, the information transmitted by the user is limited so that only other users whose corresponding virtual character is located in the same restricted area C11 at the same time can receive the corresponding information. Selectively, the user corresponding to the first virtual character U to enter the restricted area C11 has the authority to manage the restricted area C11 and can choose or exclude virtual character Us corresponding to other users from entering the restricted area C11. In this case (when entry and exit to the restricted area C11 are restricted), the virtual character U of an unauthorized user cannot move freely between the public area C10 and the unauthorized restricted area C11.

[0042] Selectively, the public area C10 of the interaction scene C1 is provided with at least one passage Px. In the example shown in Figure 2, the passage Px includes a classroom scene passage P2, a live streaming scene passage P3, an activity scene passage P4, and a user scene passage P5. The classroom scene passage P2, the live streaming scene passage P3, the activity scene passage P4, and the user scene passage P5 are used to transfer / switch the user to the corresponding classroom scene C2, live streaming scene C3, activity scene C4, and user scene C5, respectively. For example, the transfer function of the passage Px is triggered when a user selects / specifies a corresponding passage Px via the physical operation device 3, or moves a corresponding virtual character U to enter or pass through the corresponding passage Px. Similarly, the classroom scene C2, the live streaming scene C3, the activity scene C4, and the user scene C5 may have an interaction scene passage P1, which is used to transfer the user to the interaction scene C1.

[0043] Figure 3 is a schematic diagram of an example of interface arrangement in the planar configuration of the aforementioned classroom scene C2, and is intended to explain the technical features of the classroom scene C2. In classroom scene C2 of Figure 3, triangular shapes are used to indicate the positions of different users' virtual characters U, star shapes are used to indicate the position of a specific user's virtual character U as the instructor (teacher, lecturer, etc.) T, rectangular areas are used to indicate the classroom content display area D1, circular areas are used to indicate the seat S to which the user's virtual character U is bound, and elliptical areas are used to indicate the interaction scene passage P1 leading to the interaction scene C1, and the interaction scene passage P1 also belongs to one category of the passage Px. These shapes and areas having different shapes, quantities, and positions are used to conveniently explain that they have different properties and to make the content of the present invention easier to understand, and the present invention is not limited thereto.

[0044] The aforementioned classroom scene C2 provides a dedicated scene (similar to a real-world classroom or auditorium) in which the user listens to and learns from a lesson, allowing the user to feel as if they are concentrating on learning. The classroom scene C2 also provides a dedicated scene in which the user, as the instructor T, has the right to lead the progress of the educational activity. One area in the classroom scene C2 is provided with a lesson content display area D1, which is used to display lesson data such as object information, video / audio information (including video and / or audio data), or image / document information (including text and / or image data) that the instructor T needs to use during the lesson. This lesson data can be loaded from the object database 43, the video / audio database 44, or the image / document database 45.

[0045] Multiple seats S are provided in multiple areas of the aforementioned classroom scene C2. When a user designates / selects a corresponding seat S via the physical control device 3, or moves a corresponding virtual character U into the corresponding seat S, the virtual character U and the seat S form a temporary binding, and the position of the virtual character U is fixed to the designated seat S, and this continues until the corresponding temporary binding is released. Selectively, the position of each seat S has a corresponding virtual display (not shown), which synchronously displays the contents of the classroom content display area D1 to the user.

[0046] Figure 4 is a schematic diagram of an example of interface arrangement in the planar configuration of the live streaming scene C3, and is intended to explain the technical features of the live streaming scene C3. In the live streaming scene C3 of Figure 4, triangular shapes are used to indicate the positions of different users' virtual characters U, rectangular areas are used to indicate the video content display area D2, and elliptical areas are used to indicate the interaction scene passage P1 leading to the interaction scene C1. These shapes and areas, having different shapes, quantities, and positions, are used to conveniently explain that they have different characteristics and to make the content of the present invention easier to understand, and the present invention is not limited thereto.

[0047] The live streaming scene C3 provides a scene for users to watch a live stream, and in particular, multiple users can share their impressions of the live stream content in real time within the same scene, and users can choose to provide feedback to the live streamer in real time and display it on the live stream video to create an interactive effect. One area of ​​the live streaming scene C3 is provided with a video content display area D2, which is used to play videos (especially live stream videos) via a network connection. In addition, real-time feedback messages from users corresponding to the virtual character U in the live streaming scene C3 are displayed in synchronization with the video content display area D2. The feedback messages include voice messages spoken by the user or text messages entered, and are displayed in the video content display area D2 in a text format, thereby diversifying the interaction modes between users in the live streaming scene C3 (other than voice conversation) and improving the enjoyment of real-time interaction. Among these, the function of automatically converting voice messages into text messages can be realized by applying known technology, so its explanation is omitted in this invention.

[0048] Figure 5 is a schematic diagram of an example of interface arrangement in the planar configuration of the activity scene C4, and is intended to explain the technical features of the activity scene C4. The activity scene C4 provides a dedicated scene for users to engage in various different activity themes (the content of the activity themes may include lessons, leisure, hobbies, sports, etc., and similar activities, such as jazz drum instruction / practice, movie watching, golf, yoga, etc.), and in particular, multiple users can feel a sense of interacting and engaging with other users in the same scene, thereby enhancing the sense of positive physical and mental interaction. In this context, since the activity themes of the activity scene C4 are diverse and varied, the activity scene C4 includes at least one user-customizable area UD (corresponding to the rectangular or circular area in Figure 5, and areas of different sizes or shapes are used to show that the user-customizable area UD is diverse) to accommodate the usage of the activity scene C4. The user customization area UD can be coupled / linked with one or more of the object database 43, the video / audio database 44, and the image / document database 45, thereby realizing the activity theme of the activity scene C4 and setting the corresponding virtual object.

[0049] Figure 6 is a schematic diagram showing an example of interface arrangement in the planar configuration of user scene C5, and is intended to explain the technical features of user scene C5. User scene C5 provides a dedicated scene managed by the user and can be used to set up the user's ideal personal space. It has at least one user customization area UD, and the user can load one or more scene information, object information, video / audio information, or image / document information available from the platform database 4, and in particular can make selections regarding available scene information and object information, and selectively load virtual objects (corresponding to the external dedicated objects) available from the external user database 72. In user scene C5, the user customization area UD is displayed as a rectangular area and is used to indicate links to various available or dedicated objects in the object database 43 or the external user database 72, such as virtual objects like a bed, television, sofa, desk, laptop, and chair. Furthermore, the elliptical area is used to indicate a passage Px leading to other scenes, and the type of passage Px can be selected according to the user's preference (for example, in Figure 6, the types of passages currently placed are the interaction scene passage P1 and the activity scene passage P4).

[0050] As shown in the example of the arrangement in Figure 6, the arrangement is set as a default setting by the corresponding user and stored in the default setting record 461. When the corresponding user next logs in to the educational metaverse interaction platform EMIP of the present invention, the associated arrangement in their user scene C5 can be automatically loaded. More specifically, the initial associated information stored in the default setting record 461 can also record a selection (as a default or preferred default setting) in which the individual user's user scene C5 corresponds to at least one of the scene database 42, the object database 43, and the selective associated dedicated dataset 462. Furthermore, these figures and areas having different shapes, quantities, and positions are used to conveniently illustrate that they have different characteristics and to facilitate understanding of the present invention, and the present invention is not limited thereto.

[0051] Furthermore, in the implementation of the various functions or technologies of the Educational Metaverse Interaction Platform EMP of the present invention, the ability for a user to manipulate the display and use of various simulated real-world states or functions, such as lectures, podium presentations, attendance, casual conversations, conference discussions, manipulation or viewing of various virtual objects, and live streaming, between scenes (and scenes C1 to C5), and to achieve the effect of interaction with other users or other objects, can all be realized by applying known technologies. In particular, the transition between scenes via the passage Px, the fact that virtual objects have functions different from those in reality, the fact that virtual scenes have effects different from those in reality, or that virtual characters have abilities different from those in reality, can all be realized by applying known technologies. Therefore, the technology for realizing these functions or contents will not be explained in this invention.

[0052] Of particular note is that one of the main contributions of the Educational Metaverse Interaction Platform EMP of the present invention is that the interaction scene C1 includes an interface arrangement of the public area C10 and the restricted area C11 (as shown in Figure 2), preferably with the perimeter of the restricted area C11 surrounded by the public area C10. When the processing module 1 determines that a virtual character U controlled by a user via the physical operation device 3 is located within the range corresponding to the restricted area C11 or the public area C10, the corresponding user's video projection device 2 can receive only the information transmitted by virtual character Us corresponding to other users located within the same range. In particular, the confidentiality of the information transmitted differs depending on the location of the user's virtual character U; that is, the confidentiality in the public area C10 is relatively low (it is made public without being limited to specific individuals), while the confidentiality in the restricted area C11 is relatively high (it is generally kept private, and disclosure is limited to specific individuals). In particular, regarding confidentiality, "public" means that any user (regardless of whether they are in the same location at the time) can obtain a record of the corresponding past transmission information, while "private" means that, for example, typically only users who are in the same location at the same time can obtain a record of the corresponding past transmission information. Thus, if two users need to exchange more private information, they can move the virtual character U of the corresponding user from the public area C10 to the restricted area C11, thereby achieving the effect of combining public access, privacy protection, and real-time interaction in the interface arrangement of the same scene.

[0053] More specifically, in the interaction scene C1, which includes the interface arrangement of the public area C10 and the restricted area C11, the processing module 1 determines whether the user's virtual character moves to the corresponding area by determining whether the coordinate position of the user's virtual character in the interaction scene C1 is within the range enclosed by the corresponding area boundary coordinates. Within this range, the coordinate position of the user's virtual character changes as the user controls the physical operation device 3, and the processing module 1 corresponds to a specific area (the public area C10 and the restricted area C11) in a specific scene (the interaction scene C1) of the virtual world based on the above-mentioned change, transmits a corresponding control signal to the video projection device 2 to generate corresponding video and audio, and can synchronize the user's actions in the real world (generated by the physical operation device 3) with the virtual world, and can also synchronize and feed back sensations in the virtual world to the real world (generated by the video projection device 2), thereby achieving the effect of virtual-real integration.

[0054] Referring again to Figure 1, the Educational Metaverse Interaction Platform EMIP may further include the authentication device 6. The authentication device 6 is a biometric signal detection device used to detect mutually distinct and identifiable biometric information (e.g., fingerprints, iris, or facial features) between different users and to achieve the effect of identifying the user's identity. The authentication device 6 is coupled with the processing module 1 and the authentication information database 460 and is used to authenticate the user's identity. More specifically, the user can have their biometric information detected via the authentication device 6, and the processing module 1 receives and determines / verifies whether the biometric information detected by the authentication device 6 matches the biometric information in the authentication information database 460. If the processing module 1 determines that there is a match (defined as "successful user identity authentication"), the processing module 1 can send a control command corresponding to the corresponding component or module, triggering the corresponding component or module to generate the corresponding authentication function. The authentication function includes fast login, initial character loading, initial user scene loading, and loading of external dedicated data, and is described in detail below.

[0055] When the authentication function is high-speed login, the authentication device 6, the processing module 1, the authentication information database 460, and the login module A are directly or indirectly coupled. If the user's identity is successfully authenticated, the login module A is triggered to activate the high-speed login function, allowing the user to complete / pass the login process of the login module A.

[0056] When the authentication function is the loading of an initial character, the authentication device 6, the processing module 1, the authentication information database 460, the character module B, and the regular setting record 461 are directly or indirectly coupled, and further coupled with the character database 41 or the related dedicated dataset 462, and selectively coupled with the object database 43 or the related dedicated dataset 462. If user identity authentication is successful, the character module B is triggered to activate the initial character loading function, load the initial related information stored in the regular setting record 461, and link to the character database 41 or the related dedicated dataset 462 to load the corresponding virtual character. Selectively, since a virtual character can be equipped with a corresponding virtual object, the initial related information can also include the corresponding object information, link to the object database 43 or the related dedicated dataset 462 to load the corresponding virtual object, and equip the loaded virtual character with the corresponding virtual object.

[0057] When the authentication function is the loading of the initial user scene, the authentication device 6, the processing module 1, the authentication information database 460, the scene module C, the scene database 42, and the frequently used settings record 461 are directly or indirectly coupled, and further coupled with the object database 43 or the related dedicated dataset 462. If user identity authentication is successful, the scene module C is triggered to activate the initial user scene loading function, loads the initial related information stored in the frequently used settings record 461, and links to at least one of the scene database 42, the object database 43, the video / audio database 44, the image / document database 45, and the selective related dedicated dataset 462 to load the corresponding user scene C5.

[0058] When the authentication function is the loading of externally exclusive data, the Educational Metaverse Interaction Platform EMIP of the present invention is further coupled with an external platform 7. The external platform 7 has a corresponding external processing module 71 and an external user database 72. The external processing module 71 includes at least one processor and is coupled with the processing module 1. The external user database 72 is coupled with the external processing module 71 and includes an external authentication information set 720 and an externally exclusive dataset 721. Similar to the authentication information database 460 described above, the external authentication information set 720 stores authentication data for users to log in to the external platform 7, which in particular corresponds to the biometric information of individual users. In this arrangement, the external processing module 71, the authentication device 6, and the external user database 72 are coupled, and the user's biometric information is detected via the authentication device 6, and the external processing module 71 receives and determines whether the biometric information detected by the authentication device 6 matches the biometric information in the external authentication information set 720. If the external processing module 71 determines that a match exists (successful authentication of user identity), the external processing module 71 transmits a control command corresponding to the corresponding component or module to execute the corresponding function and transmits the external-only data of the corresponding user in the external-only dataset 721 to the user database 46 (particularly the related-only dataset 462) of the educational metaverse interaction platform EMIP for storage.

[0059] More specifically, Figure 7 is a schematic diagram showing the coupling and information-related relationships between each component / module, illustrating an example of how to implement the loading of external-only data. In the above example, the cooperative relationships between these components include the following: 1. Data-related requests are transmitted from the processing module 1 of the Educational Metaverse Interaction Platform EMP to the external processing module 71 of the external platform 7. 2. After receiving the data-related request, the external processing module 71 couples with the authentication device 6. More specifically, after receiving the data-related request, the external processing module 71 transmits the authentication request to the processing module 1, and after receiving the authentication request, the processing module 1 couples the authentication device 6 with the external processing module 71, enabling the user to perform identity authentication. Preferably, the processing module 1 transmits a presentation signal corresponding to the authentication request to the user's video projection device 2, presenting the user with the option to perform authentication using the authentication device 6. 3. The user detects their biometric information via the authentication device 6 (obtaining "detected authentication information") and transmits the biometric information to the external processing module 71. The external processing module 71 also receives the biometric information stored in the external authentication information set 720 (obtaining "verification authentication information") and determines via the external processing module 71 whether the detected authentication information and the verification authentication information match. 4. When the external processing module 71 determines that the detection authentication information and the matching authentication information match, the related dedicated dataset 462 receives and stores the corresponding user's external dedicated data (external dedicated character data or external dedicated object data) in the external dedicated dataset 721. It should be noted that, because the standards for character information or object information differ across different platforms, during the transmission of the external dedicated data from the external processing module 71 to the processing module 1, or from the processing module 1 to the related dedicated dataset 462, the external dedicated data is converted into converted dedicated data that conforms to an information format usable by the Educational Metaverse Interaction Platform EMIP via an information conversion protocol between the two platforms (the Educational Metaverse Interaction Platform EMIP and the external platform 7).

[0060] In actual applications (for illustrative purposes only and not limiting the present invention), the external platform 7 may be a specific game platform, and after fulfilling certain conditions on the specific game platform, a user may acquire a dedicated virtual object or virtual character (code, style), and through cooperation between components such as the educational metaverse interaction platform EMP, the authentication device 6, and the external platform 7, it may be possible to load and use a virtual object or virtual character from a platform other than the educational metaverse interaction platform EMP, which is exclusive to that user, into the educational metaverse interaction platform EMP.

[0061] The authentication information acquired by the authentication device 6 is preferably biometric information such as fingerprints or iris scans, achieving a highly exclusive effect of proving that the corresponding user is the genuine user. However, the authentication information is not limited to this and includes authentication methods in current and future technologies. For example, the authentication information can also be the user's facial features (facial recognition technology). The authentication information can also use an authentication code authentication mechanism. In actual application examples, for example, a mechanism similar to online transactions can be operated, and when a user requests payment (compatible with the acquisition of the external dedicated data) to a credit card system (compatible with the external platform 7), it can be triggered to request the user to transmit an authentication code (compatible with the detection of authentication information) via a mobile phone (compatible with the authentication device 6) to obtain authorization and payment from the credit card system. The authentication information can also be realized by inputting information such as the user's account and password.

[0062] Selectively, in various scenes of the Educational Metaverse Interaction Platform EMP of the present invention, administrative privileges corresponding to a specific user (hereinafter referred to as "Scene Administrator") can be granted, corresponding administrative functions can be executed in various scenes, and other users in the scenes (hereinafter referred to as "Managed Users") can be managed. The administrative functions include at least one of group association, location association, permission management, and state determination. The group association is used to specify groups among managed users, the location association is used to specify that managed users move to specific coordinates in the corresponding scene, the permission management controls the operability of specific abilities of managed users in the corresponding scene, and can particularly be a voice switch function, and the state determination makes a determination on the interest state of managed users, and can particularly be a function for determining the order of operations.

[0063] Regarding the aforementioned group associations: While group assignment is common in the learning process, some students find it relatively difficult to find group members for various reasons. To address this, a group association function can be provided to the scene administrator to facilitate the progress of the lesson. This group association function allows the scene administrator to adjust group associations and group managed users who have not selected a group using a specific method. This specific method can be random assignment, average assignment based on specific attributes, or extreme assignment based on specific attributes. These specific attributes can be one or more of the following: height, weight, academic performance, gender, and platform usage time, but are not limited to these. Among these, the extreme assignment method based on specific attributes allows for the selection of groups with relatively high attributes to participate in external competitions. In particular, if some managed users have already selected a group, the member composition of the already selected groups can be maintained, and managed users who have not selected a group can be added to one of the already selected groups. For example, in this situation, the scene administrator can execute the corresponding function by pressing a virtual button on its display interface, for example, named "One-Click Group Assignment."

[0064] Regarding the aforementioned positional association: During the learning process, if some managed users are allowed to act independently in the scenes they are responsible for, it could affect the learning concentration of other managed users. To address this, a location-based functionality can be added to the scene administrator to facilitate the progress of the lesson. The specific details of the aforementioned location-based functionality are as follows. 1. Associate a seat S that is not associated with the virtual character U of the managed user, and move the position of the virtual character U of the specified managed user to the associated seat S. For example, in this situation, the scene administrator can execute the corresponding function by pressing a virtual button, for example, named "Assign Seating" on its display interface. 2. You can selectively specify that all managed users be associated with their corresponding seats S. For example, in this scenario, the scene administrator can execute the corresponding function by pressing a virtual button, for example, named "One-Click Seating," on its display interface. 3. Selectively, if managed users are already grouped, it is possible to specify that, based on the grouping status, managed users should generate associations with corresponding seats S according to their group, and that seats S of managed users in the same group should be adjacent to each other. For example, in this situation, the scene administrator can execute the corresponding function by pressing a virtual button on its display interface, for example, named "Assign Seats by Group". 4. Selectively, the managed users associated with seat S through the above operation have their mobility in the classroom scene C2 temporarily suspended.

[0065] Regarding the voice switch in the aforementioned access control: During the learning process, if managed users are allowed to speak freely in scenes they are responsible for, it could affect their concentration during learning. To address this, voice switch control can be implemented for scene administrators to facilitate the progress of the lesson. The specific details of the voice switch control are as follows: 1. Specify whether to start or end the voice function corresponding to at least one managed user. If started, the managed user can make sounds in the scene; that is, the sounds are transmitted in the scene. If ended, the managed user cannot make sounds in the scene; that is, the sounds are muted in the scene. For example, in this situation, the scene administrator can execute the corresponding function by pressing virtual buttons on its display interface, for example, named "Specified Speech" (start voice function) and "Specified Speech Prohibition" (end voice function). 2. Selectively, you can specify whether to start or end the voice function for all managed users. For example, in this situation, the scene administrator can execute the corresponding function by pressing virtual buttons on its display interface, such as "One-Click Speak" (start voice function) and "One-Click Speak Prohibited" (end voice function).

[0066] Regarding the operation sequence determination during the state determination: In the learning process, for the purpose of the lesson, the scene administrator can determine whether a managed user will acquire specific privileges based on whether they are the first to complete a specific action, and then invite the managed user to participate. For example, in a buzzer quiz activity, the first person to raise their hand or press the buzzer bell will acquire the privilege to answer a specific topic. In particular, the corresponding audio function is turned off until a specific managed user acquires the privilege to answer. Especially in a buzzer quiz format where managed users raise their hands, it is often not easy to determine which managed user raised their hand first, so the scene administrator can be given a function to determine the order of actions to facilitate the progress of the lesson.

[0067] In the aforementioned operation sequence determination function, the scene administrator can press a virtual button, for example, named "Best Press," on its display interface. At this time, the completion time of each managed user's corresponding action is recorded and ordered, and the scene administrator can select the managed user who completed their corresponding action the fastest and have them answer the current agenda item. Selectively, based on demand, and in chronological order, managed users can be selected to answer the current agenda item. In particular, it allows later managed users to provide supplementary information, which is advantageous for improving speculative ability by accepting different perspectives during the learning process.

[0068] Taking a buzzer quiz as an example, the aforementioned "point in time when the corresponding action is completed" is defined as follows: 1. Let's take the buzzer quiz format, where quizzes are answered by raising hands, as an example: The aforementioned educational metaverse interaction platform EMP determines which managed users have raised their arms until they are fully extended, after the scene administrator has triggered the corresponding function, and records the corresponding completion time. 2. Let's take the buzzer quiz format as an example: The aforementioned educational metaverse interaction platform, EMP, records the moment each managed user's buzzer bell is pressed after the scene administrator triggers the corresponding function.

[0069] While the various management functions described above, performed by the scene administrator, are intended for user management, these management functions can also be adapted to manage various objects.

[0070] As shown in Figure 8, another preferred embodiment of the Educational Metaverse Interaction Platform EMIP of the present invention further includes a virtual-real integration system IS, which is coupled with the processing module 1 and can be coupled with any one of the image projection device 2, the physical operation device 3, the platform database 4, the platform module 5, and the authentication device 6, wherein the virtual-real integration system IS includes a physical module RM and a virtual module VM, and the virtual module VM is coupled with the physical module RM.

[0071] The physical module RM includes a physical device RD, a physical controller RC, a selective physical sensor RS, and a selective basic information BI. The physical device RD can be any device in the real world. The physical controller RC is coupled to the physical device RD and controls / drives the operation of the physical device RD. In particular, when only the physical controller RC and the physical device RD are present, the user can control the operation of the physical device RD by directly inputting corresponding information or performing corresponding operations to the physical controller RC in the real world. When a virtual controller VC, the physical controller RC, and the physical device RD are present, the user can generate corresponding operation input signals by directly operating or inputting to the virtual controller VC in the virtual scene, and the physical controller RC controls the operation of the physical device RD based on the operation input signals. The physical sensor RS can be provided in at least one of the physical controller RC, the physical device RD, and the real environment, and detects information of interest in the physical controller RC, the physical device RD, or the corresponding real environment. The basic information BI records demand information and / or limitation information in the actual environment in which the physical device RD is applied, the demand information being resource information required for the physical device RD to perform a single operation and which can be used to calculate the limit of the operable numerical value, and the limitation information being limitation information that must not be exceeded when the physical device RD performs an operation and which can be used to calculate the limit of the operable numerical value.

[0072] The virtual module VM is coupled with the physical module RM and includes a virtual controller VC and a selective virtual device VD. The virtual controller VC is coupled with the physical operating device 3, the physical controller RC, and the physical sensor RS. There is a specific relationship between the operation or input of the physical operating device 3 and the operation or input of the virtual controller VC, thereby generating a corresponding operation input signal. The physical controller RC receives the operation input signal and operates the physical device RD based on the operation input signal. Selectively, the processing module 1 or the physical controller RC is coupled with the physical sensor RS to obtain the information of interest of the physical controller RC, the physical device RD, or the actual environment. Preferably, the processing module 1 or the physical controller RC can further receive the basic information BI, calculate the limit value of the operable numerical value corresponding to the physical device RD via the relationship between the information of interest and the basic information BI, and use the user to input the corresponding operation input signal within the range of the limit value of the operable numerical value.

[0073] In particular, in some applications, the interest information and the operable numerical value of the physical device RD may have a conversion relationship in terms of numerical units, and the current state numerical value can be obtained by multiplying the interest information by the conversion relationship. If the processing module 1 determines that the current state numerical value satisfies the demand information or does not exceed the limit information, it calculates the limit value of the operable numerical value through the relationship between the current state numerical value and the demand information and / or the limit information, displays the information of the limit value of the operable numerical value on the operation interface of the virtual controller VC, and provides the user with the ability to input a corresponding operation input signal within the range of the limit value of the operable numerical value. Furthermore, if the processing module 1 determines that the current state numerical value converted by the interest information does not satisfy the demand information or exceeds the limit information, it stops the function for the user to input an operation input signal and preferably displays corresponding unoperable notification information on the operation interface, for example, displaying "Current resources do not meet the minimum demand resources and are not executable" or "Current numerical value exceeds the limit upper limit and is not executable."

[0074] Selectively, if the virtual controller VC cannot be coupled with the physical controller RC, the inoperability notification information may be "Online connection with the corresponding physical device is impossible." Selectively, if the physical device RD is damaged, the inoperability notification information may be "Physical device is damaged."

[0075] In particular, after the user inputs a corresponding operation input signal, the virtual controller VC controls the physical controller RC to control the operation of the physical device RD based on the operation input signal. The virtual controller VC calculates the difference between the corresponding numerical value in the operation input signal and the limit value of the operable numerical value, and updates the limit value of the operable numerical value based on the difference. For example, if the limit value of the operable numerical value is 100 units before the update and the corresponding numerical value in the operation input signal is 30 units, the updated limit value of the operable numerical value becomes 70 units. Selectively, if the difference is zero, the virtual controller VC displays an unoperable notification on the operation interface.

[0076] Selectively, the virtual device VD has a virtual appearance of the corresponding physical device RD. In particular, the virtual device VD is coupled with the object database 43 and loads the virtual appearance of the corresponding physical device RD from the object database 43. In this way, in the virtual scene generated by the video projection device 2, a virtual device VD similar to the physical device RD can be displayed, and the user can operate the real-world physical device RD and the virtual device VD in the virtual scene through their virtual character and input to the virtual controller VC.

[0077] In embodiment A of the virtual-real integrated application, virtual operations realize real operations and do not involve signals of interest and basic information (BI). In embodiment A, the virtual-real integrated system (IS) may include only a physical device (RD), a physical controller (RC), and a virtual controller (VC), and may optionally further include a virtual device (VD).

[0078] As an example corresponding to the above-described embodiment A, for example, when controlling the on / off state of a light, the virtual controller VC displays a simulated object of a light switch (defined as a virtual light switch), and when the user turns on the virtual light switch in the corresponding virtual scene via the physical operating device 3, the virtual controller VC transmits a corresponding operation input signal to the corresponding physical controller RC, and the physical controller RC controls the physical device RD, simulating the state in which electricity is flowing. For example, if the physical device RD is a light, the corresponding light will emit light.

[0079] Another example corresponding to the above-described embodiment A is an example in which the rotation of a power-generating object is simulated to provide power to a physical device RD in a real environment. In this example, the virtual controller VC is coupled to the physical operating device 3 and displays a corresponding virtual object, for example, a rotating wheel with a handle, in a corresponding scene. When the user operates the physical operating device 3 to simulate gripping and rotating the rotating wheel with a handle in the virtual scene, the virtual controller VC transmits a corresponding operation input signal to the corresponding physical controller RC, which controls the physical device RD via the physical controller RC, simulating that it is electrically powered and operating. For example, if the physical device RD is a light bulb, the corresponding light bulb will emit light.

[0080] If a corresponding virtual device VD is optionally further available, the virtual device VD displays the appearance of a light bulb, and when the virtual controller VC transmits a corresponding operation input signal, the virtual device VD of the light bulb is displayed as an illuminated image in the virtual scene.

[0081] In embodiment B of the virtual-real integrated application, virtual operations realize real-world operation, and virtual scenes fluctuate based on interest signals in the real environment. In embodiment B, the virtual-real integrated system IS may include a physical device RD, a physical controller RC, a physical sensor RS, and a virtual controller VC, and may optionally further include a virtual device VD.

[0082] Based on the description of embodiment A above, embodiment B adds the physical sensor RS. The physical sensor RS is used to detect whether or not the physical device RD is operating or its operating state and to generate corresponding information of interest. The processing module 1 or the virtual controller VC receives the information of interest and controls the video in the virtual scene to generate corresponding changes based on the information of interest. In particular, the virtual module further includes a virtual device VD, which generates corresponding changes in the video in the virtual scene based on the information of interest.

[0083] In an example simulating a light bulb switch, the corresponding physical sensor RS is a light sensor, and the information of interest is whether the lighting of the physical device RD is on or information about the light intensity, such that the brightness of the corresponding virtual scene and the information of interest have a positive correlation. In particular, if the virtual module VM further includes a virtual device VD that displays a light bulb, the virtual device VD displays in accordance with the lighting state of the physical device RD based on the information of interest.

[0084] In an example simulating vehicle driving, the virtual controller VC is coupled with the physical operating device 3 and displays corresponding virtual objects, such as a steering wheel, accelerator, and brakes, in a corresponding scene. The user can operate the physical operating device 3 to simulate the operation of the steering wheel, accelerator, and brakes in the virtual scene. The virtual controller VC transmits corresponding operation input signals to the corresponding physical controller RC, which controls the physical device RD, simulating operation upon receiving the corresponding operation input signals. For example, if the physical device RD is a vehicle, it can be an actual vehicle or a physical model vehicle, and the corresponding vehicle is operated. In particular, the physical model vehicle is similar to the concept of a radio-controlled car and is physically placed in the simulation field. The corresponding physical sensor RS is an image acquisition unit, and the information of interest is an image of at least one azimuthal viewing angle of the physical device RD, in particular the viewing angle in the direction of travel of the operated physical vehicle. The information of interest is displayed in real time in the corresponding virtual scene, displaying an image of the corresponding viewing angle in the direction of travel when simulating vehicle driving. More specifically, the interest information is transmitted to the processing module 1, which controls the video projection device 2 to display the interest information.

[0085] In embodiment C of the virtual-real integrated application, virtual operation realizes real operation, the virtual scene changes based on signals of interest in the real environment, and the physical operation device 3 generates corresponding operation based on other signals of interest in the real environment. More specifically, embodiment C has additional physical sensors RS compared to embodiment B described above, the additional physical sensors RS are used to detect other states of operation of the physical device RD and generate corresponding other information of interest, the processing module 1 or the virtual controller VC receives the other information of interest and controls the physical operation device 3 to generate corresponding operation based on the other information of interest. Based on the vehicle driving simulation example described above, the additional physical sensors RS are installed on the physical device RD and detect vibration signals during the corresponding vehicle's movement, the processing module 1 receives the vibration signals as signals of interest and controls the physical operation device 3 to generate corresponding vibrations. In particular, the physical operation device 3 has a corresponding vibration motor that generates corresponding vibrations.

[0086] In embodiment D of the virtual-real integrated application, user-generated input operation signals are limited to a range of the limit of the operable numerical value, the limit of the operable numerical value depends on the corresponding interest information and background information BI. More specifically, in embodiment D, the virtual-real integrated system IS may include a physical device RD, a physical controller RC, a physical sensor RS, background information BI, and a virtual controller VC, and may optionally further include a virtual device VD. The virtual controller VC is displayed as a display interface, which allows the user to input operation input signals within the range of the limit of the operable numerical value, based on the interest information detected by the physical sensor RS and the limit of the operable numerical value calculated by the background information BI.

[0087] Taking as an example a sub-configuration in which the limit value of the operable numerical value is calculated by a single interest information and a single basic information BI, for example in the application of plant irrigation, it can be applied in particular to plant / crop irrigation work, and the corresponding scene image can display a virtual environment image of the current true image of the corresponding plant. In the corresponding physical module RM, the corresponding physical device RD can be an irrigation device, such as a sprinkler, water truck, or other sprinkler device. The corresponding physical controller RC controls the operation of the physical device RD. The corresponding physical sensor RS is a soil moisture sensor that detects the current soil moisture (particularly volumetric water content) as interest information. The corresponding basic information BI is the water required by the plant, and is defined as the corresponding limit information by a numerical value of the preferred water or extreme water required in particular during the growth process of the target plant. In the corresponding virtual module VM, the corresponding virtual device VD displays the object image of the physical device RD in the virtual environment image, and the corresponding virtual controller VC is coupled with the physical controller RC.

[0088] Based on the above configuration, after the user triggers the virtual controller VC, the virtual controller VC displays either the limit value of the corresponding operable numerical value (calculated by subtracting the current numerical information converted by the interest information from the limit information, for example, the calculation result being the maximum amount of water that can be re-irrigated in the current state) or an inoperability notification. In particular, the inoperability notification can be "soil moisture upper limit has been reached". If the virtual controller VC displays the limit value of the operable numerical value, the user inputs a corresponding operation input signal within a range that does not exceed the limit value of the operable numerical value, and the virtual controller VC controls the physical controller RC, which controls the operation of the physical device RD. In this case, the virtual device VD can selectively generate a corresponding operation (watering) video. In particular, the limit value of the operable numerical value is calculated by subtracting the amount of water (current numerical information) converted by the current soil moisture (interest information) from the limit information, and the converted amount of water can be calculated using the soil volume and the current soil moisture.

[0089] Similarly, taking as an example a child embodiment in which the limit value of the operable numerical value is calculated by a single piece of interest information and a single piece of basic information BI, in an application example of air conditioner control, for example, an object image of a virtual device VD having the appearance of an air conditioner can be displayed in any scene image. In the corresponding physical module RM, the corresponding physical device RD can be a device that implements ambient temperature control, such as an air conditioner. The corresponding physical controller RC controls the operation of the physical device RD. The corresponding physical sensor RS can be used to detect the corresponding piece of interest information, which includes the current target temperature and / or ambient temperature of the physical device RD. In particular, the target temperature is the cooling temperature initially set when the air conditioner is started, the cooling temperature in the last operation, or the currently entered cooling temperature. The corresponding basic information BI includes the temperature range that the air conditioner can adjust. In the corresponding virtual module VM, the corresponding virtual device VD displays an object image of the physical device RD in the virtual environment image, and the corresponding virtual controller VC is coupled with the physical controller RC. Preferably, in addition to the temperature control described above, the user can select other functions of the physical controller RC (e.g., dehumidification or ventilation) in the virtual controller VC based on the coupling relationship between the corresponding virtual controller VC and the physical controller RC.

[0090] Based on the above configuration, after the user triggers the virtual controller VC, the virtual controller VC displays the current ambient temperature and various functions of the air conditioner (e.g., cooling, dehumidifying, or fan). After the user selects the cooling function, the virtual controller VC further displays the limit value of the corresponding operable value or information indicating that it is not operable. More specifically, the limit value of the operable value has an upper and lower operating limit. The upper operating limit is defined by subtracting the current target temperature from the upper limit of the temperature range in the basic information, and the lower operating limit is defined by subtracting the lower limit of the temperature range in the basic information from the current target temperature. For example, if the target temperature is 26°C (interest information) and the upper and lower limits of the temperature range that the air conditioner can adjust are 32°C and 16°C, respectively (limit information in basic information BI), then the upper operating limit of the corresponding operable value will be (increase) 6°C and the lower operating limit will be (decrease) 10°C. If the virtual controller VC displays the limit values ​​(upper and lower limits) of the operable numerical values, the user inputs a corresponding operation input signal within a range that does not exceed the limit values ​​of the operable numerical values, and the virtual controller VC controls the physical controller RC, thereby controlling the operation of the physical device RD. In this case, the virtual device VD can selectively generate corresponding operation (air conditioner operation) video.

[0091] Taking as an example a sub-mode in which the limit value of the operable numerical value is calculated by multiple pieces of interest information and multiple related basic information BIs, for example in a coffee brewing application example, an object image of a virtual device VD having the appearance of a coffee machine can be displayed in any scene image. In the corresponding physical module RM, the corresponding physical device RD can be a device that performs coffee brewing, such as a coffee machine. In particular, it can, but is not limited to, a device that brews complex coffee beverages (e.g., Americano, espresso, latte, cappuccino, macchiato, etc.). The corresponding physical controller RC controls the operation of the physical device RD. Multiple corresponding physical sensors RS can be used to detect their respective pieces of interest information, which include the amount of coffee beans, the amount of coffee grounds, and the amount of water in the water tank. In particular, for coffee machines that can brew complex coffee beverages, a corresponding physical sensor RS for detecting the amount of milk is further provided. The corresponding basic information BI includes the amount of coffee beans required for brewing various types of coffee (belonging to demand information), the threshold volume of coffee grounds (belonging to limit information), the volume of coffee grounds generated by brewing various types of coffee, and the amount of water required for brewing various types of coffee (belonging to demand information). In particular, for coffee machines capable of brewing complex coffee beverages, the corresponding basic information BI further includes the amount of milk required for various types of coffee (belonging to demand information). In the corresponding virtual module VM, the corresponding virtual device VD displays the object image of the physical device RD in the virtual environment image, and the corresponding virtual controller VC is coupled with the physical controller RC.

[0092] Based on the above configuration, after the user triggers the virtual controller VC, the virtual controller VC displays the limit value of the corresponding operable numerical value (calculated from each of the interest information and basic information BI, for example, the calculation result being the number of cups of coffee that can be brewed for various purposes) or an inoperability notification. In particular, the inoperability notification information can be "insufficient coffee beans," "full of coffee grounds," "insufficient water," or "insufficient milk." If the virtual controller VC displays the limit value of the operable numerical value, the user inputs the corresponding operation input signal within a range that does not exceed the limit value of the operable numerical value, and the virtual controller VC controls the physical controller RC, which controls the operation of the physical device RD. In this case, the virtual device VD can selectively generate the corresponding operation (coffee brewing) video.

[0093] In particular, the limit value of the operable numerical value is calculated considering the relationship between the following interest information and basic information BI. For example, taking the extraction of American coffee as an example, the first ratio (considering the extractable quantity of coffee beans) can be calculated by dividing the current coffee bean content (interest information) by the amount of coffee beans required to extract the corresponding coffee (demand information in basic information BI). If the current volume of coffee grounds (interest information) is smaller than the threshold volume of coffee grounds (limit information in basic information BI), the volume difference can be calculated by subtracting the current volume of coffee grounds from the threshold volume of coffee grounds, and then dividing the volume difference by the volume of coffee grounds produced by the extraction of the corresponding coffee (demand information in basic information BI) can be calculated to determine the extractable quantity of coffee grounds. The third ratio (considering the extractable quantity of water) can be calculated by dividing the current water volume in the water tank (interest information) by the amount of water required to extract the corresponding coffee (demand information in basic information BI). Furthermore, by taking the integer part of the smallest value from the first, second, and third ratios, it is possible to calculate the limit of the corresponding operable numerical value (i.e., the maximum number of cups of American coffee that can be brewed).

[0094] Selectively, considering the extraction of milk-based beverages, the fourth ratio (considering the extractable quantity of milk) can be calculated by dividing the current milk content (interest information) by the milk content required for the extraction of the corresponding coffee (demand information in basic information BI). Furthermore, by taking the integer part of the smallest value from the first to fourth ratios, the limit value of the corresponding operable numerical value (i.e., the maximum number of cups of milk-based coffee that can be extracted) can be calculated.

[0095] Furthermore, if any one of the above-mentioned ratios 1 through 4 is less than 1, it indicates that the corresponding resource is insufficient and the corresponding beverage cannot be produced. In this case, the corresponding error message from the "Insufficient Coffee Beans," "Full of Coffee Grounds," "Insufficient Water," or "Insufficient Milk" can be displayed on the operation interface.

[0096] Based on the relationships between the multiple pieces of interest information, the multiple basic information BIs, and the limit values ​​of the operable numerical values, it can be understood that the quantity of the physical sensors is multiple and corresponds to the detection of multiple pieces of interest information, the quantity of the basic information BIs is multiple, and multiple ratios are calculated from each piece of interest information and at least one corresponding basic information BI, each of which represents a limit value, the limit value of the operable numerical value is the minimum limit value of the range defined by the intersection of each of the limit values, and if the integer part of the minimum limit value is less than 1, the virtual controller displays an unoperable notification on the operation interface.

[0097] As described above, the educational metaverse interaction platform of the present invention can adjust the state of managed users by granting the scene administrator the management authority, and further facilitate various activities, especially educational activities. In addition, through the cooperation of the authentication device, the interaction platform, and external platforms, users can use dedicated objects acquired on other external platforms within this interaction platform, enabling the educational metaverse interaction platform not only to enable interaction by multiple users but also to realize interaction and data linkage with other external platforms. Furthermore, by placing at least one restricted area within the public area in the interface arrangement of the interaction scene, if a user needs to engage in more private interaction (expression of opinion or transmission of information), the user can directly enter the restricted area from the public area, enabling rapid switching between the corresponding functions of public and private interaction. In addition, by arranging a virtual-real integrated system, it is possible to realize that control performed in the virtual scene drives the operation of corresponding actual devices in the real world. Furthermore, the limit value of the operable numerical value of the physical device can be calculated based on the relationship between interest information and basic information. Furthermore, by calculating the difference between the corresponding numerical value in the operation input signal and the limit value of the operable numerical value, the virtual controller can update the limit value of the operable numerical value.

[0098] As described above, the educational metaverse interaction platform of the present invention can adjust the state of managed users by granting the scene administrator the management authority, and further facilitate various activities, especially educational activities. In addition, through the cooperation of the authentication device, the interaction platform, and external platforms, users can use dedicated objects acquired on other external platforms within this interaction platform, enabling the educational metaverse interaction platform not only to enable interaction by multiple users but also to realize interaction and data linkage with other external platforms. Furthermore, by placing at least one restricted area within the public area in the interface arrangement of the interaction scene, if a user needs to engage in more private interaction (expression of opinion or transmission of information), the user can directly enter the restricted area from the public area, enabling rapid switching between the corresponding functions of public and private interaction. In addition, by arranging a virtual-real integrated system, it is possible to realize that control performed in the virtual scene drives the operation of corresponding actual devices in the real world. Furthermore, the limit value of the operable numerical value of the physical device can be calculated based on the relationship between interest information and basic information. Furthermore, by calculating the difference between the corresponding numerical value in the operation input signal and the limit value of the operable numerical value, the virtual controller can update the limit value of the operable numerical value.

[0099] While the present invention has been disclosed with the above embodiments, they do not limit the invention. Those skilled in the art will recognize that various modifications to the above embodiments, as long as they do not deviate from the spirit and scope of the invention, will remain within the scope of protection. Accordingly, the scope of protection includes all modifications within the scope of the language set forth in the claims and equivalents described below. Furthermore, the present invention includes any combination of embodiments, provided that such combinations are possible. [Explanation of Symbols]

[0100] EMIP Educational Metaverse Interaction Platform 1. Processing Module 2. Video projection device 3 Physical operation device 4. Platform Database 41 Character Database 42 Scene Database 43 Object Databases 44 Video and Audio Databases 45 Image and Document Databases 46 User Databases 460 Authentication Information Database 461 Normal Settings Record 462 Related Dedicated Datasets 5 Platform Modules A Login Module B Character Module C Scene Module C1 Interaction Scene C10 Public Area C11 Restricted Area C2 Classroom Scene C3 Live Streaming Scene C4 Activity Scene C5 User Scene 6 Authentication device 7. External Platforms 71 External Processing Module 72 External User Database 720 External Authentication Information Set 721 External-only dataset BI Basic Information D1 Course content display area D2 Video content display area IS Virtual-Real Integrated System Px aisle P1 Interaction Scene Corridor P2 Classroom scene hallway P3 Live Streaming Scene Corridor P4 Activity Scene Corridor P5 User Scene Corridor RC physical controller RD physical device RM Physical Module RS physical sensor S seat T teacher U Virtual Character UD User Customization Area VC Virtual Controller VD Virtual Device VM Virtual Module

Claims

1. It is an educational metaverse interaction platform, A processing module including at least one processor, A video projection device coupled to the processing module, which receives control commands from the processing module and generates a corresponding video; A platform database coupled with the processing module, the platform database includes a character database, a scene database, and an object database, each providing character information, scene information, and object information, respectively, and is used by the video projection device to generate images of the corresponding virtual character, scene, and virtual object. A physical operating device coupled to the processing module for a user to input a corresponding command or action, wherein the processing module, after receiving the command or action, generates a corresponding control command to control the video projection device and brings about a change corresponding to at least one of the images of a corresponding virtual character, a scene, and a virtual object, In a scene video corresponding to scene information, one user is granted administrative privileges as the scene administrator, and other users are defined as managed users. The scene administrator, through the administrative privileges, performs at least one of the following actions with respect to the managed users: group association, location association, permission management, and state determination. The group association is used to specify groups among managed users; the location association is used to specify that managed users move to specific coordinates in the corresponding scene; permission management is used to control the operability of specific abilities of managed users in the corresponding scene; and state determination is used to determine the interest state of managed users. An educational metaverse interaction platform.

2. The educational metaverse interaction platform according to claim 1, wherein the scene administrator performs the group association and groups managed users who have not selected a group in a specific manner, the specific manner being random assignment, average assignment by specific attribute, or extreme assignment by specific attribute.

3. The educational metaverse interaction platform according to claim 2, wherein, if the managed users are already grouped, the scene administrator specifies that the managed users should be associated with corresponding seats according to their groups based on the grouping status, and the seats of managed users in the same group should be adjacent to each other.

4. The educational metaverse interaction platform according to claim 1, wherein the scene administrator performs the location association and specifies that at least one managed user be associated with a corresponding seat, and the location of the specified managed user is moved to the associated seat.

5. The educational metaverse interaction platform according to claim 1, wherein the scene administrator performs voice switch control in the access control, specifies the start or end of a voice function corresponding to at least one managed user, and when the control of the corresponding voice function is started, the voice emitted by the specified managed user is transmitted in the scene, and when the control of the corresponding voice function is ended, the voice emitted by the specified managed user is muted in the scene.

6. The educational metaverse interaction platform according to claim 1, wherein the scene manager performs an operation sequence determination in the state determination, and records and sequences the point in time when each managed user completes the corresponding operation.

7. The platform database further includes a user database for storing user-specific data, and the educational metaverse interaction platform further includes an authentication device for detecting individual user biometric information and an external platform. The aforementioned external platform is External processing module, Includes an external user database containing an external authentication information set and an external-only dataset, The external authentication information set is an external authentication information set that stores authentication data for a user to log in to the external platform, wherein the authentication data includes the biometric information of an individual user. The aforementioned external-only dataset includes external-only data for individual users, The Educational Metaverse Interaction Platform according to any one of claims 1 to 6, wherein the external processing module, the authentication device, the external user database, and the user database are coupled to each other, and when a user detects their biometric information via the authentication device, the external processing module receives the biometric information detected by the authentication device, determines whether it matches the biometric information in the external authentication information set, and if the external processing module determines that it matches, the external processing module transmits a corresponding control command and transmits the external-only data of the corresponding user in the external-only dataset to the user database in the Educational Metaverse Interaction Platform for storage.

8. An educational metaverse interaction platform according to any one of claims 1 to 6, further comprising a platform module, the platform module being coupled with the processing module, the platform module comprising a scene module, the scene module being coupled with the platform database to generate a corresponding scene image, the scene module comprising an interaction scene, the interface arrangement of the interaction scene defining a public area and a restricted area, the restricted area being located within the public area, the information transmitted by the user in the public area being made public when the user's virtual character is located in the public area, and the information transmitted by the user in the restricted area being limited to other users whose corresponding virtual characters are similarly located in the restricted area at the same time.

9. The virtual-real integration system further includes, the virtual-real integration system is coupled with the processing module, and the virtual-real integration system includes a physical module and a virtual module. The aforementioned physical module is Physical devices, which are devices in the real world, The physical device is coupled to a physical controller that controls the operation of the physical device, The virtual module is coupled with the physical module, Includes a virtual controller for the user to generate input operation signals in a virtual scene, The educational metaverse interaction platform according to any one of claims 1 to 6, wherein the physical controller receives the input operation signal and controls the physical device based on the input operation signal to generate a corresponding operation.

10. The educational metaverse interaction platform according to claim 9, wherein the physical module further includes a physical sensor and basic information, the physical sensor being provided in at least one of the physical controller, the physical device and the real environment and detecting information of interest in the physical controller, the physical device or the real environment, the basic information recording demand information and / or limit information in the real environment to which the physical device is applied, the demand information being resource information required for the physical device to perform a single operation, and the limit information being limit information that the physical device must not exceed when performing an operation, and the processing module or the virtual controller calculating a limit value of an operable numerical value corresponding to the physical device based on the relationship between the information of interest and the basic information, and enabling the user to input a corresponding operation input signal within the range of the limit value of the operable numerical value.

Images