Education game display method and device, storage medium and electronic equipment

By collecting and loading virtual environment elements, creating virtual game spaces and displaying them in augmented reality devices, the problem of insufficient interactivity of traditional educational games is solved, and more efficient educational interaction and learning effects are achieved.

CN119236388AInactive Publication Date: 2025-01-03GUANGZHOU SANQI DREAM NETWORK TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411312686.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-19
Publication Date
2025-01-03
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The interaction method of traditional educational games is single and the educational effect is limited. How to improve the interaction between users and educational games is an important issue.

Method used

By collecting the panoramic physical space environment images of the game user, loading pre-stored virtual environment elements, creating virtual game space, and displaying game screens in augmented reality devices, enhancing the user's interaction with the game.

Benefits of technology

It improves the interactivity and educational effect of educational games, enables users to interact more immersively with the game in the panoramic virtual space, and enhances the learning experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119236388A_ABST
    Figure CN119236388A_ABST
Patent Text Reader

Abstract

The invention discloses an educational game display method and device, a storage medium and electronic equipment, and the method comprises the steps: responding to a starting operation of a game user, collecting an environment image corresponding to a physical space of a panorama where the game user is located, loading each pre-stored virtual environment element in a virtual physical space according to the environment image, and displaying the virtual environment elements in the virtual physical space. And obtaining a virtual game space of the educational game. And determining a first pose of the current augmented reality device in the virtual game space, and displaying a game picture corresponding to the first pose in the augmented reality device based on the virtual game space. The virtual game space is obtained by loading each virtual environment element in the panoramic virtual physical space, and the virtual game space is displayed through the augmented reality device, so that a game user interacts with an educational game, the interactivity is improved, and a better educational effect is brought.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present specification relates to the field of computer technology, and in particular to a display method, device, storage medium and electronic device for an educational game. Background Art

[0002] With the continuous development of science and technology, the means of implementing education are becoming more and more diverse, especially through educational games, which allow users to learn knowledge.

[0003] At present, in traditional educational games, users usually interact with educational games through screens such as mobile phones and computers. This interactive method is single and has limited educational effects. Therefore, how to display educational games to improve interactivity with users is a very important issue.

[0004] Based on this, this specification provides a method for displaying an educational game. Summary of the invention

[0005] This specification provides a display method, device, storage medium and electronic device for educational games to partially solve the above-mentioned problems existing in the prior art.

[0006] This manual adopts the following technical solutions:

[0007] This specification provides a method for displaying an educational game, comprising:

[0008] In response to a start-up operation by a game user, an environment image corresponding to the panoramic physical space where the game user is located is collected; the environment image is used to display the panoramic virtual physical space corresponding to the physical space;

[0009] According to the environment image, various virtual environment elements stored in advance are loaded into the virtual physical space to obtain a virtual game space of the educational game;

[0010] Determine a first posture of the current augmented reality device in the virtual game space, and based on the virtual game space, display a game screen corresponding to the first posture in the augmented reality device.

[0011] Optionally, according to the environment image, various virtual environment elements pre-stored in the virtual physical space are loaded to obtain a virtual game space of the educational game, specifically including:

[0012] Recognize the environment image to determine each real environment element in the virtual physical space;

[0013] Determining a matching relationship between each pre-stored virtual environment element and each real environment element;

[0014] According to the matching relationship, the virtual environment elements are loaded into the virtual physical space to obtain a virtual game space for the educational game.

[0015] Optionally, according to the environment image, various virtual environment elements pre-stored in the virtual physical space are loaded to obtain a virtual game space of the educational game, specifically including:

[0016] Loading pre-stored environment selection buttons in the virtual physical space to obtain a first space for the educational game;

[0017] Determine a second posture of the current augmented reality device in the first space, and based on the first space, display an initial screen corresponding to the second posture in the augmented reality device;

[0018] In response to a first click operation by the game user, determining an environment corresponding to an environment selection button clicked by the game user and using it as a target environment;

[0019] Determining each virtual environment element corresponding to the target environment stored in advance;

[0020] The environment selection buttons in the first space are deleted, and the virtual environment elements are loaded in the deleted first space according to the environment image to obtain a virtual game space.

[0021] Optionally, according to the environment image, various virtual environment elements pre-stored in the virtual physical space are loaded to obtain a virtual game space of the educational game, specifically including:

[0022] Determining the positions and postures of other users except the game user in the virtual physical space, and determining the role parameters preset by the other users;

[0023] Generate a virtual user character according to the character parameters and the position and posture, and load the virtual user character into the virtual physical space to obtain a second space;

[0024] According to the environment image, various virtual environment elements stored in advance are loaded into the second space to obtain a virtual game space of the educational game.

[0025] Optionally, the method comprises:

[0026] In response to a second click operation by the game user, determining the virtual environment element clicked by the game user and using it as the first element;

[0027] Determining a game task corresponding to the first element, and loading the task element corresponding to the game task into the virtual game space to obtain a third space;

[0028] Based on the third space, in the augmented reality device, a game screen corresponding to the first posture is updated.

[0029] Optionally, the method further comprises:

[0030] When the game task is a multi-player task, other users within the preset range of the game user are determined and used as target users; the multi-player task is a task in which several users participate;

[0031] Sending a task execution request to the target user;

[0032] When receiving the first reply message returned by the target user, merging the third space of the game user and the third space of the target user;

[0033] Based on the fused third space, in the augmented reality device, a game screen corresponding to the first posture is updated.

[0034] Optionally, the method further comprises:

[0035] When the educational game display ends, determining the game data corresponding to the game user;

[0036] Acquire feedback information corresponding to the game users, and optimize the educational game according to the game data and the feedback information.

[0037] This specification provides a display device for educational games, comprising:

[0038] A collection module, configured to collect an environment image corresponding to the panoramic physical space where the game user is located in response to a start-up operation of the game user; the environment image is used to display the panoramic virtual physical space corresponding to the physical space;

[0039] A loading module, used for loading various virtual environment elements stored in advance in the virtual physical space according to the environment image, so as to obtain a virtual game space of the educational game;

[0040] The display module is used to determine the first posture of the current augmented reality device in the virtual game space, and based on the virtual game space, display the game screen corresponding to the first posture in the augmented reality device.

[0041] This specification provides a computer-readable storage medium, wherein the storage medium stores a computer program, and when the computer program is executed by a processor, the display method of the educational game is implemented.

[0042] This specification provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned educational game display method when executing the program.

[0043] At least one of the above technical solutions adopted in this specification can achieve the following beneficial effects:

[0044] The display method of the educational game provided in this specification responds to the start-up operation of the game user, collects the environment image corresponding to the panoramic physical space where the game user is located, and then loads the pre-stored virtual environment elements in the virtual physical space according to the environment image to obtain the virtual game space of the educational game. Determine the first position of the current augmented reality device in the virtual game space, and based on the virtual game space, display the game screen corresponding to the first position in the augmented reality device.

[0045] It can be seen from the above method that when displaying an educational game, the present application first responds to the game user's startup operation, collects the environment image corresponding to the panoramic physical space where the game user is located, and then loads the pre-stored virtual environment elements in the virtual physical space according to the environment image to obtain the virtual game space of the educational game. Determine the first position of the current augmented reality device in the virtual game space, and based on the virtual game space, display the game screen corresponding to the first position in the augmented reality device. By loading each virtual environment element in the panoramic virtual physical space, a virtual game space is obtained, and the virtual game space is displayed through the augmented reality device, so that the game user can interact with the educational game, which improves interactivity and brings better educational effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The drawings described herein are used to provide a further understanding of this specification and constitute a part of this specification. The illustrative embodiments and descriptions of this specification are used to explain this specification and do not constitute an improper limitation on this specification. In the drawings:

[0047] Figure 1 A schematic diagram of a flow chart of a method for displaying an educational game provided in this specification;

[0048] Figure 2 A schematic diagram of a startup page of an educational game provided in this specification;

[0049] Figure 3 A schematic diagram of a virtual physical space provided in this specification;

[0050] Figure 4 A schematic diagram of loading a virtual environment element provided in this specification;

[0051] Figure 5A schematic diagram showing a game screen provided in this specification;

[0052] Figure 6 A schematic diagram of an initial screen provided in this manual;

[0053] Figure 7 A schematic diagram of a combination element provided in this specification;

[0054] Figure 8 A schematic diagram of spatial fusion provided in this specification;

[0055] Fig. 9 A schematic diagram of another fusion space provided in this specification;

[0056] Fig.10 A schematic diagram of a display device for an educational game provided in this specification;

[0057] Fig.11 A method corresponding to the Figure 1 Schematic diagram of the structure of an electronic device. DETAILED DESCRIPTION

[0058] In order to make the purpose, technical solutions and advantages of this specification more clear, the technical solutions of this specification will be clearly and completely described below in combination with the specific embodiments of this specification and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of this specification, not all of them. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this specification.

[0059] The technical solutions provided by the embodiments of this specification are described in detail below in conjunction with the accompanying drawings.

[0060] Figure 1 This is a flow chart of a method for displaying an educational game provided in this specification, comprising the following steps:

[0061] S100: In response to a start-up operation by a game user, an environment image corresponding to a panoramic physical space where the game user is located is collected; the environment image is used to display a panoramic virtual physical space corresponding to the physical space.

[0062] In this specification, the device for displaying educational games can respond to the game user's start-up operation and collect the environment image corresponding to the panoramic physical space where the game user is located. Among them, the device for displaying educational games can be a system, a server, or an augmented reality (AR) device, a server or system of an augmented reality device, and of course, it can also be an electronic device such as a desktop computer or a laptop computer. For the sake of ease of description, the following only takes the server as the execution subject to explain the display method of the educational game provided in this specification.

[0063] In this specification, the server may collect an environmental image corresponding to the panoramic physical space where the game user is located in response to a startup operation by a game user. The physical space is the real space where the game user is located, and the physical space may be a real space such as a room, place, or area where the user is located. The environmental image is an image corresponding to the panoramic physical space where the game user is located, and the environmental image is used to display the panoramic virtual physical space corresponding to the physical space. The virtual physical space is a virtual panoramic physical space, and the virtual physical space may be a three-dimensional space corresponding to the panoramic physical space. Specifically, the server may perform three-dimensional reconstruction based on the environmental image to obtain the virtual physical space. Specifically, any existing three-dimensional reconstruction method may be used to obtain the virtual physical space, and this specification does not make specific limitations. The virtual physical space is exactly the same as the physical space, and the virtual physical space has the same shape, size, and objects contained as the physical space.

[0064] It should be noted that both the space for collection and the space displayed by the collected environmental images are panoramic spaces, rather than partial spaces or a certain area in the space. That is, the space for collection mentioned above is a panoramic physical space, the obtained environmental image is an image corresponding to the panoramic physical space, and the space displayed by the collected environmental images is a panoramic virtual physical space corresponding to the panoramic physical space.

[0065] In this specification, the server can respond to the game user's startup operation, and use the image acquisition device deployed in the augmented reality device to capture the panoramic physical space of the game user, and obtain the environmental image corresponding to the panoramic physical space. Among them, the augmented reality device can be an electronic device such as a mobile phone, a computer, a tablet, or a wearable AR glasses and other devices, which is not specifically limited in this specification. Game users can hold electronic devices such as mobile phones, computers, tablets, or wearable AR glasses and other devices. The image acquisition device can be an image acquisition device such as a video camera or a still camera, which is not specifically limited in this specification. Specifically, taking the augmented reality device as a mobile phone as an example, Figure 2 As shown, Figure 2 is a schematic diagram of a startup page of an educational game provided in this specification, Figure 2The "Start" button in the game is the start button of the educational game. Assuming that the educational game is "History Explorer", the educational game is used to guide game users to explore historical events and historical figures, so as to popularize the figures and events of various historical periods to game users. When the educational game starts, the game player can start the educational game through the mobile phone. Specifically, the game user can click the "Start" button to start the educational game. When the game user clicks the "Start" button, the server can respond to the game user's start operation and collect the environmental image corresponding to the panoramic physical space where the game user is located through the camera of the mobile phone.

[0066] S102: According to the environment image, various virtual environment elements stored in advance are loaded into the virtual physical space to obtain a virtual game space of the educational game.

[0067] In this specification, the server can load various pre-stored virtual environment elements in the virtual physical space according to the environment image to obtain the virtual game space of the educational game. Among them, the virtual environment elements are pre-stored by the server, and the virtual environment elements are pre-set three-dimensional models. The virtual environment elements may include virtual characters and virtual objects. The virtual characters may be various types of characters required for the educational game, and the virtual objects may be various types of objects required for the educational game. Different educational games have different virtual characters and virtual objects. Specifically, taking the educational game as a historical explorer, and taking the educational game as an example for guiding game users to explore the ancient Egyptian civilization, the above-mentioned virtual characters may be Egyptian pharaohs, priests or craftsmen, etc., and the above-mentioned virtual objects may be ancient Egyptian landmark buildings and cultural relics such as pyramids and sphinxes.

[0068] Specifically, the server can identify the environmental image and determine the various real environmental elements in the virtual physical space. Then, in the virtual physical space, except for the space where the various real environmental elements are located, the pre-stored virtual environmental elements are loaded to obtain the virtual game space of the educational game. Among them, the real environmental element is a three-dimensional model corresponding to all entities included in the virtual physical space. At the same time, the real environmental element is also a three-dimensional model corresponding to all entities included in the physical space. The entity may include various types of objects in the virtual physical space or the physical space. The object may include tables, chairs, wardrobes, air conditioners, flower pots and other types of objects, which are not specifically limited in this specification. Specifically, the virtual physical space can be as follows: Figure 3 As shown, Figure 3 is a schematic diagram of a virtual physical space provided in this specification, Figure 3 The virtual physical space shown is a top view. It should be noted that Figure 3 This is only an example of a virtual physical space, which may include three-dimensional models corresponding to entities such as walls, doors, wardrobes, plants A to C, sofas, tables, stools and bookshelves.

[0069] In this specification, when the above-mentioned spaces other than the spaces where the real environment elements are located in the virtual physical space are loaded with pre-stored virtual environment elements to obtain the virtual game space of the educational game, the server can randomly load the pre-stored virtual environment elements in the spaces other than the spaces where the real environment elements are located in the virtual physical space to obtain the virtual game space of the educational game.

[0070] Of course, the server can also determine other spaces in the virtual physical space except the space where each real environment element is located, divide the other spaces, and obtain a preset number of subspaces. For each virtual environment element, determine the subspace corresponding to the virtual environment element in each subspace, and load the virtual environment element in the determined subspace. The preset number is not less than the number of virtual environment elements, and the preset number can be preset by the server. The volume of each subspace (that is, the size of each subspace) can be the same or different, and this specification does not make specific restrictions. It should be noted that there is at least one subspace that can accommodate the virtual environment element with the largest volume.

[0071] When determining the subspace corresponding to the virtual environment element in each subspace, the server may determine a subspace whose volume is not less than the volume corresponding to the virtual environment element from each subspace, and use it as a candidate subspace, and then randomly determine the subspace corresponding to the virtual environment element from the candidate subspace. In addition, the server may also determine the difference between the volume of each subspace and the volume corresponding to the virtual environment element. The subspace with the smallest difference is determined and used as the subspace corresponding to the virtual environment element. The difference may be a volume difference.

[0072] In the present specification, the process of randomly loading pre-stored virtual environment elements in other spaces in the virtual physical space except the space where the real environment elements are located to obtain the virtual game space of the educational game is similar to the process of loading the virtual environment elements in the determined subspace. Specifically, taking the process of loading the virtual environment elements in the determined subspace as an example, the server may use the position of the determined subspace in the virtual physical space as the first placement position, and place the virtual environment element in the first placement position to load the virtual environment element in the determined subspace.

[0073] For example, based on Figure 3 ,like Figure 4 As shown, Figure 4 A schematic diagram of loading virtual environment elements provided in this specification, Figure 4It includes sub-graph a and sub-graph b, both of which are top views of virtual physical space, sub-graph a is a top view of virtual physical space before virtual environment elements (i.e., 3D model O in sub-graph b) are placed, and both sub-graph a and sub-graph b include 3D models corresponding to entities such as walls, doors, wardrobes, plants A-C, sofas, tables, stools, and bookshelves, and sub-graph a also includes sub-spaces 1-9, i.e., areas marked as 1-9 in sub-graph a. Assuming that the virtual reality element is a 3D model corresponding to a square stool, i.e., 3D model O in sub-graph b, and the first placement position is sub-space 3, the server can place 3D model O in sub-space 3, as shown in sub-graph b.

[0074] In this specification, the server can also identify the environment image, determine each real environment element in the virtual physical space, and then determine the matching relationship between each pre-stored virtual environment element and each real environment element. According to the matching relationship, each virtual environment element is loaded in the virtual physical space to obtain a virtual game space for the educational game.

[0075] The above matching relationship may be preset by the server, that is, the server presets the corresponding relationship between each type of real environment element and each type of virtual environment element. Specifically, take the real environment elements as the first table and the first wardrobe, and the virtual environment elements as the second table and the second wardrobe as an example, wherein the first table and the first wardrobe are tables and wardrobes of any style in reality, and the second table is an Egyptian-style table, and the second wardrobe is an Egyptian-style wardrobe. The server may predetermine that there is a corresponding relationship between the first table and the second table, and there is a corresponding relationship between the first wardrobe and the second wardrobe. In addition, the above matching relationship may also be randomly determined by the server. Specifically, when determining the matching relationship between each pre-stored virtual environment element and each real environment element, the server may randomly determine a real environment element from each real environment element for each virtual environment element, and use it as the first environment element to determine that the virtual environment element has a matching relationship with the first environment element.

[0076] In this specification, when the environment image is recognized and each real environment element in the virtual physical space is determined, the server may use a pre-set recognition algorithm or a pre-trained recognition model to determine each entity included in the environment image, and then determine the three-dimensional model corresponding to each entity in the virtual physical space, and use it as each real environment element. Among them, the recognition algorithm may be pre-set by the server, or any existing recognition algorithm, which is not specifically limited in this specification. The recognition algorithm is used to recognize the environment image to determine each entity included in the environment image. Similarly, the recognition model may also be a model pre-trained by the server, or any existing recognition model, which is not specifically limited in this specification. The recognition model is used to recognize the environment image to determine each entity included in the environment image, and each entity may be various types of objects included in the environment image, which may include objects of the type of table, chair, wardrobe, air conditioner, flower pot, etc., which is not specifically limited in this specification. The training sample for training the recognition model may be an image sample, and the annotation corresponding to the training sample may be each entity included in the image sample, and the annotation may be manually pre-marked. The specific process of training the recognition model is similar to the training process of supervised learning and will not be repeated here.

[0077] In this specification, when determining the matching relationship between each pre-stored virtual environment element and each real environment element, the server may use a pre-set matching algorithm or a pre-trained matching model to determine the matching relationship between each pre-stored virtual environment element and each real environment element. Among them, the above matching algorithm may be pre-set by the server, or it may be any existing matching algorithm, which is not specifically limited in this specification. The matching algorithm can be used to match each virtual environment element with each real environment element. The above matching model may be pre-trained by the server, or it may be any existing matching model, which is not specifically limited in this specification. The matching model is used to match each virtual environment element with each real environment element. The training samples for training the matching model may be each virtual three-dimensional model and each real three-dimensional model, and the annotations corresponding to the training samples may be the corresponding relationship (i.e., matching relationship) between each virtual three-dimensional model and each real three-dimensional model, and the annotations may be manually pre-marked. The specific process of training the matching model is similar to the training process of supervised learning, and will not be repeated here.

[0078] In addition, the server may also determine the similarity between each virtual environment element and each real environment element for each virtual environment element. Determine the maximum similarity among the similarities, and determine that there is a matching relationship between the virtual environment element and the real environment element corresponding to the maximum similarity. Among them, when the similarity between a virtual environment element and a real environment element is the greatest, it means that the virtual environment element is most similar to the real environment element, and the server may determine that there is a matching relationship between the virtual environment element and the real environment element.

[0079] For example, assuming that the real environment elements are the three-dimensional models corresponding to the table, stool, etc., and the virtual environment elements are the three-dimensional models corresponding to the ancient Egyptian triangular table, square stool, etc., for each virtual environment element, assuming that the three-dimensional model corresponding to the square stool is determined, the similarity between the three-dimensional model corresponding to the square stool and each real environment element is determined. The maximum similarity among the similarities is determined. Obviously, the three-dimensional model corresponding to the square stool is more similar to the three-dimensional model corresponding to the stool, so it is determined that there is a matching relationship between the three-dimensional model corresponding to the square stool and the three-dimensional model corresponding to the stool.

[0080] When determining the similarity between the virtual environment element and each real environment element as described above, the server may use any existing similarity calculation method to calculate the similarity between the virtual environment element and each real environment element. The similarity calculation method may be to calculate the feature similarity between the virtual environment element and the real environment element. Of course, it may also be any other existing means, which is not specifically limited in this specification. Specifically, taking the calculation of feature similarity as an example, the server may determine the first feature corresponding to the virtual environment element, and then determine the second feature corresponding to each real environment element. Then, the similarity between the first feature and each second feature is determined, and used as the similarity between the virtual environment element and each real environment element. The similarity may be the Euclidean distance or the cosine distance between the features, which is not specifically limited in this specification.

[0081] In this specification, when the virtual environment elements are loaded in the virtual physical space according to the matching relationship to obtain the virtual game space of the educational game, the server can determine the real environment element that has a matching relationship with the virtual environment element for each virtual environment element, and use it as the target environment element. The target environment element is merged with the virtual environment element to obtain a merged environment element, and the merged environment element directly replaces the real environment element in the virtual physical space. Among them, when the target environment element is merged with the virtual environment element, a model that is different from the target environment element is determined from the virtual environment element and used as the first model. If the volume of the first model is not less than the preset threshold, the server can add the first model to the target environment element to obtain the merged environment element. If the volume of the first model is less than the preset threshold, the server can directly use the virtual environment element as the merged environment element. The first model is a partial model included in the virtual environment element and a partial model not included in the target environment element. The preset threshold is a preset volume.

[0082] In addition, when merging the target environment elements with the virtual environment elements, the server may also use a pre-set fusion technology to merge the target environment elements with the virtual environment elements. The fusion technology may be any existing three-dimensional model fusion technology, and the fusion technology may be Boolean operations, grid fusion, and deep learning methods, which are not specifically limited in this specification.

[0083] In this specification, if there are virtual environment elements that do not match the real environment elements, the server can load the virtual environment elements in other spaces in the virtual physical space except the spaces where the real environment elements are located. The specific process is similar to the above-mentioned process of loading pre-stored virtual environment elements in other spaces in the virtual physical space except the spaces where the real environment elements are located, and will not be repeated here.

[0084] S104: Determine a first posture of the current augmented reality device in the virtual game space, and based on the virtual game space, display a game screen corresponding to the first posture in the augmented reality device.

[0085] In this specification, the server can determine the first position of the current augmented reality device in the virtual game space, and based on the virtual game space, display the game screen corresponding to the first position in the augmented reality device. The first position is the first position and the first position of the current augmented reality device in the virtual game space. The first position can be the first position angle or the first viewing angle of the current augmented reality device in the virtual game space. The first position can be used as the current game user's position.

[0086] Specifically, the server may first determine the first position of the current augmented reality device in the virtual game space, and determine the field of view corresponding to the current augmented reality device based on the first position. In the virtual game space, the space within the field of view is determined, and based on the determined space, a game screen corresponding to the first position is generated, and displayed through the augmented reality device. Among them, the field of view is all the space that can be seen at the first position and from the first perspective. When the game screen corresponding to the first position is generated based on the determined space, the server may project the determined space to obtain the projected image, and use it as the game screen corresponding to the first position.

[0087] Specifically, the process of displaying the game screen can be as follows: Figure 5 As shown, Figure 5 is a schematic diagram showing a game screen provided in this specification. Figure 5The space D in the figure is the virtual game space, and the mobile phone X is the augmented reality device. The server can first determine the first position of the current mobile phone X in the space D, and determine the field of view corresponding to the current mobile phone X according to the first position. In the space D, the space within the field of view is determined, and based on the determined space, the game screen corresponding to the first position is generated, that is, the screen S composed of points E, F, G, and H is the game screen.

[0088] It can be seen from the above method that when displaying an educational game, the server of this application can first respond to the game user's startup operation, collect the environment image corresponding to the panoramic physical space where the game user is located, and then load the pre-stored virtual environment elements in the virtual physical space according to the environment image to obtain the virtual game space of the educational game. Determine the first position of the current augmented reality device in the virtual game space, and based on the virtual game space, display the game screen corresponding to the first position in the augmented reality device. By loading each virtual environment element in the panoramic virtual physical space, a virtual game space is obtained, and the virtual game space is displayed through the augmented reality device, so that the game user can interact with the educational game, the interactivity is improved, and a better educational effect is brought.

[0089] In this specification, after starting the educational game, the game user can select a historical period to explore, and according to the historical period selected by the game user, load the virtual environment elements corresponding to the historical period. Specifically, in the above step S102, the server can first load the pre-stored environment selection buttons in the virtual physical space to obtain the first space of the educational game. Then determine the second posture of the current augmented reality device in the first space, and based on the first space, display the initial screen corresponding to the second posture in the augmented reality device. Then, in response to the first click operation of the game user, determine the environment corresponding to the environment selection button clicked by the game user, and use it as the target environment. Determine the virtual environment elements corresponding to the pre-stored target environment. Delete the environment selection buttons in the first space, and load the virtual environment elements in the deleted first space according to the environment image to obtain the virtual game space.

[0090] Among them, the first click operation is used to represent that the game user clicks the environment selection button. The above-mentioned environment selection button can be pre-stored by the server, and the environment selection button represents the game environment. The environment selection buttons represent the pre-set historical periods (i.e., environments), and each historical period has corresponding virtual environment elements. The historical period can be the period of the four ancient civilizations such as ancient Egypt and ancient India. Of course, the historical period can also be other historical periods, and this specification does not make specific restrictions. The above-mentioned process of loading the pre-stored environment selection buttons in the virtual physical space to obtain the first space of the educational game is similar to the process of loading the pre-stored virtual environment elements in the virtual physical space according to the environment image in the above-mentioned step S102 to obtain the virtual game space of the educational game, and will not be repeated here.

[0091] The process of determining the second position of the current augmented reality device in the first space and displaying the initial screen corresponding to the second position in the augmented reality device based on the first space is similar to the process described in step S104 above, and will not be repeated here. The second position includes a second position and a second posture, the second position is the position of the current augmented reality device in the first space, and the second posture is the posture of the augmented reality device in the first space. The initial screen can be as shown in FIG. Figure 6 As shown, Figure 6 is a schematic diagram of an initial screen provided in this manual, Figure 6 Only the environment selection buttons corresponding to the three historical periods of "Historical Explorer" are shown, namely Figure 6 The buttons marked as "Ancient Egypt", "Ancient India" and "Ancient Babylon" in the image are shown in the figure. It should be noted that in addition to the environment selection buttons, the initial screen can also display other elements in the first space. Figure 6 This is just an example of the initial screen, and Figure 6 Only the initial screen including only the environment selection button is shown. Figure 6 It also shows that the game user clicks a button labeled "Ancient Egypt", that is, the game user selects the historical period of Ancient Egypt.

[0092] Each of the above-mentioned environment selection buttons has a corresponding historical period (i.e., environment), and each historical period (i.e., environment) has corresponding virtual environment elements. The server can determine the target environment (i.e., the historical period corresponding to the environment selection button selected by the game user) according to the environment selection button selected by the game user, and then load the virtual environment elements corresponding to the target environment. When loading the virtual environment elements corresponding to the target environment later, it is necessary to first delete the environment selection buttons in the first space, and load the virtual environment elements in the deleted first space according to the environment image to obtain the virtual game space. The specific process is similar to the process of loading the pre-stored virtual environment elements in the virtual physical space according to the environment image in the above-mentioned step S102 to obtain the virtual game space of the educational game, and will not be repeated here.

[0093] In the present specification, the above-mentioned virtual environment elements may be combination elements, and the combination element may be composed of at least two virtual environment sub-elements, that is, each of the above-mentioned virtual environment elements may have at least one virtual environment element as a combination element, and the combination element may include at least two virtual environment sub-elements. As for which virtual environment element or elements are the combination element, and which virtual environment sub-elements the combination element specifically includes, they are all pre-set and stored by the server. It should be noted that the combination element may be composed of at least two virtual environment sub-elements, and the combination of the at least two virtual environment sub-elements may be splicing, that is, splicing at least two virtual environment sub-elements. In addition, at least one virtual environment sub-element may be loaded into other environment sub-elements to obtain a combination element, and the at least one virtual environment sub-element is a built-in virtual environment sub-element, and the other environment sub-element is an external virtual environment sub-element. Specifically, taking the virtual character of the Egyptian Pharaoh and the virtual object of the ancient Egyptian cabinet as an example, the Egyptian Pharaoh can be placed inside the ancient Egyptian cabinet to obtain a combination element. The combination element includes a built-in Egyptian Pharaoh and an external ancient Egyptian cabinet. Specifically, Figure 7 As shown, Figure 7 It is a schematic diagram of a combination element provided in this specification, wherein the combination element includes an Egyptian pharaoh and an ancient Egyptian cabinet, wherein the Egyptian pharaoh is placed inside the ancient Egyptian cabinet.

[0094] Based on this, since there is a combination element, and the combination element is obtained by inserting at least one virtual environment sub-element into other environment sub-elements, when the game user clicks on the combination element, the display animation corresponding to the combination element will be triggered. The display animation is to open the external virtual environment sub-element (that is, the other environment sub-element), and then remove the built-in virtual environment sub-element (that is, the at least one virtual environment sub-element) from the external virtual environment sub-element and display it. Figure 7For example, the display animation may be opening an ancient Egyptian cabinet, and an Egyptian pharaoh in the ancient Egyptian cabinet walks out of the ancient Egyptian cabinet.

[0095] In this specification, the game user can move in the virtual game space. As the game user moves in the virtual game space, the screen displayed by the augmented reality device is also updated accordingly. However, all three-dimensional models in the virtual game space, whether real environment elements or virtual environment elements, are fixed in the virtual game space, and the positions of the two have not changed. It is just that when the game user moves, since all three-dimensional models in the virtual game space are fixed, when viewing all three-dimensional models in the virtual game space with different positions, the three-dimensional models displayed in the game screen corresponding to different positions will be different, that is, the three-dimensional models at different angles are displayed. Based on this, during the movement of the game user, the server needs to determine the real-time position of the current augmented reality device in the virtual game space in real time, and based on the virtual game space, display the game screen corresponding to the real-time position in real time in the augmented reality device. The specific process is similar to the process described in step S104 above, and will not be repeated here.

[0096] In this specification, in addition to the game user, there are other users in the above-mentioned physical space, so the above-mentioned virtual physical space also includes virtual user characters corresponding to other users, that is, player characters. The virtual user characters are generated according to the character parameters pre-set by other users. Specifically, in the above-mentioned step S102, the server can determine the posture of other users except the game user in the virtual physical space, and determine the character parameters pre-set by other users. Based on the character parameters and posture, a virtual user character is generated, and the virtual user character is loaded into the virtual physical space to obtain a second space. Then, according to the environmental image, the pre-stored virtual environment elements are loaded in the second space to obtain a virtual game space for the educational game.

[0097] Among them, the server can obtain the posture of other users by determining the posture of the augmented reality device of other users in the virtual physical space. The above-mentioned role parameters are pre-set by other users and exist in the server. The role parameters include gender, age, clothing, body and other parameters. The body parameters include height, weight, hairstyle, face shape and other parameters, which are not specifically limited in this specification. The clothing parameters include parameters such as clothing type and clothing color. When generating a virtual user role according to the role parameters and posture, the server can use a pre-set generation algorithm or a pre-trained generation model to generate a virtual user role according to the role parameters and posture. The virtual user role meets the role parameters, and the posture of the virtual user role is the posture of other users determined above. The generation algorithm or generation model can be any existing generation algorithm or generation model. The generation algorithm can also be pre-set by the server, and the generation model can also be pre-trained by the server. This specification does not make specific limitations. The training samples for training the generation model can be role parameters and role postures, and the annotations corresponding to the training samples can be virtual roles, which can be marked manually. The specific process of training the generative model is similar to the training process of supervised learning and will not be repeated here.

[0098] When the virtual user character is loaded into the virtual physical space to obtain the second space, the server can determine the location of other users in the virtual physical space and use it as the second placement location to place the virtual user character at the second placement location to obtain the second space. The process of loading the pre-stored virtual environment elements in the second space according to the environment image to obtain the virtual game space of the educational game is similar to the process of loading the pre-stored virtual environment elements in the virtual physical space according to the environment image to obtain the virtual game space of the educational game in step S102, and will not be repeated here.

[0099] In this specification, the educational game includes several game tasks, each virtual environment element corresponds to at least one game task, and the game user can click on the virtual environment element to view the game task corresponding to the virtual environment element and perform the game task. The game task can be various types of game tasks such as browsing, question and answer, puzzles and challenges. Specifically, the game task can be browsing historical events, browsing historical stories, interpreting hieroglyphs, rebuilding ancient Egyptian buildings, ancient Egyptian knowledge questions and answers, etc. By setting the game task, not only can the game user understand the history of each historical period, but also the game user can better master the knowledge learned. In addition, when the game user performs the game task of question and answer, puzzle and challenge type, the game user needs to use historical knowledge and logical thinking, thereby improving the knowledge and logical thinking of the game user, and bringing better educational effects. At the same time, the interactivity between the game user and the educational game is also increased.

[0100] Based on this, the server can respond to the second click operation of the game user, determine the virtual environment element clicked by the user, and use it as the first element. Determine the game task corresponding to the first element, and load the task element corresponding to the game task into the virtual game space to obtain the third space. Based on the third space, in the augmented reality device, update the game screen corresponding to the first posture. Among them, the second click operation is used to characterize the game user clicking on the virtual environment element. The game tasks corresponding to each virtual environment element are pre-set, and the game tasks have corresponding task elements. The task elements are three-dimensional models required to perform the game tasks. The task elements can be virtual display panels for displaying historical events or historical stories. The task elements can also be virtual question and answer panels, or virtual puzzle panels. This specification does not make specific restrictions. Which task elements correspond to specific game tasks are all pre-set by the server. When the task elements corresponding to the game tasks are loaded into the virtual game space to obtain the third space, the server can determine the position of the first element in the virtual game space and use it as the third placement position, and then place the task elements corresponding to the game tasks in the third placement position to obtain the third space. The above process of updating the game screen corresponding to the first posture in the augmented reality device based on the third space is similar to the process described in the above step S104, and will not be repeated here. It should be noted that if the position of the augmented reality device of the game user changes at this time, that is, from the first posture to the third posture, when updating the game screen, the game screen can be updated based on the third posture, and the specific process is also the process described in the above step S104, and will not be repeated here.

[0101] In this specification, the above-mentioned game task can be a multi-person task, which is a task in which several users participate. The multi-person task can be performed by the game user interacting with other users to improve the interactivity of the educational game, and also improve the user's solidarity, cooperation and communication skills. Based on this, when the game task is a multi-person task, the server can determine other users within the preset range of the game user, and send a task execution request to the target user as the target user. When the first reply message returned by the target user is received, the third space of the game user and the third space of the target user are merged. Based on the merged third space, in the augmented reality device, the game screen corresponding to the first posture is updated.

[0102] Among them, the preset range is a range preset by the server, and the preset range can be 3 meters. The target user and the game user perform the same multiplayer task. The task execution request is used to represent the invitation to the target user to jointly perform the multiplayer task. The first reply message represents that the target user accepts the invitation. When the third space of the game user and the third space of the target user are merged, the server can also use a preset fusion technology to merge the third space of the game user and the third space of the target user. The specific process is such as the process of merging the target environment element with the virtual environment element in the above step S102, which will not be repeated here. The volume of the third space of the game user is the same as the volume of the third space of the target user. The above process of updating the game screen corresponding to the first posture in the augmented reality device based on the fused third space is similar to the above process of updating the game screen corresponding to the first posture in the augmented reality device based on the third space, and will not be repeated here.

[0103] In this specification, when the third space of the game user and the third space of the target user are the same, the server can directly load the target user into the third space of the game user according to the position of the target user in the third space of the target user to obtain the fused third space. Figure 8 As shown, Figure 8 is a schematic diagram of spatial fusion provided in this specification, Figure 8 It includes the third space of the game user, the third space of the target user and the merged third space, namely space 1, space 2 and space 3. The circle marked with "L" represents the game user, and the circle marked with "M" represents the target user. The server can load the target user into the third space of the game user according to the position of the target user in the third space of the target user to obtain the merged third space. It should be noted that Figure 8 Space 1, Space 2 and Space 3 are just examples of the third space of the game user, the third space of the target user and the merged third space.

[0104] However, when the third space of the game user and the third space of the target user are not exactly the same, the server can directly splice the third space of the game user and the third space of the target user to obtain a fused space. It should be noted that the movement range of the game user and the target user is still within the third space before fusion.

[0105] In addition, the server can also determine a model that is different from the third space of the game user from the third space of the target user, and use it as the second model. If the volume of the second model is not less than the preset threshold, the server can add the second model to the third space of the game user, and load the target user into the third space of the game user according to the position of the target user in the third space of the target user, so as to obtain the fused third space. If the volume of the second model is less than the preset threshold, it means that the third space of the game user and the third space of the target user are the same, so the server can directly load the target user into the third space of the game user according to the position of the target user in the third space of the target user, and obtain the fused third space. The second model is a partial model included in the third space of the target user, and a partial model not included in the third space of the game user. The preset threshold is a pre-set volume.

[0106] When the second model is added to the third space of the game user, the server may determine the position of the second model in the third space of the target user, and place the second model at the fourth placement position of the third space of the game user as the fourth placement position. It should be noted that the volume of the third space of the game user is the same as the volume of the third space of the target user, and the shape of the third space of the game user is the same as the shape of the third space of the target user, except that the three-dimensional model included in the third space of the game user and the three-dimensional model included in the third space of the target user may be completely the same or partially the same.

[0107] Specific as Fig. 9 As shown, Fig. 9 is a schematic diagram of another fusion space provided in this specification, Fig. 9 It includes the third space of the game user, the third space of the target user and the fused third space, namely, space 4, space 5 and space 6. The circle marked with "L" represents the game user, and the circle marked with "M" represents the target user. Space 4 only includes the three-dimensional model of the carpet, and space 5 only includes the three-dimensional models corresponding to the square stool and the ancient Egyptian table, respectively. Therefore, the second model is the three-dimensional model corresponding to the square stool and the ancient Egyptian table, respectively. The server can add the second model to the third space of the game user, and according to the position of the target user in the third space of the target user, load the target user into the third space of the game user to obtain the fused third space, namely, space 6. It should be noted that Fig. 9 Space 4, Space 5 and Space 6 are just examples of the third space of the game user, the third space of the target user and the merged third space.

[0108] In this specification, when the educational game display ends, the server can determine the game data corresponding to the game user, and optimize the educational game according to the game data. The game data includes the completion status of the game tasks of the game user, and the completion status is the number of completed game tasks. The game data may also include game duration and number of games. When optimizing the educational game according to the game data, the server may display the game data to the developer so that the developer can optimize the educational game according to the game data and return the optimized game, and the server receives the optimized game returned by the developer. Of course, the server can also use any existing optimization algorithm or optimization model to optimize the educational game. When optimizing the educational game, the number of game tasks of the educational game, the time required to execute the game tasks, etc. can be optimized. How to optimize the educational game specifically is not specifically limited in this specification.

[0109] In addition, in addition to optimizing the educational game based on the game data, the server can also obtain feedback information corresponding to the game users, and optimize the educational game based on the game data and feedback information. The feedback information can be feedback information from the game users on the educational game, and the feedback information can be the rating of the educational game by the game users, and the rating includes the rating of the game time, the number of game tasks, etc. of the educational game. The above process of optimizing the educational game based on the game data and feedback information is similar to the above process of optimizing the educational game based on the game data, and will not be repeated here.

[0110] The above are one or more implementation methods of this specification. Based on the same idea, this specification also provides a corresponding display device for educational games, such as Fig.10 shown.

[0111] Fig.10 A schematic diagram of a display device for an educational game provided in this specification, comprising:

[0112] The acquisition module 200 is used to acquire an environment image corresponding to the panoramic physical space where the game user is located in response to a start-up operation of the game user; the environment image is used to display the panoramic virtual physical space corresponding to the physical space;

[0113] A loading module 202, used to load various virtual environment elements stored in advance in the virtual physical space according to the environment image, so as to obtain a virtual game space of the educational game;

[0114] The display module 204 is used to determine the first posture of the current augmented reality device in the virtual game space, and based on the virtual game space, display the game screen corresponding to the first posture in the augmented reality device.

[0115] Optionally, the loading module 202 is specifically used to identify the environmental image and determine the real environmental elements in the virtual physical space; determine the matching relationship between the pre-stored virtual environmental elements and the real environmental elements; and load the virtual environmental elements in the virtual physical space according to the matching relationship to obtain a virtual game space for the educational game.

[0116] Optionally, the loading module 202 is specifically used to load the pre-stored environment selection buttons in the virtual physical space to obtain the first space of the educational game; determine the second posture of the current augmented reality device in the first space, and based on the first space, display the initial screen corresponding to the second posture in the augmented reality device; in response to the first click operation of the game user, determine the environment corresponding to the environment selection button clicked by the game user, and use it as the target environment; determine the pre-stored virtual environment elements corresponding to the target environment; delete the environment selection buttons in the first space, and load the virtual environment elements in the deleted first space according to the environment image to obtain the virtual game space.

[0117] Optionally, the loading module 202 is specifically used to determine the positions and postures of other users except the game user in the virtual physical space, and to determine the pre-set role parameters of the other users; generate a virtual user character according to the role parameters and the positions and postures, and load the virtual user character into the virtual physical space to obtain a second space; and load the pre-stored virtual environment elements in the second space according to the environment image to obtain a virtual game space for the educational game.

[0118] Optionally, the device further comprises:

[0119] The click module 206 is used to respond to the second click operation of the game user, determine the virtual environment element clicked by the game user, and use it as the first element; determine the game task corresponding to the first element, and load the task element corresponding to the game task into the virtual game space to obtain a third space; based on the third space, update the game screen corresponding to the first posture in the augmented reality device.

[0120] Optionally, the click module 206 is also used to, when the game task is a multi-player task, determine other users within a preset range of the game user and use them as target users; the multi-player task is a task in which several users participate; send a task execution request to the target user; when a first reply message returned by the target user is received, merge the third space of the game user and the third space of the target user; based on the merged third space, update the game screen corresponding to the first posture in the augmented reality device.

[0121] Optionally, the device further comprises:

[0122] The optimization module 208 is used to determine the game data corresponding to the game user when the display of the educational game ends; obtain the feedback information corresponding to the game user, and optimize the educational game according to the game data and the feedback information.

[0123] This specification also provides a computer-readable storage medium, which stores a computer program, which can be used to execute the above Figure 1 A display method for an educational game is provided.

[0124] This manual also provides Fig.11 The one shown corresponds to Figure 1 A schematic diagram of the electronic device. Fig.11 As shown, at the hardware level, the electronic device includes a processor, an internal bus, a network interface, a memory, and a non-volatile memory, and may also include other hardware required for the business. The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs it to achieve the above Figure 1 The display method of the educational game.

[0125] Of course, in addition to software implementation, this specification does not exclude other implementation methods, such as logic devices or a combination of software and hardware, etc., that is to say, the executor of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.

[0126] In the 1990s, improvements to a technology could be clearly distinguished as hardware improvements (for example, improvements to the circuit structure of diodes, transistors, switches, etc.) or software improvements (improvements to the method flow). However, with the development of technology, many improvements to the method flow today can be regarded as direct improvements to the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that an improvement in a method flow cannot be implemented using a hardware entity module. For example, a programmable logic device (PLD) (such as a field programmable gate array (FPGA)) is such an integrated circuit whose logical function is determined by the user's programming of the device. Designers can "integrate" a digital system on a PLD by programming it themselves, without having to ask a chip manufacturer to design and produce a dedicated integrated circuit chip. Moreover, nowadays, instead of manually making integrated circuit chips, this kind of programming is mostly implemented by "logic compiler" software, which is similar to the software compiler used when developing and writing programs, and the original code before compilation must also be written in a specific programming language, which is called hardware description language (HDL). There is not only one HDL, but many kinds, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. The most commonly used ones are VHDL (Very-High-Speed ​​Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also know that it is only necessary to program the method flow slightly in the above-mentioned hardware description languages ​​and program it into the integrated circuit, and then it is easy to obtain the hardware circuit that implements the logic method flow.

[0127] The controller can be implemented in any appropriate manner, for example, the controller can take the form of a microprocessor or processor and a computer-readable medium storing a computer-readable program code (such as software or firmware) that can be executed by the (micro)processor, a logic gate, a switch, an application-specific integrated circuit (ASIC), a programmable logic controller, and an embedded microcontroller. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320. The memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art also know that in addition to implementing the controller in a purely computer-readable program code manner, the controller can be implemented in the form of a logic gate, a switch, an application-specific integrated circuit, a programmable logic controller, and an embedded microcontroller by logically programming the method steps. Therefore, this controller can be considered as a hardware component, and the devices included therein for implementing various functions can also be regarded as structures within the hardware component. Or even, the devices for implementing various functions can be regarded as both software modules for implementing the method and structures within the hardware component.

[0128] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0129] For the convenience of description, the above device is described in various units according to their functions. Of course, when implementing this specification, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0130] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems, or computer program products. Therefore, this specification may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0131] This specification is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of this specification. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0132] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0133] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0134] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0135] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0136] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0137] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0138] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems or computer program products. Therefore, this specification may take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, this specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0139] This specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. This specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

[0140] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0141] The above description is only an embodiment of the present specification and is not intended to limit the present specification. For those skilled in the art, the present specification may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present specification shall be included in the scope of the claims of the present specification.

Claims

1. A method for displaying an educational game, characterized in that: include: In response to a start-up operation by a game user, an environment image corresponding to the panoramic physical space where the game user is located is collected; the environment image is used to display the panoramic virtual physical space corresponding to the physical space; According to the environment image, various virtual environment elements stored in advance are loaded into the virtual physical space to obtain a virtual game space of the educational game; Determine a first posture of the current augmented reality device in the virtual game space, and based on the virtual game space, display a game screen corresponding to the first posture in the augmented reality device.

2. The method according to claim 1, characterized in that According to the environment image, various virtual environment elements pre-stored in the virtual physical space are loaded to obtain a virtual game space of the educational game, specifically including: Recognize the environment image to determine each real environment element in the virtual physical space; Determining a matching relationship between each pre-stored virtual environment element and each real environment element; According to the matching relationship, the virtual environment elements are loaded into the virtual physical space to obtain a virtual game space for the educational game.

3. The method according to claim 1, characterized in that According to the environment image, various virtual environment elements pre-stored in the virtual physical space are loaded to obtain a virtual game space of the educational game, specifically including: Loading pre-stored environment selection buttons in the virtual physical space to obtain a first space for the educational game; Determine a second posture of the current augmented reality device in the first space, and based on the first space, display an initial screen corresponding to the second posture in the augmented reality device; In response to a first click operation by the game user, determining an environment corresponding to an environment selection button clicked by the game user and using it as a target environment; Determining each virtual environment element corresponding to the target environment stored in advance; The environment selection buttons in the first space are deleted, and the virtual environment elements are loaded in the deleted first space according to the environment image to obtain a virtual game space.

4. The method according to claim 1, characterized in that According to the environment image, various virtual environment elements pre-stored in the virtual physical space are loaded to obtain a virtual game space of the educational game, specifically including: Determining the positions and postures of other users except the game user in the virtual physical space, and determining the role parameters preset by the other users; Generate a virtual user character according to the character parameters and the position and posture, and load the virtual user character into the virtual physical space to obtain a second space; According to the environment image, various virtual environment elements stored in advance are loaded into the second space to obtain a virtual game space of the educational game.

5. The method according to claim 1, characterized in that The method comprises: In response to a second click operation by the game user, determining the virtual environment element clicked by the game user and using it as the first element; Determining a game task corresponding to the first element, and loading the task element corresponding to the game task into the virtual game space to obtain a third space; Based on the third space, in the augmented reality device, a game screen corresponding to the first posture is updated.

6. The method according to claim 5, characterized in that The method further comprises: When the game task is a multi-player task, other users within the preset range of the game user are determined and used as target users; the multi-player task is a task in which several users participate; Sending a task execution request to the target user; When receiving the first reply message returned by the target user, merging the third space of the game user and the third space of the target user; Based on the fused third space, in the augmented reality device, a game screen corresponding to the first posture is updated.

7. The method according to claim 1, characterized in that The method further comprises: When the educational game display ends, determining the game data corresponding to the game user; Acquire feedback information corresponding to the game users, and optimize the educational game according to the game data and the feedback information.

8. A display device for educational games, characterized in that: include: A collection module, configured to collect an environment image corresponding to the panoramic physical space where the game user is located in response to a start-up operation of the game user; the environment image is used to display the panoramic virtual physical space corresponding to the physical space; A loading module, used for loading various virtual environment elements stored in advance in the virtual physical space according to the environment image, so as to obtain a virtual game space of the educational game; The display module is used to determine the first posture of the current augmented reality device in the virtual game space, and based on the virtual game space, display the game screen corresponding to the first posture in the augmented reality device.

9. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Method and a system for realizing spatial interaction AR based on multi-user visual angle positioning

    CN113342167A

  • Method and device for rendering digital resources in augmented reality scene, equipment and medium

    CN116883577A