Virtual Space Fusion Method and Related Devices, Electronic Devices, and Storage Media

Abstract

The present application discloses a virtual space fusion method and related devices, electronic devices, and storage media. Among them, the virtual space fusion method includes: in response to the current states of multiple first virtual spaces satisfying a preset fusion condition, reconstructing a second virtual space based on a target physical space; wherein, the multiple first virtual spaces are all reconstructed based on the target physical space; placing the virtual objects contained in each of the multiple first virtual spaces in the second virtual space to obtain a fusion virtual space of the multiple first virtual spaces. The above solution can enrich the virtual space and improve the user experience.

Description

Technical Field

[0001] This application relates to the field of computer vision technology, and particularly to a virtual space fusion method, related devices, electronic devices, and storage media. Background Art

[0002] By digitally replicating things in the real space, people can move in the virtual space through digital avatars. For example, the metaverse, which has recently attracted increasing attention from the public, is a digital space created by linking and using technologies such as augmented reality. In essence, it is a virtualization and digitalization process of the real world, which requires a large number of transformations in content production, economic systems, user experiences, and real-world content. Exemplarily, a school auditorium in the real space can be virtualized, and graduates can participate in the graduation ceremony in the virtual school auditorium as virtual avatars.

[0003] In recent years, technologies related to virtual spaces have also received increasing attention. In terms of user experience, existing methods can support users to freely define the form, affairs, interaction methods, and their relationship with the space in various virtual spaces to enhance the user experience. In view of this, how to enrich virtual spaces to improve user experience has become a topic with great research value. Summary of the Invention

[0004] This application provides a virtual space fusion method, related devices, electronic devices, and storage media.

[0005] In a first aspect of this application, a virtual space fusion method is provided, including: in response to the current states of multiple first virtual spaces satisfying a preset fusion condition, reconstructing a second virtual space based on a target physical space; wherein, the multiple first virtual spaces are all reconstructed based on the target physical space; placing the virtual objects contained in each of the multiple first virtual spaces in the second virtual space to obtain a fusion virtual space of the multiple first virtual spaces.

[0006] Therefore, in response to the current states of multiple first virtual spaces satisfying a preset fusion condition, a second virtual space is reconstructed based on a target physical space, and the multiple first virtual spaces are all reconstructed based on the target physical space. Then, the virtual objects contained in each of the multiple first virtual spaces are placed in the second virtual space to obtain a fusion virtual space of the multiple first virtual spaces. Therefore, for virtual spaces reconstructed based on the same physical space, once it is detected that the preset fusion condition is satisfied, they are automatically fused to obtain a fusion virtual space, and the fusion virtual space contains the virtual objects contained in the original virtual spaces. Therefore, it can greatly enrich the virtual space and is beneficial to improving the user experience.

[0007] Among them, the current state includes: the physical locations where the creators of each first virtual space are located respectively, and the preset fusion condition includes: the distance between physical locations is lower than the first threshold.

[0008] Therefore, by setting the current state to include the physical locations where the creators of each first virtual space are located respectively, and the preset fusion condition includes: the distance between physical spaces is lower than the first threshold, so that when it is detected that the physical distance is lower than the first threshold, the first virtual spaces will fuse, and further, by setting the trigger fusion condition in the physical distance dimension, the randomness of space fusion can be improved, which is beneficial to further enrich the virtual space.

[0009] Among them, the first virtual space is created by the terminal device of the creator, and the physical location is obtained by the terminal device through visual positioning.

[0010] Therefore, the first virtual space is created by the terminal device of the creator, and the physical distance is obtained by the terminal device through visual positioning. Therefore, the creator can create a virtual space through the terminal device, and determine its physical location through visual positioning during the subsequent use of the terminal device for decision-making on whether to fuse, so as to further increase the randomness of space fusion.

[0011] Among them, the current state includes: the user sets of each first virtual space, and the preset fusion condition includes: the overlap degree between the user sets is higher than the second threshold.

[0012] Therefore, by setting the current state to include: the user sets of each first virtual space, and the preset fusion condition is set to include that the overlap degree between the user sets is higher than the second threshold, so that when it is detected that the overlap degree is higher than the second threshold, the first virtual spaces will fuse, and further, by setting the trigger fusion condition in the set overlap degree dimension, the randomness of space fusion can be improved, which is beneficial to further enrich the virtual space.

[0013] Among them, the user set includes several users, and the several users include at least one of the following: the placer of virtual objects in the first virtual space, the followers of the first virtual space.

[0014] Therefore, the user set is set to include several users, and the several users include at least one of the placer of virtual objects in the first virtual space and the followers of the first virtual space. Therefore, the user set can be measured from at least one of the perspectives of the placer and the followers, which is beneficial to enhancing the spatial fusion perception of the placer and the followers after space fusion.

[0015] Among them, the current state includes: the placement positions of the virtual objects contained in each first virtual space respectively, and the preset fusion condition includes: the placement positions do not overlap.

[0016] Therefore, by setting the current state to include the placement positions of the virtual objects contained in each of the first virtual spaces, and setting the preset fusion condition to include non-overlapping placement positions, when the non-overlapping placement positions are detected, the first virtual spaces are fused, and thus the randomness of space fusion can be improved by setting the trigger fusion condition in the placement position dimension, which is beneficial to further enrich the virtual space.

[0017] After placing the virtual objects contained in each of the multiple first virtual spaces in the second virtual space to obtain the fused virtual space of the multiple first virtual spaces, the method further includes: in response to an access request for a first virtual space, redirecting to the fused virtual space to display the fused virtual space.

[0018] Therefore, after obtaining the fused virtual space, in response to an access request for a first virtual space, redirecting to the fused virtual space to display the fused virtual space, so by automatically redirecting to the fused virtual space, the interest of the virtual space can be improved.

[0019] After placing the virtual objects contained in each of the multiple first virtual spaces in the second virtual space to obtain the fused virtual space of the multiple first virtual spaces, the method further includes: in response to a rollback request for the fused virtual space by the creator of the first virtual space, rolling back to the first virtual space before fusion.

[0020] Therefore, after obtaining the fused virtual space, in response to a rollback request for the fused virtual space by the creator of the first virtual space, rolling back to the first virtual space before fusion, so the creator can be supported to freely roll back to the first virtual space before fusion, which is beneficial to improving the freedom of space fusion.

[0021] After placing the virtual objects contained in each of the multiple first virtual spaces in the second virtual space to obtain the fused virtual space of the multiple first virtual spaces, the method further includes: in response to the object attributes of the virtual objects in the fused virtual space satisfying the preset interaction condition, the virtual objects interact in the fused virtual space based on their respective object attributes.

[0022] Therefore, after obtaining the fused virtual space, in response to the object attributes of the virtual objects in the fused virtual space satisfying the preset interaction condition, the virtual objects interact in the fused virtual space based on their respective object attributes, which can further increase the interest under the virtual space.

[0023] The second aspect of the present application provides a virtual space fusion device, including: a reconstruction module and a fusion module. The reconstruction module is configured to, in response to the current states of multiple first virtual spaces satisfying a preset fusion condition, reconstruct a second virtual space based on a target physical space; wherein, the multiple first virtual spaces are all reconstructed based on the target physical space. The fusion module is configured to place the virtual objects included in each of the multiple first virtual spaces in the second virtual space to obtain a fusion virtual space of the multiple first virtual spaces.

[0024] The third aspect of the present application provides an electronic device, including a memory and a processor coupled to each other. The processor is configured to execute program instructions stored in the memory to implement the virtual space fusion method in the first aspect above.

[0025] The fourth aspect of the present application provides a computer-readable storage medium, on which program instructions are stored. When the program instructions are executed by a processor, the virtual space fusion method in the first aspect above is implemented.

[0026] In the above solution, in response to the current states of multiple first virtual spaces satisfying a preset fusion condition, a second virtual space is reconstructed based on a target physical space, and the multiple first virtual spaces are all reconstructed based on the target physical space. Then, the virtual objects included in each of the multiple first virtual spaces are placed in the second virtual space to obtain a fusion virtual space of the multiple first virtual spaces. Therefore, for virtual spaces reconstructed based on the same physical space, once it is detected that the preset fusion condition is satisfied, they are automatically fused to obtain a fusion virtual space, and the fusion virtual space contains the virtual objects included in the original virtual spaces. Therefore, the virtual space can be greatly enriched, which is beneficial to improving the user experience. Description of the Drawings

[0027] Figure 1 is a flowchart of an embodiment of the virtual space fusion method of the present application;

[0028] Figure 2 is a schematic diagram of an embodiment of a first virtual space;

[0029] Figure 3 is a schematic diagram of the process of an embodiment of the virtual space fusion method of the present application;

[0030] Figure 4 is a schematic framework diagram of an embodiment of the virtual space fusion device of the present application;

[0031] Figure 5 is a schematic framework diagram of an embodiment of the electronic device of the present application;

[0032] Figure 6 is a schematic framework diagram of an embodiment of the computer-readable storage medium of the present application. Detailed Embodiments

[0033] The solution of the embodiment of the present application will be described in detail below with reference to the accompanying drawings of the specification.

[0034] In the following description, specific details such as specific system architectures, interfaces, and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the present application.

[0035] The terms "system" and "network" are often used interchangeably in this article. The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " in this article generally represents an "or" relationship between the associated objects before and after. In addition, "multiple" in this article means two or more than two.

[0036] Please refer to Figure 1 , Figure 1 which is a schematic flowchart of an embodiment of the virtual space fusion method of the present application. Specifically, it may include the following steps:

[0037] Step S11: In response to the current states of multiple first virtual spaces satisfying a preset fusion condition, a second virtual space is reconstructed based on the target physical space.

[0038] In the embodiments of the present disclosure, multiple first virtual spaces are all reconstructed based on the target physical space. It should be noted that the target physical space can be any real space. Exemplarily, the target physical space may include but is not limited to: floors, streets, parks, museums, scenic spots, etc., which are not limited herein.

[0039] In an implementation scenario, the first virtual space can be reconstructed based on reconstruction technologies such as 3D reconstruction. Exemplarily, the reconstruction technologies may specifically include but are not limited to SFM (i.e., Structure From Motion), etc., which are not limited herein.

[0040] In an implementation scenario, the first virtual space can specifically be created by the terminal device of its creator. The terminal device can include, but is not limited to, intelligent devices such as smartphones, tablets, and smart glasses. For example, if the terminal device itself has relatively abundant computing resources, the terminal device can reconstruct the real space through the aforementioned reconstruction technology to obtain the first virtual space; or, for example, if the terminal device itself does not have relatively abundant computing resources, after the terminal device captures video data of the real space, it can upload the video data to the background server. The server uses the above reconstruction technology to reconstruct the video data to obtain the first virtual space, and the background server hosts the first virtual space. The terminal device can access the first virtual space through the access address provided by the background server.

[0041] In an implementation scenario, the creator can further place virtual objects in the first virtual space through the terminal device. It should be noted that the virtual objects can include living things such as animals and plants, and can also include non-living things such as statues, buildings, and decorations, which are not limited here. Taking the real space as a street as an example, after reconstructing the first virtual space representing the street, the creator can place a statue in front of a certain store on the street represented by the first virtual space, or can place pets such as cats and dogs on the street represented by the first virtual space. Other situations can be inferred by analogy and will not be exemplified one by one here.

[0042] In an implementation scenario, in addition to the creator, there can also be followers in the first virtual space. For example, if the first virtual space created by the creator attracts the attention of users, that is, the users become fans of the first virtual space, then these users can be regarded as followers of the first virtual space. On this basis, not only the creator of the first virtual space can place virtual objects in the first virtual space, but also the followers of the first virtual space can place virtual objects in the first virtual space to further enrich the first virtual space. Of course, the creator of the first virtual space can set the operating rules of the first virtual space. For example, the operating rules can include allowing followers to edit. In this case, the followers of the first virtual space can also place virtual objects in the first virtual space; or, the operating rules can include allowing followers to edit and not allowing non-followers to edit. In this case, the followers of the first virtual space can place virtual objects in the first virtual space, while if a user is not a follower of the first virtual space, this user is not allowed to place virtual objects in the first virtual space; or, the operating rules can also include allowing any user to edit. In this case, whether a user is a follower of the first virtual space or not, they can place virtual objects in the first virtual space. In addition, the virtual objects in the first virtual space can have the highest authority of their placer, that is, the virtual items can be operated by their placer, such as moving, deleting, etc., and the placer can set the editing authority of the virtual objects they place in the first virtual space. For example, the placer can set that other users can only perform operations such as moving, but are not allowed to perform operations such as deleting.

[0043] In an implementation scenario, please refer to Figure 2 , Figure 2 which is a schematic diagram of an embodiment of the first virtual space. As Figure 2 shown, based on the target physical space, various different styles of the first virtual space can be created. For example, the first virtual space from bottom to top is in an "ocean style", and there are ocean creatures such as whales, dolphins, seagrass, and corals placed in the first virtual space. The second first virtual space from bottom to top is in a "forest style", and there are forest creatures such as trees and lawns placed in the first virtual space. The third first virtual space from bottom to top is in a "mixed style", and there are both ocean creatures and various commercial signs placed in the first virtual space. It should be noted that Figure 2 these are just several possible implementation ways of the first virtual space, and do not limit the specific implementation way of the first virtual space accordingly.

[0044] In an implementation scenario, the current state and the preset fusion condition can be set from multiple dimensions such as the physical location of the creator of the first virtual space, the user set of the first virtual space, and the placement position of virtual objects in the first virtual space. There is no limitation here. For the specific meaning, please refer to the following relevant descriptions and will not be elaborated here for the time being. In addition, when it is detected that the current states of multiple first virtual spaces meet the preset fusion condition, subsequent fusion operations can be automatically executed, that is, a second virtual space can be automatically created based on the target physical space and subsequent related operations described in step S12 can be executed; of course, when it is detected that the current states of multiple first virtual spaces meet the preset fusion condition, an inquiry message can also be output first on the terminal device of the creator, and the inquiry message is used to inquire whether the creator executes subsequent fusion operations. If the creator confirms to execute subsequent fusion operations, a second virtual space can be reconstructed based on the target physical space and subsequent related operations described in step S12 can be executed. Or, if the user confirms not to execute subsequent fusion operations, the process can be ended.

[0045] In an implementation scenario, the current state may include: the physical locations where the creators of the respective first virtual spaces are located. It should be noted that the physical location represents the location of the creator in the real space. In this case, the preset fusion condition can be set to include: the distance between the physical locations is lower than the first threshold. In the above manner, by setting the current state to include the physical locations where the creators of the respective first virtual spaces are located, and the preset fusion condition includes: the distance between the physical spaces is lower than the first threshold, the first virtual space will be fused when it is detected that the physical distance is lower than the first threshold. Furthermore, by setting the trigger fusion condition in the physical distance dimension, the randomness of space fusion can be improved, which is beneficial to further enriching the virtual space.

[0046] In a specific implementation scenario, as described above, the first virtual space can be created by the terminal device of the creator. Then the physical location can specifically be obtained by the terminal device through visual positioning. For the specific process of visual positioning, please refer to the technical details of visual positioning and will not be elaborated here. In the above manner, the first virtual space is created by the terminal device of the creator, and the physical distance is obtained by the terminal device through visual positioning. Therefore, the creator can create a virtual space through the terminal device and determine its physical location through visual positioning during the subsequent use of the terminal device for decision-making on whether to fuse, thereby further increasing the randomness of space fusion.

[0047] In a specific implementation scenario, the specific value of the first threshold can be set according to actual application requirements. For example, in a case where a higher randomness requirement for spatial fusion is needed, the first threshold can be set appropriately larger, such as the first threshold can be set to 20 meters, 25 meters, 30 meters, etc.; or, in a case where a lower randomness requirement for spatial fusion is needed, the first threshold can be set appropriately smaller, such as the first threshold can be set to 5 meters, 10 meters, 15 meters, etc., which is not limited herein.

[0048] In an implementation scenario, the current state may include: the user sets of each first virtual space, and the preset fusion condition may include: the overlap degree between the user sets is higher than a second threshold. In the above manner, by setting the current state to include: the user sets of each first virtual space, and setting the preset fusion condition to include that the overlap degree between the user sets is higher than the second threshold, the first virtual space will fuse when it is detected that the overlap degree is higher than the second threshold. Furthermore, by setting the trigger fusion condition in the dimension of the set overlap degree, the randomness of spatial fusion can be improved, which is beneficial to further enrich the virtual space.

[0049] In a specific implementation scenario, the user set of the first virtual space may include at least one of the following: the placer of virtual objects in the first virtual space, the followers of the first virtual space. The specific meanings of the placer and the followers can refer to the foregoing related descriptions and will not be elaborated herein. Exemplarily, the user set of the first virtual space may include: the placer of virtual objects in the first virtual space and the followers who follow the first virtual space; or, the user set of the first virtual space may include: the placer of virtual objects in the first virtual space; or, the user set of the first virtual space may include: the followers who follow the first virtual space, which is not limited herein. In the above manner, the user set is set to include several users, and the several users include at least one of the placer of virtual objects in the first virtual space and the followers of the first virtual space. Therefore, the user set can be measured from at least one of the perspectives of the placer and the followers, which is beneficial to enhancing the spatial fusion perception of the placer and the followers after spatial fusion.

[0050] In a specific implementation scenario, the overlap degree between the user sets can be obtained through the intersection-to-union ratio of the user sets. Exemplarily, please refer to Figure 3 , Figure 3 is a schematic diagram of the process of an embodiment of the virtual space fusion method of this application. As Figure 3As shown, taking the example where the user set includes the placer of virtual objects in the first virtual space, the placers of virtual objects in the first virtual space created by user A include user 1, user 2, user 3, and user 4, and the placers of virtual objects in the first virtual space created by user B include user 1, user 2, user 3, and user 4. Therefore, the intersection of the user sets of the two first virtual spaces is: the set composed of user 1, user 2, user 3, and user 4, and the union of the user sets of the two first virtual spaces is: the set composed of user 1, user 2, user 3, and user 4. Thus, the coincidence degree between the two can be measured by the intersection-to-union ratio as 100%. Other cases can be deduced by analogy and will not be exemplified one by one here.

[0051] In a specific implementation scenario, the specific value of the second threshold can be set according to actual application needs. For example, in the case where a higher randomness requirement for space fusion is needed, the second threshold can be set appropriately smaller, such as the second threshold can be set to 50%, 60%, etc.; or, in the case where a lower randomness requirement for space fusion is needed, the second threshold can be set appropriately larger, such as the second threshold can be set to 80%, 90%, etc., which is not limited here.

[0052] In an implementation scenario, the current state may include: the placement positions of the virtual objects contained in each first virtual space, and the preset fusion condition may include: non-overlapping placement positions. In the above manner, by setting the current state to include the placement positions of the virtual objects contained in each first virtual space and setting the preset fusion condition to include non-overlapping placement positions, the first virtual spaces will fuse when it is detected that the placement positions do not overlap. Furthermore, by setting the trigger fusion condition in the dimension of the placement position, the randomness of space fusion can be improved, which is beneficial to further enriching the virtual space.

[0053] In a specific implementation scenario, as mentioned above, multiple first virtual spaces are all reconstructed based on the target physical space. Therefore, when there is only one virtual object or no virtual object at any position in the target physical space in each of the first virtual spaces, it can be considered that the placement positions do not overlap, that is, in this case, the preset fusion condition is satisfied.

[0054] In a specific implementation scenario, when the requirement for the randomness of spatial fusion is relatively high, the preset fusion condition can also be set such that the overlap rate of the placement positions is not higher than a third threshold. That is to say, when there are multiple virtual objects at any position in the target physical space in each of the first virtual spaces, the decision on whether to perform spatial fusion can also be made based on the overlap rate. Specifically, the overlap rate can also be measured by the intersection-over-union ratio of the virtual objects that produce the overlap, that is, the partial region where the spaces occupied by the virtual objects that produce the overlap intersect, and the region of the spaces completely occupied by the virtual objects that produce the overlap. The ratio between these two regions can be regarded as the overlap rate of the virtual objects that produce the overlap. On this basis, the third threshold can be set as needed, such as it can be set to 5%, 10%, 15%, etc., which is not limited here. In particular, the third threshold can be set to 0%, in which case the preset fusion condition is equivalent to non-overlapping placement positions.

[0055] It should be noted that the numerical methods of the current states and the setting methods of the preset fusion conditions in the above various scenarios can be combined according to the situation. For example, the current state can include: the physical positions where the creators of each of the first virtual spaces are located respectively, the user sets of each of the first virtual spaces, and the placement positions of the virtual objects contained in each of the first virtual spaces. The preset fusion condition can include: the distance between the physical positions is lower than the first threshold, the coincidence degree between the user sets is higher than the second threshold, and the placement positions do not overlap; or, at least one of them can be selected for the current state. For example, the current state can include: the physical positions where the creators of each of the first virtual spaces are located respectively and the user sets of each of the first virtual spaces, then the preset fusion condition can be set to include: the distance between the physical positions is lower than the first threshold and the coincidence degree between the user sets is higher than the second threshold. Other situations can be deduced by analogy and will not be exemplified one by one here.

[0056] Step S12: Place the virtual objects contained in each of the multiple first virtual spaces into the second virtual space to obtain a fusion virtual space of the multiple first virtual spaces.

[0057] In an implementation scenario, after obtaining the second virtual space based on the target physical space, the virtual objects originally contained in each of the first virtual spaces can be placed into the second virtual space, and the positions of the virtual objects in the first virtual space and in the second virtual space are the same. That is to say, when placing the virtual objects, they are placed in situ in the second virtual space according to their positions in the first virtual space.

[0058] In an implementation scenario, as described above, even when there is an overlap in the placement positions, spatial fusion can still be performed. In this case, after placing the virtual objects in place according to their positions in the first virtual space into the second virtual space, it is possible to check whether there is an overlap among the virtual objects in the second virtual space. If there is an overlap, the virtual objects can be automatically adjusted so that there is no overlap between the virtual objects. Exemplarily, if there are virtual objects "tiger" and "dog" placed at the same position in the first virtual space created by user A and the first virtual space created by user B respectively, then after placing them in place according to their positions in the first virtual space into the second virtual space, their positions can be fine-tuned so that there is no overlap between them. Other situations can be deduced by analogy, and no further examples will be given here.

[0059] In an implementation scenario, after obtaining the fused virtual space, in response to an access request for the first virtual space, it is possible to redirect to the fused virtual space to display the fused virtual space. In a real scenario, the creator of the first virtual space, the placer of the virtual objects in the first virtual space, the follower of the first virtual space, and other users other than the above three are all likely to access the first virtual space. Then, when any one of the above four accesses the first virtual space, in response to the access request, it is possible to redirect to the fused virtual space, thereby directly displaying the fused virtual space. It should be noted that in the actual application process, the access entry (such as the access link) of the original first virtual space may not be changed. When the received access request contains this access entry, it is possible to automatically link to the fused virtual space. By the above method, after obtaining the fused virtual space, in response to the access request for the first virtual space, it is redirected to the fused virtual space to display the fused virtual space. Therefore, by automatically redirecting to the fused virtual space, the interestingness of the virtual space can be enhanced.

[0060] In an implementation scenario, after obtaining the fused virtual space, in response to the rollback request of the creator of the first virtual space for the fused virtual space, it is possible to roll back to the first virtual space before fusion. In a real scenario, after experiencing the fused virtual space, the creator of the first virtual space may have the application requirement to roll back to the originally created first virtual space. Based on this, a physical button can be set on the terminal device or a virtual button can be set in the virtual space. After receiving the trigger of the above button by the creator, it can be determined that the creator expects to roll back to the originally created first virtual space, and then it is possible to directly roll back to the first virtual space before fusion. By the above method, after obtaining the fused virtual space, in response to the rollback request of the creator of the first virtual space for the fused virtual space, it is rolled back to the first virtual space before fusion. Therefore, it is possible to support the creator to freely roll back to the first virtual space before fusion, which is beneficial to improving the degree of freedom of spatial fusion.

[0061] In one implementation scenario, after obtaining the fused virtual space, the virtual objects can interact in the fused virtual space based on their respective object attributes in response to the object attributes of the virtual objects in the fused virtual space satisfying the preset interaction conditions. Specifically, the object attributes of the virtual objects may include, but are not limited to: object categories (such as animals, plants, non-living things, etc.), biological attributes related to the food chain (such as herbivorous, carnivorous, etc.), materials (such as metal, plastic, etc.), etc., which are not limited here. On this basis, the preset interaction conditions may include, but are not limited to, the object attributes of the virtual objects having interactive reactions. For example, when the virtual object "tiger" is a carnivore and there is a virtual object "dog" nearby, since the biological attributes of the "tiger" related to the food chain include its diet "dog", in this case, the virtual object "tiger" may chase and prey on the virtual object "dog". Other situations can be deduced by analogy, and examples are not given one by one here. In the above manner, after obtaining the fused virtual space, in response to the object attributes of the virtual objects in the fused virtual space satisfying the preset interaction conditions, the virtual objects interact in the fused virtual space based on their respective object attributes, which can further increase the fun of the virtual space.

[0062] In the above scheme, in response to the current status of multiple first virtual spaces satisfying preset fusion conditions, a second virtual space is reconstructed based on the target physical space, and the multiple first virtual spaces are all reconstructed based on the target physical space, and then the virtual objects contained in the multiple first virtual spaces are placed in the second virtual space to obtain a fused virtual space of the multiple first virtual spaces. Therefore, for the virtual space reconstructed based on the same physical space, once it is detected that the preset fusion conditions are met, they are automatically merged to obtain a fused virtual space. The fused virtual space contains the virtual objects contained in the original virtual space, so it can greatly enrich the virtual space and is conducive to improving the user experience.

[0063] See also Figure 4 , Figure 4 It is a schematic diagram of a framework of an embodiment of a virtual space fusion device 40 of the present application. The virtual space fusion device 40 includes: a reconstruction module 41 and a fusion module 42. The reconstruction module 41 is used to reconstruct a second virtual space based on a target physical space in response to the current state of multiple first virtual spaces satisfying a preset fusion condition; wherein the multiple first virtual spaces are all reconstructed based on the target physical space; and the fusion module 42 is used to place the virtual objects contained in each of the multiple first virtual spaces in the second virtual space to obtain a fused virtual space of the multiple first virtual spaces.

[0064] In the above solution, in response to the current states of multiple first virtual spaces meeting a preset fusion condition, a second virtual space is reconstructed based on the target physical space, and multiple first virtual spaces are all reconstructed based on the target physical space. Then, the virtual objects contained in each of the multiple first virtual spaces are placed in the second virtual space to obtain a fusion virtual space of the multiple first virtual spaces. Therefore, for virtual spaces reconstructed based on the same physical space, once it is detected that the preset fusion condition is met, they are automatically fused to obtain a fusion virtual space, and the fusion virtual space contains the virtual objects contained in the original virtual spaces. Thus, the virtual space can be greatly enriched, which is beneficial to improving the user experience.

[0065] In some disclosed embodiments, the current state includes: the physical locations where the creators of each of the first virtual spaces are located respectively, and the preset fusion condition includes: the distance between the physical locations is lower than a first threshold.

[0066] Therefore, by setting the current state to include the physical locations where the creators of each of the first virtual spaces are located respectively, and the preset fusion condition includes: the distance between the physical spaces is lower than a first threshold, so that when it is detected that the physical distance is lower than the first threshold, the first virtual spaces are fused. Furthermore, by setting the trigger fusion condition in the physical distance dimension, the randomness of space fusion can be improved, which is beneficial to further enriching the virtual space.

[0067] In some disclosed embodiments, the first virtual space is created by the terminal device of the creator, and the physical location is obtained by the terminal device through visual positioning.

[0068] Therefore, the first virtual space is created by the terminal device of the creator, and the physical distance is obtained by the terminal device through visual positioning. Thus, the creator can create a virtual space through the terminal device, and determine its physical location through visual positioning during the subsequent use of the terminal device for decision-making on whether to fuse, so as to further increase the randomness of space fusion.

[0069] In some disclosed embodiments, the current state includes: the user sets of each of the first virtual spaces, and the preset fusion condition includes: the overlap degree between the user sets is higher than a second threshold.

[0070] Therefore, by setting the current state to include: the user sets of each of the first virtual spaces, and the preset fusion condition is set to include that the overlap degree between the user sets is higher than a second threshold, so that when it is detected that the overlap degree is higher than the second threshold, the first virtual spaces are fused. Furthermore, by setting the trigger fusion condition in the dimension of set overlap degree, the randomness of space fusion can be improved, which is beneficial to further enriching the virtual space.

[0071] In some disclosed embodiments, the user set includes a number of users, and the number of users includes at least one of the following: the placer of virtual objects in the first virtual space, and the followers of the first virtual space.

[0072] Therefore, the user set is set to include a number of users, and the number of users includes at least one of the placer of virtual objects in the first virtual space and the followers of the first virtual space. Thus, the user set can be measured from at least one perspective of the placer and the followers, which is beneficial to enhancing the spatial fusion perception of the placer and the followers after spatial fusion.

[0073] In some disclosed embodiments, the current state includes the placement positions of the virtual objects contained in each first virtual space, and the preset fusion condition includes that the placement positions do not overlap.

[0074] Therefore, by setting the current state to include the placement positions of the virtual objects contained in each first virtual space, and setting the preset fusion condition to include that the placement positions do not overlap, the first virtual spaces will fuse when it is detected that the placement positions do not overlap. Furthermore, by setting the trigger fusion condition in the dimension of the placement position, the randomness of spatial fusion can be improved, which is beneficial to further enriching the virtual space.

[0075] In some disclosed embodiments, the virtual space fusion device 40 further includes a redirection module, which is used to redirect to the fused virtual space in response to an access request for the first virtual space, so as to display the fused virtual space.

[0076] Therefore, after obtaining the fused virtual space, in response to an access request for the first virtual space, it redirects to the fused virtual space to display the fused virtual space. Thus, by automatically redirecting to the fused virtual space, the interestingness of the virtual space can be enhanced.

[0077] In some disclosed embodiments, the virtual space fusion device 40 further includes a rollback module, which is used to roll back to the first virtual space before fusion in response to a rollback request from the creator of the first virtual space for the fused virtual space.

[0078] Therefore, after obtaining the fused virtual space, in response to a rollback request from the creator of the first virtual space for the fused virtual space, it rolls back to the first virtual space before fusion. Thus, it can support the creator to freely roll back to the first virtual space before fusion, which is beneficial to enhancing the freedom of spatial fusion.

[0079] In some disclosed embodiments, the virtual space fusion device 40 further includes an interaction module, which is used to enable the virtual objects to interact in the fused virtual space based on their respective object attributes in response to the object attributes of the virtual objects in the fused virtual space satisfying the preset interaction conditions.

[0080] Therefore, after obtaining the fused virtual space, in response to the object attributes of the virtual objects in the fused virtual space satisfying the preset interaction conditions, the virtual objects interact in the fused virtual space based on their respective object attributes, which can further increase the fun in the virtual space.

[0081] See also Figure 5 , Figure 5 : is a schematic diagram of a framework of an embodiment of an electronic device 50 of the present application. The electronic device 50 includes a memory 51 and a processor 52 coupled to each other, and the processor 52 is used to execute program instructions stored in the memory 51 to implement the steps of any of the above-mentioned virtual space fusion method embodiments. In a specific implementation scenario, the electronic device 50 may include but is not limited to: a microcomputer, a server, and in addition, the electronic device 50 may also include a mobile device such as a smart phone, a tablet computer, and smart glasses, which is not limited here.

[0082] Specifically, the processor 52 is used to control itself and the memory 51 to implement the steps of any of the above-mentioned virtual space fusion method embodiments. The processor 52 can also be called a CPU (Central Processing Unit). The processor 52 may be an integrated circuit chip with signal processing capabilities. The processor 52 can also be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field-programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. In addition, the processor 52 can be implemented by an integrated circuit chip.

[0083] The above scheme, for the virtual space reconstructed based on the same physical space, automatically merges once it detects that the preset fusion conditions are met to obtain a fused virtual space. The fused virtual space contains the virtual objects contained in the original virtual space, so it can greatly enrich the virtual space and help improve the user experience.

[0084] See also Figure 6 , Figure 6 The schematic diagram of the framework of an embodiment of a computer-readable storage medium 60 of the present application. The computer-readable storage medium 60 stores program instructions 601 that can be executed by a processor, and the program instructions 601 are used to implement the steps of any of the above-mentioned virtual space fusion method embodiments.

[0085] For the virtual space reconstructed based on the same physical space, once the preset fusion condition is detected, it is automatically fused to obtain a fused virtual space. Since the fused virtual space contains the virtual objects included in the original virtual space, it can greatly enrich the virtual space and is beneficial to improving the user experience.

[0086] This disclosure relates to the field of augmented reality. By obtaining the image information of a target object in the real environment, and then using various vision-related algorithms to detect or identify the relevant features, states, and attributes of the target object, an AR effect combining virtual and real that matches the specific application is obtained. Exemplarily, the target object can involve the face, limbs, gestures, actions, etc. related to the human body, or identification markers, landmarks related to objects, or sand tables, display areas, or display items related to venues or places. The vision-related algorithms can involve visual positioning, SLAM, three-dimensional reconstruction, image registration, background segmentation, key point extraction and tracking of objects, pose or depth detection of objects, etc. The specific application can not only involve interaction scenarios related to real scenes or items such as guided tours, navigation, explanations, reconstructions, virtual effect overlay displays, etc., but also involve special effect processing related to people, such as makeup beautification, limb beautification, special effect displays, virtual model displays, etc.

[0087] The relevant features, states, and attributes of the target object can be detected or identified through a convolutional neural network. The above convolutional neural network is a network model obtained by training the model based on a deep learning framework.

[0088] In several embodiments provided in this application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device implementation described above is only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there can be other division methods. For example, units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection to each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in electrical, mechanical, or other forms.

[0089] The unit described as a separated component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it can be located in one place, or it can be distributed to network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0090] In addition, in each embodiment of the present application, each functional unit may be integrated into a processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of a software functional unit.

[0091] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods in various embodiments of the present application. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical discs that can store program codes.

Claims

1. A method for virtual space fusion, characterized in that, it includes: In response to the current states of multiple first virtual spaces meeting a preset fusion condition, a second virtual space is reconstructed based on a target physical space; wherein, the multiple first virtual spaces are all reconstructed based on the target physical space, the target physical space represents the real space, and both the first virtual space and the second virtual space are digital spaces of the target physical space; Placing the virtual objects contained in each of the multiple first virtual spaces in the second virtual space to obtain a fusion virtual space of the multiple first virtual spaces; In response to the object attributes of the virtual objects in the fusion virtual space meeting a preset interaction condition, the virtual objects interact in the fusion virtual space based on their respective object attributes; wherein, the preset interaction condition at least includes that the object attributes of the virtual objects have interaction reactions.

2. The method according to claim 1, characterized in that, the current state includes: the physical positions where the creators of each of the first virtual spaces are located respectively, and the preset fusion condition includes: the distance between the physical positions is lower than a first threshold.

3. The method according to claim 2, characterized in that, the first virtual space is created by the terminal device of the creator, and the physical position is obtained by the terminal device through visual positioning.

4. The method according to any one of claims 1 to 3, characterized in that, the current state includes: the user sets of each of the first virtual spaces, and the preset fusion condition includes: the overlap degree between the user sets is higher than a second threshold.

5. The method according to claim 4, characterized in that, the user set includes several users, and the several users include at least one of the following: the placer of the virtual object in the first virtual space, the follower of the first virtual space.

6. The method according to any one of claims 1 to 5, characterized in that, the current state includes: the placement positions of the virtual objects contained in each of the first virtual spaces, and the preset fusion condition includes: the placement positions do not overlap.

7. The method according to any one of claims 1 to 6, characterized in that, after placing the virtual objects contained in each of the multiple first virtual spaces in the second virtual space to obtain a fusion virtual space of the multiple first virtual spaces, the method further includes: In response to an access request for the first virtual space, redirecting to the fusion virtual space to display the fusion virtual space.

8. The method according to any one of claims 1 to 7, characterized in that, after placing the virtual objects contained in each of the multiple first virtual spaces in the second virtual space to obtain a fusion virtual space of the multiple first virtual spaces, the method further includes: In response to a rollback request of the creator of the first virtual space for the fusion virtual space, rolling back to the first virtual space before fusion.

9. A virtual space fusion device, characterized in that, it includes: A reconstruction module, configured to reconstruct a second virtual space based on a target physical space in response to the current states of a plurality of first virtual spaces satisfying a preset fusion condition; wherein, the plurality of first virtual spaces are all reconstructed based on the target physical space, the target physical space represents the real space, and both the first virtual space and the second virtual space are digital spaces of the target physical space; A fusion module, configured to place the virtual objects included in each of the plurality of first virtual spaces in the second virtual space to obtain a fusion virtual space of the plurality of first virtual spaces; An interaction module, configured to, in response to the object attributes of the virtual objects in the fusion virtual space satisfying a preset interaction condition, the virtual objects interact in the fusion virtual space based on their respective object attributes; wherein, the preset interaction condition at least includes that the object attributes of the virtual objects have interaction reactions.

10. An electronic device, characterized in that, it includes a memory and a processor that are coupled to each other, and the processor is configured to execute program instructions stored in the memory to implement the virtual space fusion method according to any one of claims 1 to 8.

11. A computer-readable storage medium, on which program instructions are stored, characterized in that, when the program instructions are executed by a processor, the virtual space fusion method according to any one of claims 1 to 8 is implemented.

Images