Management system, server device, method, and computer program product including program

Abstract

The invention provides a management system, a server device, a method and a computer program product containing a program. A management system for providing a virtual space to a user is provided with: a user device used by a user; a sensor for observing a change over time of an object present in a real space; and a server device that transmits information for providing the virtual space to the user device. The server device acquires a detection result of the sensor, calculates a degree of change of the object on the basis of the detection result, and arranges an individual representing the object reflecting the degree of change in the virtual space.

Description

Technical Field

[0001] The present disclosure relates to a system, a server device, a method, and a computer program product including a program for providing a virtual space to a user. Background Art

[0002] Conventionally, a system for providing a virtual space to a user has been known. For example, Japanese Patent Application Laid-Open No. 2001-118081 (Patent Document 1) discloses the following system: based on information obtained from a server that manages information related to the weather in the real space, the weather in the virtual space is matched with the weather in the real space. More specifically, the system of Patent Document 1 selects the weather in the virtual space from any one of "sunny", "cloudy", and "rainy" based on information related to the weather in the real space. Summary of the Invention

[0003] Problems to be Solved by the Invention

[0004] As in the system of Patent Document 1, by presenting the current state of an observation object in the real space in the virtual space, a user can be immersed in the virtual space. However, if the change over time of an observation object existing in the real space can be presented in the virtual space, the user can be more immersed in the virtual space.

[0005] The present disclosure has been made to solve the above problems, and an object thereof is to provide a technology that can make a user more immersed in a virtual space.

[0006] The management system of the present disclosure is a management system that provides a virtual space to a user. The management system includes: a user device used by a user; a sensor for observing the change over time of an object existing in the real space; and a server device that sends information for providing a virtual space to the user device. The server device obtains the detection result of the sensor, calculates the degree of change of the object based on the detection result, and arranges an individual (Object) of the object reflecting the degree of change in the virtual space.

[0007] The server device of the present disclosure is a server device that provides a virtual space to a user. The server device obtains the detection result of a sensor for observing the change over time of an object existing in the real space, calculates the degree of change of the object based on the detection result, and arranges an individual of the object reflecting the degree of change in the virtual space.

[0008] The method of the present disclosure is a method for providing a virtual space to a user. The method includes the following steps as processing to be executed by a computer: obtaining the detection result of a sensor for observing the change over time of an object existing in the real space; calculating the degree of change of the object based on the detection result; and arranging an individual of the object reflecting the degree of change in the virtual space.

[0009] The program of the present disclosure is a program executed by a server device that provides a virtual space to a user. The program includes the following steps as processing to be executed by a computer: obtaining detection results of a sensor for observing changes over time of an object existing in the real space; calculating a degree of change of the object based on the detection results; and arranging an individual of the object representing the degree of change in the virtual space.

[0010] The above objects, features, aspects, and advantages of the present invention, as well as other objects, features, aspects, and advantages, will become clear from the following detailed description of the present invention understood in association with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 is a diagram showing a schematic configuration of the management system according to Embodiment 1.

[0012] Figure 2 is a block diagram of the configuration included in the management system.

[0013] Figure 3 is a diagram for explaining an example of reflecting the degree of change in the real space in the virtual space in Embodiment 1.

[0014] Figure 4 is a flowchart for explaining the reflection process of the real space in Embodiment 1.

[0015] Figure 5 is a flowchart for explaining the NFT issuance process in Embodiment 1.

[0016] Figure 6 is a diagram for explaining an individual to which an NFT has been issued.

[0017] Figure 7 is a flowchart for explaining the purchase process of a product in Embodiment 1.

[0018] Figure 8 is a diagram for explaining an example of reflecting the degree of change in the real space in the virtual space in a modification.

[0019] Figure 9 is a diagram showing a schematic configuration of the management system according to Embodiment 2.

[0020] Figure 10 is a diagram for explaining an example of reflecting the degree of change in the real space in the virtual space in Embodiment 2. DETAILED DESCRIPTION OF THE INVENTION

[0021] [Embodiment 1]

[0022] This embodiment will be described in detail with reference to the accompanying drawings. In addition, the same or corresponding parts in the drawings are denoted by the same reference numerals, and the description thereof will not be repeated in principle.

[0023] <Structure of the management system>

[0024] Figure 1 FIG. is a diagram showing a schematic configuration of a management system 1000 according to Embodiment 1. The management system 1000 is a system for managing a virtual space. The management system 1000 includes a server device 100, sensors 11, cameras 12 and 13, and a user device 200. The sensors 11 and the cameras 12 and 13 are arranged at a position Ar1 in the real space. The server device 100 is arranged at a position Ar2 in the real space. The user device 200 is arranged at a position Ar3 in the real space.

[0025] The positions Ar1 to Ar3 are not virtual spaces but real spaces in the real world. The position Ar1 is within a specific forest. This forest is maintained by a specific company as part of its CSR (Corporate Social Responsibility) activities. The position Ar2 is within a server room owned by the company that maintains the forest at the position Ar1. The position Ar3 is within the residence of a user Ur1 who is immersed in the virtual space. The positions Ar1 to Ar3 are mutually different spaces.

[0026] The above-mentioned company keeps the forest in an appropriate state by maintaining the forest and participates in the movement to improve the global environment. As Figure 1 shown, a tree Tr1 is planted at the position Ar1. In Embodiment 1, the tree Tr1 is, for example, a tree such as Quercus acutissima or Quercus crispula with a tree height exceeding 10 m. In a certain situation, the tree Tr1 may also be a plant with a lower tree height such as Asarum caulescens Maxim, Eupatorium japonicum, Sanguisorba officinalis, or Chrysanthemum lavandulifolium, or may be other types of plants. The tree Tr1 is one of the multiple trees existing at the position Ar1. The growth degree of the tree Tr1 varies according to the surrounding environment. A nest box Bh1 is set around the tree Tr1, for example, on a branch of the tree Tr1.

[0027] The sensor 11 and the camera 12 detect information related to the tree Tr1. The camera 13 detects information related to the nest box Bh1. The server device 100 uses the information obtained by the sensor 11 and the cameras 12 and 13 to generate and update a virtual space representing the forest at the location Ar1. The representation through the virtual space, specifically, can be either to represent the cultivation status of the trees planted at the location Ar1 on the virtual space or to collect the sounds generated at the location Ar1 (e.g., bird chirping, the sound of the wind blowing the leaves, the sound of the river flowing) and output them into the virtual space to represent the sounds generated at the location Ar1. Thus, the user can take a simulated forest bath, and a healing effect can be given to users who have not actually visited the location Ar1. In addition, the representation through the virtual space is not limited to the representation for the user to take a forest bath. For example, it can also represent the ecosystem of the animals and plants at the location Ar1, the content of the chemical substances contained in the soil, the water quality of the river, etc., and can also represent the number of visitors who have visited the location Ar1. Thus, the degree of contribution of the maintenance at the location Ar1 carried out by the enterprise can be presented to the user by various methods.

[0028] The user Ur1 can be, for example, a shareholder of an enterprise that maintains the forest, a purchaser of the products sold by the enterprise, an employee of the enterprise, a trading partner that conducts joint research with the enterprise, etc. The user Ur1 immerses in the virtual space by means of the user device 200, and thus can feel the feeling of visiting the forest at the location Ar1. Thus, the user Ur1 can experience the measures of the enterprise's CSR activities without actually visiting the forest at the location Ar1.

[0029] The sensor 11 is, for example, LiDAR (Light Detection And Ranging), and captures the shape and size of the entire tree Tr1 as three-dimensional data. The camera 12 captures the appearance of the tree Tr1. The image data representing the appearance of the tree Tr1 contains information representing the color of the leaves of the tree Tr1 and information representing the shape and size of the entire tree Tr1. The camera 13 captures the inside of the nest box Bh1. The image data representing the inside of the nest box Bh1 contains the information on whether an animal has visited the nest box Bh1. The sensor 11, the camera 12, and the camera 13 each continuously detect the state of the object over time. In other words, the tree Tr1 is the observation object of the sensor 11 and the camera 12. The nest box Bh1 is the observation object of the camera 13.

[0030] The user device 200 displays a virtual space managed by the server device 100 to the user Ur1. The server device 100 sends information for displaying the virtual space to the user device 200. The user device 200 is, for example, a Head-Mounted Display (HMD). In Embodiment 1, the user Ur1 wears the user device 200 on the head to immerse in the virtual space.

[0031] The server device 100 generates and updates individuals in the virtual space based on the data acquired by the sensor 11, the cameras 12, 13. Further, the sensor 11 can correspond to the "first sensor" in the present disclosure. The camera 12 can correspond to the "second sensor" in the present disclosure. The camera 13 can correspond to the "third sensor" in the present disclosure. The tree Tr1 can correspond to the "first object" in the present disclosure. The overall shape of the tree Tr1 can correspond to the "first part" in the present disclosure. The leaves of the tree Tr1 can correspond to the "second part" in the present disclosure. The nest box Bh1 can correspond to the "second object" in the present disclosure. Hereinafter, the sensor 11, the cameras 12, 13 may be collectively referred to as the "respective sensors".

[0032] Figure 2 is a block diagram of the structure included in the management system 1000. The server device 100, the user device 200, the sensor 11, and the cameras 12, 13 are connected to each other via the network NW. The network NW is, for example, the Internet. The server device 100 includes a communication interface (I / F) 101, a processor 102, a RAM (Random Access Memory) 103, and a storage device 104. The communication interface 101, the processor 102, the RAM 103, and the storage device 104 are configured to be connected to a common bus and capable of transmitting and receiving signals to and from each other.

[0033] The processor 102 is an arithmetic entity (computer) that executes various processes by executing various programs. The processor 102 includes, for example, a CPU (Central Processing Unit), an MPU (Micro-Processing Unit), etc. The processor 102 has the function of executing various processes by executing programs, but a part or all of these functions can also be specific-purpose integrated circuits such as an FPGA (Field Programmable Gate Array) and an ASIC (Application Specific Integrated Circuit). The term "processor" is not limited to a narrow-sense processor that executes processes in a stored-program manner like a CPU or an MPU, and can include hardwired circuits such as an ASIC or an FPGA.

[0034] Therefore, the processor 102 can also be renamed as a processing circuitry that has been predefined with processes by computer-readable codes and / or hardwired circuits. In addition, the processor 102 can be composed of a single chip or multiple chips. Also, the processor 102 and the associated processing circuitry can be composed of multiple computers that are connected to each other in a wired or wireless manner via a local area network or a wireless network, etc. The processor 102 and the associated processing circuitry can also be composed of a cloud computing mechanism that remotely performs operations based on input data and outputs the operation results to other devices located at a remote location.

[0035] The RAM 103 is a transient storage medium for storing operation results obtained by the CPU 102, etc. The storage device 104 is a memory such as a ROM (Read Only Memory), and a non-transient storage medium such as an HDD (Hard Disc Drive) or an SSD (Solid State Drive). The storage device 104 is used as a buffer during the processing of the CPU 102, and is used to store the program 1041 executed by the CPU 102, the detection values of the sensor 11, and / or the image data of the cameras 12 and 13. In addition, the storage device 104 can also be used to store operation results obtained by the CPU 102, etc., in the same way as the RAM 103.

[0036] In Embodiment 1, the user device 200 includes a communication interface (I / F) 201, a processor 202, a RAM (Random Access Memory) 203, a storage device 204, and a display 205. The communication interface 201, the processor 202, the RAM 203, and the storage device 204 in the user device 200 respectively correspond to the communication interface 101, the processor 102, the RAM 103, and the storage device 104 in the server device 100. Since they have the same structure, repeated description will be omitted.

[0037] The user device 200 is a head-mounted display worn on the head of the user Ur1 and covering the eyes of the user Ur1 for displaying a virtual space. In addition, Figure 2 An example in which the processor 202, the RAM 203, and the storage device 204 are built into the user device 200 is shown. However, in a certain situation, the processor 202, the RAM 203, and the storage device 204 may also be provided separately from the user device 200. For example, the processor 202, the RAM 203, and the storage device 204 are provided as a general-purpose PC.

[0038] The sensors 11, the cameras 12, 13 send the detection results to the server device 100 via a general-purpose computer (not shown) arranged at the position Ar1.

[0039] <Reflection of the real space>

[0040] Figure 3 It is a diagram for explaining an example in which the degree of change in the real space in Embodiment 1 is reflected in the virtual space. Figure 3 The structure arranged within the position Ar1 is shown within the left dashed line of Figure 3 Individuals arranged within the virtual space are shown within the right dashed line of Figure 3 In , the states of the real space and the virtual space are shown at times T1, T2, and T3 respectively. Among times T1, T2, and T3, time T1 is the earliest time, and time T3 is the latest time.

[0041] In Figure 3 In the example of , at the earliest time T1 among times T1 to T3, the tree Tr1 is in the state of a sapling and is in the state of having just been planted in the forest at the position Ar1 not long ago. At time T1, the tree Tr1 has a height H1. The sensor 11 acquires the shape of the tree Tr1 with a height H1 in the form of three-dimensional data and sends the three-dimensional data to the server device 100.

[0042] The server device 100 determines that the tree Tr1 has a height H1 based on the three-dimensional data. The server device 100 generates an individual Ob1 in the virtual space based on the acquired three-dimensional data. In Embodiment 1, the individual Ob1 is a three-dimensional model that mimics the shape of the tree Tr1 and is set in the virtual space. Thus, the user Ur1 can experience the existence of the tree Tr1 by immersing in the virtual space with the individual Ob1 having the same shape and size as the tree Tr1.

[0043] Similarly, at time T1, the camera 12 sends image data including the color information of the leaves of the tree Tr1 to the server device 100. The server device 100 determines the color information of the leaves of the tree Tr1 based on the image data acquired from the camera 12. The server device 100 generates the color information of the leaves of the individual Ob1 in the virtual space based on the determined color information of the leaves of the tree Tr1.

[0044] In addition, at time T1, the camera 13 sends image data representing the state inside the nest box Bh1 to the server device 100. The server device 100 generates a new individual corresponding to the animal when there is an animal inside the nest box Bh1 based on the information representing the state inside the nest box Bh1 acquired from the camera 13. In Figure 3 the example, at time T1, no animal visits the nest box Bh1, so no individual corresponding to the animal is generated.

[0045] Next, the processing of the server device 100 at time T2 will be described. Time T2 is a time after a specified period has elapsed since time T1. Time T2 can be, for example, a time after 1 second, 1 minute, 1 hour, 1 day, 1 week, etc. since time T1.

[0046] The tree Tr1 in the real space has grown compared to time T1 and has a height H2. The height H2 is higher than the height H1. In addition, as the temperature and sunlight duration around the tree Tr1 change, the color of the leaves of the tree Tr1 changes. In Embodiment 1, the color of the leaves of the tree Tr1 at time T2 is darker than the color of the leaves of the tree Tr1 at time T1. And the wild bird B1 is visiting the nest box Bh1.

[0047] As Figure 3 shown, at time T2, similarly to time T1, the sensor 11 acquires the shape of the tree Tr1 in the form of three-dimensional data and sends the three-dimensional data to the server device 100. At time T2, the tree Tr1 has a height H2. The server device 100 updates the shape of the individual Ob1 in the virtual space based on the acquired three-dimensional data.

[0048] At this time, the server device 100 determines the shape and size of the individual Ob1 at time T2 based on the shape of the individual Ob1 at time T1, in order to show the growth degree of the tree Tr1. Specifically, as Figure 3 shown, the height of the individual Ob1 at time T2 is higher than the height of the individual Ob1 at time T1.

[0049] In this way, in the management system 1000 of the first embodiment, the size of the tree Tr1 in the real space is reflected at any time. The user Ur1 who has experienced the individual Ob1 at time T1 can more specifically grasp the growth of the tree Tr1 by experiencing the individual Ob1 again at time T2.

[0050] In the first embodiment, the individual Ob1 is generated and updated in accordance with the shape of the three-dimensional data. Therefore, the degree of change of the individual Ob1 from time T1 to time T2 is the same as the degree of change of the tree Tr1 from time T1 to time T2. However, in a certain situation, the degree of change of the actual tree Tr1 and the degree of change of the individual Ob1 do not need to be the same degree of change. For example, the server device 100 may also exaggerate the degree of change of the individual Ob1 in order to express the growth degree of the tree Tr1 in an easy-to-understand manner for the user Ur1.

[0051] At time T2, the camera 12 sends the image data including the color information of the leaves of the tree Tr1 to the server device 100. The server device 100 determines the color information of the leaves of the tree Tr1 based on the acquired image data. At time T2, the server device 100 updates the color information of the leaves of the individual Ob1 in the virtual space based on the determined color information of the leaves of the tree Tr1.

[0052] At this time, the server device 100 determines the color information of the leaves of the individual Ob1 at time T2 based on the color information of the leaves of the individual Ob1 at time T1, in order to show the degree of change in the color of the leaves of the tree Tr1. In this way, in the management system 1000 of the first embodiment, the degree of change in the color of the leaves of the tree Tr1 in the real space can be easily shown. In addition, similar to the example of the shape, the degree of change in the color of the individual Ob1 can also be exaggerated compared to the actual degree of change in the color of the leaves.

[0053] In addition, at time T2, the camera 13 sends the image data indicating the state inside the nest box Bh1 to the server device 100. At time T2, the wild bird B1 is visiting the nest box Bh1. The server device 100 determines that the wild bird B1 has visited the nest box Bh1 based on the image data received from the camera 13. The server device 100 newly generates an individual Ob2 corresponding to the visiting wild bird B1.

[0054] Some wild birds build their nests in the tree Tr1 at a height above a specified height. That is, the presence or absence of wild bird visits is correlated with the height of the tree Tr1. The user Ur1 can sense the growth of the tree Tr1 by confirming whether wild birds visit the nest box Bh1, and can sense the growth of the entire forest based on the growth of the tree Tr1.

[0055] At time T3, the tree Tr1 in the real space has further grown compared to the tree Tr1 at time T2 and has a height H3. The height H3 is higher than the height H2. The color of the leaves of the tree Tr1 has become darker compared to the color at the time point of time T2. Also, at time T3, in addition to the wild bird B1, the wild bird B2 is also visiting the nest box Bh1.

[0056] Next, as Figure 3 shown, at time T3, similar to times T1 and T2, the sensor 11 sends three-dimensional data representing the shape of the tree Tr1 to the server device 100. At time T3, the tree Tr1 has a height H3. The server device 100 updates the shape of the individual Ob1 in the virtual space based on the three-dimensional data. At this time, the server device 100 determines the shape and size of the individual Ob1 at time T3 based on the shape of the individual Ob1 at time T2 to show the growth degree of the tree Tr1.

[0057] At time T3, the camera 12 sends image data including the color information of the leaves of the tree Tr1 to the server device 100. The server device 100 updates the color information of the leaves of the individual Ob1 in the virtual space based on the obtained color information of the leaves of the tree Tr1. At this time, the server device 100 determines the color information of the leaves of the individual Ob1 at time T3 based on the color information of the leaves of the individual Ob1 at time T2 to show the degree of change in the color of the leaves of the tree Tr1.

[0058] In addition, at time T3, the camera 13 sends image data representing the state inside the nest box Bh1 to the server device 100. At time T3, in addition to the wild bird B1, the wild bird B2 is also visiting the nest box Bh1. The server device 100 newly generates an individual Ob3 corresponding to the wild bird B2. The wild bird B2 is a bird of a different species from the wild bird B1. The server device 100 generates different individuals for each species of wild bird. Therefore, the shapes, sizes, and colors of the individuals Ob2 and Ob3 imitating the birds are different.

[0059] Thus, in the management system 1000 of Embodiment 1, the states of the objects (tree Tr1, nest box Bh1) arranged at the position Ar1 in the real space are successively detected, and the individuals in the virtual space are updated based on the detection results. Thereby, the user Ur1 can feel the growth of the tree Tr1 according to the change of the individual every time the virtual space is accessed. That is, in Embodiment 1, by feeling the change of the individual Ob1, the user Ur1 can more strongly and realistically feel the feeling of accessing the position Ar1 reflected in the virtual space. Thereby, the management system 1000 of the embodiment can make the user immersed in the virtual space more immersed in the virtual space.

[0060] In addition, in Embodiment 1, even when the user Ur1 has never actually visited the position Ar1, the user Ur1 can feel the growth of the tree Tr1 existing at the position Ar1 by means of the change of the individual Ob1. Thus, in Embodiment 1, even for a space that has not been actually visited, the user Ur1 can be made to feel a sense of familiarity or nostalgia for the position Ar1 by feeling the change of the individual Ob1. Since the user has a sense of nostalgia for the position Ar1, it is easy for the user to also have a sense of nostalgia for the enterprise that is maintaining the forest at the position Ar1, and the improvement of the corporate image can be achieved.

[0061] <Processing of the flowchart reflecting the real space>

[0062] Figure 4 It is a flowchart for explaining the reflection process of the real space in Embodiment 1. Figure 4 The processing of the flowchart shown is stored in the storage device 104 of the server device 100 as a program. Regarding Figure 4 the processing of the flowchart shown, the processing is realized by the processor 102 executing the program 1041 in the storage device 104.

[0063] The server device 100 acquires the detection results from each sensor (step S101). Each sensor in step S101 refers to the sensor 11, cameras 12, 13. It is judged whether the individuals corresponding to the detection results of each sensor exist (step S102). In Figure 3 this example, the server device 100 judges whether the individual Ob1 corresponding to the tree Tr1, or the individuals Ob2, Ob3 corresponding to the wild bird B1 already exist in the virtual space.

[0064] In the case where the corresponding individual does not exist (in step S102, it is "no"), the server device 100 generates the corresponding individual (step S103). For example, the server device 100 generates the individual Ob1 corresponding to the tree Tr1, the individual Ob2 corresponding to the wild bird B1, or the individual Ob3 corresponding to the wild bird B2.

[0065] On the other hand, when a corresponding individual already exists (Yes in step S102), the server device 100 calculates the degree of change for each object (step S104). More specifically, the server device 100 calculates the degree of change by comparing the previous detection result obtained from each sensor with the current detection result. For example, at time T2, the server device 100 obtains the length obtained by subtracting height H1 from height H2 based on the three-dimensional data as the growth degree. At time T2, the server device 100 obtains the degree of change in the color density of the leaves of tree Tr1 from the image data.

[0066] The server device 100 reflects the calculated degree of change in the individual (step S105). That is, the server device 100 updates the shape of the current individual Ob1 based on the shape information of the previous individual Ob1 according to the growth degree from height H1 to height H2. In addition, the server device 100 updates the color information of the leaves of the current individual Ob1 based on the degree of change in the color of the leaves, with the color information of the leaves of the previous individual Ob1 as the reference.

[0067] After executing step S103 or S105, the server device 100 determines whether a predetermined period has elapsed (step S106). The predetermined period can be, for example, a period of 1 second, 1 minute, 1 hour, 1 day, 1 week, etc. When the predetermined period has not elapsed (No in step S106), the server device 100 repeats the process of step S106. When the predetermined period has elapsed (Yes in step S106), the server device 100 returns the process to step S101. Thus, in Embodiment 1, the detection results of each sensor are used to update the information of the individual over time. In addition, in program 1041, the process of step S106 may not be described, or program 1041 itself may be executed at regular intervals.

[0068] <Issuance of Non-Fungible Tokens>

[0069] Next, the issuance of non-fungible tokens (Non-Fungible Token: NFT) will be described. Hereinafter, non-fungible tokens will sometimes be simply referred to as "NFTs". The server device 100 uses blockchain technology to manage data such as the individual Ob1 in the virtual space. In Embodiment 1, the data managed by blockchain technology is the non-fungible token (NFT) granted to the user. More specifically, a user who has purchased the data of individual Ob1 is granted a proof that has been NFTized.

[0070] Figure 5 It is a flowchart for explaining the NFT issuance process in Embodiment 1. Figure 5The processing of the flowchart shown is stored as Program 1041 in the storage device 104 of the server device 100. Regarding Figure 5 The processing of the flowchart shown is implemented by the processor 102 executing the program in the storage device 104.

[0071] The server device 100 determines whether there is an NFT issuance request from the user device 200 (step S201). If there is no NFT issuance request from the user device 200 (in step S201, "no"), the server device 100 repeats the processing of step S201.

[0072] If there is an NFT issuance request from the user device 200 (in step S201, "yes"), the server device 100 issues an NFT for proving that the data of the individual Ob1 is the property of the user (step S202). After that, the server device 100 generates an individual representing the issued NFT in the virtual space (step S203).

[0073] Figure 6 This is a diagram for explaining the individual Ob4 for which an NFT has been issued. In Figure 6 the individual Ob1 in the virtual space is shown. In the virtual space, a new individual Ob4 has been generated near the individual Ob1. The individual Ob4 is an individual in the shape of a signboard, on which the words "Owner: User Ur1" are written. Thus, in Embodiment 1, it is possible to make other users accessing the virtual space aware that the individual Ob1 is the property of the user Ur1.

[0074] For example, the NFT issuance request in step S201 can also be based on the fact that the user has donated the cultivation cost of the tree Tr1 in the real space corresponding to the individual Ob1. Thus, it is possible to show other users in the virtual space that the user Ur1 has contributed to the tree-planting activity in the real space and the improvement of the earth's environment. In addition, the shape of the individual Ob4 is not limited to the shape of a signboard, and can also be a stele, a hologram, or the name of the user Ur1 is displayed on the individual Ob1 itself. Or, an individual such as a badge or a crown can be displayed on the user Ur1 itself. In addition, the individual Ob4 can correspond to the "proving individual" in the present disclosure.

[0075] <Purchase Processing of Products Obtained Using Trees>

[0076] Figure 7 This is a flowchart for explaining the product purchase processing in Embodiment 1. Figure 7 The processing of the flowchart shown is stored as a program in the storage device 104 of the server device 100. Regarding Figure 7The processing of the flowchart shown is achieved by the processor 102 executing the program 1041 in the storage device 104.

[0077] As described above, in Embodiment 1, the virtual space managed by the server device 100 represents a forest maintained by an enterprise. Thinning is carried out during the forest maintenance operation. Thinning refers to the operation of adjusting the density of a crowded forest by felling a part of the trees according to the growth of the forest. When thinning is carried out, light reaches the ground surface, promoting the growth of the understory vegetation and enhancing the functions of the forest. If thinning is not carried out and the forest remains overcrowded, the trees may hinder each other's growth and become stunted.

[0078] The enterprise fells the tree Tr1 for thinning and uses the felled tree Tr1 to manufacture products. Products obtained by using the thinned tree Tr1 can be, for example, furniture, tableware, paper, aromatherapy oils formulated using essential oils distilled from the trunk and branches of the tree Tr1, etc.

[0079] The server device 100 determines whether there is a purchase request from the user device 200 for a product obtained by using the thinned tree Tr1 (step S301). If there is no purchase request from the user device 200 for a product obtained by using the thinned tree Tr1 (in step S301, "no"), the server device 100 repeats the process of step S301.

[0080] If there is a purchase request from the user device 200 for a product obtained by using the thinned tree Tr1 (in step S301, "yes"), the server device 100 executes the purchase process for the product obtained by using the thinned tree Tr1 (step S302). The purchase process for the product is a process in which the server device 100 agrees to the user's settlement of the product purchase using a credit card, virtual currency, etc. After that, the server device 100 performs the product delivery process (step S303). The delivery process refers to the process in which the server device 100 entrusts the responsible department within the company to deliver the product.

[0081] In this way, in Embodiment 1, it is possible to deliver the product manufactured using the tree located at position Ar1 to the user Ur1. For example, when the user Ur1 purchases an aromatherapy oil, the user Ur1 can enjoy the aroma of the aromatherapy oil using a nebulizer. Also, in Embodiment 1, by immersing in the virtual space while smelling the aroma of the aromatherapy oil, it is possible to enhance the sense of immersion in the virtual space by representing the forest in the virtual space through the sense of smell.

[0082] <Modification Example>

[0083] In Embodiment 1, a structure has been described in which the shape of the individual Ob1 that imitates the tree Tr1 is changed according to the degree of change of the tree Tr1 existing in the real space. However, the size, scale, and quantity of the individual Ob1 only need to be growing, and are not limited to having a three-dimensional model that imitates the shape of the tree Tr1. In addition, "growing" in the present embodiment is not limited to the case where the size, scale, and quantity increase, and may also be the case where they decrease. For example, in the case of taking the weathering of a rock as an object, the size of the rock existing in the real space gradually becomes smaller as it weathers. In the present embodiment, it can also be applied to an object whose size, scale, and quantity decrease over time. In the modified example, a structure for generating an individual of a character that represents the growth degree of the tree Tr1 will be described.

[0084] Figure 8 This is a diagram for explaining an example in which the degree of change in the real space is reflected in the virtual space in the modified example. In addition, in Figure 8 a description of a structure that duplicates the management system 1000 of Figure 1 will not be repeated.

[0085] Figure 8 The tree Tr1 in the real space shown in Figure 3 grows at the same growth degree as

[0086] In the modified example, the server device 100 uses the number of individuals of the character to represent the degree of change of the tree Tr1. At time T1, the server device 100 sets the individual Ob5 of the character in the virtual space corresponding to the tree Tr1 having a height H1. The individual Ob5 is, for example, an individual representing a tree sprite.

[0087] And at time T2, the server device 100, corresponding to the tree Tr1 having a height H2, in addition to setting the individual Ob5 of the character in the virtual space, newly sets the individual Ob6 in the virtual space. Thus, the user Ur1 can grasp that the tree Tr1 is growing based on the increase in the number of individuals of the tree sprite representing the tree Tr1.

[0088] Also, Figure 8 as shown, the server device 100 makes the color of the leaves of the tree Tr1 correspond to, for example, the color of the clothes worn by the character. Thus, the user Ur1 can grasp the change in the color of the leaves of the tree Tr1.

[0089] Next, other modification examples in Embodiment 1 will be described. In the above example, an example of using LiDAR to generate three-dimensional data representing the shape of the tree Tr1 was described. However, the method for generating the three-dimensional data representing the shape of the tree Tr1 is not limited to the method using LiDAR, and for example, it can also be generated by a stereo image method or a photogrammetry technique.

[0090] In the example of Embodiment 1, an example in which the user device 200 is a head-mounted display was described. However, the user device 200 can also be merely a liquid crystal panel or an organic EL (Electro Luminescence) panel.

[0091] In Embodiment 1, the height of the tree Tr1 is detected over time, and the degree of change in the detected height is calculated as the growth degree of the tree Tr1. However, the object to be detected can also be, instead of the height of the tree Tr1, the growth degree of the tree Tr1 extending horizontally, the number of leaves, the density of the leaves, etc. In addition, in Embodiment 1, an example of detecting the color of the leaves was described, but the colors of flowers, fruits, branches, etc. can also be detected.

[0092] In the example of Embodiment 1, wild birds were detected in the nest box Bh1, but the animals detected in the nest box Bh1 are not limited to wild birds, and can also be animals such as flying squirrels, squirrels, snakes, etc. In addition, the imaging target of the camera 13 for detecting animals is not limited to the nest box Bh1. For example, it can also be the area above or below the tree Tr1. The animals generated as individuals can also be insects such as butterflies.

[0093] In the example of Embodiment 1, the camera 13 that images the inside of the nest box Bh1 is a sensor that observes an object different from the tree Tr1 associated with the growth of the tree Tr1 over time. However, the sensor that observes an object different from the tree Tr1 over time is not limited to the camera 13. For example, it can also be a CO2 sensor that detects the carbon dioxide concentration in the atmosphere near the tree Tr1. If photosynthesis is activated by forest growth, the surrounding carbon dioxide concentration decreases. The server device 100 can also represent the decrease in the carbon dioxide concentration in the virtual space. For example, the server device 100 increases the transparency of the individuals representing the air in the virtual space as the carbon dioxide concentration decreases. Or, the server device 100 can also increase the number of star individuals configured at night as the carbon dioxide concentration decreases, thereby increasing the number of stars that can be visually recognized.

[0094] In addition, in the example of Embodiment 1, an example in which the server device 100, each sensor, and the tree Tr1 are arranged at different positions has been described. However, the server device 100, each sensor, and the tree Tr1 may also be arranged at the same position. That is, the position Ar1 and the position Ar2 may also be the same position.

[0095] In the above-described modification example, an example in which the number of tree spirits increases as the tree Tr1 grows has been described. However, the server device 100 may also change the age, appearance, and size of the tree spirits as the tree Tr1 grows.

[0096] [Embodiment 2]

[0097] In Embodiment 1, a method of expressing the growth degree of the tree Tr1 existing at the position Ar1 in the virtual space with the tree Tr1 as an object has been described. However, the object existing in the real space is not limited to a tree, and may be any object as long as it is an object that changes over time. In Embodiment 2, a structure for expressing the inventory number of products stored by an enterprise in the virtual space will be described.

[0098] Figure 9 FIG. is a diagram showing a schematic configuration of the management system 1000A according to Embodiment 2. In addition, in Figure 9 the description of the structure that duplicates the management system 1000 of Figure 1 will not be repeated. The management system 1000A includes a server device 100 and a sensor 14. The sensor 14 is arranged at the position Ar4 in the real space. The position Ar4 is a warehouse for storing the inventory of the enterprise's products.

[0099] The enterprise's products stored at the position Ar4 are products related to the improvement of the water quality of rivers. The enterprise's products in Embodiment 2 are, for example, devices for detecting the pollution of the soil near rivers. By trading the enterprise's products, the improvement of the pollution of the soil near rivers is related, and ultimately the improvement of the water quality of rivers is related.

[0100] As Figure 9 shown, the sensor 14 and the product inventory St1 are arranged at the position Ar4. In Figure 9 the example, the product inventory St1 includes 45 products. The sensor 14 is a sensor for detecting the number of products, and is, for example, a three-dimensional measuring device, a camera, or a detection device for reading an RFID (Radio Frequency Identification) tag.

[0101] In Embodiment 2, the server device 100 generates and updates individuals in the virtual space based on the data acquired by the sensor 14. In addition, in Embodiment 2, the inventory number of products can correspond to the "first object". Further, in Embodiment 2, the sensor 14 can correspond to the "first sensor".

[0102] Figure 10 It is a diagram for explaining an example in which the degree of change in the real space is reflected in the virtual space in Embodiment 2. In Embodiment 2, the server device 100 uses the number of fish in the river Rv1 arranged in the virtual space to represent the sales status of the enterprise's products.

[0103] At time T1, the server device 100 arranges the individual Ob8 in the river Rv1 corresponding to the inventory number of 45. The individual Ob8 is, for example, an individual representing a fish.

[0104] Through the transaction of products, at time T2, the inventory number becomes 30. At time T2, the server device 100 adds the individual Ob9 to the river Rv1 corresponding to the inventory number of 30. Thus, the user Ur1 can grasp that the inventory number has decreased after the transaction of the enterprise's products based on the increase in the number of fish individuals arranged in the river Rv1.

[0105] Through further transaction of products, at time T3, the inventory number becomes 15. At time T3, the server device 100 adds the individual Ob10 to the river Rv1 corresponding to the inventory number of 15. Thus, the user Ur1 can grasp that the inventory number has further decreased after the transaction of the enterprise's products based on the further increase in the number of fish individuals arranged in the river Rv1.

[0106] In this way, in the management system 1000A of Embodiment 2, it is possible to intuitively represent the improvement of the river in the real space through the sales status of the enterprise's products and the number of fish individuals in the virtual space. In addition, in Embodiment 2, it is also possible to more easily represent the status of the real space to the user immersed in the virtual space. In addition, in Embodiment 2, a technology that enables the user to be more immersed in the virtual space is also provided.

[0107] [Embodiment]

[0108] Those skilled in the art can understand that the above-mentioned multiple exemplary embodiments are specific examples of the following embodiments.

[0109] (First) The management system involved in one approach is a management system that provides a virtual space for users, and it includes: a user device used by the user; a sensor for observing the changes of an object existing in the real space over time; and a server device that sends information for providing the virtual space to the user device. The server device obtains the detection result of the sensor, calculates the degree of change of the object based on the detection result, and arranges the individual of the object reflecting the degree of change in the virtual space.

[0110] According to the management system described in the first item, a technology that enables users to be more immersed in the virtual space is provided.

[0111] (Second) In the management system described in the first item, the object grows over time, and the degree of change includes the degree of growth of the object.

[0112] According to the management system described in the second item, the degree of growth of the object can be reflected in the individual.

[0113] (Third) In the management system described in the second item, the degree of growth of the object varies according to the environment.

[0114] According to the management system described in the third item, the degree of growth corresponding to the environment of the real space can be reflected in the individual.

[0115] (Fourth) In the management system described in any one of the first to third items, the object includes a plant.

[0116] According to the management system described in the fourth item, the degree of change of the plant can be reflected in the individual.

[0117] (Fifth) In the management system described in the fourth item, the individual includes an individual imitating a plant.

[0118] According to the management system described in the fifth item, the plants in the real space can be represented in the virtual space.

[0119] (Sixth) In the management system described in the fourth or fifth item, the sensor includes a first sensor for observing the first part of the object and a second sensor for observing the second part of the object.

[0120] According to the management system described in the sixth item, the degree of change of multiple parts included in the object can be reflected in the individual.

[0121] (Seventh) In the management system described in the sixth item, the first part is the shape of the whole plant, and the second part is the leaves of the plant.

[0122] According to the management system described in the seventh item, the shape of the whole plant and the degree of change of the leaves of the plant can be reflected in the individual.

[0123] (Eighth item) In the management system described in the fourth or fifth item, the objects include a first object and a second object. The sensors include a first sensor for observing the first object and a third sensor for observing the second object.

[0124] According to the management system described in the eighth item, in the virtual space, in addition to being able to represent the first object, the second object can also be represented.

[0125] (Ninth item) In the management system described in the eighth item, the second object is a nest box set around the plant.

[0126] According to the management system described in the ninth item, the ecology of the animals associated with the first object as the plant can be reflected in the virtual space.

[0127] (Tenth item) In the management system described in any one of the first to ninth items, the server device generates a non-fungible token for proving that an individual is the property of the user according to a command from the user device.

[0128] According to the management system described in the tenth item, users can own individuals on the virtual space by issuing NFTs.

[0129] (Eleventh item) In the management system described in the tenth item, the server device configures a proof individual for proving that an individual is the property of the user in the virtual space.

[0130] According to the management system described in the eleventh item, all users immersed in the virtual space can identify the owner of the individual.

[0131] (Twelfth item) In the management system described in any one of the first to eleventh items, the server device performs a purchase process for the product manufactured by the use object according to a command from the user device.

[0132] According to the management system described in the twelfth item, users can purchase products associated with the object that is the reflection prototype of the individual.

[0133] (Thirteenth item) In the management system described in the first item, the object includes the inventory number of the product.

[0134] According to the management system described in the thirteenth item, the inventory number can be used as an individual for users to identify in an easy-to-understand manner.

[0135] (Fourteenth item) The server device involved in one mode is a server device that provides a virtual space to users. The server device obtains the detection results of sensors for observing the changes of objects existing in the real space over time, calculates the degree of change of the objects based on the detection results, and configures an individual representing the object reflecting the degree of change in the virtual space.

[0136] The server device according to the fourteenth item provides a technology that enables users to be more immersed in the virtual space.

[0137] (Fifteenth item) A method according to one aspect is a method of providing a virtual space to a user. The method includes the following steps as processing to be executed by a computer: obtaining detection results of a sensor for observing changes in an object existing in the real space over time; calculating a degree of change of the object based on the detection results; and arranging an individual of the object representing the degree of change in the virtual space.

[0138] The method according to the fifteenth item provides a technology that enables users to be more immersed in the virtual space.

[0139] (Sixteenth item) A program according to one aspect is a program executed by a server device that provides a virtual space to a user. The program includes the following steps as processing to be executed by a computer: obtaining detection results of a sensor for observing changes in an object existing in the real space over time; calculating a degree of change of the object based on the detection results; and arranging an individual of the object representing the degree of change in the virtual space.

[0140] The program according to the sixteenth item provides a technology that enables users to be more immersed in the virtual space.

[0141] The embodiments of the present invention have been described, but it should be considered that the embodiments disclosed this time are illustrative in all respects and not restrictive. The scope of the present invention is shown by the claims and is intended to include all modifications within the meaning and scope equivalent to the claims.

Claims

1. A management system that provides a virtual space to a user, the management system comprising: A user device used by the user; A sensor for observing the change of an object existing in the real space over time; and A server device that sends information for providing the virtual space to the user device, Among them, The server device acquires the detection result of the sensor, The server device calculates the degree of change of the object based on the detection result, The server device arranges an individual of the object representing the degree of change in the virtual space.

2. The management system according to claim 1, wherein The object grows over time, The degree of change includes the degree of growth of the object.

3. The management system according to claim 2, wherein The degree of growth of the object varies according to the environment.

4. The management system according to claim 1, wherein The object includes a plant.

5. The management system according to claim 4, wherein The individual includes an individual imitating the plant.

6. The management system according to claim 4, wherein The sensor includes a first sensor for observing a first part of the object and a second sensor for observing a second part of the object.

7. The management system according to claim 6, wherein The first part is the shape of the whole plant, The second part is the leaves of the plant.

8. The management system according to claim 4, wherein The object includes a first object and a second object, The sensor includes a first sensor for observing the first object and a third sensor for observing the second object.

9. The management system according to claim 8, wherein The second object is a nest box provided around the plant.

10. The management system according to claim 1, wherein The server device generates a non-fungible token for proving that the individual is the property of the user according to a command from the user device.

11. The management system according to claim 10, wherein The server device arranges a proof individual for proving that the individual is the property of the user in the virtual space.

12. The management system according to claim 1, wherein The server device performs a purchase process of a product manufactured using the object according to a command from the user device.

13. A server device that provides a virtual space to a user, The server device includes a control unit and a storage unit, Among them, The control unit acquires the detection result of a sensor for observing the change of an object existing in the real space over time, The control unit calculates the degree of change of the object based on the detection result, The control unit arranges an individual of the object representing the degree of change in the virtual space.

14. A method for providing a virtual space to a user, wherein The method includes the following steps as processing to be executed by a computer: Acquire the detection result of a sensor for observing the change of an object existing in the real space over time; Calculate the degree of change of the object based on the detection result; and Arrange the individual of the object that represents the degree of change in the virtual space.

15. A computer program product, comprising a program executed by a server device that provides a virtual space to a user, wherein the program includes the following steps as processing for causing a computer to execute: Obtain the detection result of a sensor for observing the change of an object existing in the real space over time; Calculate the degree of change of the object based on the detection result; and Arrange the individual of the object that represents the degree of change in the virtual space.

Images