Management system, server device, method, and program

Abstract

To provide a technology for enabling a user to further immerse in a virtual space.SOLUTION: A management system (1000) for providing a user (Ur1) with a virtual space includes a user device (200) used by the user (Ur1), a sensor (11) for observing secular change of an object (Tr1) existing in a real space, and a server (100) for transmitting information for providing the virtual space to the user device (200). The server device (100) acquires a detection result of the sensor (S101), calculates a change degree of a target on the basis of the detection result (S104), and arranges an object (Ob1) representing a target reflecting the change degree in the virtual space (S105).SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present disclosure relates to a system, a server device, a method, and a program for providing a virtual space to a user.

Background Art

[0002] Conventionally, a system for providing a virtual space to a user has been known. For example, Patent Document 1 (Japanese Patent Application Laid-Open No. 2001-118081) discloses a system that aligns the weather in a virtual space with the weather in the real space based on information obtained from a server that manages information related to the weather in the real space. More specifically, the system of Patent Document 1 selects the weather in the virtual space from among "sunny", "cloudy", and "rainy" based on the information related to the weather in the real space.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By expressing the current state of an observation target in the real space in a virtual space as in the system of Patent Document 1, it is possible to immerse the user in the virtual space. However, if the temporal change of the observation target existing in the real space can be expressed in the virtual space, the user can be more immersed in the virtual space.

[0005] The present disclosure has been made to solve the above problems, and an object thereof is to provide a technology that can immerse a user in a virtual space.

Means for Solving the Problems

[0006] The management system of the present disclosure is a management system that provides a virtual space for a user. The management system includes a user device used by the user, a sensor that observes the change over time of an object existing in the real space, and a server device that transmits information for providing the virtual space to the user device. The server device acquires the detection result of the sensor, calculates the degree of change of the object based on the detection result, and arranges an object representing the object reflecting the degree of change in the virtual space.

[0007] The server device of the present disclosure is a server device that provides a virtual space for a user. The server device acquires the detection result of a sensor that observes the change over time of an object existing in the real space, calculates the degree of change of the object based on the detection result, and arranges an object representing the object reflecting the degree of change in the virtual space.

[0008] The method of the present disclosure is a method of providing a virtual space for a user. The method includes, as processes to be executed by a computer, a step of acquiring the detection result of a sensor that observes the change over time of an object existing in the real space, a step of calculating the degree of change of the object based on the detection result, and a step of arranging an object representing the object reflecting the degree of change in the virtual space.

[0009] The program of the present disclosure is a program executed by a server device that provides a virtual space for a user. The program includes, as processes to be executed by a computer, a step of acquiring the detection result of a sensor that observes the change over time of an object existing in the real space, a step of calculating the degree of change of the object based on the detection result, and a step of arranging an object representing the object reflecting the degree of change in the virtual space.

Advantages of the Invention

[0010] According to the present disclosure, a user immersed in the virtual space can be immersed by the virtual space.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Embodiments for Carrying Out the Invention

[0012] [First Embodiment] This embodiment will be described in detail with reference to the drawings. For the same or corresponding parts in the drawings, the same reference numerals are given, and the description will not be repeated in principle.

[0013] <Configuration of the Management System> FIG. 1 is a diagram showing a schematic configuration of a management system 1000 according to Embodiment 1. The management system 1000 is a system for managing a virtual space. The management system 1000 includes a server device 100, sensors 11, cameras 12 and 13, and a user device 200. The sensors 11 and the cameras 12 and 13 are arranged at a position Ar1 in the real space. The server device 100 is arranged at a position Ar2 in the real space. The user device 200 is arranged at a position Ar3 in the real space.

[0014] The positions Ar1 to Ar3 are in the real space in the real world, not in the virtual space. The position Ar1 is within a specific forest. The forest has been maintained by a specific company as part of its CSR (Corporate Social Responsibility) activities. The position Ar2 is within a server room owned by the company that maintains the forest at the position Ar1. The position Ar3 is within the residence of a user Ur1 who immerses in the virtual space. The positions Ar1 to Ar3 are different spaces from each other.

[0015] The above-mentioned company participates in the movement to improve the global environment by maintaining the forest in an appropriate state through forest maintenance. As shown in FIG. 1, a tree Tr1 is planted at the position Ar1. In Embodiment 1, the tree Tr1 is, for example, a tree with a tree height exceeding 10 m such as Quercus serrata or Quercus mongolica. In a certain aspect, the tree Tr1 may be a plant with a low tree height such as Hibiscus trionum, Blyxa echinosperma, Cacalia hastata, or Lactuca tatarica, or may be another type of plant. The tree Tr1 is one of a plurality of trees existing at the position Ar1. The growth rate of the tree Tr1 varies according to the surrounding environment. The nest box Bh1 is installed around the tree Tr1, for example, on a branch of the tree Tr1.

[0016] The sensor 11 and the camera 12 detect information about the tree Tr1. The camera 13 detects information about the birdhouse Bh1. The server device 100 generates and updates a virtual space representing the forest at the location Ar1 using the information acquired by the sensor 11 and the cameras 12 and 13. Specifically, the representation by the virtual space may be, for example, representing the growth status of the trees planted at the location Ar1 on the virtual space, or collecting the sounds generated at the location Ar1 (for example, the chirping of birds, the sound of the wind moving the leaves, the sound of the river flowing) and outputting them within the virtual space to represent the acoustics generated at the location Ar1. Thereby, the user can perform a pseudo-forest bathing, and can give a healing effect to a user who has not actually visited the location Ar1. Further, the representation by the virtual space is not limited to the representation for making the user perform forest bathing. For example, it may be a representation of the ecosystem of the flora and fauna at the location Ar1, a representation of the content of chemical substances contained in the soil, the water quality of the river, etc., or a representation of the number of visitors who have visited the location Ar1. Thereby, the degree of contribution of the company's maintenance of the location Ar1 to the user can be shown in various ways.

[0017] The user Ur1 can be, for example, a shareholder of a company that maintains the forest, a purchaser of a product sold by the company, an employee of the company, a business partner who conducts joint research with the company, etc. By immersing in the virtual space via the user device 200, the user Ur1 can feel as if visiting the forest at the location Ar1. Thereby, the user Ur1 can experience the efforts of the company's CSR activities without actually visiting the forest at the location Ar1.

[0018] Sensor 11 is, for example, a LiDAR (Light Detection And Ranging), which images the shape and size of the entire tree Tr1 as three-dimensional data. Camera 12 images the appearance of the tree Tr1. The image data showing the appearance of the tree Tr1 includes information indicating the color of the leaves of the tree Tr1 and information indicating the shape and size of the entire tree Tr1. Camera 13 images the inside of the nest box Bh1. The image data showing the inside of the nest box Bh1 includes information on whether an animal has visited the nest box Bh1. Each of the sensor 11 and the cameras 12 and 13 continuously detects the state of the object over time. In other words, the tree Tr1 is an observation target of the sensor 11 and the camera 12. The nest box Bh1 is an observation target of the camera 13.

[0019] The user device 200 displays the virtual space managed by the server device 100 to the user Ur1. The server device 100 transmits information for displaying the virtual space to the user device 200 for the user Ur1. The user device 200 is, for example, a head-mounted display (HMD). In Embodiment 1, the user Ur1 wears the user device 200 on the head and immerses into the virtual space.

[0020] The server device 100 generates and updates the objects in the virtual space based on the data acquired by the sensor 11 and the cameras 12 and 13. Note that the sensor 11 may correspond to the "first sensor" in the present disclosure. The camera 12 may correspond to the "second sensor" in the present disclosure. The camera 13 may correspond to the "third sensor" in the present disclosure. The tree Tr1 may correspond to the "first object" in the present disclosure. The shape of the entire tree Tr1 may correspond to the "first part" in the present disclosure. The leaves of the tree Tr1 may correspond to the "second part" in the present disclosure. The nest box Bh1 may correspond to the "second object" in the present disclosure. Hereinafter, the sensor 11 and the cameras 12 and 13 may be collectively referred to as "each sensor".

[0021] FIG. 2 is a block diagram of the configuration included in the management system 1000. The server device 100, the user device 200, the sensor 11, and the cameras 12 and 13 are connected to each other via the network NW. The network NW is, for example, the Internet. The server device 100 includes a communication interface (I / F) 101, a processor 102, a RAM (Random Access Memory) 103, and a storage device 104. The communication interface 101, the processor 102, the RAM 103, and the storage device 104 are connected to a common bus and are configured to be able to exchange signals with each other.

[0022] The processor 102 is an arithmetic entity (computer) that executes various processes by executing various programs. The processor 102 includes, for example, a CPU (Central Processing Unit), an MPU (Micro-Processing Unit), etc. The processor 102 has a function of executing various processes by executing programs, but some or all of these functions may be specific-purpose integrated circuits such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The term "processor" is not limited to a narrow-sense processor that executes processes in a stored-program manner such as a CPU or an MPU, and may include a hard-wired circuit such as an ASIC or an FPGA.

[0023] Therefore, the processor 102 can also be regarded as a processing circuitry whose preprocessing is defined by computer-readable code and / or hardwired circuits. Note that the processor 102 may be composed of one chip or multiple chips. Furthermore, the processor 102 and related processing circuits may be composed of multiple computers interconnected by wire or wirelessly via a local area network or a wireless network, etc. The processor 102 and related processing circuits may be composed of a cloud computer that remotely performs calculations based on input data and outputs the calculation results to other devices located at a distance.

[0024] The RAM 103 is a temporary storage medium used to store the calculation results by the CPU 102 and the like. The storage device 104 is a memory such as a ROM (Read Only Memory), and a non-temporary storage medium such as an HDD (Hard Disc Drive) or an SSD (Solid State Disk). The storage device 104 is used as a buffer during the processing of the CPU 102 and is also used to store the program 1041 executed by the CPU 102, the detection values of the sensor 11, and / or the image data of the cameras 12 and 13. Note that the storage device 104 may also be used to store the calculation results by the CPU 102, etc., similar to the RAM 103.

[0025] In the first embodiment, the user device 200 includes a communication interface (I / F) 201, a processor 202, a RAM (Random Access Memory) 203, a storage device 204, and a display 205. The communication interface 201, the processor 202, the RAM 203, and the storage device 204 in the user device 200 correspond to those of the communication interface 101, the processor 102, the RAM 103, and the storage device 104 in the server device 100 respectively, and have the same configuration, so the description will not be repeated.

[0026] The user device 200 is a head-mounted display that is worn on the head of user Ur1 and covers both eyes of user Ur1 to display a virtual space. In FIG. 2, an example is shown in which a processor 202, a RAM 203, and a storage device 204 are built into the user device 200. However, in some aspects, the processor 202, the RAM 203, and the storage device 204 may be provided separately from the user device 200. For example, the processor 202, the RAM 203, and the storage device 204 may be provided as a general-purpose PC.

[0027] The sensors 11, cameras 12, 13 transmit the detection results to the server device 100 via a general-purpose computer (not shown) arranged at the position Ar1.

[0028] <Reflection of the real space> FIG. 3 is a diagram for explaining an example of reflecting the degree of change in the real space in the virtual space in Embodiment 1. The inside of the left dashed line in FIG. 3 shows the configuration arranged within the position Ar1. The inside of the right dashed line in FIG. 3 shows the objects arranged within the virtual space. In FIG. 3, the states of the real space and the virtual space are shown for each of the timings T1, T2, and T3. Among the timings T1, T2, and T3, the timing T1 is the oldest timing, and the timing T3 is the newest timing.

[0029] In the example of FIG. 3, among the timings T1 to T3, at the oldest timing T1, the tree Tr1 is in the state of a sapling and is in the state immediately after being planted in the forest at the position Ar1. At the timing T1, the tree Tr1 has a height H1. The sensor 11 acquires the shape of the tree Tr1 with the height H1 as three-dimensional data and transmits the three-dimensional data to the server device 100.

[0030] The server device 100 identifies that the tree Tr1 has a height H1 based on the three-dimensional data. The server device 100 generates an object Ob1 in the virtual space based on the acquired three-dimensional data. In Embodiment 1, the object Ob1 is a three-dimensional model imitating the shape of the tree Tr1 and is installed in the virtual space. Thereby, the user Ur1 can experience the existence of the tree Tr1 through the object Ob1 having the same shape and size as the tree Tr1 by immersing in the virtual space.

[0031] Similarly, at timing T1, the camera 12 transmits image data including the color information of the leaves of the tree Tr1 to the server device 100. The server device 100 identifies the color information of the leaves of the tree Tr1 from the image data acquired from the camera 12. The server device 100 generates the color information of the leaves of the object Ob1 in the virtual space based on the identified color information of the leaves of the tree Tr1.

[0032] Also, at timing T1, the camera 13 transmits image data indicating the state inside the nest box Bh1 to the server device 100. When an animal exists inside the nest box Bh1 based on the information indicating the state inside the nest box Bh1 acquired from the camera 13 by the server device 100, a new object corresponding to the animal is generated. In the example of FIG. 3, since no animal visits the nest box Bh1 at timing T1, no object corresponding to the animal is generated.

[0033] Subsequently, the processing of the server device 100 at timing T2 will be described. Timing T2 is the timing after a predetermined period has elapsed from timing T1. Timing T2 can be, for example, the timing after 1 second, 1 minute, 1 hour, 1 day, 1 week, etc. have elapsed from timing T1.

[0034] The tree Tr1 in the real space grows from timing T1 and has a height H2. The height H2 is higher than the height H1. Also, as the temperature and sunlight hours around the tree Tr1 change, the color of the leaves of the tree Tr1 changes. In Embodiment 1, the color of the leaves of the tree Tr1 at timing T2 is darker than the color of the leaves of the tree Tr1 at timing T1. Furthermore, a wild bird B1 visits the birdhouse Bh1.

[0035] As shown in FIG. 3, at timing T2 as well as at timing T1, the sensor 11 acquires the shape of the tree Tr1 as three-dimensional data and transmits the three-dimensional data to the server device 100. At timing T2, the tree Tr1 has a height H2. The server device 100 updates the shape of the object Ob1 in the virtual space based on the acquired three-dimensional data.

[0036] At this time, the server device 100 determines the size of the shape of the object Ob1 at timing T2 so as to indicate the growth degree of the tree Tr1 with reference to the shape of the object Ob1 at timing T1. Specifically, as shown in FIG. 3, the height of the object Ob1 at timing T2 is higher than the height of the object Ob1 at timing T1.

[0037] In this way, in the management system 1000 of Embodiment 1, the size of the tree Tr1 in the real space is reflected at any time. The user Ur1 who experienced the object Ob1 at timing T1 can more specifically grasp the growth of the tree Tr1 by experiencing the object Ob1 again at timing T2.

[0038] In Embodiment 1, the object Ob1 is generated and updated according to the shape of the three-dimensional data. Therefore, the degree of change of the object Ob1 from timing T1 to timing T2 is the same as the degree of change of the tree Tr1 from timing T1 to timing T2. However, in a certain situation, the degree of change of the actual tree Tr1 and the degree of change of the object Ob1 do not necessarily have to be the same degree of change. For example, the server device 100 may exaggerate the degree of change of the object Ob1 in order to express the growth degree of the tree Tr1 to the user Ur1 in an easy-to-understand manner.

[0039] At timing T2, the camera 12 transmits image data including the color information of the leaves of the tree Tr1 to the server device 100. The server device 100 specifies the color information of the leaves of the tree Tr1 from the acquired image data. At timing T2, the server device 100 updates the color information of the leaves of the object Ob1 in the virtual space based on the specified color information of the leaves of the tree Tr1.

[0040] At this time, the server device 100 determines the color information of the leaves of the object Ob1 at timing T2 so as to indicate the degree of change in the color of the leaves of the tree Tr1, based on the color information of the leaves of the object Ob1 at timing T1. In this way, in the management system 1000 of Embodiment 1, the degree of change in the color of the leaves of the tree Tr1 in the real space can be expressed in an easy-to-understand manner. Note that, similar to the example of the shape, the degree of change in the color of the object Ob1 may be exaggerated more than the actual degree of change in the color of the leaves.

[0041] Also, at timing T2, the camera 13 transmits image data indicating the state inside the nest box Bh1 to the server device 100. At timing T2, a wild bird B1 has visited the nest box Bh1. The server device 100 specifies that the wild bird B1 has visited the nest box Bh1 based on the image data received from the camera 13. The server device 100 newly generates an object Ob2 corresponding to the visited wild bird B1.

[0042] Some wild birds build nests in trees Tr1 that have a height equal to or greater than a predetermined height. That is, the presence or absence of wild bird visits is related to the height of tree Tr1. By checking whether wild birds are visiting the nesting box Bh1, user Ur1 can feel the growth of tree Tr1 and, from the growth of tree Tr1, can feel the growth of the entire forest.

[0043] At timing T3, the tree Tr1 in the real space has grown further than the tree Tr1 at timing T2 and has a height H3. Height H3 is higher than height H2. The color of the leaves of tree Tr1 has become darker since timing T2. Furthermore, at timing T3, in addition to wild bird B1, wild bird B2 is visiting the nesting box Bh1.

[0044] Subsequently, as shown in FIG. 3, also at timing T3, similar to timings T1 and T2, the sensor 11 transmits three-dimensional data indicating the shape of the tree Tr1 to the server device 100. At timing T3, the tree Tr1 has a height H3. The server device 100 updates the shape of the object Ob1 in the virtual space based on the three-dimensional data. At this time, the server device 100 determines the shape and size of the object Ob1 at timing T3 so as to indicate the degree of growth of the tree Tr1, based on the shape of the object Ob1 at timing T2.

[0045] At timing T3, the camera 12 transmits image data including the color information of the leaves of the tree Tr1 to the server device 100. The server device 100 updates the color information of the leaves of the object Ob1 in the virtual space based on the acquired color information of the leaves of the tree Tr1. At this time, the server device 100 determines the color information of the leaves of the object Ob1 at timing T3 so as to indicate the degree of change in the color of the leaves of the tree Tr1, based on the color information of the leaves of the object Ob1 at timing T2.

[0046] Also, at timing T3, the camera 13 transmits image data showing the state inside the nest box Bh1 to the server device 100. At timing T3, in addition to the wild bird B1, the wild bird B2 has visited the nest box Bh1. The server device 100 newly generates an object Ob3 corresponding to the wild bird B2. The wild bird B2 is a different type of bird from the wild bird B1. The server device 100 generates different objects for each type of wild bird. Therefore, the object Ob2 and the object Ob3 that mimic birds are different in shape, size, and color.

[0047] In this way, in the management system 1000 of the first embodiment, the states of the objects (the tree Tr1 and the nest box Bh1) arranged at the position Ar1 in the real space are sequentially detected, and the objects in the virtual space are updated based on the detection results. As a result, the user Ur1 can feel the growth of the tree Tr1 as the object changes each time the user visits the virtual space. That is, in the first embodiment, by feeling the change of the object Ob1, the user Ur1 can more strongly feel the sense of visiting the position Ar1 reflected in the virtual space. Thereby, in the management system 1000 of the embodiment, the user who immerses in the virtual space can be made to immerse in the virtual space.

[0048] Also, in the first embodiment, even when the user Ur1 has never actually visited the position Ar1, the user Ur1 can feel the growth of the tree Tr1 existing at the position Ar1 through the change of the object Ob1. Thereby, in the first embodiment, even in a space that has never been actually visited, by making the user feel the change of the object Ob1, the user Ur1 can be made to have a sense of familiarity or attachment to the position Ar1. Since the user can be made to have an attachment to the position Ar1, it becomes easier to make the user have an attachment to the company that maintains the forest at the position Ar1, and the image of the company can be improved.

[0049] <Processing of the flowchart of real space reflection> FIG. 4 is a flowchart for explaining the real-space reflection process in Embodiment 1. The processes of the flowchart shown in FIG. 4 are stored as programs in the storage device 104 of the server device 100. The processes of the flowchart shown in FIG. 4 are realized by the processor 102 executing the program 1041 in the storage device 104.

[0050] The server device 100 acquires detection results from each sensor (step S101). Each sensor in step S101 means sensor 11, cameras 12, 13. It is determined whether there is an object corresponding to the detection result of each sensor (step S102). In the example of FIG. 3, the server device 100 determines whether an object Ob1 corresponding to the tree Tr1 or objects Ob2, Ob3 corresponding to the wild bird B1 already exists in the virtual space.

[0051] If there is no corresponding object (NO in step S102), the server device 100 generates a corresponding object (step S103). For example, the server device 100 generates an object Ob1 corresponding to the tree Tr1, an object Ob2 corresponding to the wild bird B1, or an object Ob3 corresponding to the wild bird B2.

[0052] On the other hand, if the corresponding object already exists (YES in step S102), the server device 100 calculates the degree of change of each object (step S104). More specifically, the server device 100 compares the previous detection result acquired from each sensor with the current detection result to calculate the degree of change. For example, at timing T2, the server device 100 acquires, based on the three-dimensional data, the length obtained by subtracting the height H1 from the height H2 as the growth degree. At timing T2, the server device 100 acquires, from the image data, the degree of change in the density of the color of the leaves of the tree Tr1.

[0053] The server device 100 reflects the calculated degree of change in the object (step S105). That is, the server device 100 updates the shape of the current object Ob1 based on the shape information of the previous object Ob1 according to the degree of growth from height H1 to height H2. Further, the server device 100 updates the leaf color information of the current object Ob1 based on the leaf color information of the previous object Ob1 according to the degree of change in the color of the leaves.

[0054] After executing step S103 or S105, the server device 100 determines whether a predetermined period has elapsed (step S106). The predetermined period can be, for example, a period of 1 second, 1 minute, 1 hour, 1 day, 1 week, etc. If the predetermined period has not elapsed (NO in step S106), the server device 100 repeats the process of step S106. If the predetermined period has elapsed (YES in step S106), the server device 100 returns the process to step S101. Thus, in Embodiment 1, the information of the object is updated over time using the detection results of each sensor. Note that the process of step S106 does not necessarily have to be described in program 1041, and program 1041 itself may be executed at predetermined intervals.

[0055] <Issuance of Non-Fungible Tokens> Subsequently, the issuance of non-fungible tokens (Non-Fungible Tokens: NFTs) will be described. Hereinafter, non-fungible tokens may be simply referred to as "NFTs". The server device 100 manages data such as the object Ob1 in the virtual space using blockchain technology. In Embodiment 1, the data managed by the blockchain technology is a non-fungible token (NFT) given to the user. More specifically, a proof NFT is given to the user who purchased the data of the object Ob1.

[0056] FIG. 5 is a flowchart for explaining the NFT issuance process in Embodiment 1. The processes of the flowchart shown in FIG. 5 are stored as program 1041 in the storage device 104 of the server device 100. The processes of the flowchart shown in FIG. 5 are realized by the processor 102 executing the program in the storage device 104.

[0057] The server device 100 determines whether there is an NFT issuance request from the user device 200 (step S201). If there is no NFT issuance request from the user device 200 (NO in step S201), the server device 100 repeats the process of step S201.

[0058] If there is an NFT issuance request from the user device 200 (YES in step S201), the server device 100 issues an NFT that proves that the data of the object Ob1 is the user's possession (step S202). Thereafter, the server device 100 generates an object indicating that the NFT has been issued in the virtual space (step S203).

[0059] FIG. 6 is a diagram for explaining the object Ob4 indicating that the NFT has been issued. FIG. 6 shows the object Ob1 in the virtual space, and in the virtual space, the object Ob4 is newly generated near the object Ob1. The object Ob4 is an object having the shape of a signboard, and the characters "Owner: User Ur1" are described thereon. Thus, in Embodiment 1, it is possible to notify other users visiting the virtual space that the object Ob1 is the possession of the user Ur1.

[0060] The NFT issuance request in step S201 may be made, for example, based on the user's fundraising for the cultivation cost of the tree Tr1 in the real space corresponding to the object Ob1. Thereby, the user Ur1 can display to other users in the virtual space that they have contributed to the afforestation activity in the real space and the improvement of the global environment. Note that the shape of the object Ob4 is not limited to the shape of a signboard, and the name of the user Ur1 may be displayed on a stele, a hologram, or the object Ob1 itself. Alternatively, an object such as a badge or a crown may be displayed on the user Ur1 himself / herself. Note that the object Ob4 may correspond to the "proof object" in the present disclosure.

[0061] <Purchase process of products using trees> FIG. 7 is a flowchart for explaining the product purchase process in Embodiment 1. The processes of the flowchart shown in FIG. 7 are stored as programs in the storage device 104 of the server device 100. The processes of the flowchart shown in FIG. 7 are realized by the processor 102 executing the program 1041 in the storage device 104.

[0062] As described above, in Embodiment 1, the virtual space managed by the server device 100 represents a forest maintained by a company. In the forest maintenance work, thinning is performed. Thinning is an operation of felling a part of the trees according to the growth of the forest and adjusting the density of the overcrowded forest. When thinning is performed, light reaches the ground surface, promoting the development of the understory vegetation, and improving the functions of the forest. If thinning is not performed and the forest remains overcrowded, the trees may inhibit each other's growth and may become stunted.

[0063] The company fells the tree Tr1 for thinning and manufactures products using the felled tree Tr1. The products using the thinned tree Tr1 may be, for example, furniture, tableware, paper, or aromatic oils prepared using essential oils distilled from the trunk, branches, and leaves of the tree Tr1.

[0064] The server device 100 determines whether there is a purchase request for a product using the thinned tree Tr1 from the user device 200 (step S301). If there is no purchase request for a product using the thinned tree Tr1 from the user device 200 (NO in step S301), the server device 100 repeats the process of step S301.

[0065] If there is a purchase request for a product using the thinned tree Tr1 from the user device 200 (YES in step S301), the server device 100 executes a purchase process for the product using the thinned tree Tr1 (step S302). The purchase process for the product is a process in which the server device 100 approves the settlement of the product purchase from the user using a credit card, virtual currency, or the like. After that, the server device 100 performs a product shipping process (step S303). The shipping process is a process in which the server device 100 requests the in-house responsible department to ship the product.

[0066] In this way, in the first embodiment, it is possible to ship the product manufactured from the tree existing at the position Ar1 to the user Ur1. For example, when the user Ur1 purchases aromatherapy oil, the user Ur1 can enjoy the scent of the aromatherapy oil using an atomizer. Furthermore, in the first embodiment, by immersing into the virtual space while smelling the scent of the aromatherapy oil, the forest in the virtual space is expressed through the sense of smell, and the sense of immersion into the virtual space can be enhanced.

[0067] <Modification Example> In Embodiment 1, a configuration was described in which the shape of the object Ob1 modeled after the tree Tr1 changes according to the degree of change of the tree Tr1 existing in the real space. However, the object Ob1 only needs to grow in size, scale, and number, and is not limited to a three-dimensional model having a shape modeled after the tree Tr1. Note that "growth" in the present embodiment is not limited to an increase in size, scale, and number, and may also decrease. For example, when targeting the weathering of a rock, the size of the rock existing in the real space gradually decreases with weathering. In the present embodiment, it is also applicable to objects whose size, scale, and number decrease over time. In a modified example, a configuration will be described in which an object of a character representing the degree of growth of the tree Tr1 is generated.

[0068] FIG. 8 is a diagram for explaining an example of reflecting the degree of change in the real space in the modified example in the virtual space. Note that in FIG. 8, the description of the configuration overlapping with the management system 1000 in FIG. 1 will not be repeated.

[0069] The tree Tr1 in the real space shown in FIG. 8 is growing at the same rate of growth as in FIG. 3. In the modified example, the server device 100 represents the degree of change of the tree Tr1 by the number of character objects. At timing T1, the server device 100 installs an object Ob5 of a character in the virtual space corresponding to the tree Tr1 having the height H1. The object Ob5 is, for example, an object representing a wood sprite.

[0070] Furthermore, at timing T2, the server device 100 installs a new object Ob6 in the virtual space in addition to the object Ob5 of the character corresponding to the tree Tr1 having the height H2. As a result, the user Ur1 can recognize that the tree Tr1 is growing because the number of objects of the wood sprite representing the tree Tr1 has increased.

[0071] Also, at timing T3, the server device 100 installs a new object Ob7 in the virtual space in addition to the character objects Ob5 and Ob6 corresponding to the tree Tr1 having height H3. As a result, since the number of objects representing the tree Tr1 has increased, the user Ur1 can grasp that the tree Tr1 has further grown.

[0072] As shown in FIG. 8, the server device 100 makes the color of the leaves of the tree Tr1 correspond to, for example, the color of the clothes worn by the character. Thereby, the user Ur1 can grasp the change in the color of the leaves of the tree Tr1.

[0073] Hereinafter, other modification examples in the first embodiment will be described. In the above example, an example of generating three-dimensional data representing the shape of the tree Tr1 using LiDAR has been described. However, the method for generating the three-dimensional data representing the shape of the tree Tr1 is not limited to the method using LiDAR, and may be generated, for example, by a stereo image method or photogrammetry technology.

[0074] In the example of the first embodiment, an example in which the user device 200 is a head-mounted display has been described. However, the user device 200 may simply be a liquid crystal panel or an organic EL (Electro Luminescence) panel.

[0075] In the first embodiment, the height of the tree Tr1 is detected over time, and the degree of change in the detected height is calculated as the degree of growth of the tree Tr1. However, the object to be detected may be, instead of the height of the tree Tr1, the degree of growth of the tree Tr1 spreading in the horizontal direction, the number of leaves, the degree of leaf density, etc. Also, in the first embodiment, an example in which the color of the leaves is detected has been described, but the colors of flowers, fruits, branches, etc. may also be detected.

[0076] In the example of Embodiment 1, wild birds were detected in the nesting box Bh1. However, the animals detected inside the nesting box Bh1 are not limited to wild birds and may be animals such as squirrels, mice, and snakes. Also, the imaging target of the camera 13 for detecting animals is not limited to the nesting box Bh1. For example, it may be above or below the tree Tr1. The animals generated as objects may be insects such as butterflies.

[0077] In the example of Embodiment 1, the camera 13 that images the inside of the nesting box Bh1 was a sensor that observed a target different from the tree Tr1 related to the growth of the tree Tr1 over time. However, the sensor that observes a target different from the tree Tr1 over time is not limited to the camera 13. For example, it may be a CO2 sensor that detects the carbon dioxide concentration in the atmosphere near the tree Tr1. When photosynthesis is activated as the forest grows, the surrounding carbon dioxide concentration decreases. The server device 100 may represent the decrease in the carbon dioxide concentration in the virtual space. For example, as the carbon dioxide concentration decreases, the server device 100 increases the transparency of the object indicating the air in the virtual space. Alternatively, as the carbon dioxide concentration decreases, the server device 100 may increase the number of star objects arranged at night to increase the number of visible stars.

[0078] Also, in the example of Embodiment 1, an example where the server device 100 and each sensor and the tree Tr1 are arranged at different positions was described. However, the server device 100 and each sensor and the tree Tr1 may be arranged at the same position. That is, the position Ar1 and the position Ar2 may be the same position.

[0079] In the above modification example, an example where the number of wood elves increases as the tree Tr1 grows was described. However, the server device 100 may change the age, appearance, and size of the wood elves as the tree Tr1 grows.

[0080] [Embodiment 2] In Embodiment 1, a method for expressing the growth degree of the tree Tr1 existing at the position Ar1 in the virtual space was described with the tree Tr1 as the object. However, the object existing in the real space is not limited to a tree, and any object may be used as long as it is an object that changes over time. In Embodiment 2, a configuration for expressing the inventory quantity of products stored by a company in the virtual space will be described.

[0081] FIG. 9 is a diagram showing a schematic configuration of the management system 1000A according to Embodiment 2. In FIG. 9, the description of the configuration overlapping with that of the management system 1000 in FIG. 1 will not be repeated. The management system 1000A includes a server device 100 and a sensor 14. The sensor 14 is arranged at the position Ar4 which is the real space. The position Ar4 is a warehouse where the inventory of the company's products is stored.

[0082] The products of the company stored at the position Ar4 are products related to the improvement of the water quality of the river. The products of the company in Embodiment 2 are, for example, devices for detecting soil pollution near the river. When the company's products are bought and sold, it leads to the improvement of soil pollution near the river, and ultimately leads to the improvement of the water quality of the river.

[0083] As shown in FIG. 9, at the position Ar4, the sensor 14 and the product inventory St1 are arranged. In the example of FIG. 9, the product inventory St1 includes 45 products. The sensor 14 is a sensor for detecting the number of products, and is, for example, a three-dimensional measuring instrument, a camera, or a detection device for reading an RFID (Radio Frequency Identification) tag.

[0084] The server device 100 in Embodiment 2 generates and updates objects in the virtual space based on the data acquired by the sensor 14. In Embodiment 2, the inventory quantity of products may correspond to the "first object". Also, in Embodiment 2, the sensor 14 may correspond to the "first sensor".

[0085] FIG. 10 is a diagram for explaining an example of reflecting the degree of change in the real space in the virtual space in Embodiment 2. In Embodiment 2, the server device 100 represents the sales status of a company's product by the number of fish in the river Rv1 arranged in the virtual space.

[0086] At timing T1, the server device 100 arranges an object Ob8 in the river Rv1 corresponding to 45 inventory counts. The object Ob8 is, for example, an object indicating a fish.

[0087] When the product is bought and sold, the inventory count becomes 30 at timing T2. At timing T2, the server device 100 adds an object Ob9 in the river Rv1 corresponding to 30 inventory counts. As a result, the user Ur1 can grasp that the product of the company has been bought and sold and the inventory count has decreased because the number of fish objects arranged in the river Rv1 has increased.

[0088] Furthermore, when the product is bought and sold, the inventory count becomes 15 at timing T3. At timing T3, the server device 100 adds an object Ob10 in the river Rv1 corresponding to 15 inventory counts. As a result, the user Ur1 can grasp that the product of the company has been bought and sold and the inventory count has further decreased because the number of fish objects arranged in the river Rv1 has further increased.

[0089] In this way, in the management system 1000A of Embodiment 2, the sales status of the company's product can be intuitively expressed by the number of fish objects in the virtual space, indicating that the river in the real space has been improved. Also, in Embodiment 2, the situation in the real space can be more easily understood by the user immersed in the virtual space. Also, in Embodiment 2, it is to provide a technology that can immerse the user in the virtual space.

[0090] [Aspect] It will be understood by those skilled in the art that the above-described multiple exemplary embodiments are specific examples of the following aspects.

[0091] (Item 1) The management system according to one aspect is a management system that provides a virtual space for a user, and includes a user device used by the user, a sensor that observes the change over time of an object existing in the real space, and a server device that transmits information for providing the virtual space to the user device. The server device acquires the detection result of the sensor, calculates the degree of change of the object based on the detection result, and arranges an object representing the object reflecting the degree of change in the virtual space.

[0092] According to the management system described in Item 1, it is to provide a technology that can immerse the user in the virtual space.

[0093] (Item 2) In the management system described in Item 1, the object grows over time, and the degree of change includes the degree of growth of the object.

[0094] According to the management system described in Item 2, the degree of growth of the object can be reflected in the object.

[0095] (Item 3) In the management system described in Item 2, the degree of growth of the object varies depending on the environment.

[0096] According to the management system described in Item 3, the degree of growth according to the environment of the real space can be reflected in the object.

[0097] (Item 4) In the management system according to any one of Items 1 to 3, the object includes a plant.

[0098] According to the management system described in Item 4, the degree of change of the plant can be reflected in the object.

[0099] (Item 5) In the management system described in Item 4, the object includes an object imitating a plant.

[0100] According to the management system described in claim 5, plants in the real space can be represented in the virtual space.

[0101] (Claim 6) In the management system described in claim 4 or 5, the sensor includes a first sensor that observes a first part of the target and a second sensor that observes a second part of the target.

[0102] According to the management system described in claim 6, the degree of change of a plurality of parts included in the target can be reflected in the object.

[0103] (Claim 7) In the management system described in claim 6, the first part is the shape of the whole plant, and the second part is the leaf of the plant.

[0104] According to the management system described in claim 7, the shape of the whole plant and the degree of change of the leaves of the plant can be reflected in the object.

[0105] (Claim 8) In the management system described in claim 4 or 5, the target includes a first target and a second target. The sensor includes a first sensor that observes the first target and a third sensor that observes the second target.

[0106] According to the management system described in claim 8, in addition to the first target, the second target can be represented in the virtual space.

[0107] (Claim 9) In the management system described in claim 8, the second target is a nest box installed around the plant.

[0108] According to the management system described in claim 9, the ecology of animals related to the first target, which is a plant, can be reflected in the virtual space.

[0109] (Claim 10) In the management system described in any one of claims 1 to 9, the server device generates a non-fungible token that proves that the object is the user's property according to an instruction from the user device.

[0110] According to the management system described in claim 10, by issuing NFTs, objects in the virtual space can be made to be owned by users.

[0111] (Claim 11) In the management system described in claim 10, the server device places a proof object in the virtual space that proves that the object is the property of the user.

[0112] According to the management system described in claim 11, all users immersed in the virtual space can be made to recognize the owner of the object.

[0113] (Claim 12) In the management system described in any one of claims 1 to 11, the server device performs a purchase process for a product manufactured using the target according to an instruction from the user device.

[0114] According to the management system described in claim 12, the user can be made to purchase a product related to the target that is the source of the object.

[0115] (Claim 13) In the management system described in claim 1, the target includes the inventory quantity of the product.

[0116] According to the management system described in claim 13, the inventory quantity can be made to be easily recognized by the user as an object.

[0117] (Claim 14) In a server device according to one aspect, it is a server device that provides a virtual space to a user. The server device acquires the detection result of a sensor that observes the change over time of a target existing in the real space, calculates the degree of change of the target based on the detection result, and places an object representing the target that reflects the degree of change in the virtual space.

[0118] According to the management system described in claim 14, it is to provide a technology that can immerse the user in the virtual space.

[0119] (Item 15) A method according to one aspect, which is a method of providing a virtual space to a user. The method includes, as processing to be executed by a computer, a step of obtaining detection results of a sensor that observes the change over time of an object existing in the real space, a step of calculating the degree of change of the object based on the detection results, and a step of arranging an object representing the object reflecting the degree of change in the virtual space.

[0120] According to the management system described in Item 15, it is to provide a technology that can immerse a user in a virtual space.

[0121] (Item 16) A program according to one aspect, which is a program executed by a server device that provides a virtual space to a user. The program includes, as processing to be executed by a computer, a step of obtaining detection results of a sensor that observes the change over time of an object existing in the real space, a step of calculating the degree of change of the object based on the detection results, and a step of arranging an object representing the object reflecting the degree of change in the virtual space.

[0122] According to the program described in Item 16, it is to provide a technology that can immerse a user in a virtual space.

[0123] The embodiments disclosed this time should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is shown not by the description of the above embodiments but by the claims, and it is intended that all changes within the meaning and scope equivalent to the claims are included.

Explanation of Reference Numerals

[0124] 11, 14 sensors, 12, 13 cameras, 100 server device, 101, 201 communication interfaces, 102, 202 processors, 103, 203 RAMs, 104, 204 storage devices, 200 user device, 205 display, 1000, 1000A management systems, 1041 program, Ar1 to Ar4 positions, B1, B2 wild birds, Bh1 nest box, H1 to H3 heights, NW network, Ob1 to Ob10 objects, St1 inventory, T1 to T3 timings, Tr1 tree, Ur1 user.

Claims

1. A management system that provides a virtual space for a user, comprising: a user device used by the user; a sensor that observes the change over time of an object existing in the real space; a server device that transmits information for providing the virtual space to the user device, wherein the server device acquires the detection result of the sensor, calculates the degree of change of the object based on the detection result, and arranges an object representing the object reflecting the degree of change in the virtual space.

2. The object grows over time, and the management system according to claim 1, wherein the degree of change includes the degree of growth of the object.

3. The management system according to claim 2, wherein the degree of growth of the object varies according to the environment.

4. The management system according to any one of claims 1 to 3, wherein the object includes a plant.

5. The management system according to claim 4, wherein the object includes an object imitating the plant.

6. The management system according to claim 4, wherein the sensor includes a first sensor that observes a first part of the object and a second sensor that observes a second part of the object.

7. The first part is the shape of the whole plant, and the management system according to claim 6, wherein the second part is the leaf of the plant.

8. The object includes a first object and a second object, and the management system according to claim 4, wherein the sensor includes a first sensor that observes the first object and a third sensor that observes the second object.

9. The management system according to claim 8, wherein the second object is a nest box installed around the plant.

10. The management system according to any one of claims 1 to 3, wherein the server device generates a non-fungible token that proves that the object is the user's possession according to an instruction from the user device.

11. The management system according to claim 10, wherein the server device arranges a proof object that proves that the object is the user's possession in the virtual space.

12. The management system according to any one of claims 1 to 3, wherein the server device performs a purchase process of a product manufactured using the object according to an instruction from the user device.

13. The management system according to claim 1, wherein the object includes the inventory quantity of the product.

14. A server device that provides a virtual space for a user, wherein the server device obtains a detection result of a sensor that observes a change over time of an object existing in the real space, calculates a degree of change of the object based on the detection result, and arranges an object representing the object reflecting the degree of change in the virtual space.

15. A method for providing a virtual space for a user, wherein the method includes, as a process to be executed by a computer, a step of obtaining a detection result of a sensor that observes a change over time of an object existing in the real space, a step of calculating a degree of change of the object based on the detection result, and a step of arranging an object representing the object reflecting the degree of change in the virtual space.

16. A program executed by a server device that provides a virtual space for a user, wherein the program includes, as a process to be executed by a computer, a step of obtaining a detection result of a sensor that observes a change over time of an object existing in the real space, a step of calculating a degree of change of the object based on the detection result, and a step of arranging an object representing the object reflecting the degree of change in the virtual space.

Images