Virtual space management device and program

Abstract

To improve the quality of the virtual space experience. [Solution] The virtual space management device 10 of this disclosure comprises a first acquisition unit 230a, a second acquisition unit 230b, and a control unit 230c. The first acquisition unit 230a acquires first feature information representing a first feature that is perceived by hearing and whose degree of proximity changes according to the degree of opening and closing of the virtual door, from among the feature information representing the characteristics of the virtual space entered by passing through the virtual door. The second acquisition unit 230b acquires information representing the degree of opening and closing of the virtual door. The control unit 230c reproduces the first feature according to the degree of opening and closing of the virtual door represented by the information acquired by the second acquisition unit.

Description

Technical Field

[0005] ,

[0001] The present disclosure relates to a management device for a virtual space and a program.

Background Art

[0002] Patent Document 1 discloses a technique for reproducing sounds that can be heard from the opposite side of a wall (such as a virtual wall of a virtual room) when the user is close to the wall. Patent Document 1 also describes reproducing the sound at the source of movement and the sound at the destination of movement during the period when the user passes through a virtual door and moves.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

[0006] Furthermore, a program according to one aspect of this disclosure causes a computer to function as follows: a first acquisition unit that acquires feature information representing one or more features perceived by either hearing, smell, or touch, from among feature information representing the characteristics of a virtual space entered by passing through a virtual door; a second acquisition unit that acquires information representing the degree of opening and closing of the virtual door; and a control unit that reproduces a first feature, among the one or more features, whose degree of perception changes according to the degree of opening and closing of the virtual door, according to the degree of opening and closing of the virtual door represented by the information acquired by the second acquisition unit. [Effects of the Invention]

[0007] According to this disclosure, the quality of the experience related to the virtual space can be enhanced by reproducing a first feature, perceived by touch, hearing, or smell, that evokes the virtual space entered by passing through a virtual door, in accordance with the degree to which the virtual door is opened or closed. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram showing an example configuration of a communication system 1 including a virtual space server 20 according to one embodiment of the virtual space management device of the present disclosure. [Figure 2] This figure shows an example of a door 40 corresponding to a virtual door for entering a virtual space. [Figure 3] This figure shows an example of a virtual door VD displayed overlaid on door 40. [Figure 4] This diagram shows an example configuration of the virtual space server 20. [Figure 5] This figure shows an example of a management table TBL stored in the storage device 220 of the virtual space server 20. [Figure 6] This diagram illustrates the reproduction of sound corresponding to the degree of opening and closing of the door 40, which corresponds to the virtual door. [Figure 7] This flowchart shows the processing flow in the reproduction method executed by the processing unit 230 of the virtual space server 20 according to program PR1. [Modes for carrying out the invention]

[0009] (A. Embodiment) Figure 1 is a diagram showing an example configuration of a communication system 1 including a virtual space server 20 according to one embodiment of the virtual space management device of the present disclosure. As shown in Figure 1, the communication system 1 includes, in addition to the virtual space server 20 that provides virtual space services, a terminal 10 that communicates with the virtual space server 20 via a communication network NW, and a glasses device 30 connected to the terminal 10.

[0010] Terminal 10 acquires virtual space data related to the virtual space by communicating with the virtual space server 20 via the communication network NW. Specific examples of virtual space data include image data representing a virtual door for entering the virtual space, image data representing the scenery of the virtual space to which entry is made, and sound data representing the sounds in the virtual space to which entry is made.

[0011] Terminal 10 is, for example, a smartphone or a tablet device. In this embodiment, terminal 10 is connected to the glasses device 30 by a wired connection, but it may also be connected to the glasses device 30 by a wireless connection. Based on virtual space data acquired from the virtual space server 20, terminal 10 displays images related to the virtual space on the glasses device 30 and plays sounds from the virtual space. Images related to the virtual space include images representing a virtual door for entering the virtual space, and images of the scenery of the virtual space to which entry is made.

[0012] The glasses device 30 is a spectacle-type display device. The glasses device 30 is a transmissive HMD that transmits light and displays images. The glasses device 30 includes temples 91 and 92, a rim 93, a body 94 and 95, and lenses 2aL and 2aR.

[0013] The body portion 94 is provided with a display panel for the left eye and an optical element for the left eye. The display panel is, for example, a liquid crystal panel or an organic EL (Electro-Luminescence) panel. The display panel for the left eye displays an image related to the virtual space based on control from, for example, terminal 10. The optical element for the left eye is an optical element that guides the light emitted from the display panel for the left eye to lens 2aL.

[0014] The body 95 is provided with a display panel for the right eye and an optical element for the right eye. The display panel for the right eye displays an image related to the virtual space, for example, based on control from the terminal 10. The optical element for the right eye is an optical element that guides the light emitted from the display panel for the right eye to the lens 2aR.

[0015] Lens 2aL and lens 2aR each have a half-mirror. The half-mirror in lens 2aL transmits light representing real space, guiding it to user U's left eye B1L. The half-mirror in lens 2aL also reflects light guided by the optical component for the left eye back to user U's left eye B1L. The half-mirror in lens 2aR transmits light representing real space, guiding it to user U's right eye B1R. The half-mirror in lens 2aR also reflects light guided by the optical component for the right eye back to user U's right eye B1R.

[0016] Light representing the real world passes through lenses 2aL and 2aR. When user U wears the glass device 30 on the head, lens 2aL is positioned in front of user U's left eye B1L, and lens 2aR is positioned in front of user U's right eye B1R. User U wearing the glass device 30 can visually recognize the real space represented by the light passing through lenses 2aL and 2aR and the image related to the virtual space displayed on lenses 2aL and 2aR. For example, user U can visually recognize the image related to the virtual space superimposed on the real space.

[0017] The glass device 30 includes a sound emitting part 2b. As shown in FIG. 1, the sound emitting part 2b is located on each of the body parts 94 and 95. The sound emitting part 2b may be located, for example, on one of the body parts 94 and 95, at least one of the temples 91 and 92, or the rim 93, instead of being located on each of the body parts 94 and 95. The sound emitting part 2b is, for example, a speaker. The sound emitting part 2b may be separate from the glass device 30 instead of being included in the glass device 30. The sound emitting part 2b separate from the glass device 30 is not limited to a speaker and may be, for example, earphones or headphones. The sound emitting part 2b separate from the glass device 30 is connected to the terminal 10 or the glass device 30 wirelessly, for example. The sound emitting part 2b separate from the glass device 30 may be connected to the terminal 10 or the glass device 30 by wire. The sound emitting part 2b is controlled directly by the terminal 10 or via the glass device 30. The sound emitting part 2b outputs sound in the virtual space based on the control from the terminal 10. User U wearing the glass device 30 can hear the sound in the virtual space while looking at the image related to the virtual space and the real space.

[0018] A camera 96L is provided near lens 2aL on the rim 93, and a camera 96R is provided near lens 2aR on the rim 93. Cameras 96L and 96R form a stereo camera for acquiring an image of the field of view (hereinafter referred to as the field of view image) of user U wearing the glasses device 30 on their head, and depth information regarding objects within that field of view (for example, the distance from the center of the rim 93 on the glasses device 30). Cameras 96L and 96R are used to detect and locate AR markers that serve as landmarks when displaying a virtual door for entering a virtual space.

[0019] In this embodiment, the real space is the living room of user U, who uses terminal 10 and glasses device 30. In this real space, a door 40 corresponding to a virtual door for entering the virtual space is installed. The AR marker described above is attached to door 40. Door 40 is constructed to resemble a real door. Figure 2 shows an example of the configuration of door 40. Door 40 has a frame made up of a combination of prismatic members 41L, 41R, 41B, and 41T, and a door panel 42 that is rotatably connected to member 41R by hinges 43a and 43b. A doorknob 44 is provided on the door panel 42. User U can open door 40 by grasping the doorknob 44 and pulling it towards them. In addition, an AR marker 45 is provided in the center of door panel 42, which serves as a marker when displaying the virtual door.

[0020] Details will be described later. The virtual space server 20 stores virtual door information representing an image of a virtual door to be displayed superimposed on the door 40, landscape information representing an image of the scenery of the virtual space entered by passing through this virtual door, and sound data representing the sound in the virtual space, in association with the identification information indicating the door 40. A specific example of the identification information indicating the door 40 is an image of the AR marker 45. When the user U wears the glass device 30 on the head and performs an operation to instruct the start of using the virtual space service on the terminal 10, the terminal 10 instructs the cameras 96L and 96R to capture a view image, and transmits the image data representing the view image captured by the cameras 96L and 96R to the virtual space server 20. When the virtual space server 20 analyzes the view image received from the terminal 10 and detects that the image of the AR marker 45 is included in this view image, the virtual space server 20 transmits the virtual door information corresponding to the AR marker 45 to the terminal 10, and instructs the terminal 10 to display the image represented by the virtual door information at a position corresponding to the AR marker 45. In response to this instruction, when the terminal 10 displays the image of the virtual door on the glass device 30, a virtual door VD is displayed superimposed on the door 40 in the eyes of the user U as shown in FIG. 3.

[0021] FIG. 4 is a block diagram showing a configuration example of the virtual space server 20. As shown in FIG. 4, the terminal 10 includes a communication device 210, a storage device 220, a processing device 230, and a bus 240 that interconnects these devices.

[0022] The communication device 210 includes a communication interface circuit. The communication device 210 is connected to the communication network NW by wire or wirelessly. The communication device 210 communicates with other devices via the communication network NW. A specific example of another device that communicates with the communication device 210 is the terminal 10.

[0023] The storage device 220 is a recording medium that can be read by the processing device 230. The storage device 220 includes, for example, non-volatile memory and volatile memory. Non-volatile memory is, for example, ROM (Read Only Memory), EPROM (Erasable Programmable Read Only Memory), and EEPROM (Electrically Erasable Programmable Read Only Memory). Volatile memory is, for example, RAM (Random Access Memory). The storage device 220 pre-stores the management table TBL, the learning model MDL, and the program PR1.

[0024] Figure 5 shows an example of the data structure of the management table TBL. As shown in Figure 5, the management table TBL stores virtual door information, landscape information, and feature information that represents features perceived by at least one of hearing, touch, and smell in the virtual space, associated with identification information that indicates a door 40 corresponding to a virtual door. In this embodiment, the feature information is sound data that represents sounds in the virtual space and represents features perceived by hearing. In this embodiment, the landscape information represents the landscape of a sandy beach, and in this embodiment, the feature information represents the sound of the waves on the sandy beach.

[0025] The learning model MDL is a machine - learned learning model that associates the reproduction amount of the features represented by the above - mentioned feature information with the degree of opening and closing of the virtual door corresponding to the AR marker 45. As described above, since the feature information in the present embodiment is sound data representing sound in the virtual space, the above - mentioned reproduction amount represents the volume when playing the sound. The degree of opening and closing of the virtual door corresponding to the AR marker 45 is preferably represented by the solid angle occupied by the opening in the frame of the door 40 corresponding to the virtual door as seen by the user U, but it may also be represented by the angle θ formed by the door plate 42 with respect to the frame of the door 40 corresponding to the virtual door. In the present embodiment, the latter aspect is adopted. Specifically, if θ = 0°, it means that the virtual door is in a closed state, and the closer the value of the angle θ is to 90°, the more it means that the virtual door is in a wide - open state. In this case, the learning model MDL has learned that for each of a plurality of angles at predetermined intervals (for example, 5°) in the range of 0 to 90°, the larger the angle θ, the larger the reproduction amount. Specifically, the learning model MDL has learned to associate the reproduction amount V0 with the angle θ = 0°, has learned to associate the reproduction amount V1 (V0 < V1) with the angle θ = 30°, and has learned to associate the reproduction amount V2 (V1 < V2) with the angle θ = 60°. This is because in the case of a real door, the closer the door is to being fully open, the louder the volume of the sound on the other side of the door that the user U standing in front of the door hears. When the learning model MDL is input with the angle θ (the angle θ formed by the door plate 42 with respect to the frame of the door 40) representing the degree of opening and closing of the virtual door corresponding to the AR marker 45, it outputs the learned reproduction amount associated with the angle θ.

[0026] The processing unit 230 includes one or more CPUs (Central Processing Units). One or more CPUs are an example of one or more processors. Each of the processors and CPUs is an example of a computer. For example, when the virtual space server 20 is powered on, the processing unit 230 reads program PR1 from the storage device 220. Then, the processing unit 230 executes program PR1 that it read from the storage device 220. The processing unit 230, operating according to program PR1, communicates with the terminal 10 using the communication device 210. When the processing unit 230 receives field of view image data using the communication device 210, it determines whether or not the image of the AR marker 45 is included in the image represented by this field of view image data. If the image of the AR marker 45 is included in the image represented by the field of view image data, the processing unit 230 reads the virtual door information stored in the management table TBL in association with the identification information indicating door 40, and instructs the terminal 10 to display the image represented by this virtual door information, i.e., the image of the virtual door, at the position of the AR marker 45.

[0027] Furthermore, the processing unit 230, upon detecting the image of the AR marker 45 from the image represented by the visual field image data, functions as the first acquisition unit 230a, second acquisition unit 230b, determination unit 230c, and control unit 230d shown in Figure 4. The functions of the first acquisition unit 230a, second acquisition unit 230b, determination unit 230c, and control unit 230d are as follows.

[0028] The first acquisition unit 230a acquires the characteristic information by reading the characteristic information stored in the management table TBL in association with the identification information indicating door 40 from the management table TBL. As a result, characteristic information is acquired that represents the characteristics of the virtual space entered by passing through the virtual door, and that is perceived by hearing and whose degree of perception changes depending on the degree of opening and closing of the virtual door.

[0029] The second acquisition unit 230b acquires opening degree information representing the degree of opening and closing of the virtual door for entering the virtual space. In this embodiment, the second acquisition unit 230b identifies the opening and closing angle θ of the door 40 corresponding to the virtual door by analyzing the field of view image data received from the terminal 10, and acquires the angle θ as opening degree information. Existing technologies may be appropriately adopted for the method of identifying the opening and closing angle θ of the door 40 based on the field of view image data.

[0030] The determination unit 230c determines the amount of feature reproduction of the feature information acquired by the first acquisition unit 230a based on the opening degree information acquired by the second acquisition unit 230b. In this embodiment, the determination unit 230c inputs the angle θ represented by the opening degree information acquired by the second acquisition unit 230b to the learning model MDL, and determines the amount of reproduction output from the learning model MDL to be the amount of feature reproduction of the feature information acquired by the first acquisition unit 230a.

[0031] The control unit 230d reproduces the feature (i.e., the sound of the waves) represented by the feature information acquired by the first acquisition unit 230a, according to the degree of opening and closing of the virtual door represented by the opening degree information acquired by the second acquisition unit 230b. In this embodiment, the control unit 230d reproduces the sound of the waves at the reproduction amount determined by the determination unit 230c. In this embodiment, the control unit 230d transmits the feature information and a communication message instructing the terminal 10 to reproduce the sound represented by the feature information at the above reproduction amount using the communication device 210. Upon receiving the communication message, the terminal 10 outputs the sound of the waves at the volume indicated by the received communication message to the sound emission unit 2b of the glass device 30.

[0032] For example, as shown in Figure 6, when user U, wearing the glasses device 30 on their head, is standing in front of a closed door 40 (angle θ=0°), the sound of waves is reproduced at a reproduction amount V0. Then, as shown in Figure 6, as user U opens the door 40, the sound of waves is reproduced at a reproduction amount V1 at an angle θ=30°, and at an angle θ=60°, the sound of waves is reproduced at a reproduction amount V2. The auditory features that evoke the virtual space entered by passing through the virtual door are reproduced according to the degree of opening and closing of the virtual door, improving realism and thus enhancing the quality of the experience related to the virtual space.

[0033] Furthermore, the processing unit 230, operating according to program PR1, communicates with the terminal 10 using the communication device 210 and, upon receiving the field of view image data, determines whether or not the image of the AR marker 45 is included in the image represented by this field of view image data. If the image of the AR marker 45 is included in the image represented by the field of view image data, the processing unit 230 reads the virtual door information stored in the management table TBL in association with the image of the AR marker 45 and instructs the terminal 10 to display the image represented by this virtual door information, i.e., the image of the virtual door, at the position of the AR marker 45. In addition, the processing unit 230, operating according to program PR1, executes a feature reproduction method that prominently displays the features of this disclosure. Figure 7 is a flowchart showing the processing flow in this reproduction method. As shown in Figure 7, this reproduction method includes the first acquisition process SA110, the second acquisition process SA120, the decision process SA230, and the control process SA140.

[0034] In the first acquisition process SA110, the processing unit 230 functions as the first acquisition unit 230a. In the first acquisition process SA110, the processing unit 230 acquires the feature information by reading the feature information stored in the management table TBL, which is associated with the image of the AR marker 45, from the management table TBL.

[0035] In the second acquisition process SA120, the processing unit 230 functions as the second acquisition unit 230b. In the second acquisition process SA120, the processing unit 230 acquires opening degree information representing the degree of opening and closing of the virtual door by analyzing the field of view image data received from the terminal 10.

[0036] In the determination process SA230, the processing unit 230 functions as a determination unit 230c. In the determination process SA230, the processing unit 230 determines the amount of feature reproduction represented by the feature information acquired in the first acquisition process SA110 based on the opening information acquired in the second acquisition process SA120. More specifically, the processing unit 230 inputs the angle θ represented by the opening information acquired in the second acquisition process SA120 to the learning model MDL, and determines the amount of reproduction output from the learning model MDL to be the amount of feature reproduction represented by the feature information acquired in the first acquisition process SA110.

[0037] In control processing SA140, the processing unit 230 functions as a control unit 230d. In control processing SA140, the processing unit 230 reproduces the feature (in this embodiment, the sound of waves) represented by the feature information acquired in the first acquisition processing SA110, according to the degree of opening and closing of the virtual door represented by the opening degree information acquired in the second acquisition processing SA120. In this embodiment, the processing unit 230 reproduces the sound of waves with the reproduction amount determined in the determination processing SA130. As described above, when user U, wearing the glasses device 30 on their head, is standing in front of the closed door 40 (angle θ=0°), the sound of waves is reproduced with a reproduction amount V0. As user U opens the door 40, the sound of waves is reproduced with a reproduction amount V1 at an angle θ=30°, and with a reproduction amount V2 at an angle θ=60° (see Figure 6).

[0038] According to this disclosure, auditory perceptual features that evoke the virtual space entered by passing through a virtual door are reproduced according to the degree of opening and closing of the virtual door, thereby improving realism and enhancing the quality of the virtual space experience. As this embodiment enhances the quality of the virtual space experience, applying this embodiment to tourism products for regional revitalization (using image data of tourist destinations as landscape information) will promote behavioral changes such as actually visiting the region more than before.

[0039] (B: Transformation) The above embodiment can be modified as follows. (B-1: Torture 1) In the above embodiment, the terminal 10 was a smartphone or a tablet terminal, but it may also be a stationary personal computer. Also, in the above embodiment, the glasses device 30 was a transparent HMD that transmits light from the real world and displays images, but it may also be a video see-through HMD. A video see-through HMD is a non-transparent HMD that does not transmit light from the real world and displays images of the real world captured by an imaging device to the user. Also, in the above embodiment, the glasses device 30 was used as a display device that displays images related to the virtual world. However, images related to the virtual world may be displayed on a display device equipped in the terminal 10 (for example, a liquid crystal display), or on a display device connected to the terminal 10 (for example, a liquid crystal display or liquid crystal monitor). Also, in the above embodiment, the speaker (sound emission unit 2b) equipped in the glasses device 30 was used as a reproduction device that reproduces feature information, but the speaker equipped in the terminal 10, or a speaker connected to the terminal 10, may be used.

[0040] (B-2: Variation 2) In the above embodiment, the degree of opening and closing of the door 40 corresponding to the virtual door was detected based on the field of view image. However, a sensor for detecting the degree of opening and closing of the door panel 42 (for example, a sensor for detecting the rotation angle of the door panel 42) may be provided on the door 40, and the terminal 10 may acquire the output data of the sensor and transmit it to the virtual space server 20.

[0041] (B-3: Modification 3) In the above embodiment, a door 40 that mimics a real door was used as the real door corresponding to the virtual door. However, it could also be a real door installed in the real space where user U is located (for example, if the real space is user U's room, it could be a door for entering and exiting that room). If a real door installed in the real space where user U is located is used as the real door corresponding to the virtual door, the degree of opening and closing of the door can be detected based on the field of view image, as in the above embodiment. In the above embodiment, an AR marker 45 was attached to the door panel 42 of the door 40, and the image of the AR marker 45 was used as identification information to indicate the door 40. However, the door 40 may also be detected by performing object recognition on the field of view image, in which case it is not necessary to attach the AR marker 45 to the door panel 42 of the door 40. In the embodiment in which the door 40 is detected by object recognition on the field of view image, for example, the image of the door 40 may be used as the identification information. Even when using a real door located in the real space where user U is located as the real door corresponding to the virtual door, the real door corresponding to the virtual door may be detected by object recognition of the visual field image.

[0042] (B-4: Modification 4) In the above embodiment, one feature information is stored in the management table TBL in association with identification information indicating door 40. However, multiple feature information representing sounds from different sound sources may also be stored in the management table TBL in association with identification information indicating door 40. Generally, it is thought that the higher the frequency of the sound, the greater the change in the amount of reproduction according to the degree of opening and closing of the door. For this reason, a learning model MDL may be generated by learning the amount of reproduction for each of the multiple feature information in association with the degree of opening and closing of the virtual door, such that the change in the amount of reproduction is greater for higher frequency sounds, and the volume of sounds with frequencies below a threshold remains constant regardless of the degree of opening and closing of the door. According to this embodiment, the quality of the experience related to the virtual space is further enhanced. A feature in which the amount of reproduction (i.e., the degree of perception) changes according to the degree of opening and closing of the door is an example of the first feature in this disclosure.

[0043] (B-5: Variation 5) In the above embodiment, the feature information represents features of the virtual space that are perceived by hearing, but it may also represent features perceived by smell (for example, odors floating in the virtual space) or features perceived by touch (vibrations corresponding to wind in the virtual space, or temperature in the virtual space). When the feature information represents features perceived by smell or touch, as in the above embodiment, the amount of feature reproduction corresponding to the degree of opening and closing of the virtual door can be taught to the learning model MDL in association with the degree of opening and closing. When information representing odor is used as feature information, the terminal 10 or the glasses device 30 may be provided with a reproduction device that reproduces odor according to the feature information, or the reproduction device may be connected to the terminal 10. Existing technology may be appropriately adopted for the reproduction device that reproduces odor. Furthermore, if information representing vibration is used as feature information, it is conceivable that a reproduction device (for example, an actuator) that generates vibration according to the feature information is installed on the doorknob 44 of the door 40, and that the terminal 10 executes a process to drive the actuator according to the feature information and reproduction amount received from the virtual space server 20.

[0044] (B-6: Torture 6) A single door 40 may be used simultaneously by multiple users. In this case, when the door 40 is opened by any one of the multiple users, the amount of feature reproduction represented by the feature information may be controlled for each of the multiple users according to the degree of opening and closing of the door 40. Alternatively, the amount of feature reproduction represented by the feature information may be controlled according to the degree of opening and closing of the door 40 only for users whose field of view image includes an image of the AR marker 45.

[0045] (B-7: Variation 7) In the above embodiment, program PR1 was pre-stored in the storage device 220 of the virtual space server 20, but program PR1 may be manufactured or sold as a standalone product. When selling program PR1, possible methods of providing program PR1 to buyers include writing program PR1 to a computer-readable recording medium such as flash ROM and distributing it, or distributing it by download via a telecommunications line.

[0046] (B-8: Variation 8) In the above embodiment, the first acquisition unit 230a, the second acquisition unit 230b, the determination unit 230c, and the control unit 230d may be composed of electronic circuits such as ASICs. A virtual space server 20 may be configured by combining these electronic circuits.

[0047] (C: Other) (1) In the embodiments described above, ROM and RAM were given as examples of the storage device 220, but the storage device 220 may be a flexible disk, magneto-optical disk (e.g., compact disk, digital multipurpose disk, Blu-ray® disk), smart card, flash memory device (e.g., card, stick, key drive), CD-ROM (Compact Disc-ROM), register, removable disk, hard disk, floppy® disk, magnetic strip, database, server, or other suitable storage medium.

[0048] (2) In the embodiments described above, the information, signals, etc. may be represented using any of the various different techniques. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be mentioned throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0049] (3) In the embodiments described above, the input and output information may be stored in a specific location (e.g., memory) or managed using a table. The input and output information may be overwritten, updated, or appended to. The output information may be deleted. The input information may be transmitted to other devices.

[0050] (4) In the embodiments described above, the determination may be made by a value represented by 1 bit (0 or 1), by a boolean value (true or false), or by a numerical comparison (for example, a comparison with a predetermined value).

[0051] (5) The processing procedures, sequences, flowcharts, etc., exemplified in the embodiments described above may be reordered, as long as they do not contradict each other. For example, in the methods described herein, the elements of various steps are presented using an exemplary order and are not limited to the specific order presented.

[0052] (6) Each function illustrated in Figure 4 is implemented by any combination of at least one of hardware and software. Furthermore, the method of implementing each function block is not particularly limited. That is, each function block may be implemented using one device that is physically or logically coupled, or it may be implemented using two or more physically or logically separated devices that are directly or indirectly connected (for example, using wired, wireless, etc.). A function block may also be implemented by combining the above one device or the above multiple devices with software.

[0053] (7) The programs illustrated in the embodiments described above should be broadly interpreted to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., whether they are called software, firmware, middleware, microcode, hardware description languages ​​or by other names.

[0054] Furthermore, software, instructions, information, etc., may be transmitted and received via a transmission medium. For example, if software is transmitted from a website, server, or other remote source using at least one of wired technology (coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), etc.) and wireless technology (infrared, microwave, etc.), at least one of these wired and wireless technologies is included in the definition of a transmission medium.

[0055] (8) In each of the above-mentioned forms, the terms “system” and “network” shall be used interchangeably.

[0056] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values ​​from a given value, or other corresponding information.

[0057] (10) In the embodiments described above, the terms “connected,” “coupled,” or any variation thereof, mean any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are “connected” or “coupled” with each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, “connection” may be read as “access.” As used in this disclosure, two elements may be considered to be “connected” or “coupled” with each other using at least one of one or more wires, cables, and printed electrical connections, and, in some non-limiting and non-exclusive examples, electromagnetic energy having wavelengths in the radio frequency domain, microwave domain, and optical (both visible and invisible) domain.

[0058] (11) In the embodiments described above, the phrase “based on” does not mean “based solely on” unless otherwise specified. In other words, the phrase “based on” means both “based solely on” and “based at least on.”

[0059] (12) The terms “determining” and “determining” as used in this disclosure may encompass a wide variety of actions. “Determining” may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiry (e.g., searching in a table, database or other data structure), ascertaining, etc. “Determining” may also include, for example, receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), etc. Furthermore, "judgment" and "decision" can include considering something as having been "judged" or "decided" after resolving, selecting, choosing, establishing, comparing, etc. In other words, "judgment" and "decision" can include considering something as having been "judged" or "decided" after some action. Also, "judgment (decision)" can be reinterpreted as "assuming," "expecting," "considering," etc.

[0060] (13) Where the terms “include,” “including,” and variations thereof are used in the embodiments described above, these terms are intended to be inclusive, as is the term “comprising.” Furthermore, the term “or” as used in this disclosure is not intended to be exclusive OR.

[0061] (14) Where articles are added in translation, for example, a, an, and the in English, the disclosure may include the fact that the noun following these articles is plural.

[0062] (15) In this disclosure, the term “A and B are different” may mean “A and B are different from each other.” The term may also mean “A and B are each different from C.” Terms such as “separate” and “combined” may be interpreted in the same way as “different.”

[0063] (16) Each aspect / embodiment described herein may be used individually, in combination, or switched between as needed in practice. Furthermore, notification of certain information (e.g., notification that "X is") is not limited to explicit notification, but may also be implicit (e.g., by not providing such notification).

[0064] (D: Aspects understood from the above-described embodiments or modifications) Although the present disclosure has been described in detail above, it will be clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Accordingly, the descriptions in the present disclosure are for illustrative purposes only and are not intended to be restrictive in any way. The following forms can be understood from at least one of the embodiments or modifications described above.

[0065] A virtual space management device according to a first aspect of this disclosure includes: a first acquisition unit that acquires feature information representing one or more features perceived by either hearing, smell, or touch, from among feature information representing the features of a virtual space entered by passing through a virtual door; a second acquisition unit that acquires information representing the degree of opening and closing of the virtual door; and a control unit that reproduces a first feature whose degree of perception changes according to the degree of opening and closing of the virtual door, from among the one or more features, according to the degree of opening and closing of the virtual door represented by the information acquired by the second acquisition unit. According to the management device of this aspect, the quality of the virtual space experience is improved because a first feature, which is perceived by either hearing, smell, or touch, from among the features of a virtual space entered by passing through a virtual door, and whose degree of perception changes according to the degree of opening and closing of the virtual door, is reproduced according to the degree of opening and closing of the virtual door.

[0066] A virtual space management device according to a second aspect of the present disclosure (an example of the first aspect) includes a determination unit that determines the amount of reproduction of the first feature based on information acquired by the second acquisition unit, and the control unit reproduces the first feature according to the degree of opening and closing of the virtual door as represented by the information acquired by the second acquisition unit by changing the first feature with the amount of reproduction determined by the determination unit. According to the management device of this aspect, the first feature can be changed with an amount of change corresponding to the degree of opening and closing of the virtual door, so the quality of the experience related to the virtual space is further improved.

[0067] The second acquisition unit in a virtual space management device according to a third aspect of the present disclosure (an example of the first aspect or an example of the second aspect) acquires information representing the degree of closure of the virtual door based on the degree of opening and closing of a door installed in the real space corresponding to the virtual door. According to the management device of this aspect, based on the degree of opening and closing of a door installed in the real space corresponding to the virtual door, it is possible to reproduce a first feature of the virtual space entered by passing through the virtual door, which is perceived by either hearing, smell, or touch, and whose degree of perception changes according to the degree of opening and closing of the virtual door.

[0068] A program according to a first aspect of this disclosure causes a computer to function as follows: a first acquisition unit that acquires feature information representing one or more features perceived by either hearing, smell, or touch, from among feature information representing the features of a virtual space entered by passing through a virtual door; a second acquisition unit that acquires information representing the degree of opening and closing of the virtual door; and a control unit that reproduces a first feature whose degree of perception changes according to the degree of opening and closing of the virtual door, from among the one or more features, according to the degree of opening and closing of the virtual door represented by the information acquired by the second acquisition unit. According to the program of this aspect, a first feature, which is perceived by either hearing, smell, or touch, from among the features of a virtual space entered by passing through a virtual door, and whose degree of perception changes according to the degree of opening and closing of the virtual door, is reproduced according to the degree of opening and closing of the virtual door, thus improving the quality of the experience related to the virtual space. [Explanation of symbols]

[0069] 1...Communication system, 10...Terminal, 20...Virtual space server, 30...Glass device, NW...Communication network, 210...Communication device, 220...Storage device, 230...Processing device, 240...Bus, 230a...First acquisition unit, 230b...Second acquisition unit, 230c...Decision unit, 230d...Control unit, PR1...Program.

Claims

1. A first acquisition unit acquires feature information representing one or more features perceived by either hearing, smell, or touch, from among the feature information representing the characteristics of the virtual space entered by passing through a virtual door. A second acquisition unit acquires information representing the degree of opening and closing of the virtual door, A control unit reproduces, among the one or more features described above, a first feature whose degree of perception changes according to the degree of opening and closing of the virtual door, according to the degree of opening and closing of the virtual door represented by the information acquired by the second acquisition unit, A virtual space management device equipped with the necessary features.

2. The system includes a determination unit that determines the amount of reproduction of the first feature based on the information acquired by the second acquisition unit, The control unit reproduces the first feature with the amount of reproduction determined by the determination unit. A virtual space management device according to claim 1.

3. The second acquisition unit acquires information representing the degree of closing of the virtual door based on the degree of opening and closing of a door installed in the real space corresponding to the virtual door. A virtual space management device according to claim 1.

4. Computers, A first acquisition unit acquires feature information representing one or more features perceived by either hearing, smell, or touch, from among the feature information representing the characteristics of the virtual space entered by passing through a virtual door. A second acquisition unit acquires information representing the degree of opening and closing of the virtual door, A control unit reproduces, among the one or more features described above, a first feature whose degree of perception changes according to the degree of opening and closing of the virtual door, according to the degree of opening and closing of the virtual door represented by the information acquired by the second acquisition unit, A program that makes something work.

Images