Virtual reality commerce system, relay device, control method and program

Abstract

To provide a virtual reality commerce system, a relay device, a control method, and a program that promote the use of communication devices for experiencing virtual reality by general users.SOLUTION: A relay device includes a relay control unit that relays a VR terminal for experiencing virtual reality and a VR providing device for providing the virtual reality experience, and performs the control so that the VR terminal is connected to a predetermined VR providing device and information is provided to the VR terminal from the VR providing device.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a virtual reality commerce system, a relay device, a control method, and a program. [Background technology]

[0002] Patent Document 1 describes a communication system that realizes a shopping environment in which a plurality of user terminals are connected to a server device via a network and are provided with a virtual store. The server device has a construction unit that constructs a virtual store in a virtual space where users can browse and purchase products and provides the virtual store to each user's user terminal, and a focus element display control unit that identifies an element that is attracting the user's attention among elements arranged in the virtual store based on each user's operation information on the virtual store and controls the identified element to be highlighted on each user's terminal. With this configuration, a shopping environment can be easily shared with other users in a virtual store reproduced in a virtual space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-113023 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the technology described in the above-mentioned patent documents, the user terminals that experience the virtual space are personal computers, smartphones, and tablet terminals. Meanwhile, in recent years, VR glasses (also called VR goggles) for VR experiences are gradually becoming popular among general users. However, VR glasses are generally expensive, and the settings required for use are highly technical and complicated, which makes it difficult for general users to set them up. This has led to problems in that VR glasses are not easily popular among general users.

[0005] In view of the above-mentioned problems, one example of the object of the present invention is to provide a virtual reality commerce system, a relay device, a control method, and a program that promote the use of communication devices for virtual reality experiences by general users. [Means for solving the problem]

[0006] In the present disclosure, a relay device The system is equipped with a relay control means that relays between a communication device for a virtual reality experience and an information providing device that provides the virtual reality experience, connects the communication device to a predetermined information providing device, and controls the information to be provided from the information providing device to the communication device.

[0007] A method for controlling a relay device according to the present disclosure includes: One or more computers This includes relaying between a communication device for a virtual reality experience and an information providing device that provides the virtual reality experience, connecting the communication device to a predetermined information providing device, and controlling the information providing device to provide information to the communication device.

[0008] Another example of the present disclosure may be a program that causes at least one computer to execute the method disclosed above, or a computer-readable recording medium having such a program recorded thereon. The recording medium includes a non-transitory tangible medium. The computer program includes computer program code which, when executed by a computer, causes the computer to carry out the control method on the relay device.

[0009] Any combination of the above components, and conversion of the present disclosure into a method, device, system, recording medium, computer program, etc. are also valid aspects of the present disclosure.

[0010] Furthermore, the various components of the present disclosure do not necessarily have to be independent entities, but may be formed as a single member by multiple components, one component may be formed from multiple components, one component may be a part of another component, or part of one component may overlap with part of another component, etc.

[0011] In addition, although the method and computer program of the present disclosure describe a number of steps in a sequential order, the order does not limit the order in which the steps are executed. Therefore, when implementing the method and computer program of the present disclosure, the order of the steps can be changed as long as it does not affect the content.

[0012] Furthermore, the steps of the method and computer program disclosed herein are not limited to being executed at different times, and may be executed while one step is being executed, or may be executed partially or entirely overlapping with another step, etc. Effect of the Invention

[0013] According to the present disclosure, it is possible to promote the use of communication devices for experiencing virtual reality among general users. [Brief description of the drawings]

[0014] [Figure 1] FIG. 2 is a block diagram showing a configuration of a first relay device according to the present disclosure. [Diagram 2]5 is a flowchart showing an example of the operation of the first relay device according to the present disclosure. [Diagram 3] A diagram conceptually showing the system configuration of a first virtual reality commerce system according to the present disclosure. [Figure 4] FIG. 2 is a block diagram illustrating a hardware configuration of a computer that realizes a relay device according to the present disclosure. [Diagram 5] 6 is a flowchart showing a detailed operation example of the first relay device according to the present disclosure. [Figure 6] FIG. 13 is a block diagram showing a configuration of a second relay device according to the present disclosure. [Figure 7] 13 is a flowchart showing the processing operation of a virtual reality commerce system including a second relay device according to the present disclosure. [Figure 8] 13 is a flowchart showing the processing operation of a virtual reality commerce system including a second relay device according to the present disclosure. [Figure 9] 13 is a flowchart showing the processing operation of a virtual reality commerce system including a second relay device according to the present disclosure. [Figure 10] FIG. 13 is a diagram illustrating an example of a data structure of brick-and-mortar store contract site information. [Figure 11] FIG. 11 is a diagram illustrating an example of a data structure of VR terminal information. [Figure 12] FIG. 4 is a diagram illustrating an example of a data structure of user information. [Figure 13] 13 is a diagram illustrating an example of a data structure of VR terminal rental information. [Figure 14] FIG. 13 is a diagram illustrating an example of a data structure of store-specific payment information. [Figure 15] FIG. 13 is a diagram illustrating an example of a data structure of user-specific payment information. [Figure 16] FIG. 13 is a block diagram showing a configuration of a third relay device according to the present disclosure. [Figure 17] A diagram conceptually illustrating the system configuration of a second virtual reality commerce system according to the present disclosure. [Figure 18] FIG. 13 illustrates an example of a data structure of group information. [Figure 19]A diagram for explaining a shopping experience in a VR space using the second virtual reality commerce system according to the present disclosure. [Figure 20] A diagram for explaining a shopping experience in a VR space using the second virtual reality commerce system according to the present disclosure. [Figure 21] A diagram for explaining a shopping experience in a VR space using the second virtual reality commerce system according to the present disclosure. [Figure 22] A diagram for explaining a shopping experience in a VR space using the second virtual reality commerce system according to the present disclosure. [Figure 23] A diagram conceptually illustrating the system configuration of a third virtual reality commerce system according to the present disclosure. [Figure 24] FIG. 2 is a block diagram showing a configuration of a server device according to the present disclosure. [Diagram 25] FIG. 13 is a block diagram showing a configuration of a fourth relay device according to the present disclosure. [Figure 26] FIG. 13 is a block diagram showing still another configuration of the second relay device according to the present disclosure. [Figure 27] FIG. 2 is a block diagram showing the configuration of a VR terminal according to the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, in this disclosure, the drawings are associated with one or more embodiments. In addition, in all drawings, similar components are given similar reference numerals and their explanations are omitted as appropriate. In addition, in each of the following drawings, configurations of parts that are not related to the essence of this disclosure are omitted and are not shown.

[0016] In this disclosure, "acquisition" includes at least one of the following: a device goes to retrieve data or information stored in another device or storage medium (active acquisition), and a device inputs data or information output from another device (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving a reply, and accessing and reading information from another device or storage medium. An example of passive acquisition is receiving information that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may mean selecting and acquiring data or information from received data or information, or selecting and receiving distributed data or information.

[0017] <Minimum configuration example> 1 is a block diagram showing a configuration of a first relay device 100 according to the present disclosure. The relay device 100 includes a relay control unit 102. The relay control unit 102 relays between a VR (Virtual Reality) terminal 300 (a communication device for experiencing virtual reality) and a VR providing device 200 (an information providing device) that provides a virtual reality experience, and controls the VR terminal 300 to connect to a predetermined VR providing device 200 and provide information from the VR providing device 200 to the VR terminal 300.

[0018] <Example of operation> FIG. 2 is a flowchart showing an example of the operation of the first relay device 100 according to the present disclosure. The relay control unit 102 relays between the VR terminal 300 and the VR providing device 200 (step S11). Then, the relay control unit 102 controls the VR terminal 300 to connect to a predetermined VR providing device 200, and provides information from the VR providing device 200 to the VR terminal 300 (step S13).

[0019] The relay device 100 relays between the VR terminal 300 and the VR providing device 200, and includes a relay control unit 102 that controls so that the VR terminal 300 is connected to a predetermined VR providing device 200. According to this relay device 100, the VR terminal 300 is connected to an appropriate VR providing device 200, and information is provided from the VR providing device 200 to the VR terminal 300, thereby promoting the use of communication devices for experiencing virtual reality by general users.

[0020] A detailed example of the relay device 100 will be described below.

[0021] (First embodiment) <System Overview> FIG. 3 is a diagram conceptually illustrating a system configuration of a first virtual reality commerce system 1 according to the present disclosure. The virtual reality commerce system 1 includes at least a relay device 100 and a VR terminal 300. The relay device 100 and the VR terminal 300 are connected to each other via a communication network 3b by wireless communication. However, the relay device 100 and the VR terminal 300 may be connected to each other by wired communication.

[0022] In this embodiment, the relay device 100 has a relay control unit 102 that relays between the VR terminal 300 and the VR providing device 200 and controls so that the VR terminal 300 connects to a predetermined VR providing device 200. However, in another example, the VR terminal 300 may have a relay unit (not shown) that relays between the VR terminal 300 and the VR providing device 200, and may have a control unit (not shown) that connects the VR terminal 300 to a predetermined VR providing device 200 and controls so that information is provided from the VR providing device 200 to the VR terminal 300.

[0023] In other words, at least one of the relay device 100 and the VR terminal 300 has a control unit that controls the VR terminal 300 to connect to a predetermined VR providing device 200. The predetermined VR providing device 200 is, for example, a server device of a VR store 20 that has a contract with a physical store 10. The VR providing device 200 provides the user U with a shopping experience of the VR store 20 in a VR space.

[0024] The Internet space also includes a non-contractual VR providing device 202, but the relay device 100 blocks the connection between the VR terminal 300 and the non-contractual VR providing device 202. The non-contractual VR providing device 202 is a server device of a VR store 20 that has no contract with the physical store 10.

[0025] The server device of the VR store 20 is a server computer and includes a web server. The server device (VR providing device 200) of the VR store 20 may be realized by a cloud server. The VR terminal 300 accesses a predetermined cloud server corresponding to each VR store 20 via the relay device 100, and a shopping experience is provided at the VR store 20 in the VR space.

[0026] The VR terminal 300 and the VR providing device 200 are connected via a communication network 3a. The communication network 3a and the communication network 3b are, for example, a LAN (Local Area Network), a WAN (Wide Area Network) such as the Internet, or a combination of these. In the example of FIG. 3, since the relay device 100 and the VR terminal 300 are present in the physical store 10, the communication network 3b may be a LAN in the physical store 10. If the VR terminal 300 is present outside the physical store 10, the communication network 3 may be a WAN connected via the Internet.

[0027] In the example of FIG. 3, the relay device 100 is a communication device installed in the physical store 10. However, the relay device 100 may be installed in a place other than the physical store 10, and the installation place is not particularly limited. The relay device 100 may be a device dedicated to communication, or may be a computer such as a personal computer, a server computer, a smartphone, or a tablet terminal. The relay device 100 of the present disclosure may be realized as a single chip or device, or may be realized in a form that is mounted on another device.

[0028] The physical store 10 contracts with multiple VR stores 20 and develops a shopping mall including multiple VR stores 20 in a VR space. The VR providing device 200 constructs the VR store 20 in the VR space in the VR terminal 300 of the user U and provides the user U with an experience such as shopping at the VR store 20. However, the VR space experience provided by the VR providing device 200 is not limited to shopping. The VR space experience provided by the VR providing device 200 may be, for example, a tour experience provided by a travel agency, or may be a job experience in various industries such as agriculture, forestry, fishing, livestock farming, industry, and commerce.

[0029] The VR terminal 300 includes VR glasses 310 and a VR controller 320. The user U wears the VR glasses 310 and operates the VR controller 320 by holding it in his / her hand. However, the operation of the user U may be accepted using an operation acceptance device other than the VR controller 320. The operation acceptance device may be realized by, for example, a smartphone on which a specific application is installed, or may be a device that accepts an operation by a gesture using at least a part of the body or a line of sight. The VR glasses 310 are so-called head-mounted displays, and have a display that displays the VR space, a speaker that outputs the sound of the VR space, and a microphone that collects the conversation of the user U. Furthermore, the VR glasses 310 include a sensor that detects the direction and rotation speed of the head of the user U. Furthermore, the VR terminal 300 may include various sensors such as a gyro sensor, an acceleration sensor, a geomagnetic sensor, and a distance measurement sensor (for example, a ToF (Time-of-Flight) type) that detect the posture, action, movement, etc. of the user U. The VR terminal 300 may include a sensor that tracks the user U's body movements, line of sight, and the like.

[0030] The VR terminal 300 is rented to the user U at the physical store 10. Alternatively, the VR terminal 300 may be delivered to the user U's location (e.g., home, etc.). The VR terminal 300 requires setting up before use. This setting is specific to the virtual reality commerce system 1, and this setting allows the VR terminal 300 to be limited to use only in the virtual reality commerce system 1. The user U can then use the rented VR terminal 300 to immediately receive services provided by the virtual reality commerce system 1 without any prior preparation.

[0031] <Hardware configuration example> Fig. 4 is a block diagram illustrating a hardware configuration of a computer 1000 that realizes the relay device 100 according to the present disclosure. The VR providing device 200 (non-contractual VR providing device 202) and the VR terminal 300 in Fig. 3 are also realized by the computer 1000. In addition, the server device 400 described later is also realized by the computer 1000.

[0032] The computer 1000 has a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0033] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to a bus connection.

[0034] The processor 1020 is implemented by a central processing unit (CPU) or a graphics processing unit (GPU).

[0035] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0036] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), or the like. The storage device 1040 stores program modules that realize each function of the relay device 100 (e.g., the relay control unit 102, and a product purchasing unit 104, a group information acquisition unit 106, a storage processing unit 108, a calculation unit 110, etc., which will be described later), each function of the VR terminal 300 (e.g., a connection unit 302, a control unit 304), and each function of the server device 400 (e.g., a control unit 402, etc.). The processor 1020 loads each of these program modules onto the memory 1030 and executes them, thereby realizing each function corresponding to the program module.

[0037] The program module may be recorded in a recording medium. The recording medium for recording the program module may include a non-transitory tangible medium usable by the computer 1000, and the program code readable by the computer 1000 (processor 1020) may be embedded in the medium.

[0038] The input / output interface 1050 is an interface for connecting the computer 1000 to various input / output devices. The input / output interface 1050 also functions as a communication interface for performing short-range wireless communication such as Bluetooth (registered trademark) and NFC (Near Field Communication).

[0039] The network interface 1060 is an interface for connecting the computer 1000 to a communication network 3. The communication network 3 is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The method for connecting the network interface 1060 to the communication network 3 may be a wireless connection or a wired connection.

[0040] The computer 1000 is connected to necessary devices (eg, a display, a touch panel, operation buttons, a touch pad, a keyboard, a mouse, a speaker, a microphone, a camera, a printer, etc.) via an input / output interface 1050 or a network interface 1060.

[0041] Each component of the relay device 100, the VR terminal 300, and the server device 400 according to the present disclosure in each figure is realized by any combination of hardware and software of the computer 1000 in Fig. 4. Those skilled in the art will understand that there are various variations in the realization method and device. The functional block diagrams showing the relay device 100, the VR terminal 300, and the server device 400 according to the present disclosure in each figure show blocks of logical function units, not configurations of hardware units.

[0042] <Example of functional configuration> The following explanation will be given with reference to FIG. FIG. 26 is a block diagram showing still another configuration of the second relay device 100 according to the present disclosure. The relay device 100 further includes a storage processing unit 108 in addition to the components of the relay device 100 in FIG. The storage processing unit 108 associates the identification information capable of identifying the VR terminal 300 with the authentication information (dummy account) of the VR terminal 300 linked to the identification information of the VR terminal 300 and user information related to the user U of the VR terminal 300, and stores them in the storage unit. Note that the second relay device 100 in Fig. 6 may further include the storage processing unit 108 in Fig. 26. In the following description, the second relay device 100 will be described as including the relay control unit 102, the product purchasing unit 104, and the storage processing unit 108.

[0043] The identification information and authentication information of the VR terminal 300 are information indicating a dummy account, and are account information used to log in to the VR space site of the physical store 10. The relay control unit 102 uses the authentication information of the VR terminal 300 to connect the VR terminal 300 to a predetermined VR providing device 200, and controls so that information is provided from the VR providing device 200 to the VR terminal 300. The authentication information and user information will be described later.

[0044] 27 is a block diagram showing a configuration of a VR terminal 300 according to the present disclosure. The VR terminal 300 includes a connection unit 302 and a control unit 304. The connection unit 302 uses authentication information to connect to a VR providing device 200 that provides a VR space via a relay device. The control unit 304 restricts connection to a predetermined VR providing device 200.

[0045] <Example of operation> The following explanation will be given with reference to FIG. FIG. 5 is a flowchart showing a detailed operation example of the first relay device 100 according to the present disclosure. First, the storage processing unit 108 issues an account for lending the VR terminal 300 after accepting an application for use of the VR terminal 300 from the user U. Then, the storage processing unit 108 associates the lending account with identification information capable of identifying the user (hereinafter also referred to as a user ID), and stores the account in a storage unit (not shown) such as the memory 1030 or storage device 1040 of the computer 1000 constituting the relay device 100 (step S21). In the following description, "stored in the storage unit of the relay device 100", but this description is intended to mean "stored in the memory 1030 or storage device 1040 of the computer 1000 constituting the relay device 100".

[0046] Furthermore, the storage processing unit 108 further stores the account information including the issued account in a storage unit (not shown) such as the memory 1030 or storage device 1040 of the computer 1000 constituting the VR terminal 300. In the following description, "stored in the storage unit of the VR terminal 300" is used, but this description means "stored in the memory 1030 or storage device 1040 of the computer 1000 constituting the VR terminal 300".

[0047] For example, the application is accepted by displaying an application acceptance screen on an operation terminal (e.g., a tablet terminal or a computer 1000 such as a personal computer) operated by an employee of the physical store 10. However, the relay device 100 may include an operation terminal. The operation terminal may be a store terminal that performs product registration processing, etc.

[0048] The reception screen receives input of identification information (hereinafter also referred to as terminal ID) capable of identifying the VR terminal 300 that is assigned in advance to the VR terminal 300 to be rented out, and the user ID of the user U. The terminal ID of the VR terminal 300 may be recorded, for example, in a code image (barcode, two-dimensional code, etc.) or an RFID (Radio Frequency Identification) tag. The operation terminal may read and acquire the terminal ID from a code image attached to the VR terminal 300 using a code reader or a camera, or may read the terminal ID from an RFID tag attached to the VR terminal 300 using an RFID reader.

[0049] The user ID of the user U may be recorded in a code image (barcode, two-dimensional code, etc.), RFID (Radio Frequency Identification), magnetic card, etc. A code image recording the user ID is displayed on the display of a communication device (e.g., a smartphone, etc.) used by the user U. The operation terminal may read and acquire the user ID from the displayed code image using a code reader or a camera. Furthermore, the user ID may be recorded in a recording medium such as a membership card distributed by the physical store 10. The membership card may have alphanumeric characters (which may include symbols and letters) indicating the user ID printed on one side, a code image recording the user ID may be printed on it, or the user ID may be recorded in a magnetic stripe or IC chip. The operation terminal can read and acquire the user ID from the recording medium using a reader or a camera.

[0050] The operation terminal transmits the acquired terminal ID and user ID to the relay device 100, and stores them in the storage unit of the relay device 100. Furthermore, the relay device 100 transmits account information to the VR terminal 300, and stores them in the storage unit of the VR terminal 300. The account information issued by the storage processing unit 108 is an account issued for each acceptance of use of the VR terminal 300, and is an account for accessing the VR providing device 200.

[0051] For example, the account includes authentication information for authenticating the user U, such as a passcode. This account information is issued for each user U for each application for use, and is deleted from the memory of the relay device 100 and the VR terminal 300 after the use of the VR terminal 300 is terminated, for example, when the VR terminal 300 is returned to the physical store 10.

[0052] Then, the user U rents the VR terminal 300, wears the VR glasses 310, and operates the VR controller 320 to perform a login operation to access the VR space site provided by the physical store 10. The URL of the web page for logging in to the VR space site provided by the physical store 10 may be pre-stored in the storage unit of the VR terminal 300, or the URL recorded in the code image presented at the physical store 10 may be read and acquired by the camera of the VR terminal 300, or the input of the URL using the VR controller 320 may be accepted.

[0053] The relay control unit 102 of the relay device 100 acquires login information from the VR terminal 300 (step S23). The login information is the account information recorded in the storage unit of the VR terminal 300. The relay control unit 102 performs authentication processing for the VR terminal 300 by checking whether the terminal ID acquired from the VR terminal 300 and the account information match the account information associated with the terminal ID and stored in the storage unit.

[0054] If the account information matches, it is determined that the authentication has been successful, and if the account information does not match, it is determined that the authentication has failed. If the authentication is successful, the user can log in to the VR terminal 300 or the VR space site. The relay control unit 102 identifies the user ID of the VR terminal 300 that has been successfully authenticated (step S25). The relay control unit 102 acquires the user ID associated with the terminal ID that has been successfully authenticated.

[0055] The user U operates the VR controller 320 of the VR terminal 300 to access an arbitrary VR store 20. When the relay control unit 102 accepts access to the VR store 20 from the VR terminal 300 (step S27), it judges whether or not the VR store 20 is a contracted VR store 20. If the VR store 20 is an uncontracted VR store 20, the relay control unit 102 cuts off the connection between the VR terminal 300 and the uncontracted VR providing device 202 (step S29). On the other hand, if the VR store 20 is an contracted VR store 20, the relay control unit 102 relays the connection between the VR terminal 300 and the VR providing device 200 of the contracted VR store 20 (step S31).

[0056] As described above, according to this embodiment, the relay device 100 includes a relay control unit 102. The relay control unit 102 relays between the VR terminal 300 and the VR providing device 200, and controls so that the VR terminal 300 connects to a predetermined VR providing device 200 and information is provided from the VR providing device 200 to the VR terminal 300. According to this relay device 100, the VR terminal 300 is connected to an appropriate VR providing device 200, and information is provided from the VR providing device 200 to the VR terminal 300, so that the use of a communication device for experiencing virtual reality by general users can be promoted.

[0057] According to the present embodiment, the relay device 100 further includes a storage processing unit 108. The storage processing unit 108 associates the identification information capable of identifying the VR terminal 300 with the authentication information (dummy account) of the VR terminal 300 linked to the identification information of the VR terminal 300 and user information related to the user U of the VR terminal 300, and stores them in the storage unit.

[0058] According to this configuration, since no settings are required to connect the VR terminal 300 to the VR providing device 200, even general users who are not familiar with IT technology can immediately use the VR terminal 300 to experience a VR space.

[0059] Second embodiment Fig. 6 is a block diagram showing a configuration of a second relay device 100 according to the present disclosure. The relay device 100 in Fig. 6 is the same as the relay device 100 in Fig. 1 except that it further includes a product purchasing unit 104. Note that each element in Fig. 6 may be combined with each element in one or more embodiments to the extent that no contradiction occurs.

[0060] <Example of functional configuration> The relay control unit 102 relays a product purchase process performed between the VR terminal 300 and the VR providing device 200. In the example of FIG. 6, the relay device 100 includes a product purchase unit 104 that performs a product purchase process between the VR terminal 300 and the VR providing device 200.

[0061] The product purchasing unit 104 performs a process of accepting products purchased by the user U at the VR store 20 and a process of settling the price of the purchased products. The product purchasing unit 104 acquires payment information related to the product purchase process of the user U relayed using the user information from the VR providing device 200, and performs a process of settling the payment. The details of the process of settling the payment will be described later.

[0062] <Example of operation> The following description will be given with reference to FIG. 7 to FIG. 7 to 9 are flowcharts showing the processing operations of the virtual reality commerce system 1 including the second relay device 100 according to the present disclosure. The processing of the relay device 100 includes processing related to advance preparation in FIG. 7, processing related to the VR experience in FIG. 8, in particular processing related to the shopping experience at the VR store 20, and processing related to payment for goods in FIG.

[0063] <Pre-processing> 7, first, the relay device 100 of the physical store 10 prepares to relay with each of the VR providing devices 200 of the multiple VR stores 20 with which the physical store 10 has contracted (step S101). Specifically, the relay device 100 registers information on the VR providing devices 200 of the contracted VR stores 20 in the physical store contract site information 130.

[0064] 10 is a diagram showing an example of a data structure of the physical store contract site information 130. The physical store contract site information 130 is stored in the storage unit of the relay device 100. The physical store contract site information 130 stores identification information capable of identifying the physical store 10 (hereinafter also referred to as a physical store ID), identification information capable of identifying the contracted VR store 20 (hereinafter also referred to as a contract VR store ID), and information indicating the URL (Uniform Resource Locator) of the VR space site provided by the VR providing device 200 of the VR store 20, in association with each other. If the physical store contract site information 130 includes information only about the physical store 10, the physical store ID may not be necessary. The physical store contract site information 130 stores the URL of the VR space site for each VR store 20 in association with each other.

[0065] 11 is a diagram showing an example of the data structure of the VR terminal information 140. The VR terminal information 140 is stored in the storage unit of the relay device 100. The physical store 10 has at least one VR terminal 300. The VR terminal information 140 stores a physical store ID in association with the terminal ID of the VR terminal 300 owned by the physical store 10. If the VR terminal information 140 includes information only about the physical store 10, the physical store ID may not be necessary.

[0066] 12 is a diagram showing an example of a data structure of user information 150. The user information 150 is stored in a storage unit of the relay device 100. When a user U uses the physical store 10, the user U performs a user registration procedure. For example, the relay device 100 displays a registration screen on a display of an operation terminal of the relay device 100 and accepts input of information required for user registration. The relay device 100 stores the accepted information of the user U in the user information 150.

[0067] User information 150 stores a user ID and information such as user U's name in association with a physical store ID for each user U. If user information 150 includes information only about physical store 10, the physical store ID may not be necessary. The user ID may be a membership number assigned to user U by physical store 10, or may be identification information registered by user U. User information 150 may also include other information such as user U's contact phone number, email address, and address. Furthermore, user information 150 may also include attribute information of user U, including gender, date of birth, age, etc.

[0068] Returning to FIG. 7, the procedure by which the user U uses the VR terminal 300 will now be described. In the actual store 10, an employee or the like accepts an application for lending a VR terminal 300 from the user U. At this time, as described above, an application acceptance screen is displayed using an operation terminal or the like, and the relay control unit 102 acquires the user ID of the user U and the terminal ID of the VR terminal 300 to be lent to the user U (step S103).

[0069] Then, the storage processing unit 108 issues an account for each rental of the VR terminal 300 (step S105). The storage processing unit 108 transmits the issued account information to the VR terminal 300 and stores it in the storage unit of the VR terminal 300 (step S107). Furthermore, the storage processing unit 108 stores the rental account information issued and linked to the terminal ID in the storage unit of the relay device 100 in association with the user ID and the terminal ID (step S109). Then, the VR terminal 300 is rented out to the user U from the physical store 10 (step S111).

[0070] FIG. 13 is a diagram showing an example of the data structure of the VR terminal rental information 142. As shown in FIG. The VR terminal lending information 142 includes, for each lent VR terminal 300, at least the terminal ID of the VR terminal 300, the account information issued at the time of lending, and the user ID of the user U who lent the VR terminal 300. The account information includes a lending ID corresponding to user identification information used when logging in to the VR space site of the VR store 20, and authentication information associated with the lending ID. As described above, the lending account information is issued each time the user U lends a VR terminal 300.

[0071] The VR terminal lending information 142 may further include information indicating the date and time when the VR terminal 300 was lent and information indicating the date and time when the VR terminal 300 was returned, associated with the terminal ID of the VR terminal 300.

[0072] <VR Experience Processing> As shown in FIG. 8, first, in order for the VR terminal 300 to access the VR space site provided by the physical store 10 stored in the storage unit, the VR terminal 300 reads the account information from the storage unit and performs a login process (step S121). The relay control unit 102 of the relay device 100 acquires the account information from the VR terminal 300 and performs an authentication process (step S123). Specifically, the relay device 100 collates the account information acquired from the VR terminal 300 with the account information stored in the VR terminal lending information 142 and performs an authentication process. When the authentication is successful, the relay control unit 102 of the relay device 100 acquires the user ID associated with the account information in the VR terminal lending information 142.

[0073] Next, the VR terminal 300 receives the VR store 20 that the user U wants to access, specified using the VR controller 320. The VR terminal 300 transmits information indicating the VR store 20 that the user U wants to access to the relay device 100 (step S125). For example, the VR terminal 300 may display an operation screen including a list of VR stores 20. In this case, the list preferably includes only the VR stores 20 that have contracted with the physical store 10.

[0074] Alternatively, the VR terminal 300 may display an operation screen that accepts an operation for searching for a VR store 20 suitable for the content that the user U wants to experience. The user U performs an operation for selecting the VR store 20 that the user wants to access using the VR controller 320. The VR terminal 300 accepts the selection and transmits information indicating the selected VR store 20 (for example, at least one of the store name, VR store ID, URL, etc.) to the relay device 100.

[0075] The relay control unit 102 of the relay device 100 performs a process of connecting the VR store 20 to the VR providing device 200 of the VR store 20 based on the information indicating the VR store 20 transmitted from the VR terminal 300. The relay control unit 102 judges whether or not the VR store 20 has been contracted. For example, the relay control unit 102 refers to the actual store contract site information 130 and searches for the URL of the VR store 20. If the URL is not found, the VR store 20 is out of the contract, so the relay control unit 102 cuts off the connection between the VR terminal 300 and the out-of-contract VR providing device 202 (step S127). On the other hand, if the URL is found, the VR store 20 is out of the contract, so the relay control unit 102 transmits user information of the user U to the VR providing device 200 and relays the connection between the VR terminal 300 and the VR providing device 200 of the VR store 20 (step S129).

[0076] There are other possible methods for the relay control unit 102 to determine the non-contract VR providing device 202 to be disconnected. For example, the relay control unit 102 may determine the non-contract VR providing device 202 to be disconnected using a list including information indicating the VR store 20 to be disconnected. The list includes at least one of, for example, a store name, a VR store ID, and a URL, which indicate the non-contract VR providing device 202 of the VR store 20 to be disconnected. When the relay control unit 102 receives an access request to the VR store 20 from the VR terminal 300, the relay control unit 102 may determine whether the VR store 20 is included in the list. If the VR store 20 is included in the list, the relay control unit 102 determines that the non-contract VR providing device 202 is the non-contract VR providing device to be disconnected, and disconnects the connection between the VR terminal 300 and the non-contract VR providing device 202. In other words, the relay control unit 102 denies the access from the VR terminal 300 to the VR store 20.

[0077] At this time, it is preferable that the relay control unit 102 displays a message on the display of the VR terminal 300 notifying the user that the VR store 20 is unavailable.

[0078] In the relay process between the VR terminal 300 and the VR providing device 200 by the relay device 100, the VR providing device 200 receives the user information transmitted from the relay device 100 (step S131). When the connection between the VR terminal 300 and the VR providing device 200 is relayed, the VR providing device 200 provides the VR terminal 300 of the user U with a shopping experience at the VR store 20 in the VR space based on the received user information (step S133). The user U can experience shopping at the VR store 20 in the VR space using the VR terminal 300 (step S135).

[0079] Next, when the user U makes a purchase (purchase of a product) at the VR store 20, the VR terminal 300 performs the product purchase process (step S137). Specifically, the VR terminal 300 accepts the operation of the user U using the VR controller 320, and, for example, places the product that the user U has decided to purchase in a shopping cart. When the user U goes to the cash register at the VR store 20 and completes the purchase procedure, the VR store 20 performs a process to sell the product to the user U (step S139). For example, the product purchase unit 104 performs settlement information for the product added to the shopping cart. The VR providing device 200 of each VR store 20 records the payment information for each user U in the storage unit (step S141).

[0080] FIG. 14 is a diagram showing an example of the data structure of the store-specific payment information 160. As shown in FIG. The store-specific payment information 160 stores the VR store ID for each VR store 20 in association with the user ID of the user U and payment information. The store-specific payment information 160 may be stored in a storage device (not shown) of the VR providing device 200 of the VR store 20. In that case, the store-specific payment information 160 does not need to include the VR store ID. Since the store-specific payment information 160 is stored for each VR store 20, it does not need to include the VR store ID. The user ID of the user U in the store-specific payment information 160 may be the terminal ID of the VR terminal 300 used by the user U.

[0081] Returning to FIG. 8, the user U may use the VR terminal 300 to have a shopping experience at multiple VR stores 20. After the user U finishes shopping, the user U returns the VR terminal 300 to the physical store 10. At that time, the physical store 10 performs a settlement process for the user U for the prices of the products purchased at each VR store 20.

[0082] <Settlement process> 9, the VR providing device 200 of each VR store 20 shares payment information indicating the product purchase price, among information related to the product purchase by the user U, with the relay device 100 (step S151). When the user U returns the VR terminal 300 (step S155) or when the user U finishes shopping at the VR space site in the physical store 10, the product purchasing unit 104 of the relay device 100 acquires payment information associated with the identification information of the user U from the store-specific payment information 160 of each VR store 20, and stores the information in the storage unit of the relay device 100 as user-specific payment information 162 (step S153).

[0083] However, the timing for acquiring the payment information from each VR store 20 may be other timing. For example, when the user U is not using the VR terminal 300 at the actual store 10 but is using the VR terminal 300 at another place such as at home, the product purchasing unit 104 of the relay device 100 may acquire the payment information of each user U from each VR store 20 with a specific due date as the closing date.

[0084] FIG. 15 is a diagram showing an example of the data structure of the user-specific payment information 162. As shown in FIG. The user-specific payment information 162 stores, for each user U, a user ID, the VR store ID of the VR store 20 where the user U purchased a product, and payment information in association with the user ID. If the user U makes purchases at multiple VR stores 20, the user-specific payment information 162 stores the payment information for each of the multiple VR stores 20 in association with each other.

[0085] Returning to Fig. 9, when the user U returns the VR terminal 300 to the physical store 10, the operation terminal of the relay device 100 displays a return acceptance screen for the VR terminal 300. The return acceptance screen accepts input of the terminal ID of the returned VR terminal 300 and the user ID of the user U (step S155). The operation terminal of the relay device 100 acquires the terminal ID and user ID in the same way as when applying to lend the VR terminal 300.

[0086] The relay device 100, upon confirming the return of the VR terminal 300 to the user U by referring to the VR terminal rental information 142, erases the association with the rental account information stored in the VR terminal rental information 142 (step S157). Furthermore, the relay device 100 also erases the account information stored in the storage unit of the VR terminal 300 (step S159).

[0087] Then, the product purchasing unit 104 of the relay device 100 refers to the user-specific payment information 162 and totals the purchase price indicated by the payment information of each VR store 20 of the user U (step S161). Then, the product purchasing unit 104 of the relay device 100 requests the user U to pay the price (step S163). Specifically, the product purchasing unit 104 displays the amount of the payment price on the operation terminal of the relay device 100. The product purchasing unit 104 receives the payment from the user U. An employee of the actual store 10 may use the store terminal to settle the payment, or the product purchasing unit 104 of the relay device 100 may settle the payment (step S165). The payment method is not particularly limited, and may be either cash or cashless payment.

[0088] As described above, in cases where user U's VR terminal 300 is rented out for a long period of time, the product purchasing unit 104 may bill user U at specific due dates and perform settlement processing using a payment method previously registered by user U (including but not limited to bank transfer, convenience store payment, credit card payment, etc.).

[0089] The product purchasing unit 104 of the relay device 100 distributes the amount collected from each user U on behalf of the VR store 20 to each VR store 20 (step S167).

[0090] As described above, the relay device 100 of this embodiment has the product purchase unit 104 that performs the product purchase process between the VR terminal 300 and the VR providing device 200. In this way, according to the relay device 100 of this embodiment, the same effects as those of the above embodiment can be achieved, and furthermore, the user can be provided with a product purchasing experience in a VR space. Furthermore, the product purchasing unit 104 acquires payment information related to the product purchase process of the user U relayed using the user information from the VR providing device 200 and performs the settlement process, so that the user U does not need to register the settlement information etc. required for the settlement process for each VR providing device 200. The product purchasing unit 104 of the relay device 100 can compile the payment information of multiple VR stores 20 for each user U at the actual store 10, and can perform the settlement process by requesting the user U to pay the price collectively.

[0091] Third embodiment Fig. 16 is a block diagram showing a configuration of a third relay device 100 according to the present disclosure. The relay device 100 in Fig. 16 is the same as the relay device 100 in Fig. 1 except that it further includes a group information acquisition unit 106. Note that each element in Fig. 16 may be combined with each element in one or more embodiments to the extent that no contradiction occurs.

[0092] <Example of functional configuration> The group information acquisition unit 106 acquires group information including a plurality of VR terminals 300 . The relay control unit 102 transmits the acquired group information to the VR providing device 200, thereby performing relay processing between the VR terminals 300 and the VR providing device 200 on a group-by-group basis.

[0093] <System Overview> FIG. 17 is a diagram conceptually illustrating a system configuration of a second virtual reality commerce system 1 according to the present disclosure. The virtual reality commerce system 1 in Figure 17 is the same as the virtual reality commerce system 1 in Figure 3 except that multiple VR terminals 300 in a physical store 10 can be registered as a group, allowing users U of the VR terminals 300 to experience the same VR space.

[0094] 18 is a diagram showing an example of the data structure of the group information 170. The group information 170 is stored in the storage unit of the relay device 100. The group information 170 stores, for each group, identification information capable of identifying the group (hereinafter also referred to as a group ID) in association with the user ID of the user U included in the group.

[0095] <Example of operation> The following description will be given with reference to FIG. 19 to 22 are diagrams for explaining a shopping experience in a VR space using the second virtual reality commerce system 1 according to the present disclosure.

[0096] <Example of individual users using the VR terminal 300> In the example of FIG. 19, multiple users U1, U2, and U3 exist in different rooms in the real space 50. For example, each user U may be in a room in a geographically separated location (for example, a different region). Each user U may visit the VR store 20 at the same time or at different times. Even if each user U accesses the VR providing device 200 at a different time, if the users U are registered as the same group, they can meet in the VR space 60 if they visit the same VR store 20 at the same time.

[0097] Each user U wears the VR glasses 310 of the VR terminal 300, and experiences the VR store 20 in the VR space 60 together. The VR space 60 shows an image displayed on the display of the VR glasses 310 of each user U.

[0098] In the VR space 60, avatars Uv1, Uv2, and Uv3 of users U1, U2, and U3 of the same group move within the VR store 20. The figure also shows the visual field ranges v1, v2, and v3 (shown as sectors in the figure) of the avatars Uv1, Uv2, and Uv3 of users U1, U2, and U3. Conversations b1, b2, and b3 (shown as speech bubbles in the figure) between users U1, U2, and U3 of the same group are collected by microphones in the VR glasses 310, and transmitted to the VR providing device 200 via the relay device 100.

[0099] The collected conversations b1, b2, and b3 (shown by speech bubbles in the figure) of users U1, U2, and U3 in the same group are output as sounds s1, s2, and s3 (shown by sound wave marks in the figure) from the VR providing device 200 to the speakers of the VR glasses 310. In FIG. 19, since the avatars Uv2 and Uv3 of users U2 and U3 are far apart in the VR space 60, the sound s3 of the conversation of user U3 is not output from the speaker of the VR glasses 310 of user U2, and the sound s2 of the conversation of user U2 is not output from the speaker of the VR glasses 310 of user U3.

[0100] <Example 1: Multiple people using the same device at the same time> In the example of FIG. 20, multiple users U1, U2, and U3 are in the same room in the real space 50. In addition, the multiple users U1, U2, and U3 each operate a VR terminal 300. In this case, unlike the case of FIG. 19, the conversations b1, b2, and b3 of the multiple users U1, U2, and U3 can be heard directly from each other without going through the speakers of the VR glasses 310. In the example of FIG. 19, the multiple users U1, U2, and U3 were registered in the group information 170 as the same group in advance. In the example of FIG. 20, for example, when the multiple users U1, U2, and U3 who visited the physical store 10 enter the same room, they may be associated with each other as the same group.

[0101] The group information acquisition unit 106 identifies multiple VR terminals 300 whose mutual positions satisfy a predetermined relationship as the same group, and generates group information 170. The group information 170 generated by the group information acquisition unit 106 is stored in the storage unit of the relay device 100.

[0102] The predetermined relationship is that the access point accessed by the VR terminal 300 satisfies a predetermined criterion. In order to connect to the communication network 3a, the VR terminal 300 connects to, for example, an access point of the communication network 3a. The predetermined criterion is, for example, that the IP addresses of the access points are the same. Alternatively, for example, when multiple access points are installed in a large room, the predetermined criterion is that the installation locations of the access points identified from the IP addresses of the access points are included within a predetermined range.

[0103] In this way, multiple users U1, U2, and U3 who are in the same room are automatically registered as the same group, share the same VR space 60, and can enjoy a shopping experience at the VR store 20 together.

[0104] <Second example: multiple people using the same device at the same time> 21, multiple users U1, U2, and U3 are in the same room in the real space 50. However, in this example, the user U3 is the representative and operates the VR controller 320 of the VR terminal 300. The other users U1 and U2 are wearing the VR glasses 310 of the VR terminal 300.

[0105] In this case, only the avatar Uv3 of the user U3 who is performing the operation as the representative exists in the VR space 60. The user U3 performs a movement operation in the VR space 60. For example, the group information acquisition unit 106 accepts the designation of the representative user U3 on the operation screen of the VR terminal 300. For example, the group information acquisition unit 106 may display a list of users U identified as being in the same group on the operation screen, and accept the designation of the representative user U3 from the list.

[0106] The group information 170 further associates the terminal ID of the representative user U3 with information indicating that the user U3 is the representative and stores the information. The relay device 100 transmits the user ID of the representative user U3 to the VR providing device 200, and the VR providing device 200 moves the avatar Uv3 of the user U3 in the VR space 60 using an operation instruction from the VR terminal 300 of the user U3. The group information acquisition unit 106 may also accept a change in the representative user U during the VR experience. The relay device 100 may transmit information indicating that the representative user U has been changed to the VR providing device 200 together with information indicating the new representative user U.

[0107] On the other hand, the users U1 and U2 can operate the viewing direction of the avatars Uv1 and Uv2 of the other users U1 and U2 (for example, changing the direction of rotation of the face). The VR providing device 200 accepts the operation of the viewing direction of the other users U1 and U2 in the same group, and changes the viewing direction of the avatars Uv1 and Uv2 of the users U1 and U2 in the VR space 60.

[0108] In this example as well, the conversations b1, b2, and b3 between users U1, U2, and U3 in the same group can be heard directly by each other without going through the speakers of the VR glasses 310.

[0109] In this usage example, one user U is responsible for basic operations, so that other users U can experience VR even if they are beginners. The beginner can decide and operate the field of view for viewing the interior of the store in the VR space using the VR glasses 310. Thus, according to this usage example, the hurdle for beginner users U to use the virtual reality commerce system 1 is lowered, and the use of the VR terminal 300 is promoted.

[0110] <Third example: multiple people using the same device at the same time> In the example of Fig. 22, the multiple users U1, U2, and U3 in the example of Fig. 21 exist in the first real space 50a, and a representative user U4 exists in another second real space 50b. The user U4 is a so-called influencer or a store clerk working in the second real space 50b, which is a store, and the second real space 50b is an actual store that the user U4, such as an influencer, introduces to the other users U1, U2, and U3. For example, the user U4 visits the second real space 50b with a 360° camera 340 instead of wearing the VR terminal 300.

[0111] The first real space 50a and the second real space 50b are each provided with a relay device 100. However, it is preferable that the relay device 100 in the second real space 50b is a portable type. For example, the relay device 100 may be a portable wireless LAN communication device for the 360° camera 340 carried by the user U4, or may be included inside the 360° camera 340.

[0112] However, the 360° camera 340 may be installed in a store, which is the second real space 50b. The 360° camera 340 has a wireless communication function, and connects to the relay device 100 via an access point for wireless devices, and connects to the Internet (communication network 3a) via the relay device 100, and connects to the VR providing device 200 in the VR store 20. Also, if the user U4 is a store clerk, the 360° camera 340 may access the Internet and connect to the VR providing device 200 in the VR store 20, without going through the relay device 100.

[0113] For example, the video captured by the 360° camera 340 includes a user U4 showing the inside of a store. The video captured by the 360° camera 340 is transmitted in real time to the VR providing device 200, and then transmitted from the VR providing device 200 to the VR terminals 300 of the users U1, U2, and U3 present in the first real space 50a.

[0114] Furthermore, relay device 100 may be provided inside or outside portable wireless LAN communication device or 360° camera 340. In other words, relay device 100 may be a piece of hardware integrated with portable wireless LAN communication device or 360° camera 340, or may be a piece of hardware separate from portable wireless LAN communication device or 360° camera 340.

[0115] The group information acquisition unit 106 of the relay device 100 in the first real space 50a identifies the users U in the first real space 50a as being in the same group, and generates group information 170. Furthermore, the group information acquisition unit 106 of the relay device 100 in the second real space 50b registers the user U4 in the second real space 50b as a member of the same group in the group information 170 in association with the group ID of the group. Alternatively, for the user U4 who is the representative of the group of the user U who is in the first real space 50a, the group information acquisition unit 106 may accept designation of the user U4 who is the representative of the group on the operation screen of the operation terminal of the relay device 100 in the second real space 50b.

[0116] The relay device 100 in the second real space 50b transmits the group information 170 to the relay device 100 in the first real space 50a. The group information acquisition unit 106 of the relay device 100 in the first real space 50a may integrate the group information 170 received from the relay device 100 in the second real space 50b with the group information 170 of the relay device 100 in the first real space 50a.

[0117] Alternatively, the relay device 100 in the first real space 50a may accept designation of a representative user U4 on the operation screen of the VR terminal 300, and store information indicating that the user U4 is the representative of the group in association with the user ID of the user U4 in the group information 170.

[0118] 22, multiple users U1, U2, and U3 are in the same room, but multiple users U may be in different locations as in the example of Fig. 19. In that case, a designation that multiple users U are in the same group may be accepted via an operation screen of an operation terminal of the relay device 100, and the group information acquisition unit 106 may generate group information 170 according to the designation.

[0119] User U4 moves around the store, which is the second real space 50b, with a 360° camera 340. The relay device 100 in the second real space 50b transmits the video of the 360° camera 340 to the VR providing device 200. The VR providing device 200 receives the video of the 360° camera 340 and displays the video on the displays of the VR terminals 300 of users U1, U2, and U3 who are in the same group as user U4, as a 360° camera space 70.

[0120] Furthermore, the relay device 100 in the second real space 50b transmits the conversation b4 of the user U4 picked up by the microphone of the 360° camera 340 to the VR providing device 200. The VR providing device 200 receives the conversation b4 of the user U4 picked up by the microphone of the 360° camera 340, and outputs it as sound s4 from the speakers of the VR glasses 310 of the users U1, U2, and U3 in the first real space 50a.

[0121] Furthermore, the relay device 100 in the first real space 50a transmits the conversations b1, b2, and b3 of each user U, collected by the microphones of the VR terminals 300 of the users U1, U2, and U3 in the first real space 50a, to the VR providing device 200. The VR providing device 200 receives the conversations b1, b2, and b3 of the users U1, U2, and U3 in the first real space 50a, and outputs the received sounds from the speakers of the 360° camera 340 of the user U4.

[0122] As described above, the relay device 100 of this embodiment has a group information acquisition unit 106 that acquires group information including a plurality of VR terminals 300. Then, the relay control unit 102 transmits the acquired group information to the VR providing device 200, thereby performing relay processing between the VR terminals 300 and the VR providing device 200 in units of the same group. In this way, according to the relay device 100 of this embodiment, the same effects as those of the above embodiment can be achieved, and further, a plurality of users U who are set in the same group can experience the VR space together. Furthermore, according to this embodiment, it is possible to experience shopping in the real space 50 (real store) together with a specific person such as an influencer within the 360° camera space.

[0123] (Fourth embodiment) Fig. 25 is a block diagram showing a configuration of a fourth relay device 100 according to the present disclosure. The relay device 100 in Fig. 25 is the same as the relay device 100 in Fig. 1 except that it further includes a calculation unit 110. Note that each element in Fig. 25 may be combined with each element in one or more embodiments to the extent that no contradiction occurs. Also, the calculation unit 110 may be included in the server device 400. In other words, the function of the calculation unit 110 can be realized by at least one of the relay device 100 and the server device 400.

[0124] <Example of functional configuration> The calculation unit 110 calculates the price for each specific VR store 20 based on the access history of the VR terminal 300 to the VR providing device 200 corresponding to that VR store 20. The compensation may include, for example, advertising fees and fees for use of the virtual reality commerce system 1.

[0125] For example, the calculation unit 110 increases the discount rate of the advertisement fee for the VR store 20 as the number of accesses increases, and increases the advertisement fee for the VR store 20 from the standard as the number of accesses decreases. Also, the calculation unit 110 increases the discount rate of the usage fee for the VR store 20 as the number of accesses increases, and increases the usage fee for the VR store 20 from the standard as the number of accesses decreases.

[0126] There are various possible methods for the calculation unit 110 to determine whether the number of accesses is large or small, and examples thereof are given below, but the method is not limited to these. (1) If the number of accesses is equal to or greater than a first threshold, the number of accesses is determined to be large, and if the number of accesses is less than a second threshold (the second threshold is smaller than the first threshold), the number of accesses is determined to be small. (2) Using the access rankings of a plurality of VR stores 20, the number of accesses is determined to be higher or lower in the order of the ranking. (3) A predetermined number of stores in the top ranking of the number of hits (for example, the top three stores) are determined to have a large number of hits, and a predetermined number of stores in the bottom ranking (for example, the bottom three stores) are determined to have a small number of hits.

[0127] As described above, the relay device 100 of this embodiment has a calculation unit 110 that calculates a fee for each specific VR store 20 based on the access history of the VR terminal 300 to the VR providing device 200 corresponding to that VR store 20.

[0128] Thus, according to this embodiment, it is possible to obtain the same effect as the above embodiment, and furthermore, to provide compensation according to the number of accesses to the VR store 20 using the virtual reality commerce system 1. Therefore, each VR store 20 will provide an experience that increases the number of accesses in order to obtain better compensation, and a virtuous cycle will be created in which both the VR store 20 and the physical store 10 will increase their profits.

[0129] Although the embodiments have been described above with reference to the drawings, these are merely examples of the present disclosure, and various configurations other than those described above can also be adopted. (Another embodiment 1) <System Overview> FIG. 23 is a diagram conceptually illustrating a system configuration of a third virtual reality commerce system 1 according to the present disclosure. In the example of Fig. 23, the virtual reality commerce system 1 is the same as the virtual reality commerce system 1 of Fig. 3 and Fig. 17, except that it further includes a server device 400 that relays between the relay devices 100 of the multiple physical stores 10a and 10b and the multiple VR providing devices 200. The server device 400 is connected to the relay devices 100 of the multiple physical stores 10a and 10b via a communication network 3c, and is connected to the multiple VR providing devices 200 via a communication network 3a. Note that each element of Fig. 23 may be combined with each element of one or more embodiments to the extent that no contradiction occurs.

[0130] FIG. 24 is a block diagram showing a configuration of a server device 400 according to the present disclosure. The server device 400 is a computer 1000 such as a server computer. The server device 400 includes a control unit 402 that restricts the VR terminal 300 to connect to a predetermined VR providing device 200.

[0131] According to this configuration, the server device 400 can realize each function of the relay device 100, so that the functions of the relay device 100 installed in each physical store 10 can be minimized.

[0132] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-mentioned embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be appropriately combined with other embodiments. Furthermore, if any information about users is obtained or used in this disclosure, this will be done lawfully.

[0133] In addition, in the flowcharts used in the above description, the steps (processes) are described in order, but the order of the steps executed in each embodiment is not limited to the order described. In each embodiment, the order of the steps shown in the drawings can be changed as long as it does not affect the content.

[0134] (Another embodiment 2) In the virtual reality commerce system 1, the physical store 10 may be a mobile vehicle. A VR terminal 300 may be lent to a user U in the vehicle parked in a designated parking lot to provide a VR experience.

[0135] (Other embodiment 3) The virtual reality commerce system 1 may be used for work experience in various industries. As a specific example of this use, in the livestock industry, a livestock breeding site may be introduced to the user U as the second reality space 50b. The VR store 20 may then sell products such as food (meat, processed products, etc.) and fur products produced in the industry. This can increase interest in the industry and promote the distribution of products.

[0136] (Other embodiment 4) In the virtual reality commerce system 1, the actual store 10 may be a travel agency. A representative user U4 may broadcast a trip using a 360° camera 340, and other users U may virtually experience the tour. The virtual experience tour itself may be sold as a product, or may be used to advertise a real tour.

[0137] A part or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes. 1. A relay device having a relay control means that relays between a communication device for a virtual reality experience and an information providing device that provides the virtual reality experience, and controls the communication device to connect to a predetermined information providing device and provide information from the information providing device to the communication device. 2. In the relay device according to 1., The relay control means is a relay device that relays a product purchase process carried out between the communication device and the information providing device. 3. In the relay device according to 1. or 2., A group information acquisition means for acquiring group information including a plurality of communication devices, The relay control means includes: A relay device performs relay processing between the communication device and the information providing device on a group basis by transmitting the acquired group information to the information providing device. 4. In the relay device according to 3., The group information acquisition means A relay device that identifies a plurality of the communication devices whose mutual positions satisfy a predetermined relationship as being in the same group and generates the group information. 5. In the relay device according to 4., The predetermined relationship is that an access point accessed by the communication device satisfies a predetermined criterion. 6. In the relay device according to any one of 1. to 5., The relay device further comprises a calculation means for calculating a fee for each specific store based on an access history of the communication device to the information providing device corresponding to the store. 7. In the relay device according to any one of 1. to 6., The communication device further includes a storage processing means for storing, in a storage device, authentication information of the communication device linked to the identification information of the communication device and user information relating to a user of the communication device in association with identification information capable of identifying the communication device, The relay control means controls the communication device to connect to the information providing device using the authentication information of the communication device. 8. In the relay device according to 7., The relay device further comprises a product purchase processing means for acquiring payment information related to the product purchase process of the user relayed using the user information from the information providing device, and for carrying out a settlement process.

[0138] 9. A communication device for a virtual reality experience; A relay device, The relay device is a relay means for relaying between the communication device for the virtual reality experience and an information providing device for providing the virtual reality experience; At least one of the communication device and the relay device has a control means for restricting the communication device to connect to a predetermined information providing device. 10. In the virtual reality trading system according to claim 9, A virtual reality commerce system, wherein the relay means of the relay device relays a product purchase process carried out between the communication device and the information providing device. 11. In the virtual reality trading system according to 9. or 10., The relay device is A group information acquisition means for acquiring group information including a plurality of communication devices, The relay means of the relay device The virtual reality commerce system performs relay processing between the communication device and the information providing device on a same group basis by transmitting the acquired group information to the information providing device. 12. The virtual reality trading system according to claim 11, The group information acquisition means of the relay device A virtual reality commerce system that identifies a plurality of the communication devices whose mutual positions satisfy a predetermined relationship as being in the same group and generates the group information. 13. The virtual reality trading system according to claim 12, A virtual reality commerce system, wherein the predetermined relationship is that an access point to which the communication device is accessing satisfies a predetermined criterion. 14. In the virtual reality trading system according to any one of 9. to 13., The relay device is The virtual reality commerce system further comprises a calculation means for calculating a price for each specific store based on an access history of the communication device to the information providing device corresponding to the store. 15. In the virtual reality trading system according to any one of 9. to 14., The relay device is The communication device further includes a storage processing means for storing, in a storage device, authentication information of the communication device linked to the identification information of the communication device and user information relating to a user of the communication device in association with identification information capable of identifying the communication device, The control means of the relay device controls the communication device to connect with the information providing device using the authentication information of the communication device. 16. In the virtual reality trading system according to 15., The relay device is The virtual reality commerce system further comprises a product purchase processing means for acquiring payment information related to the product purchase processing of the user relayed using the user information from the information providing device, and for carrying out a settlement process.

[0139] 17. One or more computers A control method for a relay device that relays between a communication device for a virtual reality experience and an information providing device that provides a virtual reality experience, and controls the communication device to connect to a predetermined information providing device and provide information from the information providing device to the communication device. 18. The method for controlling a relay device according to claim 17, The one or more computers: A method for controlling a relay device that relays a product purchase process carried out between the communication device and the information providing device. 19. The method for controlling a relay device according to claim 17 or 18, The one or more computers: Obtaining group information including a plurality of communication devices; A method for controlling a relay device, which performs relay processing between the communication device and the information providing device on a group basis by transmitting the acquired group information to the information providing device. 20. In the method for controlling a relay device according to 19., The one or more computers: A method for controlling a relay device, the method including: identifying a plurality of communication devices whose mutual positions satisfy a predetermined relationship as being in the same group; and generating the group information. 21. The method for controlling a relay device according to claim 20, The method for controlling a relay device, wherein the predetermined relationship is that an access point accessed by the communication device satisfies a predetermined criterion. 22. In the method for controlling a relay device according to any one of 17. to 21., The one or more computers: A method for controlling a relay device, the method comprising: calculating a fee for each specific store based on an access history of the communication device to the information providing device corresponding to the store. 23. In the method for controlling a relay device according to any one of 17. to 22., The one or more computers: storing, in a storage device, authentication information of the communication device linked to the identification information of the communication device and user information relating to a user of the communication device in association with identification information capable of identifying the communication device; A method for controlling a relay device, the method controlling the relay device to connect the communication device and the information providing device using the authentication information of the communication device. 24. The method for controlling a relay device according to claim 23, The one or more computers: A method for controlling a relay device, comprising: acquiring payment information relating to the product purchase process of the user relayed using the user information from the information providing device; and carrying out a settlement process.

[0140] 25. To the computer: A program for executing a relay control process that relays between a communication device for a virtual reality experience and an information providing device that provides the virtual reality experience, connects the communication device to a predetermined information providing device, and controls the information providing device to provide information to the communication device. 26. In the program according to 25., a program for relaying a product purchase process carried out between the communication device and the information providing device in the relay control process; 27. In the program according to 25. or 26., further executing a group information acquisition process on the computer to acquire group information including a plurality of communication devices; In the relay control process, A program for performing relay processing between the communication device and the information providing device on a group-by-group basis by transmitting the acquired group information to the information providing device. 28. In the program according to 27., In the group information acquisition process, a program for identifying a plurality of the communication devices whose mutual positions satisfy a predetermined relationship as being in the same group, and generating the group information; 29. In the program according to 28., The program, wherein the specified relationship is that an access point accessed by the communication device satisfies a specified criterion. 30. In the program according to any one of 25. to 29., The program further causes the computer to execute a calculation process for calculating a price for each specific store based on an access history of the communication device to the information providing device corresponding to that store. 31. In the program according to any one of 25. to 30., a storage process for storing, in a storage device, authentication information of the communication device linked to the identification information of the communication device and user information regarding a user of the communication device in association with identification information capable of identifying the communication device; A program for controlling the relay control process so as to connect the communication device and the information providing device using the authentication information of the communication device. 32. In the program according to 31., a program for causing the computer to further execute the product purchasing process, which includes obtaining, from the information providing device, payment information related to the product purchasing process of the user relayed using the user information, and carrying out a settlement process;

[0141] 33. A server device comprising a control means for controlling a communication device for a virtual reality experience to connect to an information providing device that provides a predetermined virtual reality experience, and for controlling information to be provided from the information providing device to the communication device. 34. A server device implemented by one or more computers: A communication device for a virtual reality experience is connected to an information providing device that provides a predetermined virtual reality experience; A method for controlling a server device, the method controlling the information providing device to provide information to the communication device. 35. To the computer: A program for executing a control process in which a communication device for a virtual reality experience connects to an information providing device that provides a predetermined virtual reality experience, and controls the information providing device to provide information to the communication device.

[0142] 36. A connection means for connecting to an information providing device that provides a virtual reality experience via a relay device using authentication information; and a control means for restricting connection to a predetermined information providing device. 37. One or more computer-implemented communications devices: A method for controlling a communication device, comprising the steps of: connecting a communication device for a virtual reality experience to an information providing device that provides a predetermined virtual reality experience; and controlling the information providing device to provide information to the communication device. 38. To the computer, A program for executing a control process in which a communication device for a virtual reality experience connects to an information providing device that provides a predetermined virtual reality experience, and controls the information providing device to provide information to the communication device. [Explanation of symbols]

[0143] 1. Virtual reality trading system 3, 3a, 3b, 3c Communication Networks 10, 10a, 10b Physical store 20 VR Store 50 Real Space 50a First Reality 50b Second Reality 60 VR space 70 360° Camera Space 100 Repeater 102 Relay control section 104 Product Purchasing Department 106 Group Information Acquisition Unit 108 Memory Processing Unit 110 Calculation section 130 Physical store contract site information 140 VR device information 142 VR device rental information 150 User information 160 Payment information by store 162 Payment information by user 170 Group Information 200 VR providing equipment 202 Non-contractual VR provision equipment 300 VR terminals 302 Connection 304 Control Unit 310 VR Glasses 320 VR Controller 340 360° Camera 400 Server device 1000 Computers 1010 Bus 1020 Processor 1030 Memory 1040 Storage Device 1050 Input / Output Interface 1060 Network Interface

Claims

1. A relay device comprising a relay control means that relays between a communication device for a virtual reality experience and an information providing device that provides the virtual reality experience, and controls the communication device to connect to a predetermined information providing device and to provide information from the information providing device to the communication device.

2. 2. The relay device according to claim 1, The relay control means is a relay device that relays a product purchase process carried out between the communication device and the information providing device.

3. 2. The relay device according to claim 1, A group information acquisition means for acquiring group information including a plurality of communication devices, The relay control means includes: A relay device performs relay processing between the communication device and the information providing device on a group basis by transmitting the acquired group information to the information providing device.

4. 4. The relay device according to claim 3, The group information acquisition means A relay device that identifies a plurality of the communication devices whose mutual positions satisfy a predetermined relationship as being in the same group and generates the group information.

5. 2. The relay device according to claim 1, The relay device further comprises a calculation means for calculating a fee for each specific store based on an access history of the communication device to the information providing device corresponding to the store.

6. 2. The relay device according to claim 1, The communication device further includes a storage processing means for storing, in a storage device, authentication information of the communication device linked to the identification information of the communication device and user information relating to a user of the communication device in association with identification information capable of identifying the communication device, The relay control means controls the communication device to connect to the information providing device using the authentication information of the communication device.

7. 7. The relay device according to claim 6, The relay device further comprises a product purchase processing means for acquiring payment information related to the product purchase process of the user relayed using the user information from the information providing device, and for carrying out a settlement process.

8. A communication device for a virtual reality experience; A relay device, The relay device is a relay means for relaying between the communication device for the virtual reality experience and an information providing device for providing the virtual reality experience; At least one of the communication device and the relay device has a control means for restricting the communication device to connect to a predetermined information providing device.

9. One or more computers A control method for a relay device that relays between a communication device for a virtual reality experience and an information providing device that provides a virtual reality experience, and controls the communication device to connect to a predetermined information providing device and provide information from the information providing device to the communication device.

10. On the computer, A program for executing a relay control process that relays between a communication device for a virtual reality experience and an information providing device that provides the virtual reality experience, connects the communication device to a predetermined information providing device, and controls the information providing device to provide information to the communication device.

Images