Information Processing Server and Virtual Space Provision System

Abstract

To provide an information processing server and a virtual space providing system that make it easier to feel a connection with reality in activities in a virtual space.SOLUTION: An information processing server 30 sets a position of a first avatar according to a position of a salesperson in a first space RS1 in a virtual space having arrangement of structures imitating the first space RS1, and sets a position of a second avatar corresponding to a customer in a second space RS2. Then, display data for displaying an image of the virtual space and a display indicating the situation of the first space RS1 is transmitted to a customer terminal 21. Further, the information processing server 30 performs registration processing of registering an article selected by the customer as an article to be purchased, and settlement processing for the article registered by the registration processing.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing server used for shopping using virtual reality and a virtual space providing system.

Background Art

[0002] In recent years, systems for communication using virtual reality have been developed. The applications of such systems are not limited to games but have spread to shopping. For example, Patent Documents 1 and 2 describe systems in which a salesperson and a customer in a virtual space can communicate with each other using an avatar.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] Shopping using virtual reality is different from a game that assumes progress in a virtual space and is originally intended to replace activities that are normally carried out in the real space. If activities in the real space can be replaced by activities in the virtual space, it is highly convenient for users who have difficulty going to the place of activities in the real space due to reasons such as transportation means, time constraints, or restrictions on going out.

[0005] However, for use as an alternative to activities in the real world, conventional virtual space systems have many deficiencies. First, in activities in the virtual space, it is difficult to feel a connection with the real world. For example, sensations obtained through vision and hearing in activities in the real space, such as those obtained from face-to-face conversations or observing physical products, are lost in activities in the virtual space. Therefore, in activities in the virtual space, it is difficult to feel a connection with the real world.

[0006] Also, in the real space, when multiple people go shopping, various settlement forms such as the payer of the product price and the payment ratio can be set. On the other hand, simply diverting the settlement system in conventional online shopping to the virtual space system makes it difficult to support such various settlement forms in shopping through the virtual space.

Means for Solving the Problems

[0007] The information processing server for solving the above problems includes a first receiving unit that receives first information output from a device located in a first space that is a space where products are sold, the first information including at least position specifying information capable of specifying the position of a salesperson in the first space; a virtual space generation unit that sets the position of a first avatar, which is a first object, in the virtual space having an arrangement of structures imitating the first space according to the position of the salesperson in the first space based on the position specifying information, and sets the position of a second avatar, which is a second object corresponding to a customer in a second space different from the first space; a second receiving unit that receives second information output from a display terminal operated by the customer, the second information including at least selection product information indicating the product selected by the customer; a purchase processing unit that performs a registration process of registering the product indicated by the selection product information as a product to be purchased and a settlement process for the product registered by the registration process; a display data generation unit that generates display data for displaying the image of the virtual space and a display indicating the situation of the first space based on the first information; and a transmission unit that transmits the display data to the display terminal.

[0008] A virtual space providing system for solving the above problems includes a first acquisition unit that acquires first information in a first space that is a space where products are sold, the first acquisition unit acquiring the first information including at least position identification information that is information capable of identifying the position of a salesperson in the first space; a virtual space generation unit that sets the position of a first avatar, which is a first object, in the virtual space according to the position of the salesperson in the first space based on the position identification information in a virtual space having an arrangement of structures imitating the first space, and sets the position of a second avatar, which is a second object corresponding to a customer in a second space different from the first space; a second acquisition unit that acquires second information based on the customer operating a display terminal in the second space, the second acquisition unit acquiring the second information including at least selection product information indicating the product selected by the customer; a purchase processing unit that performs a registration process of registering the product indicated by the selection product information as a product to be purchased and a settlement process for the product registered by the registration process; and a display data generation unit that generates display data for causing the display terminal to display an image of the virtual space and a display indicating the situation of the first space based on the first information.

[0009] According to the above configuration, an image of the virtual space and a display indicating the situation of the first space are displayed on the display terminal. Therefore, compared with the case where only the image of the virtual space is displayed, a customer in the second space can more easily feel a connection with the real world in activities in the virtual space. Therefore, it is also possible to improve the customer's purchasing desire.

[0010] In the above configuration, it further includes a third receiving unit that receives third information output from a display terminal operated by a customer in a third space different from the first space. The virtual space generation unit sets, in the virtual space, the position of a third avatar, which is a third object corresponding to the customer in the third space. The display data generation unit generates the display data for the display terminal operated by the customer in the second space and the display data for the display terminal operated by the customer in the third space. The transmission unit transmits the display data for each display terminal to each display terminal. The purchase processing unit may proceed with the settlement process, designating, as the customer in the third space, at least a part of the payer for the price of the product registered by the registration process based on the selected product information included in the second information.

[0011] According to the above configuration, it is possible to share and pay the price of a product among a plurality of customers, or for a customer different from the product selector to make the payment. Therefore, in the purchase of a product through a virtual space, a settlement method similar to the settlement methods available in the real space can be used.

[0012] In the above configuration, a third receiving unit that receives third information output from a display terminal operated by a customer in a third space different from the first space, the third information including at least selection product information indicating a product selected by the customer, and a group setting unit that sets a group including the customer in the second space and the customer in the third space and sets a payment ratio of the price of the product among the customers in the group are further provided. The virtual space generation unit sets the position of a third avatar, which is a third object corresponding to the customer in the third space, in the virtual space. The display data generation unit generates the display data for the display terminal operated by the customer in the second space and the display data for the display terminal operated by the customer in the third space. The transmission unit transmits the display data for each display terminal to each display terminal. In the registration process, the purchase processing unit registers, as products to be purchased by the group, the products indicated by the selection product information from the display terminals operated by the customers in the group. In the settlement process for the products registered as products to be purchased by the group, the payment amounts of the customer in the second space and the customer in the third space may be set according to the payment ratio.

[0013] According to the above configuration, the price of the product selected by the customers in the group is shared and paid by the customers in the group. Therefore, even in the purchase of products through the virtual space, products can be jointly purchased in the same way as in the purchase of products in the real space. As a result, activities closer to those in the real space can be carried out in the virtual space.

[0014] In the above configuration, the payment ratio may be set before the purchase processing unit registers the products to be purchased by the group. According to the above configuration, since the payment ratio is set in advance, the process from the selection of the product by the customer to the settlement can proceed smoothly.

[0015] In the above configuration, the payment ratio may be set after the purchase processing unit registers the products to be purchased by the group. According to the above configuration, customers can decide whether to jointly purchase goods and the payment ratio after selecting the goods. Therefore, the settlement method can be selected more flexibly.

[0016] In the above configuration, the purchase processing unit may proceed with the settlement process, taking the payer of the full amount of the price of the goods registered by the registration process based on the selected goods information included in the second information as the customer in the third space.

[0017] According to the above configuration, the price of the goods is paid by a customer different from the customer who selected the goods. Therefore, in the purchase of goods through the virtual space, as in the purchase of goods in the real space, it is possible to divide the roles of selecting and paying for the goods. As a result, activities closer to those in the real space can be carried out in the virtual space.

[0018] In the above configuration, a family setting unit is further provided that sets the permissions recognized among the selection of goods to be purchased and the payment of the price of the goods for each customer, and sets a family that is a group including a plurality of customers having different permissions from each other. When the family including the customer in the second space and the customer in the third space is set, only the permission to select the goods is set for the customer in the second space, and the permission to pay the price of the goods is set for the customer in the third space. When the purchase processing unit receives the selected goods information from the display terminal operated by the customer having the permission to select the goods, the purchase processing unit performs the registration process, and sets the payer of the price of the goods registered by the registration process as the customer having the permission to pay the price of the goods within the same family as the customer who selected the goods, and may proceed with the settlement process.

[0019] According to the above configuration, the role sharing of customer users is managed by the information processing server as the setting of permissions, and the registration process and the settlement process are carried out accordingly. Therefore, the purchase of goods along with the role sharing proceeds smoothly. In addition, by restricting the permissions of customer users, it is also possible to manage the actions of customer users in the virtual space, so it is also suitable for use by parents and children.

[0020] In the above configuration, the display showing the situation of the first space may include at least one of the video of the salesperson in the first space, the video of the products located in the first space, and the display showing the working situation of the salesperson in the first space.

[0021] According to the above configuration, since the images and the situation of the salesperson in the first space are displayed on the display terminal, customers can easily feel the connection with the reality in their activities in the virtual space.

Effect of the Invention

[0022] According to the present invention, in activities in the virtual space, it is possible to make it easier to feel the connection with the reality.

Brief Description of the Drawings

[0023]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Mode for Carrying Out the Invention

[0024] (First Embodiment) With reference to FIGS. 1 to 15, the first embodiment of the information processing server and the virtual space providing system will be described.

[0025] [Overall Configuration of Virtual Space Providing System] With reference to FIG. 1, the overall configuration of the virtual space providing system 100 will be described. First, the user who uses the virtual space providing system 100 and the space where the user exists will be described.

[0026] The first space RS1 is the actual space where products are sold. The first space RS1 is, for example, a store, a showroom, an exhibition venue, or a venue for various events. In the first space RS1, products or product samples are displayed. In the first space RS1, there is a salesperson user P1. The salesperson user P1 is a product salesperson and conducts product sales to customers who actually visit the first space RS1.

[0027] The second space RS2 and the third space RS3 are actual spaces different from the first space RS1. In the second space RS2, there is a customer user P2, and in the third space RS3, there is a customer user P3. The customer users P2 and P3 are people who plan to purchase products using the virtual space providing system 100. The second space RS2 and the third space RS3 can be any spaces, for example, spaces within the homes of the customer users P2 and P3. Note that the second space RS2 and the third space RS3 may be different spaces from each other or the same space.

[0028] In the virtual space providing system 100, an avatar corresponding to the salesperson user P1, an avatar corresponding to the customer user P2, and an avatar corresponding to the customer user P3 are arranged in a virtual store, which is a virtual space imitating the first space RS1. Then, using these avatars, communication regarding the buying and selling of products is conducted among the users P1, P2, and P3. In the first embodiment, the customer user P2 and the customer user P3 jointly select and pay for the products to be purchased.

[0029] Subsequently, the configuration of the virtual space providing system 100 will be described. As shown in FIG. 1, the virtual space providing system 100 includes an information processing server 30, a first device 10 located in the first space RS1, a second device 20 located in the second space RS2, and a third device 25 located in the third space RS3. The first device 10 includes a position information collection device 11, a salesperson terminal 12, and a photographing device 13. The second device 20 includes a customer terminal 21. The third device 25 includes a customer terminal 26.

[0030] Each of the first device 10, the second device 20, and the third device 25 communicates with the information processing server 30 by transmitting and receiving data to and from each other through the network NW. The network NW used for communication between each device included in the first device 10, the second device 20, and the third device 25 and the information processing server 30 may be a general-purpose communication line such as the Internet, or may be a dedicated communication line for communication of each device. Further, the network NW may include a plurality of independent networks, or may be a common single network.

[0031] The position information collection device 11 acquires position identification information Ip, which is information capable of identifying the position of the salesperson user P1 in the first space RS1. The position information collection device 11 transmits the position identification information Ip to the information processing server 30.

[0032] The position specified based on the position identification information Ip may be a relative position with respect to a reference position within the first space RS1, or may be an absolute position using latitude and longitude. The position information collection device 11 includes a device capable of detecting the position of the salesperson user P1 in a desired manner. Depending on the position detection method, each device constituting the position information collection device 11 may be arranged at a predetermined position within the first space RS1, or may be carried by the salesperson user P1.

[0033] For example, the position information collection device 11 may include a camera, and the position of the salesperson user P1 may be specified by analyzing an image captured by the camera. The identification of the salesperson user P1 may be performed by identifying the face of the salesperson user P1, identifying a marker previously worn by the salesperson user P1, or the like.

[0034] Also, for example, the position information collection device 11 includes a transmitter and a receiver corresponding to short-range wireless communication such as Bluetooth (registered trademark), and the position of the salesperson user P1 may be specified from the reception status of the radio wave received by the receiver from the transmitter carried by the salesperson user P1.

[0035] Note that the location identification information Ip may be information capable of identifying the orientation in addition to the location of the salesperson user P1. In this case, the location information collection device 11 may include a motion sensor and devices constituting a head tracking or face tracking system.

[0036] The identification of the location of the salesperson user P1 based on the information collected by the location information collection device 11 may be performed by the location information collection device 11 or may be performed by the information processing server 30. That is, the location identification information Ip may be information indicating the identification result of the location of the salesperson user P1, or may be information capable of identifying the location of the salesperson user P1 by an operation using the location identification information Ip.

[0037] The salesperson terminal 12 is a device used by the salesperson user P1 for conversations with the customer users P2 and P3. The conversations between the salesperson user P1 and the customer users P2 and P3 are carried out by any of text, voice, and video. The salesperson terminal 12 only needs to include a device corresponding to the conversation means. That is, the salesperson terminal 12 may be any device capable of at least one of text input and display, voice input and output, and video shooting and display. For example, the salesperson terminal 12 is a headset, a smartphone, a tablet terminal, a wearable terminal, a device for video calls, etc.

[0038] First conversation information Ic1, which is information indicating the speech of the salesperson user P1, is input to the salesperson terminal 12. The salesperson terminal 12 transmits the first conversation information Ic1 to the information processing server 30. The first conversation information Ic1 is composed of data of any of text, voice, and video corresponding to the conversation means.

[0039] The imaging device 13 captures an image within the first space RS1. The imaging device 13 preferably can capture a moving image. The imaging device 13 includes, for example, a camera fixed at a predetermined position within the first space RS1. The camera is arranged, for example, at a position where it can capture a product. Alternatively, the imaging device 13 may be movable within the first space RS1 and its movement may be remotely operable. An example of an imaging device 13 that can be remotely operated is a telepresence robot.

[0040] The imaging device 13 generates imaging information Iv consisting of imaging data within the first space RS1 and transmits the imaging information Iv to the information processing server 30. Also, when the imaging device 13 can be remotely operated, the imaging device 13 receives an instruction from the information processing server 30 and changes the imaging position and imaging direction.

[0041] The information output by the first device 10, in other words, the information output by each of the position information collection device 11, the salesperson terminal 12, and the imaging device 13 is the first information If1 which is information indicating the situation of the first space RS1. That is, the first information If1 includes the position identification information Ip, the first conversation information Ic1, and the imaging information Iv. In the virtual space providing system 100, the first device 10 functions as a first acquisition unit that acquires the first information If1 in the first space RS1. Note that one device may also serve as two or more of the position information collection device 11, the salesperson terminal 12, and the imaging device 13.

[0042] The customer terminal 21 included in the second device 20 is a display terminal provided with a display unit for displaying an image. The customer terminal 21 is operated by the customer user P2. The customer terminal 21 is, for example, a smartphone, a tablet terminal, a personal computer, etc. The customer terminal 21 displays an image based on the display data received from the information processing server 30. The display content of the customer terminal 21 includes an image of the virtual space and a first situation display which is a display indicating the situation of the first space RS1.

[0043] Further, instruction information Is, which is information indicating an instruction from customer user P2 to the virtual space, is input to the customer terminal 21. The instruction information Is includes information for instructing the movement of the avatar corresponding to the customer user P2. The instruction information Is is transmitted from the customer terminal 21 to the information processing server 30.

[0044] Furthermore, second conversation information Ic2, which is information indicating the speech of customer user P2, is input to the customer terminal 21. The second conversation information Ic2 is composed of any one of text, voice, and video data according to the conversation means between the salesperson user P1 and the customer user P2. The customer terminal 21 has functions of inputting and displaying text, inputting and outputting voice, and shooting and displaying video according to the conversation means. The second conversation information Ic2 is transmitted from the customer terminal 21 to the information processing server 30.

[0045] In addition, various requests such as a request for an image of the first space RS1, a request for product trial, and a request for settlement are sent from the customer terminal 21 to the information processing server 30 in response to an operation of the customer user P2 on the customer terminal 21. When the remote operation of the imaging device 13 is possible, at the time of requesting an image of the first space RS1, operation information Io, which is information indicating an instruction for the movement of the imaging device 13, is input to the customer terminal 21, and the operation information Io is transmitted from the customer terminal 21 to the information processing server 30.

[0046] Also, selected product information Ig, which indicates a product selected by the customer user P2 as a product to be purchased, is input to the customer terminal 21. The selected product information Ig is transmitted from the customer terminal 21 to the information processing server 30.

[0047] Note that the functions of the customer terminal 21 in the virtual space providing system 100 are embodied by, for example, application software installed in the customer terminal 21. A specific example of such application software is a shopping app in a virtual store.

[0048] The information output by the second device 20, in other words, the information output by the customer terminal 21, is the second information If2. That is, the second information If2 includes instruction information Is, second conversation information Ic2, operation information Io, and selected product information Ig. In the virtual space providing system 100, the second device 20 functions as a second acquisition unit that acquires the second information If2 in the second space RS2.

[0049] The customer terminal 26 included in the third device 25 is a display terminal having the same configuration as the customer terminal 21 except that the operator is the customer user P3. That is, the customer terminal 26 displays an image based on the display data received from the information processing server 30. Further, instruction information Is indicating an instruction of the customer user P3 with respect to the virtual space, third conversation information Ic3 indicating a statement of the customer user P3, operation information Io indicating an instruction for the movement of the photographing device 13, and selected product information Ig indicating a product selected by the customer user P3 as a product to be purchased can be input to the customer terminal 26, and the input information is sent to the information processing server 30.

[0050] The information output by the third device 25, in other words, the information output by the customer terminal 26, is the third information If3. In the virtual space providing system 100, the third device 25 functions as a third acquisition unit that acquires the third information If3 in the third space RS3.

[0051] The information processing server 30 includes a communication unit 31, a control unit 32, and a storage unit 33. The communication unit 31 executes connection processing between the information processing server 30 and each device including the first device 10, the second device 20, and the third device 25 through the network NW, and transmits and receives data between the connected devices. The communication unit 31 functions as a first reception unit that receives the first information If1 from the first device 10, a second reception unit that receives the second information If2 from the second device 20, and a third reception unit that receives the third information If3 from the third device 25. Further, the communication unit 31 functions as a transmission unit that transmits display data to the customer terminals 21 and 26 and transmits an instruction for the movement to the photographing device 13.

[0052] The control unit 32 has a configuration including a CPU and a volatile memory such as a RAM. Based on the programs and data stored in the storage unit 33, the control unit 32 controls the processing by the communication unit 31, reads and writes information in the storage unit 33, and controls each unit included in the information processing server 30 such as various arithmetic processes. In the virtual space providing system 100, the control unit 32 functions as a virtual space generation unit 32a, a conversation processing unit 32b, a customer service status determination unit 32c, a shooting instruction unit 32d, a trial execution unit 32e, a display data generation unit 32f, a group setting unit 32g, and a purchase processing unit 32h.

[0053] The virtual space generation unit 32a sets the positions of objects including the first avatar A1, the second avatar A2, and the third avatar A3 in one virtual space having an arrangement of structures imitating the first space RS1. The first avatar A1 is an avatar corresponding to the salesperson user P1, the second avatar A2 is an avatar corresponding to the customer user P2, and the third avatar A3 is an avatar corresponding to the customer user P3. Thereby, a virtual space VS including the avatars A1, A2, and A3 as components is generated. FIG. 2 shows an example of the virtual space VS. The components of the virtual space VS also include an object indicating the product Gd.

[0054] The virtual space generation unit 32a changes the position of the first avatar A1 based on the position specifying information Ip included in the first information If1. Further, the virtual space generation unit 32a changes the position of the second avatar A2 based on the instruction information Is included in the second information If2, and changes the position of the third avatar A3 based on the instruction information Is included in the third information If3. That is, the virtual space generation unit 32a moves the first avatar A1 based on the position specifying information Ip, and moves the second avatar A2 and the third avatar A3 based on the respective instruction information Is.

[0055] The conversation processing unit 32b performs a conversation execution process, which is a process of establishing a conversation between the salesperson user P1 and the customer users P2 and P3, using the respective conversation information Ic1, Ic2, and Ic3 included in the first information If1, the second information If2, and the third information If3.

[0056] In addition, the conversation processing unit 32b performs conversation availability determination processing for determining the availability of conversation according to the distance between the avatars. Further, when the conversation means is voice or video, the conversation processing unit 32b performs conversation volume adjustment processing for adjusting the conversation volume according to the distance between the avatars.

[0057] The customer service status determination unit 32c uses the first information If1 to determine whether the salesperson user P1 is serving a customer who is actually visiting the first space RS1 in the first space RS1. When it is determined that the salesperson user P1 is serving a customer, the customer service status determination unit 32c includes, in the display content of the display data to the customer terminals 21 and 26, a display indicating that the first avatar A1 is serving a customer.

[0058] The shooting instruction unit 32d outputs an instruction to the shooting device 13 in response to a request from the customer terminals 21 and 26. The instruction to the shooting device 13 includes an instruction to transmit the shooting information Iv generated by the shooting device 13. Further, when the remote operation of the shooting device 13 is possible, the instruction to the shooting device 13 includes an instruction for the movement of the shooting device 13 based on the operation information Io.

[0059] The trial execution unit 32e performs processing to allow the second avatar A2 and the third avatar A3 to try out products in response to a request from the customer terminals 21 and 26. The trial of products includes, for example, trying on products such as clothes and accessories, and test driving products such as vehicles.

[0060] The display data generation unit 32f generates display data that defines the display content on the customer terminals 21 and 26. The display data is data for causing the customer terminals 21 and 26 to display an image of the virtual space VS and a first situation display that is a display indicating the situation of the first space RS1. The first situation display is a display indicating the situation of the first space RS1 at that time, and includes an image in the first space RS1 such as an image of the salesperson user P1 or a product, and a display indicating a work situation such as the customer service status of the salesperson user P1.

[0061] The group setting unit 32g sets a group which is a group of customer users who jointly select and pay for purchased products. The group setting unit 32g stores information about the group as group data 33b in the storage unit 33.

[0062] The purchase processing unit 32h performs a registration process of registering the product indicated by the selected product information Ig included in the second information If2 or the third information If3 as a product to be purchased by the customer users P2 and P3. The product registered as a purchase plan is managed as a product placed in the shopping cart.

[0063] In addition, the purchase processing unit 32h performs a settlement process for the product registered by the above registration process, that is, the product placed in the shopping cart. In the registration process and the settlement process, the purchase processing unit 32h refers to the group data 33b and proceeds with the process according to the conditions registered in the group data 33b.

[0064] The storage unit 33 has a configuration including a non-volatile memory and stores programs and data necessary for the processes executed by the control unit 32. Specifically, the storage unit 33 stores virtual space data 33a which is data used for generating the virtual space VS, and the above-mentioned group data 33b.

[0065] The virtual space data 33a includes data of a basic space having an arrangement of structures imitating the first space RS1 and data of objects moving within the virtual space VS. The basic space is a virtual space including fixed objects such as exhibits such as products, display stands and shelves for exhibits, pillars, and walls. The basic space only needs to imitate the first space RS1 so that the movement path of the person in the first space RS1 can be reproduced, and the arrangement of the structures between the first space RS1 and the basic space does not have to be exactly the same. For example, the basic space only needs to have a floor plan that coincides with the first space RS1, that is, an arrangement of passageways that coincides with the first space RS1, and the arrangement of exhibits in the basic space does not have to be exactly the same as that in the first space RS1.

[0066] The data of the base space includes, for example, information on a three-dimensional orthogonal coordinate system set for the base space, position information of the above-mentioned fixed object, data associating the position of the base space with the position of the first space RS1, and data for drawing the base space. Also, the object data includes data for drawing the avatars A1, A2, and A3.

[0067] The group data 33b includes, as information for each group, user information of customer users belonging to the group and payment conditions. The user information includes identification information of the customer user such as an ID. Also, the user information may include information regarding payment means such as the name, contact information, and credit card number of the customer user. The payment conditions are referred to by the purchase processing unit 32h during the payment process. The payment conditions include the payment ratio of the price of the product for the customer users belonging to the group. Also, the payment conditions may include, as a condition for the progress of the payment process, obtaining approval from other customer users in the group when an instruction for the progress of the payment process is received from one customer user.

[0068] The group data 33b may further include selection conditions as information for each group. The selection conditions are referred to by the purchase processing unit 32h during the registration process. The selection conditions may include, for example, as a condition for the progress of the registration process, obtaining approval from other customer users in the group for the registration of the product when one customer user selects the product.

[0069] The group data 33b may further include coupon information as information for each group. For example, a coupon that can be used when purchasing a product in the group is provided by the operator of the virtual store or the like, and the number of this coupon or the like may be included in the group data 33b as coupon information that can be used in the group.

[0070] The group data 33b may further include information regarding the authority of customer users as information for each group. For example, the authority is set so that only specific customer users within the group are allowed to perform some of the operations on the customer terminals 21 and 26 that occur from entering the virtual store to settlement, such as instructions for proceeding with the settlement process.

[0071] Note that the functions of each part in the control unit 32 may be separately embodied by various hardware such as a plurality of CPUs and a memory including a RAM, etc., and software that causes these to function, or may be embodied by software that gives a plurality of functions to one common hardware. Such software is stored in the storage unit 33 as a virtual space providing program.

[0072] [Operation of Virtual Space Providing System] With reference to FIGS. 3 to 15, the operation of the virtual space providing system 100 will be described. The functions of the virtual space providing system 100 include a basic function, a conversation function, a customer service status display function, an indoor photography function, a trial function, and a product purchase function. Hereinafter, the operation of the virtual space providing system 100 in each function will be described in order. Note that for the basic function, the conversation function, the customer service status display function, the indoor photography function, and the trial function, since the customer terminals 21 and 26 both perform the same operation, hereinafter, the operation of the customer terminal 21 will be mainly described.

[0073] <Basic Function> The basic function is a function of arranging and moving the avatars A1, A2, and A3 in the virtual space VS, and displaying the virtual space VS on the customer terminals 21 and 26.

[0074] As shown in FIG. 3, the position information collection device 11 acquires the position identification information Ip and transmits it to the information processing server 30 (step S10). When receiving the position identification information Ip, the virtual space generation unit 32a of the information processing server 30 sets the position of the first avatar A1 at the position of the virtual space VS corresponding to the position of the first space RS1 specified based on the position identification information Ip using the virtual space data 33a (step S11).

[0075] Accordingly, the position of the first avatar A1 is set so that the positional relationship of the salesperson user P1 with respect to the structure in the first space RS1 corresponds to the positional relationship of the first avatar A1 with respect to the structure in the virtual space VS. By repeatedly performing the processes of step S10 and step S11 at predetermined intervals, the position of the first avatar A1 within the virtual space VS changes according to the movement of the salesperson user P1 in the first space RS1.

[0076] On the other hand, when the customer user P2 performs a predetermined operation on the customer terminal 21 that requests the display of the virtual store, a request for the display of the virtual space VS is transmitted from the customer terminal 21 to the information processing server 30 (step S12). The predetermined operation is, for example, an operation of selecting a predetermined area of a screen displayed by starting a shopping app in the virtual store on the customer terminal 21.

[0077] Upon receiving the request from the customer terminal 21, the virtual space generation unit 32a of the information processing server 30 sets the position of the second avatar A2 at a predetermined position within the virtual space VS using the virtual space data 33a (step S13). The predetermined position is, for example, a position corresponding to the entrance of the virtual store.

[0078] The display data generation unit 32f of the information processing server 30 generates display data using the virtual space data 33a and the position information of the avatars A1 and A2 set by the virtual space generation unit 32a. The display data is transmitted from the communication unit 31 to the customer terminal 21 (step S14).

[0079] Upon receiving the display data, the customer terminal 21 displays an image based on the display data on the display unit. Thereby, the basic screen 200 is displayed on the customer terminal 21 (step S15). That is, the display data generated by the process of step S14 with the basic function is data for displaying the basic screen 200. FIG. 4 shows an example of the basic screen 200 displayed on the customer terminal 21. The basic screen 200 is a screen for the customer user P2 to view the products within the virtual space VS by moving the second avatar A2.

[0080] When the customer user P2 performs various operations on the basic screen 200, instruction information Is is input to the customer terminal 21, and the instruction information Is is transmitted from the customer terminal 21 to the information processing server 30 (step S16). Specifically, for example, by dragging on the basic screen 200, information indicating the moving direction and moving amount of the second avatar A2 is input to the customer terminal 21 as the instruction information Is.

[0081] Upon receiving the instruction information Is, the virtual space generation unit 32a of the information processing server 30 changes the configuration of the virtual space VS according to the instruction information Is (step S17). Specifically, the virtual space generation unit 32a changes the position of the second avatar A2 according to the instruction information Is.

[0082] The display data generation unit 32f generates display data using the information changed by the virtual space generation unit 32a, and the display data is transmitted from the communication unit 31 to the customer terminal 21 (step S18).

[0083] By the customer terminal 21 displaying an image based on the display data on the display unit, the change corresponding to the instruction information Is on the basic screen 200 is reflected (step S19). Specifically, the position of the second avatar A2 moves.

[0084] As described above, based on the operation of the customer terminal 21, the position of the second avatar A2 is set in the virtual space VS, and the image of the virtual space VS is displayed on the customer terminal 21. Similarly, based on the operation of the customer terminal 26, the position of the third avatar A3 is set in the virtual space VS, and the image of the virtual space VS is displayed on the customer terminal 26.

[0085] Referring to FIG. 4, the details of the basic screen 200 will be described. FIG. 4 shows an example of the basic screen displayed on the customer terminal 21. The basic screen 200 includes a virtual area 210 where an image of the virtual space VS is displayed, and an operation area 220 that accepts operations for various setting changes and function uses. The image in the virtual area 210 may be an image of the virtual space VS viewed from a viewpoint set around the second avatar A2, such as behind the second avatar A2, or may be an image of the virtual space VS viewed from the viewpoint of the second avatar A2. Also, these viewpoints may be switchable. When the first avatar A1 or the third avatar A3 is located within the viewing range from the set viewpoint, these avatars A1, A3 are included in the image of the virtual area 210.

[0086] At the location where the product Gd is located within the virtual area 210, a product display 211 indicating information about the product is located. The information about the product is, for example, a description of the product or an evaluation from the purchaser of the product. Note that the product display 211 may be displayed when the location where the product Gd is located is selected. The product display 211 may be a component of the virtual space VS. Alternatively, the product display 211 may not be a component of the virtual space VS, and the display data may be configured such that the product display 211 is displayed at a specific location within the image of the virtual space VS. The data required for rendering the product display 211 is stored in the storage unit 33 in advance. Note that the color and contour of the product Gd may be emphasized so that the product Gd is more prominent, or visual effects such as blinking or movement may be applied to the product Gd. Such production effects for making the product Gd prominent may be manifested when the second avatar A2 approaches the product Gd.

[0087] Further, by selecting any location within the virtual area 210, it may be possible to perform an enlarged display of the location. If an operation for moving the second avatar A2 is performed by displaying a wide range of the virtual space VS and an operation for selecting the product Gd in the enlarged display is performed, each operation can be efficiently performed. Such a display switch may be performed on the customer terminal 21 without exchanging information with the information processing server 30 by the customer terminal 21 generating data from the display data. Alternatively, information indicating a display switch is included in the instruction information Is and sent from the customer terminal 21 to the information processing server 30, and the display may be switched based on the customer terminal 21 receiving the display data in which the change according to the instruction information Is is reflected from the information processing server 30.

[0088] In addition, when the salesperson terminal 12 has an image display function, an image of the virtual space VS may also be displayed on the salesperson terminal 12. That is, in response to a request from the salesperson terminal 12, the information processing server 30 may send data for displaying an image of the virtual space VS to the salesperson terminal 12.

[0089] <Conversation function> The conversation function is a function that enables conversation between the salesperson user P1 and the customer users P2 and P3. For example, it is used when the customer users P2 and P3 want to ask the salesperson user P1 questions about the product. First, taking the case where the salesperson user P1 and the customer user P2 have a conversation as an example, the basic operation of the virtual space providing system 100 in the conversation function will be described.

[0090] As shown in FIG. 5, when the customer user P2 performs a predetermined operation on the customer terminal 21 to request a conversation with the first avatar A1, a request for a conversation targeted at the selected first avatar A1 is sent from the customer terminal 21 to the information processing server 30 (step S20). The predetermined operation is, for example, an operation of selecting the first avatar A1 and the area indicating the start of the conversation displayed on the basic screen 200. By selecting the first avatar A1, an introduction of the salesperson user P1 corresponding to the first avatar A1 may be displayed on the basic screen 200.

[0091] When the conversation processing unit 32b of the information processing server 30 receives a request from the customer terminal 21, it calls the salesperson terminal 12 of the salesperson user P1 corresponding to the target first avatar A1 via the communication unit 31 (step S21). As a result, the salesperson terminal 12 is notified of an incoming call by voice or vibration. Note that the association between the first avatar A1 and the salesperson terminal 12 may be performed in advance by the information processing server 30.

[0092] When the salesperson user P1 performs an operation to respond to the call on the salesperson terminal 12 (step S22), conversation execution processing is performed on each of the customer terminal 21, the salesperson terminal 12, and the information processing server 30 (steps S23, S24, S25).

[0093] That is, the first conversation information Ic1 input to the salesperson terminal 12 is transmitted to the customer terminal 21 via the information processing server 30, and an output based on the first conversation information Ic1 is performed on the customer terminal 21. Also, the second conversation information Ic2 input to the customer terminal 21 is transmitted to the salesperson terminal 12 via the information processing server 30, and an output based on the second conversation information Ic2 is performed on the salesperson terminal 12. As a result, a statement input in any of text, voice, or video on one terminal is output on the other terminal, and a conversation between the salesperson user P1 and the customer user P2 is established.

[0094] In this way, the conversation execution processing by the conversation processing unit 32b includes processing of instructing the communication unit 31 to transmit the first conversation information Ic1 received from the salesperson terminal 12 to the customer terminal 21 and to transmit the second conversation information Ic2 received from the customer terminal 21 to the salesperson terminal 12.

[0095] Before a conversation is established between the salesperson user P1 and the customer user P2, operations by the customer user P2 on the avatars A1 and A2 occur, such as the selection of the first avatar A1 as the conversation partner and the movement of the second avatar A2 to the area where the first avatar A1 is located. Also, during the conversation between the salesperson user P1 and the customer user P2, it is preferable that a display indicating that the first avatar A1 or the second avatar A2 is speaking is shown on the customer terminal 21. In this way, in the conversation between the salesperson user P1 and the customer user P2, the first avatar A1 and the second avatar A2 are involved in the operations or displays related to the conversation.

[0096] Note that the start form of the conversation is not limited to the form in which the information processing server 30 calls the salesperson terminal 12 in response to a request from the customer terminal 21. For example, the information processing server 30 may receive a reservation of the conversation time and order from the customer terminal 21, and according to the reservation, the conversation execution process may be started on each of the customer terminal 21, the salesperson terminal 12, and the information processing server 30.

[0097] Specifically, the storage unit 33 of the information processing server 30 stores reservation data composed of a table or the like including the reservant and the reservation time. Based on the information transmitted from the information processing server 30 to the customer terminal 21 based on the reservation data, the reservation status of the conversation with the salesperson user P1 can be confirmed on the customer terminal 21. When the customer user P2 designates an available time in the reservation status, a reservation request is sent from the customer terminal 21 to the information processing server 30, and the conversation processing unit 32b registers the reservation at the designated time as a reservation of the conversation between the customer user P2 and the salesperson user P1 in the reservation data. Then, the conversation is started according to the reservation in the reservation data. In this way, if the reservation of the conversation is possible, when the customer user P2 wants to talk to the salesperson user P1, even if the salesperson user P1 is engaged in customer service and cannot respond immediately, a time for the conversation can be secured in advance. Therefore, the convenience for the customer user P2 is enhanced.

[0098] In addition, a conversation may be started based on the information processing server 30 calling the customer terminal 21 in response to a request from the salesperson terminal 12. Also, the conversation means may be selectable on the customer terminal 21 or the salesperson terminal 12.

[0099] FIGS. 6 and 7 show an example of a conversation screen 201 displayed on the customer terminal 21 during the execution of the conversation execution process when the conversation means is a video. The conversation screen 201 includes a video area 230 in which an image of the salesperson user P1 during the conversation captured by the salesperson terminal 12 is displayed, in addition to the virtual area 210 and the operation area 220 described above. The video displayed in the video area 230 is an example of a first situation display 300 that is a display showing the situation of the first space RS1. In this case, the first situation display 300 shows the situation of the first space RS1 based on the first conversation information Ic1 among the first information If1. The first conversation information Ic1 is composed of video data.

[0100] By displaying the image of the salesperson user P1 during the conversation, the customer user P2 can obtain a feeling similar to a face-to-face conversation while communicating through the virtual space VS. Therefore, in the activities in the virtual space VS, it becomes easier to feel the connection with the real world.

[0101] As shown in FIG. 6, in the conversation screen 201, the virtual area 210 and the video area 230 may be arranged such that the video area 230 overlaps a part of the virtual area 210 mainly with the virtual area 210. Conversely, as shown in FIG. 7, the virtual area 210 and the video area 230 may be arranged such that the virtual area 210 overlaps a part of the video area 230 mainly with the video area 230. Also, it may be possible to select which of the virtual area 210 and the video area 230 is to be the main one.

[0102] In any case, the virtual area 210 and the video area 230 are simultaneously displayed on one screen. That is, while the conversation execution process is being performed, the display data generation unit 32f of the information processing server 30 generates data for displaying the virtual area 210 and the video area 230 on one screen as the display data for displaying the conversation screen 201, and transmits it to the customer terminal 21 via the communication unit 31. In this case, the first conversation information Ic1 is included in the display data based on the instruction of the conversation processing unit 32b and transmitted to the customer terminal 21.

[0103] By simultaneously displaying the virtual area 210 and the video area 230 on one screen, the customer user P2 can obtain the feeling of shopping in the virtual space VS and the feeling similar to a conversation in the real space at the same time. Therefore, by the fusion of these feelings, as the feeling obtained from the activities in the virtual space VS, a feeling closer to the experience in the real space can be obtained. Therefore, it becomes easier to feel the connection with the real world.

[0104] In addition, when the conversation means is a video, only the video of the customer user P2 photographed by the customer terminal 21 may be displayed on the salesperson terminal 12, or the video of the customer user P2 and the image of the virtual space VS may be displayed.

[0105] Subsequently, the conversation availability determination process by the conversation processing unit 32b will be described. In the conversation function, the availability of conversation may be determined according to the distance between the first avatar A1 and the second avatar A2. In this case, when receiving the conversation request from the customer terminal 21 by the process of step S20 in FIG. 5 above, the conversation processing unit 32b performs the conversation availability determination process.

[0106] In the conversation determination process, the conversation processing unit 32b determines whether the distance L between the first avatar A1 and the second avatar A2 in the virtual space VS is equal to or less than a predetermined threshold value. The predetermined threshold value is set to a distance at which conversation is possible between two persons when converted to a distance within the first space RS1. When the distance L is equal to or less than the threshold value, the conversation processing unit 32b determines to permit the conversation and ends the conversation permission determination process. When the conversation is permitted, the conversation processing unit 32b proceeds with the processes after step S21 in FIG. 5 above.

[0107] When the distance L exceeds the threshold value, the conversation processing unit 32b determines not to permit the conversation and ends the conversation permission determination process. When the conversation is not permitted, the conversation processing unit 32b notifies the customer terminal 21 via the communication unit 31 that conversation is not possible because the distance between the avatars is too far, and such notification is displayed on the customer terminal 21.

[0108] According to the above configuration, when the customer user P2 wants to talk to the salesperson user P1, it is necessary to bring the second avatar A2 closer to the first avatar A1. Also, when the customer user P2 wants to avoid being talked to by the salesperson user P1, the second avatar A2 may be moved away from the first avatar A1. Thus, similar to the fact that the distance between a customer and a salesperson in a real store affects the possibility of conversation, the distance between the avatars affects the possibility of conversation. Therefore, the customer user P2 can obtain a feeling closer to the experience in the real space in activities in the virtual space VS.

[0109] Next, the conversation volume adjustment process by the conversation processing unit 32b will be described. When the conversation means is voice or video, in the conversation function, the volume of the conversation may be adjusted according to the distance between the first avatar A1 and the second avatar A2. In this case, the conversation processing unit 32b performs a conversation volume adjustment process prior to the conversation execution process.

[0110] In the conversation volume adjustment process, the conversation processing unit 32b sets the conversation volume according to the distance L between the first avatar A1 and the second avatar A2. Specifically, the conversation processing unit 32b sets the conversation volume to be smaller as the distance L is larger.

[0111] After that, the conversation processing unit 32b proceeds with the conversation execution process at the set conversation volume. That is, the conversation processing unit 32b transmits the first conversation information Ic1 to the customer terminal 21 via the communication unit 31 together with an instruction to output voice at the set conversation volume. In this case, the first conversation information Ic1 is composed of voice data or includes voice data as part of video data. As a result, at the customer terminal 21, based on the first conversation information Ic1, the speech of the salesperson user P1 is output at the set conversation volume.

[0112] According to the above configuration, similar to the distance between a customer and a salesperson in a real store affecting the conversation volume, the distance between avatars affects the conversation volume. Therefore, the customer user P2 can obtain a feeling closer to the experience in the real space in the activities in the virtual space VS.

[0113] By performing the conversation volume adjustment process at a predetermined interval even after starting the conversation execution process, or by performing it each time an opportunity to transmit the first conversation information Ic1 to the customer terminal 21 arises, when the distance L between avatars changes during the conversation, the conversation volume changes accordingly. As a result, the customer user P2 can obtain a feeling closer to the experience in the real space.

[0114] Note that the conversation volume at the salesperson terminal 12 may be changed according to the distance L between the first avatar A1 and the second avatar A2 in the same manner as the customer terminal 21, or may be constant. Also, similar to the conversation between the salesperson user P1 and the customer user P2 described above, it is sufficient if a conversation between the customer user P2 and the customer user P3 is possible. In this case, the second conversation information Ic2 input to the customer terminal 21 is transmitted to the customer terminal 26 via the information processing server 30, and the third conversation information Ic3 input to the customer terminal 26 is transmitted to the customer terminal 21 via the information processing server 30.

[0115] <Customer service status display function> The customer service status display function is a function in which the customer service status in the first space RS1 of the salesperson user P1 is reflected in the display of the first avatar A1. Since the salesperson user P1 also provides customer service to customers who actually visit the first space RS1, when the salesperson user P1 is providing customer service in the first space RS1, the salesperson user P1 cannot respond to conversation requests from the customer users P2 and P3 through the virtual space VS. With the customer service status display function, the customer users P2 and P3 can easily grasp whether it is possible for the salesperson user P1 to provide customer service using the first avatar A1 in the virtual space VS.

[0116] FIG. 8 shows the processing procedure of the information processing server 30 in the customer service status display function. First, as the processing of step S50, the communication unit 31 of the information processing server 30 receives determination information Ij, which is information capable of determining the customer service status of the salesperson user P1, from the first device 10. When receiving the determination information Ij, the customer service status determination unit 32c of the information processing server 30 determines, as the processing of step S51, whether the salesperson user P1 is providing customer service in the first space RS1 based on the determination information Ij.

[0117] For example, when the position information collection device 11 includes a camera and the salesperson user P1 is identified by analyzing the captured image when specifying the position of the salesperson user P1 using the position identification information Ip, it is determined by analyzing a similar image whether there is another person within a predetermined range from the salesperson user P1. In this case, the information output from the position information collection device 11 functions as the determination information Ij. The determination information Ij is included in the first information If1. The predetermined range is set to a range where it is assumed that another person is located when the salesperson user P1 and another person are having a conversation. The customer service status determination unit 32c determines that the salesperson user P1 is providing customer service when there is another person within the predetermined range from the salesperson user P1.

[0118] When it is determined that the salesperson user P1 is in the process of serving a customer (positive determination in step S51), in the process of step S52, the display data generation unit 32f generates display data for displaying the basic screen 200 including a serving indication indicating that the first avatar A1 is in the process of serving a customer. When the basic screen 200 based on this display data is displayed on the customer terminals 21 and 26, the serving indication is displayed on the customer terminals 21 and 26 together with the image of the virtual space VS.

[0119] When it is determined that the salesperson user P1 is not in the process of serving a customer (negative determination in step S51), in the process of step S53, the display data generation unit 32f generates display data for displaying the basic screen 200 not including the serving indication.

[0120] FIG. 9 shows an example of the basic screen 200 including the serving indication 212 displayed on the customer terminal 21. In FIG. 9, a fourth avatar A4 different from the avatars A1, A2, and A3 is arranged near the first avatar A1, and a display indicating that they are in conversation is attached between the first avatar A1 and the fourth avatar A4. Such a display indicating that the first avatar A1 is in conversation with the fourth avatar A4 is the serving indication 212.

[0121] The serving indication 212 is not limited to the above example, and may be, for example, attaching a sign indicating that the first avatar A1 is in the process of serving a customer, changing the color of the first avatar A1, etc. The serving indication 212 only needs to be displayed in association with the first avatar A1. The serving indication 212 has a function of indicating that the first avatar A1 is in the process of serving a customer and that the salesperson user P1 is in the process of serving a customer in the first space RS1. The serving indication 212 may be a component of the virtual space VS, or alternatively, the display data may be configured such that the serving indication 212 is not a component of the virtual space VS but is displayed near the first avatar A1. The data required for rendering the serving indication 212 is stored in the storage unit 33 in advance.

[0122] The customer users P2 and P3 can easily understand that the salesperson user P1 corresponding to the first avatar A1 is unable to respond to requests for conversation by the serving display 212. This allows them to adjust the timing of speaking to the first avatar A1, and they can efficiently carry out activities in the virtual space VS.

[0123] In addition, the customer service display 212 shows the customer service status of the customer user P2 in the first space RS1 in the virtual space VS, so that the customer users P2 and P3 can easily understand that the first avatar A1 is not a character that serves customers only in the virtual space VS, but an alter ego of a salesperson who actually serves customers in a store in the real space. Therefore, the activities in the virtual space VS can easily be connected to reality. In addition, since the image of the virtual space VS and the customer service display 212 are displayed simultaneously on one screen, the connection between the activities in the virtual space VS and reality becomes more noticeable.

[0124] The serving customer display 212 is an example of the first status display 300, which is a display showing the status of the first space RS1, and is also a display showing the working status of the salesperson user P1. In this case, the first status display 300 shows the status of the first space RS1 based on the determination information Ij.

[0125] In addition, the determination of whether the salesperson user P1 is serving a customer may be made based on information output by any device included in the first device 10, not limited to information output by the position information collection device 11. In other words, the determination information Ij does not have to be information output by the position information collection device 11 as long as it is information output by the first device 10.

[0126] For example, when the salesperson user P1 starts serving a customer in the first space RS1, the salesperson user P1 performs a predetermined operation on the salesperson terminal 12. As a result, information indicating that the salesperson user P1 is serving a customer is transmitted as determination information Ij from the salesperson terminal 12 to the information processing server 30. Based on receiving the information, the customer service status determination unit 32c determines that the salesperson user P1 is serving a customer.

[0127] Also, not limited to the case where the salesperson user P1 is dealing with a customer who has visited the first space RS1, for example, even when the salesperson user P1 is on the phone, the customer service situation determination unit 32c may determine that the salesperson user P1 is in the process of serving a customer, and the in-service display 212 may be displayed. For example, when the salesperson user P1 answers the phone, the salesperson terminal 12 performs a predetermined operation. Thereby, the determination information Ij is transmitted from the salesperson terminal 12 to the information processing server 30, and the customer service situation determination unit 32c determines that the salesperson user P1 is in the process of serving a customer.

[0128] Also, not limited to when serving a customer, when the salesperson user P1 cannot respond to a conversation request through the virtual space VS for work in the first space RS1, as the first situation display 300, a display indicating that the salesperson user P1 cannot respond to the conversation request may be displayed on the customer terminal 21. Such a display is also included in the display indicating the working status of the salesperson user P1.

[0129] <Indoor photography function> The indoor photography function is a function of photographing images within the first space RS1, such as images of products, and displaying them on the customer terminals 21 and 26. The indoor photography function is used, for example, when customer users P2 and P3 want to confirm the actual color and shape of a product. Hereinafter, the operation of the virtual space providing system 100 will be described by taking the case where the customer user P2 uses the indoor photography function as an example.

[0130] As shown in FIG. 10, when the customer user P2 performs a predetermined operation on the customer terminal 21 to request shooting within the first space RS1, the shooting request is transmitted from the customer terminal 21 to the information processing server 30 (step S60). The predetermined operation is, for example, an operation of selecting an area for instructing shooting displayed on the basic screen 200.

[0131] When receiving a request from the customer terminal 21, the shooting instruction unit 32d of the information processing server 30 outputs an instruction to shoot the imaging device 13. The shooting instruction is sent from the communication unit 31 to the imaging device 13 (step S61). When receiving the shooting instruction, the imaging device 13 performs a shooting process (step S62). The shooting process includes a process of generating shooting information Iv by shooting within the first space RS1 and transmitting the shooting information Iv to the information processing server 30.

[0132] When the remote operation of the imaging device 13 is possible, operation information Io is input to the customer terminal 21, and the operation information Io is transmitted from the customer terminal 21 to the information processing server 30. In this case, the shooting instruction unit 32d outputs a shooting instruction including a movement instruction according to the operation information Io. Then, the shooting process of the imaging device 13 includes a change in position and orientation according to an instruction from the information processing server 30.

[0133] For example, in the image of the virtual space VS displayed on the customer terminal 21, a display indicating the position of the imaging device 13 is included. By operating the display, such as dragging, information indicating the moving direction and moving amount of the imaging device 13 is input to the customer terminal 21 as the operation information Io. The position of the imaging device 13 may be specified by analyzing an image captured by the position information collection device 11, for example, when the position of the salesperson user P1 is specified, or by analyzing a similar image. Alternatively, the imaging device 13 may have a function of acquiring its own position information and transmitting it to the information processing server 30. Based on the position information from the imaging device 13, the position of the imaging device 13 may be specified and reflected in the display on the customer terminal 21.

[0134] When the information processing server 30 receives the shooting information Iv from the imaging device 13, the display data generation unit 32f of the information processing server 30 generates display data for displaying the observation screen 202 including the image captured by the imaging device 13. The display data is transmitted from the communication unit 31 to the customer terminal 21 (step S63).

[0135] When the customer terminal 21 receives the display data, it displays an image based on the display data on the display unit. As a result, the observation screen 202 is displayed on the customer terminal 21 (step S64). FIG. 11 shows an example of the observation screen 202 displayed on the customer terminal 21. The observation screen 202 includes a shooting area 240 where an image captured by the imaging device 13 is displayed, in addition to the virtual area 210 and the operation area 220. The image displayed in the shooting area 240 is an example of a first situation display 300 that is a display showing the situation of the first space RS1. In this case, the first situation display 300 shows the situation of the first space RS1 based on the shooting information Iv among the first information If1.

[0136] On the observation screen 202, as shown in FIG. 11, the virtual area 210 and the shooting area 240 may be arranged such that mainly the virtual area 210 and a part of the shooting area 240 is overlapped with a part of the virtual area 210. Alternatively, the virtual area 210 and the shooting area 240 may be arranged such that mainly the shooting area 240 and a part of the virtual area 210 is overlapped with a part of the shooting area 240. Also, it may be possible to select which of the virtual area 210 and the shooting area 240 is the main one. In any case, the virtual area 210 and the shooting area 240 are simultaneously displayed on one screen. That is, the display data for displaying the observation screen 202 is data for displaying the virtual area 210 and the shooting area 240 on one screen.

[0137] When the image captured by the imaging device 13 is displayed on the customer terminal 21, the customer user P2 can confirm the color and shape of the product. Therefore, the customer user P2 can select the product to be purchased while referring to the appearance of such a product. Therefore, an appropriate selection of the product is possible and a feeling close to selecting the product by looking at it in the real space can be obtained. Therefore, in the activities in the virtual space VS, the connection with the real world is more easily felt.

[0138] Furthermore, if the imaging device 13 can be remotely operated, the will of the customer user P2 is more strongly reflected in the image displayed in the imaging area 240. Therefore, it becomes easier to proceed with the selection of products in accordance with the intention of the customer user P2, and the customer user P2 can obtain a feeling closer to the selection of products in the real space.

[0139] Also, when the virtual area 210 and the imaging area 240 are simultaneously displayed on one screen, the customer user P2 can obtain the feeling of shopping in the virtual space VS and the feeling of selecting products in the real space at the same time. Therefore, through the fusion of these feelings, as a feeling obtained from activities in the virtual space VS, a feeling closer to the experience in the real space can be obtained. Therefore, it becomes easier to feel the connection with the real world.

[0140] In addition, when the imaging device 13 can be remotely operated, it may be possible to reserve the use of the imaging device 13. This enhances the convenience for the customer user P2. Specifically, the storage unit 33 of the information processing server 30 stores reservation data composed of a table or the like including the reserving person and the reservation time. Based on the information transmitted from the information processing server 30 to the customer terminal 21 based on the reservation data, the reservation status of the use of the imaging device 13 can be confirmed at the customer terminal 21. When the customer user P2 designates an available time in the reservation status, a reservation request is sent from the customer terminal 21 to the information processing server 30, and the imaging instruction unit 32d registers the reservation at the designated time as a reservation for the use of the imaging device 13 by the customer user P2 in the reservation data. Then, the use of the imaging device 13 is started according to the reservation in the reservation data.

[0141] <Trial function> The trial function is a function for virtually trying out products. Hereinafter, the operation of the virtual space providing system 100 will be described by taking the case where the customer user P2 uses the trial function as an example.

[0142] As shown in FIG. 12, when the customer user P2 performs a predetermined operation on the customer terminal 21 to request a product trial, the trial request is transmitted from the customer terminal 21 to the information processing server 30 (step S70). The predetermined operation is, for example, an operation of selecting a region indicating a product and its trial displayed on the basic screen 200.

[0143] Upon receiving the request from the customer terminal 21, the trial execution unit 32e of the information processing server 30 performs a trial process (step S71). The trial process is, for example, a process of generating data in which a product is worn on the second avatar A2 corresponding to the customer user P2 if the product is clothing or an accessory, or a process of generating data in which the second avatar A2 is placed on the product if the product is a vehicle. Alternatively, the trial process may be a process of generating data in which the second avatar A2 holds the product. In short, any process that generates data for the second avatar A2 to try out the selected product is acceptable.

[0144] Subsequently, the display data generation unit 32f of the information processing server 30 uses the data generated by the trial execution unit 32e to generate display data for displaying a trial screen 203 including an image of the second avatar A2 trying out the product (step S72). Upon receiving the display data, the customer terminal 21 displays an image based on the display data on the display unit. As a result, the trial screen 203 is displayed on the customer terminal 21 (step S73).

[0145] FIG. 13 shows an example of the trial screen 203 displayed on the customer terminal 21. The trial screen 203 includes an operation area 220 and a trial area 250 where the second avatar A2 trying out the product Gd is displayed.

[0146] The background of the trial area 250 may be an image of the virtual space VS or an image different from the virtual space VS. Also, if the customer terminal 21 has a photographing function, the background of the trial area 250 may be an image of the second space RS2 photographed by the customer terminal 21. That is, the trial function may utilize augmented reality (AR).

[0147] When an image in which the second avatar A2 is trying out the product Gd is displayed, the customer user P2 can easily imagine how the product would look if they used it themselves, or the balance when using a combination of multiple products. Also, even for products that are difficult to try out in a physical store such as a vehicle, by having the product tried out by the second avatar A2, an image of using the product can be easily obtained. Further, when AR is used, it is easy to imagine how the product Gd would look when used in the second space RS2. Therefore, an accurate judgment can be made regarding the selection of the product to purchase. Note that when AR is used, the second avatar A2 may not be displayed and only the product Gd may be displayed.

[0148] <Product purchase function> The product purchase function is a function that realizes the selection and settlement of products through the virtual space VS. Below, the operation of the virtual space providing system 100 will be described for the case where two customer users P2 and P3 form a group and jointly proceed with the purchase of a product. In the following description, for the purpose of distinguishing between users and terminals, the customer user P2 may be referred to as the first customer user P2, the customer user P3 may be referred to as the second customer user P3, the customer terminal 21 may be referred to as the first customer terminal 21, and the customer terminal 26 may be referred to as the second customer terminal 26.

[0149] First, the case where the group data 33b has been created before the selection of the product will be described. Specifically, the group data 33b has been created such that two customer users P2 and P3 form one group, and in the group data 33b, the payment ratio of the product price between the first customer user P2 and the second customer user P3 is set as the settlement condition. Such a form is assumed to be applicable, for example, when the first customer user P2 and the second customer user P3 are friends and use the virtual store to jointly purchase a product that they will use together.

[0150] The creation of the group data 33b by the group setting unit 32g of the information processing server 30, that is, the setting of the group, may be performed, for example, at the time of registration of the use of the virtual space providing system 100 by the customer users P2 and P3 accompanying the installation of application software on the customer terminals 21 and 26, or at the time of entering a virtual store using the avatars A2 and A3, or at any timing before the selection of products.

[0151] As shown in FIG. 14, when the first customer user P2 performs a predetermined operation of selecting a product that he / she wishes to purchase on the first customer terminal 21, the selection product information Ig indicating the product is transmitted from the first customer terminal 21 to the information processing server 30 (step S80). The predetermined operation may be, for example, an operation of selecting a product displayed on the basic screen 200, or an operation of selecting a product displayed on the first customer terminal 21 during the use of the conversation function, the indoor photographing function, or the trial function.

[0152] Upon receiving the selection product information Ig, the purchase processing unit 32h of the information processing server 30 performs a registration process (step S81). As a result, the product indicated by the selection product information Ig is registered as a product scheduled to be purchased by the group to which the first customer user P2 belongs, and the first customer terminal 21 is notified that the product has been placed in the shopping cart.

[0153] Similarly, when the second customer user P3 performs a predetermined operation of selecting a product that he / she wishes to purchase on the second customer terminal 26, the selection product information Ig indicating the product is transmitted from the second customer terminal 26 to the information processing server 30 (step S82). Upon receiving the selection product information Ig, the purchase processing unit 32h of the information processing server 30 performs a registration process (step S83). As a result, the product indicated by the selection product information Ig is registered as a product scheduled to be purchased by the group to which the second customer user P3 belongs, and the second customer terminal 26 is notified that the product has been placed in the shopping cart.

[0154] Note that the shopping cart may be shared within the group or managed for each customer user. That is, the shopping cart containing the products selected by the first customer user P2 and the shopping cart containing the products selected by the second customer user P3 may be common or separate. If the shopping carts are common, it is easy to grasp all the products planned to be purchased by the group.

[0155] In addition, the addition of products to the shopping cart may be notified to each customer user within the group. That is, the registration of the products planned to be purchased based on the selected product information Ig from the first customer terminal 21 is notified not only to the first customer terminal 21 but also to the second customer terminal 26, and the registration of the products planned to be purchased based on the selected product information Ig from the second customer terminal 26 may be notified not only to the second customer terminal 26 but also to the first customer terminal 21.

[0156] During the above registration process, the purchase processing unit 32h refers to the group data 33b and checks whether selection conditions are set as information on the group of customer users P2 and P3. If selection conditions are set, the purchase processing unit 32h proceeds with the registration process according to the selection conditions.

[0157] For example, when it is set that approval from customer users within the group is required for registering a product to be purchased as a selection condition, when the purchase processing unit 32h receives the selected product information Ig from the first customer terminal 21, a request for approval to add the product indicated by the selected product information Ig to the products to be purchased is sent to the second customer terminal 26 via the communication unit 31. When the second customer user P3 at the second customer terminal 26 performs an operation to approve the addition of the product to the shopping cart, a notification of approval is sent from the second customer terminal 26 to the information processing server 30, and based on this, the purchase processing unit 32h performs a registration process for the product. As a result, the product indicated by the selected product information Ig is registered as a product to be purchased. Similarly, when the purchase processing unit 32h receives the selected product information Ig from the second customer terminal 26, a request for approval to add the product indicated by the selected product information Ig to the products to be purchased is sent to the first customer terminal 21 via the communication unit 31, and after approval is obtained, the registration process is advanced.

[0158] Note that the order of product selection by the first customer user P2 and the second customer user P3 is arbitrary. Also, the product selection may be performed by at least one of the first customer user P2 and the second customer user P3.

[0159] After the product selection is completed, when the first customer user P2 performs a predetermined operation to request settlement on the first customer terminal 21, a settlement request is sent from the first customer terminal 21 to the information processing server 30 (step S84). The predetermined operation is, for example, an operation of selecting a region for instructing the progress of settlement on a screen where the products in the shopping cart are displayed.

[0160] Note that the settlement request may be made from the second customer terminal 26 based on the operation of the second customer user P3. Alternatively, when it is set in the group data 33b that only a specific customer user has the authority to instruct the progress of the settlement process, only the settlement request by the customer user having such authority is accepted by the information processing server 30.

[0161] When receiving a payment request, the purchase processing unit 32h of the information processing server 30 performs payment setting processing as part of the payment process (step S85). Specifically, the purchase processing unit 32h refers to the group data 33b and determines the payment amounts for each customer user P2 and P3 according to the payment conditions set as the information of the group of customer users P2 and P3. Specifically, the purchase processing unit 32h calculates the total amount of the products registered as the products to be purchased in the group of customer users P2 and P3. Then, the purchase processing unit 32h calculates the payment amount of the price of each product for each customer user P2 and P3 according to the payment ratio of the price of the product determined by the payment conditions. For example, when the payment ratio of the price of customer users P2 and P3 is set at 50% each according to the payment conditions, half of the total amount of the price is set as the payment amount for each customer user P2 and P3.

[0162] When the payment amount is determined by the payment setting process, payment data indicating the payment details including the payment amount is sent from the information processing server 30 to the customer terminals 21 and 26. The payment data sent to the first customer terminal 21 is data including the payment amount of the first customer user P2, and the payment data sent to the second customer terminal 26 is data including the payment amount of the second customer user P3.

[0163] In addition, when the group data 33b includes available coupon information, the purchase processing unit 32h applies the coupon to calculate the payment amounts for each customer user P2 and P3. Also, in the group data 33b, when it is set as a payment condition to obtain the approval of the customer users within the group during the progress of the payment process, when the purchase processing unit 32h receives a payment request from the first customer terminal 21, it sends a request for approval of the progress of the payment process to the second customer terminal 26 via the communication unit 31. When the second customer user P3 performs an operation to approve the progress of the payment process on the second customer terminal 26, a notification of approval is sent from the second customer terminal 26 to the information processing server 30, and based on this, the purchase processing unit 32h proceeds with the above-described process of determining the payment amounts for each customer user P2 and P3.

[0164] When the first customer terminal 21 receives the settlement data, the settlement details based on the settlement data are displayed on the first customer terminal 21. When the first customer user P2 performs an operation to approve the settlement details on the first customer terminal 21, a notification of approval is sent from the first customer terminal 21 to the information processing server 30 (step S86).

[0165] Similarly, when the second customer terminal 26 receives the settlement data, the settlement details based on the settlement data are displayed on the second customer terminal 26. When the second customer user P3 performs an operation to approve the settlement details on the second customer terminal 26, a notification of approval is sent from the second customer terminal 26 to the information processing server 30 (step S87).

[0166] When receiving the notification of approval of the settlement details from the first customer terminal 21 and the second customer terminal 26, the purchase processing unit 32h of the information processing server 30 performs a settlement execution process as part of the settlement process (step S88). That is, for each of the customer users P2 and P3, the purchase processing unit 32h uses a known settlement means such as a credit card, communicates with an external server as necessary, and executes the settlement according to the content in the settlement data. The settlement means may be included in and registered in the group data 33b in advance, or may be input to each of the customer terminals 21 and 26 before the approval of the settlement details. The goods for which the settlement is completed are delivered to the customer users P2 and P3 by using a delivery service or the like.

[0167] Next, the case where the group data 33b is created after the selection of goods will be described. In this case, at the time of selecting the goods to be purchased, the group including the customer users P2 and P3 is not set. Hereinafter, an example will be described in which after the first customer user P2 selects the goods, the second customer user P3 joins the group and the group is set. However, it is also possible in the same way that after the second customer user P3 selects the goods, the first customer user P2 joins the group.

[0168] As shown in FIG. 15, when the first customer user P2 performs a predetermined operation on the first customer terminal 21 to select a product that the customer wishes to purchase, selection product information Ig indicating the product is transmitted from the first customer terminal 21 to the information processing server 30 (step S90).

[0169] Upon receiving the selection product information Ig, the purchase processing unit 32h of the information processing server 30 performs a registration process (step S91). As a result, the product indicated by the selection product information Ig is registered as a product scheduled to be purchased by the first customer user P2, and the first customer terminal 21 is notified that the product has been placed in the shopping cart.

[0170] After the selection of the product is completed, when the first customer user P2 performs a predetermined operation on the first customer terminal 21 to request settlement and express a desire to purchase in a group, a settlement request and a group setting request are transmitted from the first customer terminal 21 to the information processing server 30 (step S92).

[0171] Upon receiving the settlement request and the group setting request, the group setting unit 32g of the information processing server 30 performs a group recruitment process (step S93). Specifically, the group setting unit 32g transmits, via the communication unit 31, a notification calling for participation in a group for jointly purchasing the product with the first customer user P2, together with information on the product registered as a product scheduled to be purchased by the first customer user P2, to the second customer terminal 26.

[0172] Note that the destination for transmitting the notification calling for participation in the group may be specified by the first customer user P2. For example, when the first customer user P2 visits a virtual store with the second customer user P3 and wishes to jointly purchase a product while selecting the product, the destination for calling for participation in the group may be limited to the second customer user P3. Also, for example, when the first customer user P2 visits a virtual store alone and wishes to jointly purchase a product knowing about discounts etc. through joint purchasing while selecting the product, the destination for calling for participation in the group may be all of the customer users using the virtual store.

[0173] When the second customer user P3 performs an operation to request participation in the group on the second customer terminal 26 in response to a notice calling for participation in the group, a notice indicating the participation of the second customer user P3 is transmitted from the second customer terminal 26 to the information processing server 30 (step S94).

[0174] Upon receiving the participation notice, the group setting unit 32g of the information processing server 30 creates group data 33b (step S95). Specifically, the group setting unit 32g registers, as group data 33b, settlement conditions including the payment ratio of the product price, coupon information, etc., together with the user information of the customer users P2 and P3 constituting the group, while communicating with the customer terminals 21 and 26 as necessary.

[0175] When the group data 33b is created, the purchase processing unit 32h of the information processing server 30 performs a settlement setting process as part of the settlement process (step S96). That is, the purchase processing unit 32h determines the payment amounts of the respective customer users P2 and P3 according to the payment ratio of the price and the coupon information in the set settlement conditions. When the payment amounts are determined, settlement data indicating the settlement details including the payment amounts is sent from the information processing server 30 to the customer terminals 21 and 26. The settlement data transmitted to the first customer terminal 21 is data including the payment amount of the first customer user P2, and the settlement data transmitted to the second customer terminal 26 is data including the payment amount of the second customer user P3.

[0176] When the first customer user P2 performs an operation to approve the settlement details on the first customer terminal 21, a notice of approval is transmitted from the first customer terminal 21 to the information processing server 30 (step S97). Similarly, when the second customer user P3 performs an operation to approve the settlement details on the second customer terminal 26, a notice of approval is transmitted from the second customer terminal 26 to the information processing server 30 (step S98).

[0177] When the information processing server 30's purchase processing unit 32h receives a notification of approval of the settlement details from the first customer terminal 21 and the second customer terminal 26, as part of the settlement process, it performs a settlement execution process (step S99). As a result, the settlement is executed in accordance with the settlement data.

[0178] As described above, in this embodiment, customer users P2 and P3 within the group can share and pay the price of the product at a desired ratio. Therefore, even in shopping in the virtual space VS, just like shopping in the real space, products can be jointly purchased. As a result, activities closer to those in the real space can be carried out in the virtual space VS. Also, since the conditions for product selection and settlement can be set, the joint purchase of products can proceed smoothly.

[0179] Note that a part of the group data 33b may be created before the selection of the product, and the remainder of the group data 33b may be created after the selection of the product. For example, the registration of the user information of customer users P2 and P3 who make up the group may be performed before the selection of the product by customer users P2 and P3, and the setting of the payment ratio for customer users P2 and P3 within the group may be performed after the selection of the product.

[0180] Also, in this embodiment, the settlement process by the purchase processing unit 32h can also be regarded as a process in which another customer user P3 within the same group is advanced as the payer of a part of the price of the product selected by one customer user P2 within the group.

[0181] As described above, according to the first embodiment, the following effects can be obtained. (1) The image of the virtual space VS and the first situation display 300 showing the situation of the first space RS1 are displayed on the customer terminals 21 and 26. Therefore, compared with the case where only the image of the virtual space VS is displayed and the first situation display 300 is not displayed, the customer users P2 and P3 are more likely to feel the connection with the reality in their activities in the virtual space VS. As a result, even when it is difficult for the customer users P2 and P3 to go to the first space RS1, they can obtain a feeling similar to that in the activity in the first space RS1 through the activity in the virtual space VS. Therefore, it is also possible to improve the purchasing desire of the customer users P2 and P3.

[0182] (2) Each of the customer users P2 and P3 who form a group can select a product, and the price of the product selected within the group is paid by the customer users P2 and P3 in a desired ratio. Therefore, even in shopping in the virtual space VS, products can be jointly purchased in the same way as in the real space. As a result, an activity closer to that in the real space can be carried out in the virtual space VS.

[0183] (3) If the payment ratio of the customer users P2 and P3 in the group is set in a form before the purchase processing unit 32h registers the product scheduled to be purchased by the group, since the payment ratio is set in advance, the process from the selection of the product to the settlement can proceed smoothly.

[0184] (4) If the payment ratio of the customer users P2 and P3 in the group is set in a form after the purchase processing unit 32h registers the product scheduled to be purchased, the decision of whether to jointly purchase the product and the payment ratio can be made after the product is selected. Therefore, the settlement form can be selected more flexibly.

[0185] (5) The first conversation information Ic1 is composed of video data, and the first situation display 300 includes a display of an image of the salesperson user P1 engaged in a conversation based on the first conversation information Ic1. This allows the customer users P2 and P3 to feel a sense of being close to a face-to-face conversation in the conversation with the salesperson user P1 through the virtual space VS. Therefore, the activities in the virtual space VS are more likely to feel a connection with reality.

[0186] (6) The first status display 300 includes a serving display 212 indicating that the salesperson user P1 is serving customers in the first space RS1. This allows the customer users P2 and P3 to easily understand whether the salesperson user P1 is in a situation where he or she can respond to requests for conversation, and therefore allows them to adjust the timing of speaking to the first avatar A1, and to efficiently proceed with activities in the virtual space VS. In addition, the customer users P2 and P3 can easily sense that the first avatar A1 is not a character that serves customers only in the virtual space VS, but an alter-ego of a salesperson who actually serves customers in a store in the real space. Therefore, it becomes easier to feel a connection with reality in activities in the virtual space VS.

[0187] (7) The first status display 300 includes an image in the first space RS1 based on the photographed information Iv. This allows the customer users P2 and P3 to check the color and shape of the product and select the product to purchase. This allows for an appropriate product selection and a feeling similar to that of viewing and selecting a product in the real space. This makes it easier to feel a connection with reality in the activities in the virtual space VS.

[0188] Second embodiment A second embodiment of the information processing server and virtual space providing system will be described with reference to Figures 16 to 18. In the second embodiment, the configuration related to the product purchasing function of the virtual space providing system is different from that of the first embodiment. The following mainly describes the differences between the second embodiment and the first embodiment, and the same components as those in the first embodiment are denoted by the same reference numerals and their description will be omitted.

[0189] [Information processing server configuration] In the second embodiment, a family, which is a group including customer users having different authorities regarding the selection and payment of products, is set. As shown in FIG. 16, the information processing server 30 of the second embodiment includes a family setting unit 32i instead of the group setting unit 32g of the first embodiment, and stores family data 33c instead of group data 33b. Although not shown, in the virtual space providing system of the second embodiment, the first device 10, the second device 20, and the third device 25 have the same configuration as that of the first embodiment.

[0190] The family setting unit 32i causes the storage unit 33 to store information regarding the family as family data 33c. The family data 33c includes, as information for each family, user information of customer users belonging to the family and authority settings. The user information includes identification information of the customer user such as an ID. Further, the user information may include information regarding the name, contact information, payment means such as a credit card number, etc. of the customer user. The authority setting is a setting for each customer user, and indicates the possible authority among the selection of the product desired to be purchased and the payment of the price of the product. That is, the customer users included in the family may include customer users who can only select products, customer users who can only pay the price of products, and customer users who can both select and pay for products.

[0191] The family data 33c may further include selection conditions as information for each family. The selection conditions are referred to by the purchase processing unit 32h during the registration process. The selection conditions may include, for example, obtaining approval from a customer user having the authority to pay regarding the registration of the selected product as a product to be purchased when a customer user having only the authority to select products selects a product.

[0192] Further, the selection conditions may include the type and amount range of products that a customer user having only the authority to select products can select, and the upper limit of the total amount of products that a customer user having only the authority to select products can select.

[0193] [Operation of Virtual Space Provision System] Regarding the product purchase function in the virtual space provision system of the second embodiment, a case where two customer users P2 and P3 form a family and proceed with the purchase of a product will be described. Note that for functions other than the product purchase function, the virtual space provision system of the second embodiment has the same configuration as that of the first embodiment. In the following description, for the purpose of distinguishing between users and terminals, the customer user P2 may be referred to as the first customer user P2, the customer user P3 may be referred to as the second customer user P3, the customer terminal 21 may be referred to as the first customer terminal 21, and the customer terminal 26 may be referred to as the second customer terminal 26.

[0194] The family data 33c is created before the selection of the product. Specifically, the family data 33c is created so that two customer users P2 and P3 constitute one family. And in the family data 33c, only the selection of the product is permitted for the first customer user P2, and authority settings are made so that both the selection and payment of the product, or only payment, are permitted for the second customer user P3. Such a form is assumed to be applied, for example, when the first customer user P2 and the second customer user P3 are parent and child, and the second customer user P3, who is the parent, pays for the product selected by the first customer user P2, who is the child.

[0195] The creation of the family data 33c by the family setting unit 32i of the information processing server 30, that is, the setting of the family, may be performed at an arbitrary timing before the selection of the product, such as when registering the use of the virtual space provision system by the customer users P2 and P3 accompanying the installation of application software on the customer terminals 21 and 26, or when entering the virtual store using the avatars A2 and A3.

[0196] As shown in FIG. 17, when the first customer user P2 performs a predetermined operation on the first customer terminal 21 to select a product that he / she wishes to purchase, the selected product information Ig indicating the product is transmitted from the first customer terminal 21 to the information processing server 30 (step S30).

[0197] When the purchase processing unit 32h of the information processing server 30 receives the selected product information Ig, it performs a registration process (step S31). As a result, the product indicated by the selected product information Ig is registered as a product scheduled to be purchased by the family to which the first customer user P2 belongs, and the first customer terminal 21 is notified that the product has been placed in the shopping cart.

[0198] Note that the shopping cart may be shared within the family or managed for each customer user. Also, an addition of a product to the shopping cart may be notified to a customer user having the payment authority within the family. That is, the registration of the product scheduled to be purchased based on the selected product information Ig from the first customer terminal 21 may be notified not only to the first customer terminal 21 but also to the second customer terminal 26.

[0199] In the above-described registration process, the purchase processing unit 32h refers to the family data 33c and checks whether selection conditions are set as information of the families of the customer users P2 and P3. If selection conditions are set, the purchase processing unit 32h proceeds with the registration process according to the selection conditions.

[0200] For example, when it is set as a selection condition to obtain approval from a customer user having the payment authority at the time of registering a product scheduled to be purchased, when the purchase processing unit 32h receives the selected product information Ig from the first customer terminal 21, a request for approval to add the product indicated by the selected product information Ig to the product scheduled to be purchased is sent to the second customer terminal 26 via the communication unit 31. When the second customer user P3 at the second customer terminal 26 performs an operation to approve the addition of the product to the shopping cart, a notification of approval is sent from the second customer terminal 26 to the information processing server 30, and based on this, the purchase processing unit 32h performs a registration process for the product. As a result, the product indicated by the selected product information Ig is registered as a product scheduled to be purchased. If approval is not obtained, the purchase processing unit 32h does not perform the registration process and notifies the first customer terminal 21 via the communication unit 31 that approval from the second customer user P3 for the purchase of the product has not been obtained.

[0201] Also, when the types of selectable products and the range of amounts are defined as selection conditions, when the purchase processing unit 32h receives the selected product information Ig from the first customer terminal 21, it checks whether the product indicated by the selected product information Ig is a product that can be selected under the selection conditions. If the product indicated by the selected product information Ig is a selectable product, the purchase processing unit 32h performs a registration process for the product. On the other hand, if the product indicated by the selected product information Ig is not a selectable product, the purchase processing unit 32h does not perform the registration process and notifies the first customer terminal 21 via the communication unit 31 that the product cannot be purchased. If the product indicated by the selected product information Ig is not a selectable product, the customer terminal 26 of the second customer user P3 having payment authority may also be notified that the product that the first customer user P2 tried to select is not approved for purchase.

[0202] Also, when the upper limit of the total amount of selectable products is defined as a selection condition, when the purchase processing unit 32h receives the selected product information Ig from the first customer terminal 21, it checks whether the total amount of the products already registered as products scheduled for purchase and the product indicated by the selected product information Ig is equal to or less than the upper limit of the total amount of selectable products. If the total amount is equal to or less than the upper limit, the purchase processing unit 32h performs a registration process for the product indicated by the selected product information Ig. On the other hand, if the total amount exceeds the upper limit, the purchase processing unit 32h does not perform the registration process and notifies the first customer terminal 21 via the communication unit 31 that the product cannot be purchased because the total amount exceeds the upper limit. If the total amount exceeds the upper limit, the customer terminal 26 of the second customer user P3 having payment authority may also be notified that the total amount of the products scheduled for purchase set by the product that the first customer user P2 tried to select exceeds the set upper limit.

[0203] In addition, when the second customer user P3 has the authority to both select and pay for products, the second customer user P3 can also operate the second customer terminal 26 to select products.

[0204] After the selection of the product is completed, when the first customer user P2 performs a predetermined operation to request payment on the first customer terminal 21, a payment request is sent from the first customer terminal 21 to the information processing server 30 (step S32). The predetermined operation is, for example, an operation of selecting a region for instructing a payment request on a screen where the products in the shopping cart are displayed.

[0205] Upon receiving the payment request, the purchase processing unit 32h of the information processing server 30 performs a payment request process as part of the settlement process (step S33). Specifically, the purchase processing unit 32h refers to the family data 33c and identifies a customer user with payment authority set in the family of the customer users P2 and P3 as the payer. Then, the purchase processing unit 32h transmits the settlement data to the terminal of the payer, that is, the customer terminal 26 of the second customer user P3, via the communication unit 31 and requests payment. The settlement data indicates the settlement details including the payment amount, which is the total amount of the products registered as the products to be purchased by the families of the customer users P2 and P3.

[0206] When the second customer terminal 26 receives the settlement data, the settlement details based on the settlement data are displayed on the second customer terminal 26. When the second customer user P3 performs an operation to approve the settlement details on the second customer terminal 26, a notification of approval is sent from the second customer terminal 26 to the information processing server 30 (step S34).

[0207] Upon receiving the notification of approval of the settlement details from the second customer terminal 26, the purchase processing unit 32h of the information processing server 30 performs a settlement execution process as part of the settlement process (step S35). That is, the purchase processing unit 32h uses the second customer user P3 as the payer and performs the settlement in accordance with the settlement data while communicating with an external server as necessary. If the approval by the second customer user P3 cannot be obtained, the purchase processing unit 32h does not perform the settlement execution process and notifies the first customer terminal 21 via the communication unit 31 that the approval by the second customer user P3 for the purchase of the product cannot be obtained.

[0208] Instead of the first customer user P2 requesting payment, a payment request by the second customer user P3 may be possible. In this case, instead of the above steps S32 and S33, the following processing is performed. That is, a payment request is sent from the second customer terminal 26 to the information processing server 30, and the purchase processing unit 32h transmits payment data to the second customer terminal 26 via the communication unit 31. The payment data indicates the payment details including the amount to be paid, which is the total amount of the products registered as products to be purchased by the families of the customer users P2 and P3.

[0209] Also, based on an instruction from the second customer user P3, the first customer user P2 may make a payment request. In this case, instead of the above steps S32 and S33, the following processing is performed. That is, an instruction for a payment request is sent from the second customer terminal 26 to the first customer terminal 21 via the information processing server 30. Based on this, when the first customer user P2 performs a predetermined operation, a payment request is sent from the first customer terminal 21 to the information processing server 30, and the purchase processing unit 32h transmits payment data to the second customer terminal 26 via the communication unit 31.

[0210] Even if the family data 33c has not been created before the selection of the product, a customer user different from the customer user who selected the product may pay for the product. Such a form will be described with reference to FIG. 18.

[0211] As shown in FIG. 18, when the first customer user P2 performs a predetermined operation on the first customer terminal 21 to select a product that the user wishes to purchase, selection product information Ig indicating the product is transmitted from the first customer terminal 21 to the information processing server 30 (step S40).

[0212] Upon receiving the selection product information Ig, the purchase processing unit 32h of the information processing server 30 performs a registration process (step S41). As a result, the product indicated by the selection product information Ig is registered as a product to be purchased by the first customer user P2, and the first customer terminal 21 is notified that the product has been placed in the shopping cart.

[0213] After the selection of the product is completed, when the first customer user P2 performs a predetermined operation on the first customer terminal 21 to request payment from another customer user, a payment request is sent from the first customer terminal 21 to the information processing server 30 (step S42).

[0214] Upon receiving the payment request, the purchase processing unit 32h of the information processing server 30 performs a payer setting process (step S43). Specifically, the purchase processing unit 32h transmits a notice calling for payment of the price of the product selected by the first customer user P2, together with the information of the product registered as the product to be purchased by the first customer user P2, to the second customer terminal 26 via the communication unit 31. Note that the transmission destination of the notice calling for payment may be specified by the first customer user P2.

[0215] When the second customer user P3 performs an operation to accept the payment on the second customer terminal 26 upon receiving the notice calling for payment, a notice indicating acceptance of the payment is sent from the second customer terminal 26 to the information processing server 30 (step S44).

[0216] Upon receiving the notice of acceptance of the payment, the purchase processing unit 32h of the information processing server 30 performs a payment request process as part of the settlement process (step S45). That is, the purchase processing unit 32h transmits settlement data to the customer terminal 26 of the second customer user P3 via the communication unit 31 and requests payment. The settlement data indicates the settlement details including the amount to be billed, which is the price of the product registered as the product to be purchased by the first customer user P2.

[0217] When the second customer user P3 performs an operation to approve the settlement details on the second customer terminal 26, a notice of approval is sent from the second customer terminal 26 to the information processing server 30 (step S46).

[0218] When the information processing server 30's purchase processing unit 32h receives a notification of approval of the settlement details from the second customer terminal 26, as part of the settlement process, it performs a settlement execution process (step S47). That is, the purchase processing unit 32h uses the second customer user P3 as the payer and communicates with an external server as necessary to execute the settlement in accordance with the settlement data.

[0219] As described above, in the second embodiment, it is possible for a customer user different from the customer user who selected the product to pay for the product. Therefore, even in shopping in the virtual space VS, similar to shopping in the real space, it is possible to divide the roles regarding product selection and payment. As a result, activities closer to those in the real space can be carried out in the virtual space VS.

[0220] Also, regarding product selection, since it is possible to set conditions such as the types, amounts, and total amounts of selectable products, even if the product selector and the payer are different, it is possible to prevent the payer from being required to pay for unanticipated products.

[0221] As described above, according to the second embodiment, in addition to the effects of (1), (5) to (7) of the first embodiment, the following effects can be obtained. (8) The payer for the product is set to a customer user P3 different from the customer user P2 who selected the product, and the settlement process proceeds. Therefore, even in shopping in the virtual space VS, similar to shopping in the real space, it is possible to divide the roles regarding product selection and payment. As a result, activities closer to those in the real space can be carried out in the virtual space VS.

[0222] (9)Permissions regarding selection of products to be purchased and payment of product prices are set for each of customer users P2 and P3, and a family is set, which is a group including a plurality of customer users P2 and P3 having different permissions from each other. Then, the payer for the price of the product selected by customer user P2 having the permission to select the product is set to customer user P3 having the permission to pay the price of the product within the same family as customer user P2, and the settlement process proceeds. Thereby, the role sharing of customer users P2 and P3 is managed by information processing server 30, and the registration process and the settlement process proceed accordingly, so that the purchase of products according to the role sharing proceeds smoothly. Also, when customer users P2 and P3 are parent and child, since it is possible to restrict the authority of the child by the parent, it is also possible to manage the behavior of the child in shopping in virtual space VS. Therefore, the convenience of customer users is enhanced.

[0223] [Modification Example] Each of the above embodiments can be implemented by making the following changes. · The group in the first embodiment and the family in the second embodiment may include three or more customer users. In virtual space VS, an avatar corresponding to each customer user is arranged, and each customer user can proceed with the purchase of products through virtual space VS by operating a display terminal for each user. In the first embodiment, the payment ratio may be set to 0% for at least one customer user constituting the group. Also, in the second embodiment, the family may include a plurality of customer users having the same permissions.

[0224] · In the first embodiment, for the product selected by the customer user, it may be possible to select whether to register it as a product to be purchased by the group or as a product to be purchased by a single customer user. In the purchase process section 32h, in the settlement process, for the product registered as a product to be purchased by the group, the payment amount for each customer user is set according to the payment ratio, and for the product registered as a product to be purchased by a single customer user, the full amount thereof is set as the payment amount for that customer user.

[0225] · Among the customer users who form a group or family, the positions of the avatars in the virtual space VS may be set so that the avatars of other customer users move according to the movement of the avatar of a specific customer user. In other words, the movement of the avatars of the customer users does not have to be entirely based on the operation of the display terminal by the customer users.

[0226] · The first embodiment and the second embodiment may be combined. For example, a family includes a plurality of customer users having payment authority, a payment ratio is set for these plurality of customer users, and for the products registered as products to be purchased by the family, the payment amount of each customer user having payment authority is set according to the payment ratio.

[0227] · If no group or family is formed, the product selected by a single customer user is registered as the product to be purchased by the customer user, and the settlement process for this product may be advanced with the customer user as the payer.

[0228] · The image of the virtual space VS and the first situation display 300 do not have to be displayed on one screen on the customer terminals 21, 26. For example, the virtual area 210 and the video area 230 where the video of the salesperson user P1, which is the first situation display 300, is displayed or the shooting area 240 where the image shot by the shooting device 13 is displayed may be switched and displayed. Even with such a configuration, compared to the form in which only the image of the virtual space VS is displayed and the first situation display 300 is not displayed, the customer users P2, P3 are more likely to feel a connection with the reality.

[0229] ·The virtual space providing system does not necessarily have to have all of the functions described in each of the above embodiments. The virtual space providing system is a system that causes the customer terminals 21 and 26 to display an image of the virtual space VS imitating the first space RS1 and at least one first situation display 300, and as long as it is a system that allows the customer users P2 and P3 to operate the customer terminals 21 and 26 to proceed with the purchase of products through the virtual space VS.

[0230] ·The virtual space generation unit 32a of the information processing server 30 may place an avatar corresponding to a customer who has actually visited the first space RS1 in the virtual space VS. The position of the customer is specified based on, for example, the analysis of the image captured by the position information collection device 11 and reflected in the position of the avatar in the virtual space VS. According to such a configuration, depending on the number and position of the avatars corresponding to the customers in the first space RS1 in the virtual space VS, the customer users P2 and P3 can know the degree of bustle of the store in the first space RS1, popular products, etc.

[0231] ·The virtual space generation unit 32a of the information processing server 30 may control the number of avatars in the virtual space VS within a predetermined range. For example, if the number of avatars corresponding to customers is too small, it becomes difficult for the customer users P2 and P3 to feel the bustle, while if the number of avatars corresponding to customers is too large, the inside of the virtual space VS becomes congested and it becomes difficult for the customer users P2 and P3 to move the avatars and select products. If the number of avatars in the virtual space VS is controlled to a certain extent, the occurrence of these problems can be suppressed. For example, the virtual space generation unit 32a may keep the number of avatars in the virtual space VS within a predetermined range by placing avatars corresponding to some of the customers in the first space RS1 in the virtual space VS. Alternatively, the virtual space generation unit 32a may increase the number of avatars in the virtual space VS up to a predetermined range by placing avatars of customers who do not exist in the first space RS1 in the virtual space VS.

[0232] · After the display of the basic screen 200, when the avatars A1, A2, and A3 move within the virtual space VS, only the position information of the avatars A1, A2, and A3 is exchanged between the information processing server 30 and the customer terminals 21 and 26, and the customer terminals 21 and 26 may perform the process of generating an image of the virtual space VS that reflects the change in the positions of the avatars A1, A2, and A3. In other words, the information processing server 30 manages the change in the position information of the avatars A1, A2, and A3, and the movement of the avatars A1, A2, and A3 is performed by the customer terminals 21 and 26.

[0233] In this case, for example, at the customer terminal 21, the movement of the position of the first avatar A1 is performed based on the information indicating the changed position of the first avatar A1 transmitted from the information processing server 30 to the customer terminal 21 based on the position specifying information Ip, and the movement of the position of the second avatar A2 is performed based on the instruction information Is input to the customer terminal 21. In this case, the customer terminal 21 may undertake a part of the function of generating the display data. That is, the control unit 32 of the information processing server 30 and the customer terminal 21 may function as a display data generation unit.

[0234] · For one first space RS1, a plurality of virtual spaces VS may be generated. Each virtual space VS has an arrangement of structures imitating the first space RS1. For example, for each group or family to which the customer user belongs, a virtual space VS including an avatar corresponding to the customer user within the group or family may be generated. Thereby, activities within the virtual space VS can be enjoyed leisurely for each group or family. In each of the plurality of virtual spaces VS, an avatar of the same salesperson user may be arranged, or when there are a plurality of salesperson users, avatars of different salesperson users may be arranged for each virtual space VS. Note that it is not necessary for all the customer service staff existing in the first space RS1 to be reflected as avatars in the virtual space VS as salesperson users.

Explanation of Reference Numerals

[0235] A1… First avatar A2… Second avatar A3… Third avatar Gd… Commodity Ic1… First conversation information Ic2… Second conversation information Ic3… Third conversation information If1… First information If2… Second information If3… Third information Ig… Selected commodity information Ij… Information for judgment Io… Operation information Ip… Location identification information Is… Instruction information Iv… Shooting information P1… Salesperson user P2, P3… Customer users RS1… First space RS2… Second space RS3… Third space VS… Virtual space 10… First device 11… Location information collection device 12… Salesperson terminal 13… Shooting device 20… Second device 25… Third device 21, 26… Customer terminals 30… Information processing server 31… Communication unit 32… Control unit 32a… Virtual space generation unit 32b… Conversation processing unit 32c… Customer service situation judgment unit 32d… Shooting instruction unit 32e… Trial execution unit 32f… Display data generation unit 32g… Group setting unit 32h… Purchase processing unit 32i… Family setting unit 33… Memory unit 33a… Virtual space data 33b… Group data 33c… Family data 100… Virtual space providing system 200… Basic screen 201… Conversation screen 202…Observation screen 203…Trial screen 210…Virtual area 211…Product display 212…In-service display 220…Operation area 230…Video area 240…Shooting area 250…Trial area 300…First situation display

Claims

1. A first receiving unit that receives the first information output from a device located in a first space, which is a space where a product is sold, the first information including at least position-specifying information that can specify the position of a salesperson within the first space; A virtual space generation unit that sets the position of a first avatar, which is a first object, in the virtual space having the arrangement of structures imitating the first space according to the position of the salesperson in the first space based on the position-specifying information, and sets the position of a second avatar, which is a second object corresponding to a second customer who is a customer in a second space different from the first space; A second receiving unit that receives second information output from a second terminal, which is a display terminal operated by the second customer, the second information including at least selection product information indicating the product selected by the second customer; A purchase processing unit that performs a registration process of registering the product indicated by the selection product information as a product to be purchased, and a settlement process for the product registered by the registration process; A display data generation unit that generates display data for displaying an image of the virtual space and a display indicating the situation of the first space based on the first information; An information processing server comprising a transmission unit that transmits the display data to the second terminal, A third receiving unit that receives third information output from a third terminal, which is a display terminal operated by a third customer who is a customer in a third space different from the first space; A family setting unit that sets, for each customer, an authorized right among selection of a product to be purchased and payment of the price of the product, and sets a family, which is a group including a plurality of customers having different rights from each other; The virtual space generation unit sets the position of a third avatar, which is a third object corresponding to the third customer, in the virtual space; The display data generation unit generates the display data for the second terminal and the display data for the third terminal; The transmission unit transmits the display data for each terminal to each terminal; The family setting unit sets the family including the second customer and the third customer, sets only the right to select the product for the second customer, and sets the right to pay the price of the product for the third customer; When the purchase processing unit receives the selected product information from the second terminal operated by the second customer, it requests, through the third terminal, approval from the third customer who has the authority to pay for the product within the same family as the second customer who selected the product, to register the product indicated by the selected product information as a product scheduled for purchase. When the approval is obtained, the registration process is performed, and the third customer is set as the payer for the product registered by the registration process, and the settlement process is advanced. Information processing server.

2. The display showing the situation of the first space includes at least one of the video of the salesperson in the first space, the video of the products located in the first space, and the display showing the working situation of the salesperson in the first space. The information processing server according to claim 1.

3. A first acquisition unit that acquires first information in a first space where products are sold, the first information including at least position identification information that can identify the position of the salesperson in the first space. A virtual space generation unit that sets the position of a first avatar, which is a first object, in the virtual space having the arrangement of the structure imitating the first space according to the position of the salesperson in the first space based on the position identification information, and sets the position of a second avatar, which is a second object, corresponding to a second customer who is a customer in a second space different from the first space. A second acquisition unit that acquires second information based on the operation of a second terminal, which is a display terminal, by the second customer in the second space, the second information including at least selected product information indicating the product selected by the second customer. A purchase processing unit that performs a registration process of registering the product indicated by the selected product information as a product scheduled for purchase, and a settlement process for the product registered by the registration process. A virtual space providing system including a display data generation unit that generates display data for displaying on the display terminal the image of the virtual space and the display showing the situation of the first space based on the first information. A third acquisition unit that acquires third information based on the operation of a third terminal, which is a display terminal, by a third customer who is a customer in a third space different from the first space. A family setting unit that sets, for each customer, the authority recognized among the selection of a product to be purchased and the payment of the price of the product, and sets a family that is a group including a plurality of customers having different authorities from each other. The virtual space generation unit sets, in the virtual space, the position of a third avatar that is a third object corresponding to the third customer. The display data generation unit generates the display data for the second terminal and the display data for the third terminal. The family setting unit sets the family including the second customer and the third customer, sets only the authority to select the product for the second customer, and sets the authority to pay the price of the product for the third customer. When the selection product information is acquired based on the operation of the second terminal by the second customer, the purchase processing unit requests, through the third terminal, the third customer who has the authority to pay the price of the product within the same family as the second customer who selected the product, for approval to register the product indicated by the selection product information as a product to be purchased. When the approval is obtained, the registration process is performed, and the third customer is set as the payer of the price of the product registered by the registration process, and the settlement process is advanced. Virtual space providing system.

Images