Information processing server and virtual space provision system

Abstract

To provide an information processing server and a virtual space provision system that make it easier to feel a connection with the reality in activities in a virtual space.SOLUTION: An information processing server 30 moves a first avatar according to the movement of a salesperson user P1 in a first space RS1, in a virtual space having the arrangement of structures imitating the first space RS1, and moves a second avatar according to an instruction from a customer user P2 in a second space RS2. Furthermore, the information processing server 30 performs processing for establishing a conversation between the salesperson user P1 and the customer user P2 with the first avatar and the second avatar intervening and transmits, to a customer terminal 21, display data for displaying both an image of the virtual space and the situation of the first space RS1.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing server and a virtual space providing system used for communication using virtual reality. [Background technology]

[0002] In recent years, development of systems for communication using virtual reality has been progressing. The applications of such systems are not limited to games, but are expanding to new applications such as the provision of services. One example of the provision of services is the sale of products. For example, Patent Documents 1 and 2 describe systems that enable communication between salespeople and customers using avatars in a virtual space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2009-205661 A [Patent Document 2] JP 2012-8638 A Summary of the Invention [Problem to be solved by the invention]

[0004] The above-mentioned new uses of the system that provides a virtual space are different from those of games and the like that are premised on progress in the virtual space, and are originally intended to replace activities that are carried out in the real space. If activities in the real space can be replaced by activities in the virtual space, it is highly convenient for users who have difficulty going to the place of activity in the real space due to transportation means, time constraints, or restrictions on going out. On the other hand, since activities in the virtual space make it difficult to feel a connection with reality, there are still many insufficient points as a substitute for activities in the real space. For example, the senses obtained through vision and hearing in activities in the real space, such as the senses obtained from face-to-face conversations and observation of real objects such as products, are impaired in activities in the virtual space, making it difficult to feel a connection with reality. [Means for solving the problem]

[0005] The information processing server for solving the above problem includes a first receiving unit that receives first information output from a device located in a first space, the first information including at least position identification information that is information capable of identifying a position of a first user in the first space and first conversation information that indicates a statement of the first user, a second receiving unit that receives second information output from a display terminal operated by a second user in a second space, the second information including at least instruction information that indicates an instruction of the second user and second conversation information that indicates a statement of the second user, and a display unit that displays the first space based on the position identification information in a virtual space having an arrangement of structures that mimics the first space. the virtual space generation unit moving a first avatar, which is a first object, in response to movement of the first user within the virtual space, and moving a second avatar, which is a second object, in response to instructions from the second user based on the instruction information; a conversation processing unit using the first conversation information and the second conversation information to process a conversation between the first user and the second user mediated by the first avatar and the second avatar; a display data generation unit generating display data for displaying an image of the virtual space and a display showing the situation of the first space based on the first information; and a transmission unit transmitting the display data to the display terminal.

[0006] The virtual space providing system for solving the above problem includes a first acquisition unit that acquires first information in a first space, the first acquisition unit acquiring the first information including at least position identification information that is information capable of identifying a position of a first user in the first space and first conversation information that indicates a statement by the first user; a second acquisition unit that acquires second information in a second space, the second acquisition unit acquiring the second information including at least instruction information that indicates an instruction based on an operation of a second user on a display terminal in the second space and second conversation information that indicates a statement by the second user; and a virtual space providing system that acquires the position identification information in a virtual space having an arrangement of structures simulating the first space. a virtual space generation unit that moves a first avatar, which is a first object, in accordance with the movement of the first user within the first space based on fixed information, and moves a second avatar, which is a second object, in accordance with instructions from the second user based on the instruction information; a conversation processing unit that uses the first conversation information and the second conversation information to perform processing to establish a conversation between the first user and the second user via the first avatar and the second avatar; and a display data generation unit that generates display data for displaying, on the display terminal, an image of the virtual space and a display showing the situation of the first space based on the first information.

[0007] According to the above configuration, an image of the virtual space and a display showing the situation of the first space are displayed on the display terminal. Therefore, compared to a case where only an image of the virtual space is displayed, the second user is more likely to feel a connection with reality in the activity in the virtual space.

[0008] In the above configuration, the first space may be a space in which a service is provided using an exhibit, the first user may be a customer service representative for the service, and the second user may be a person who receives the service through the virtual space.

[0009] The provision and enjoyment of a service using an exhibit is an activity that has traditionally been carried out in real space, but when this is carried out in a virtual space, it is important to provide a sensation similar to that of an activity in real space in order to increase the satisfaction of the recipient of the service. By using the above-mentioned virtual space providing system to provide a service using an exhibit, the second user can experience a sensation similar to that of an activity in real space, making it easier for the second user to feel a connection with reality, and therefore the satisfaction of the second user who is the recipient of the service can be favorably increased.

[0010] In the aforementioned configuration, the first conversation information may be composed of video data, and the display showing the situation of the first space may include an image of the first user based on the first conversation information. According to the above configuration, the second user can have a feeling similar to a face-to-face conversation in a conversation with the first user through the avatar. Therefore, the second user can easily feel a connection with reality in the activity in the virtual space.

[0011] In the aforementioned configuration, the display indicating the status of the first space may include a display indicating a work status of the first user in the first space. According to the above configuration, the second user can grasp the situation of the first user in the first space, and can adjust the timing of the conversation, etc., and can efficiently proceed with activities in the virtual space. In addition, the second user can easily sense that the first avatar is an alter ego of a person who is actually active in the first space. Therefore, the second user can easily feel a connection with reality in activities in the virtual space.

[0012] In the above configuration, the first information includes determination information which is information capable of determining the customer service status of the first user in the first space, and the display indicating the status of the first space is a serving customer display indicating that the first user is serving customers in the first space and includes the serving customer display displayed in association with the first avatar, and the display data generation unit may generate the display data for displaying an image including the serving customer display when it is determined that the first user is serving customers based on the determination information.

[0013] According to the above configuration, the second user can easily grasp whether the first user is in a situation where he or she can respond to a conversation request, and can adjust the timing of the conversation, etc., and can efficiently proceed with activities in the virtual space. In addition, the second user can easily sense that the first avatar is not a character that only serves customers in the virtual space, but an alter ego of a person who actually serves customers in a store in the real space. Therefore, the second user can easily feel a connection with reality in activities in the virtual space.

[0014] In the above configuration, the first information may include shooting information consisting of shooting data within the first space, and the display showing the situation of the first space may include an image of the first space based on the shooting information.

[0015] According to the above configuration, the second user can check the appearance of the items in the first space. Therefore, the second user can get a feeling similar to that of actually visiting the first space. Therefore, the second user can easily feel a connection with reality in the activities in the virtual space.

[0016] In the above configuration, the device located in the first space may include a photographing device that generates the photographing information and is configured to be movable within the first space, the second information may include operation information that is information indicating instructions for movement of the photographing device, and the transmission unit may transmit instructions for the movement of the photographing device in accordance with the operation information to the photographing device.

[0017] According to the above configuration, since the second user can remotely control the photographing device, the second user's intention is more strongly reflected in the image of the first space displayed on the display terminal. Therefore, it becomes easier to proceed with checking the appearance of the items in the first space according to the second user's intention, and the second user can get a feeling closer to that of actually visiting the first space.

[0018] In the aforementioned configuration, the display data may be data for displaying an image of the virtual space and a display showing a situation in the first space on one screen. According to the above configuration, the second user can obtain both the sensation of being active in a virtual space and a sensation similar to an experience in a real space. Therefore, by combining these sensations, the sensation obtained from the activity in the virtual space can be closer to the experience in a real space. Therefore, the connection with reality is more easily felt in the activity in the virtual space.

[0019] In the above configuration, each of the first conversation information and the second conversation information includes audio data, and the conversation processing unit sets the volume of the audio output based on the first conversation information to be lower the greater the distance between the first avatar and the second avatar, and the transmission unit may send an instruction to the display terminal to output the audio based on the first conversation information at a volume in accordance with the setting of the conversation processing unit.

[0020] According to the above configuration, the distance between avatars affects the volume of conversation in the same way that the distance between people affects the volume of conversation in the real space, so that the second user can get a sense of activity in the virtual space that is closer to the experience in the real space.

[0021] In the above configuration, the conversation processing unit may determine whether or not a conversation can take place depending on a distance between the first avatar and the second avatar, and may perform processing to establish the conversation if the distance is equal to or less than a predetermined value.

[0022] According to the above configuration, the distance between avatars affects whether or not they can converse with each other in the same way that the distance between people affects whether or not they can converse with each other in the real world. Therefore, the second user can get a sense of activity in the virtual world that is closer to the experience in the real world. Effect of the Invention

[0023] According to the present invention, it is possible to make activities in a virtual space more likely to feel connected to reality. [Brief description of the drawings]

[0024] [Figure 1] FIG. 1 is a block diagram showing an overall configuration of a virtual space providing system according to an embodiment. [Diagram 2] FIG. 1 is a diagram showing an example of a virtual space generated by the virtual space providing system of an embodiment. [Diagram 3] FIG. 2 is a sequence diagram showing a process flow in a basic function of the virtual space providing system according to an embodiment. [Figure 4] FIG. 2 is a diagram showing an example of a screen of a display terminal in the virtual space providing system according to an embodiment. [Diagram 5] FIG. 11 is a sequence diagram showing a process flow in a conversation function of the virtual space providing system according to an embodiment. [Figure 6] FIG. 2 is a diagram showing an example of a screen of a display terminal in the virtual space providing system according to an embodiment. [Figure 7] FIG. 2 is a diagram showing an example of a screen of a display terminal in the virtual space providing system according to an embodiment. [Figure 8] 11 is a flowchart showing the flow of a conversation availability determination process in the virtual space providing system of an embodiment. [Figure 9] FIG. 11 is a sequence diagram showing a process flow of a conversation volume adjustment process in the virtual space providing system according to an embodiment. [Figure 10] 11 is a flowchart showing the process flow of a customer service status display function of the virtual space providing system according to an embodiment. [Figure 11] FIG. 2 is a diagram showing an example of a screen of a display terminal in the virtual space providing system according to an embodiment. [Figure 12] FIG. 11 is a sequence diagram showing a process flow in an indoor photography function of the virtual space providing system according to an embodiment. [Figure 13] FIG. 2 is a diagram showing an example of a screen of a display terminal in the virtual space providing system according to an embodiment. [Figure 14]FIG. 11 is a sequence diagram showing a process flow in a trial function of the virtual space providing system according to an embodiment. [Figure 15] FIG. 2 is a diagram showing an example of a screen of a display terminal in the virtual space providing system according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0025] An embodiment of an information processing server and a virtual space providing system will be described with reference to FIGS. [Overall configuration of the virtual space provision system] The overall configuration of a virtual space providing system 100 will be described with reference to Fig. 1. In this embodiment, as an example, a case will be described in which the virtual space providing system 100 is used for selling products.

[0026] The first space RS1 and the second space RS2 are real spaces separated from each other. The first space RS1 is a space in a store that sells products displayed in front of the store, and a salesperson user P1, who is a first user, is located in the first space RS1. The salesperson user P1 is a salesperson for products and sells products to customers who actually visit the first space RS1.

[0027] In the second space RS2, a customer user P2 who is a second user is located. The customer user P2 is a person who plans to purchase a product through the virtual space provided by the virtual space providing system 100. The second space RS2 may be any space, such as a space in the home of the customer user P2.

[0028] In the virtual space providing system 100, an avatar corresponding to a salesperson user P1 and an avatar corresponding to a customer user P2 are placed in a virtual store, which is a virtual space simulating the first space RS1. Using these avatars, communication regarding the buying and selling of goods is carried out between the salesperson user P1 and the customer user P2.

[0029] 1, the virtual space providing system 100 includes an information processing server 30, a first device 10 located in a first space RS1, and a second device 20 located in a second space RS2. The first device 10 includes a location information collecting device 11, a salesperson terminal 12, and a photographing device 13. The second device 20 includes a customer terminal 21.

[0030] The first device 10, the second device 20, and the information processing server 30 transmit and receive data to and from each other through a network NW. The network NW used for communication between each device included in the first device 10 and the second device 20 and the information processing server 30 may be a general-purpose communication line such as the Internet, or a dedicated communication line for communication between each device. The network NW may include multiple independent networks, or may be a single common network.

[0031] The position information collecting device 11 acquires position specifying information Ip, which is information capable of specifying the position of the salesperson user P1 in the first space RS1. The position information collecting device 11 transmits the position specifying information Ip to the information processing server 30.

[0032] The position identified based on the position identification information Ip may be a relative position with respect to a reference position in the first space RS1, or may be an absolute position using latitude and longitude. The position information collection device 11 includes devices capable of detecting the position of the salesperson user P1 by a desired method. Depending on the method of detecting the position, each device constituting the position information collection device 11 may be disposed at a predetermined position in the first space RS1, or may be carried by the salesperson user P1.

[0033] For example, the location information collection device 11 may include a camera, and the location of the salesperson user P1 may be specified by analyzing an image captured by the camera. The salesperson user P1 may be identified by identifying the face of the salesperson user P1 or identifying a marker attached to the salesperson user P1 in advance.

[0034] For example, the location information collection device 11 may include a transmitter and a receiver compatible with short-range wireless communication such as Bluetooth (registered trademark), and the location of the salesperson user P1 may be identified from the reception conditions when the receiver receives radio waves from the transmitter carried by the salesperson user P1.

[0035] The position identification information Ip may be information capable of identifying the orientation of the salesperson user P1 in addition to the position thereof. In this case, the position information collection device 11 may include a motion sensor or a device constituting a head tracking or face tracking system.

[0036] The location of the salesperson user P1 based on the information collected by the location information collecting device 11 may be identified by the location information collecting device 11 or by the information processing server 30. In other words, the location identification information Ip may be information indicating the result of identifying the location of the salesperson user P1, or may be information that enables the location of the salesperson user P1 to be identified by a calculation using the location identification information Ip.

[0037] The salesperson terminal 12 is a device used by the salesperson user P1 to converse with the customer user P2. The conversation between the salesperson user P1 and the customer user P2 is carried out by any one of text, audio, and video. The salesperson terminal 12 only needs to include a device corresponding to the conversation means. In other words, the salesperson terminal 12 only needs to be a device capable of at least one of inputting and displaying text, inputting and outputting audio, and capturing and displaying video. For example, the salesperson terminal 12 is a headset, a smartphone, a tablet terminal, a wearable terminal, a device for video calling, etc.

[0038] First conversation information Ic1, which is information indicating what the salesperson user P1 said, is input to the salesperson terminal 12. The salesperson terminal 12 transmits the first conversation information Ic1 to the information processing server 30. The first conversation information Ic1 is composed of any one of text, audio, and video data depending on the conversation medium.

[0039] The photographing device 13 photographs an image in the first space RS1. It is preferable that the photographing device 13 is capable of photographing a moving image. The photographing device 13 includes, for example, a camera fixed at a predetermined position in the first space RS1. The camera is disposed at a position where it can photograph a product, for example. Alternatively, the photographing device 13 may be movable in the first space RS1, and the movement of the photographing device 13 may be remotely controlled. An example of a photographing device 13 that can be remotely controlled is a telepresence robot.

[0040] The photographing device 13 generates photographing information Iv consisting of photographing data within the first space RS1, and transmits the photographing information Iv to the information processing server 30. In addition, when the photographing device 13 can be remotely controlled, the photographing device 13 receives an instruction from the information processing server 30 to change the photographing position and the photographing direction.

[0041] The information output by the first device 10, in other words, the information output by each of the position information collecting device 11, the salesperson terminal 12, and the photographing device 13, is the first information If1 which is information indicating the situation of the first space RS1. That is, the first information If1 includes the position identification information Ip, the first conversation information Ic1, and the photographing information Iv. In the virtual space providing system 100, the first device 10 functions as a first acquisition unit which acquires the first information If1 in the first space RS1. One device may function as two or more of the location information collecting device 11, the salesperson terminal 12, and the photographing device 13.

[0042] The customer terminal 21 is a display terminal equipped with a display unit that displays images. The customer terminal 21 is operated by the customer user P2. The customer terminal 21 is, for example, a smartphone, a tablet terminal, a personal computer, etc. The customer terminal 21 displays images based on display data received from the information processing server 30. The display contents of the customer terminal 21 include an image of the virtual space and a first status display that is a display showing the status of the first space RS1.

[0043] In addition, instruction information Is, which is information indicating an instruction of the customer user P2 with respect to the virtual space, is input to the customer terminal 21. The instruction information Is includes information instructing the movement of an avatar corresponding to the customer user P2. The instruction information Is is transmitted from the customer terminal 21 to the information processing server 30.

[0044] Furthermore, second conversation information Ic2, which is information indicating what the customer user P2 said, is input to the customer terminal 21. The second conversation information Ic2 is composed of any one of text, audio, and video data, depending on the means of conversation between the salesperson user P1 and the customer user P2. The customer terminal 21 has the functions of inputting and displaying text, inputting and outputting audio, and capturing and displaying video, depending on the means of conversation. The second conversation information Ic2 is transmitted from the customer terminal 21 to the information processing server 30.

[0045] In response to an operation of the customer user P2 on the customer terminal 21, a request for an image of the first space RS1 and a request for a product trial are sent from the customer terminal 21 to the information processing server 30. If the image capturing device 13 can be remotely controlled, operation information Io, which is information indicating an instruction for the movement of the image capturing device 13, is input to the customer terminal 21 upon requesting an image of the first space RS1, and the operation information Io is sent from the customer terminal 21 to the information processing server 30.

[0046] The functions of the customer terminal 21 in the virtual space providing system 100 are embodied, for example, by application software installed in the customer terminal 21. A specific example of such application software is a shopping application for a virtual store.

[0047] The information output by the second device 20, in other words, the information output by the customer terminal 21, is the second information If2. That is, the second information If2 includes the instruction information Is, the second conversation information Ic2, and the operation information Io. In the virtual space providing system 100, the second device 20 functions as a second acquisition unit that acquires the second information If2 in the second space RS2.

[0048] The information processing server 30 includes a communication unit 31, a control unit 32, and a storage unit 33. The communication unit 31 executes connection processing between the information processing server 30 and each device including the first device 10 and the second device 20 through the network NW, and transmits and receives data between the connected devices. The communication unit 31 functions as a first receiving unit that receives the first information If1 from the first device 10, and a second receiving unit that receives the second information If2 from the second device 20. The communication unit 31 also functions as a transmitting unit that transmits display data to the customer terminal 21 and transmits movement instructions to the imaging device 13.

[0049] The control unit 32 has a configuration including a CPU and a volatile memory such as a RAM. The control unit 32 controls each unit of the information processing server 30, such as controlling the processing by the communication unit 31, reading and writing information in the storage unit 33, and performing various calculation processes, based on the programs and data stored in the storage unit 33. In the virtual space providing system 100, the control unit 32 functions as a virtual space generation unit 32a, a conversation processing unit 32b, a customer service situation determination unit 32c, a photography instruction unit 32d, a trial execution unit 32e, and a display data generation unit 32f.

[0050] The virtual space generating unit 32a sets the positions of objects including the first avatar A1 and the second avatar A2 in one virtual space having an arrangement of structures simulating the first space RS1. The first avatar A1 is an avatar corresponding to the salesperson user P1, and the second avatar A2 is an avatar corresponding to the customer user P2. In this way, a virtual space VS is generated that includes the first avatar A1 and the second avatar A2 as components. FIG. 2 shows an example of the virtual space VS. The components of the virtual space VS also include an object representing the product Gd.

[0051] The virtual space generation unit 32a changes the position of the first avatar A1 based on the position identification information Ip included in the first information If1. The virtual space generation unit 32a also changes the position of the second avatar A2 based on the instruction information Is included in the second information If2. That is, the virtual space generation unit 32a moves the first avatar A1 based on the position identification information Ip, and moves the second avatar A2 based on the instruction information Is.

[0052] The conversation processing unit 32b performs a conversation execution process, which is a process of establishing a conversation between the salesperson user P1 and the customer user P2, using the first conversation information Ic1 contained in the first information If1 and the second conversation information Ic2 contained in the second information If2.

[0053] The conversation processor 32b also performs a conversation availability determination process for determining whether or not a conversation can take place depending on the distance between the first avatar A1 and the second avatar A2. Furthermore, when the conversation means is audio or video, the conversation processor 32b performs a conversation volume adjustment process for adjusting the volume of the conversation depending on the distance between the first avatar A1 and the second avatar A2.

[0054] The customer service status determination unit 32c uses the first information If1 to determine whether the salesperson user P1 is serving a customer who is actually visiting the first space RS1 in the first space RS1. When it is determined that the salesperson user P1 is serving a customer, the customer service status determination unit 32c causes the display content of the display data to be displayed on the customer terminal 21 to include an indication that the first avatar A1 is serving a customer.

[0055] The photographing instruction unit 32d outputs an instruction to the photographing device 13 in response to a request from the customer terminal 21. The instruction to the photographing device 13 includes an instruction to transmit the photographing information Iv generated by the photographing device 13. In addition, when the photographing device 13 can be remotely controlled, the instruction to the photographing device 13 includes an instruction to move the photographing device 13 based on the operation information Io included in the second information If2.

[0056] The trial execution unit 32e performs a process of having the second avatar A2 try out a product in response to a request from the customer terminal 21. Trialing out a product includes, for example, trying on a product such as clothing or an accessory, or test-driving a product such as a vehicle.

[0057] The display data generating unit 32f generates display data that specifies the display contents on the customer terminal 21. The display data is data for displaying an image of the virtual space VS and a first status display, which is a display showing the status of the first space RS1, on the customer terminal 21. The first status display is a display showing the status of the first space RS1 at that time, and includes images in the first space RS1, such as images of the salesperson user P1 and products, and a display showing the work status, such as the customer service status of the salesperson user P1.

[0058] The storage unit 33 has a configuration including a non-volatile memory, and stores programs and data necessary for the processing executed by the control unit 32. Specifically, the storage unit 33 stores virtual space data 33a which is data used to generate the virtual space VS.

[0059] The virtual space data 33a includes data of a basic space having an arrangement of structures simulating the first space RS1, and data of objects moving within the virtual space VS. The basic space is a virtual space including exhibits such as products, display stands and shelves for exhibits, pillars, walls, and other fixed objects. The basic space only needs to mimic the first space RS1 so that the movement path of a person in the first space RS1 can be reproduced, and the arrangement of structures in the first space RS1 and the basic space does not need to be completely the same. For example, the basic space only needs to have a floor plan that matches the first space RS1, i.e., an arrangement of corridors that matches the first space RS1, and the arrangement of exhibits in the basic space does not need to be completely the same as the first space RS1.

[0060] The data of the basic space includes, for example, information on a three-dimensional orthogonal coordinate system set for the basic space, position information of the fixed object, data that associates the position of the basic space with the position of the first space RS1, and data for drawing the basic space. The data of the objects includes data for drawing the first avatar A1 and the second avatar A2.

[0061] The functions of each part in the control unit 32 may be realized by various hardware such as multiple CPUs and memories such as RAM and the like, and software that operates them, or may be realized by software that gives multiple functions to a single common piece of hardware. Such software is stored in the storage unit 33 as a virtual space providing program.

[0062] [Virtual space provision system operation] The operation of the virtual space providing system 100 will be described with reference to Figures 3 to 15. The functions of the virtual space providing system 100 include a basic function, a conversation function, a customer service status display function, an indoor photography function, and a trial function. The operation of the virtual space providing system 100 for each function will be described below in order.

[0063] <Basic functions> The basic functions are the placement and movement of avatars A1 and A2 in the virtual space VS, and the display of this virtual space VS on the customer terminal 21.

[0064] 3, the position information collecting device 11 acquires position identification information Ip and transmits it to the information processing server 30 (step S10). Upon receiving the position identification information Ip, the virtual space generating unit 32a of the information processing server 30 uses the virtual space data 33a to set the position of the first avatar A1 to a position in the virtual space VS corresponding to the position of the first space RS1 identified based on the position identification information Ip (step S11).

[0065] As a result, the position of the first avatar A1 is set so that the positional relationship of the salesperson user P1 to the structures in the first space RS1 corresponds to the positional relationship of the first avatar A1 to the structures in the virtual space VS. By repeating the processes of steps S10 and S11 at predetermined intervals, the position of the first avatar A1 in the virtual space VS changes according to the movement of the salesperson user P1 in the first space RS1.

[0066] On the other hand, when the customer user P2 performs a predetermined operation on the customer terminal 21 to request the display of a virtual store, a request to display the virtual space VS is transmitted from the customer terminal 21 to the information processing server 30 (step S12). The predetermined operation is, for example, an operation of selecting a predetermined area on a screen displayed by starting a shopping application for the virtual store on the customer terminal 21.

[0067] When receiving the request from the customer terminal 21, the virtual space generating unit 32a of the information processing server 30 uses the virtual space data 33a to set the position of the second avatar A2 at a predetermined position in the virtual space VS (step S13). The predetermined position is, for example, a position corresponding to the entrance of the virtual store.

[0068] The display data generating unit 32f of the information processing server 30 generates display data using the virtual space data 33a and the position information of the avatars A1 and A2 set by the virtual space generating unit 32a. The display data is transmitted from the communication unit 31 to the customer terminal 21 (step S14).

[0069] Upon receiving the display data, the customer terminal 21 displays an image based on the display data on the display unit. As a result, the basic screen 200 is displayed on the customer terminal 21 (step S15). That is, the display data generated by the processing of step S14 using the basic function is data for displaying the basic screen 200. FIG. 4 shows an example of the basic screen 200. The basic screen 200 is a screen for the customer user P2 to look around at products in the virtual space VS by moving the second avatar A2.

[0070] When the customer user P2 performs various operations on the basic screen 200, instruction information Is is input to the customer terminal 21, and the instruction information Is is transmitted from the customer terminal 21 to the information processing server 30 (step S16). Specifically, for example, by dragging on the basic screen 200, information instructing the movement direction and movement amount of the second avatar A2 is input to the customer terminal 21 as instruction information Is.

[0071] Upon receiving the instruction information Is, the virtual space generation unit 32a of the information processing server 30 changes the configuration of the virtual space VS in accordance with the instruction information Is (step S17). Specifically, the virtual space generation unit 32a changes the position of the second avatar A2 in accordance with the instruction information Is.

[0072] The display data generating unit 32f generates display data using the information changed by the virtual space generating unit 32a, and the display data is transmitted from the communication unit 31 to the customer terminal 21 (step S18).

[0073] The customer terminal 21 displays an image based on the display data on the display unit, so that the change according to the instruction information Is is reflected on the basic screen 200 (step S19). Specifically, the position of the second avatar A2 moves.

[0074] The basic screen 200 will be described in detail with reference to Fig. 4. The basic screen 200 includes a virtual area 210 in which an image of the virtual space VS is displayed, and an operation area 220 in which operations for changing various settings and using functions are accepted. The image in the virtual area 210 may be an image of the virtual space VS viewed from a viewpoint set around the second avatar A2, such as behind the second avatar A2, or an image of the virtual space VS viewed from the viewpoint of the second avatar A2. In addition, these viewpoints may be switchable.

[0075] At the location where the product Gd is located in the virtual area 210, a product display 211 showing information about the product is located. The information about the product is, for example, a description of the product or an evaluation from a purchaser of the product. The product display 211 may be displayed when the location where the product Gd is located is selected. The product display 211 may be a component of the virtual space VS. Alternatively, the product display 211 does not have to be a component of the virtual space VS, and the display data may be configured so that the product display 211 is displayed at a specific location in the image of the virtual space VS. Data required for drawing the product display 211 is stored in advance in the storage unit 33.

[0076] Also, by selecting any part in the virtual area 210, the part may be enlarged and displayed. By displaying a wide range of the virtual space VS, performing an operation for moving the second avatar A2, and performing an operation for selecting the product Gd in the enlarged display, each operation can be performed efficiently. Such display switching may be performed by the customer terminal 21 without transmitting or receiving information to or from the information processing server 30, by the customer terminal 21 generating data from the display data. Alternatively, the display may be switched based on the information instructing the display switching being included in the instruction information Is and being sent from the customer terminal 21 to the information processing server 30, and the display being switched based on the display data in which the change according to the instruction information Is is reflected being received by the customer terminal 21 from the information processing server 30.

[0077] If the salesperson terminal 12 has an image display function, the image of the virtual space VS may also be displayed on the salesperson terminal 12. In other words, in response to a request from the salesperson terminal 12, the information processing server 30 may transmit data for displaying the image of the virtual space VS to the salesperson terminal 12.

[0078] <Conversation feature> The conversation function is a function that realizes a conversation between a salesperson user P1 and a customer user P2. For example, the conversation function is used when the customer user P2 wants to ask the salesperson user P1 a question about a product. First, the basic operation of the virtual space providing system 100 in the conversation function will be described.

[0079] 5, when the customer user P2 performs a predetermined operation on the customer terminal 21 to request a conversation with the first avatar A1, a conversation request for the selected first avatar A1 is transmitted from the customer terminal 21 to the information processing server 30 (step S20). The predetermined operation is, for example, an operation of selecting the first avatar A1 displayed on the basic screen 200 and an area for instructing the start of a conversation. By selecting the first avatar A1, an introduction to the salesperson user P1 corresponding to the first avatar A1 may be displayed on the basic screen 200.

[0080] When receiving a request from the customer terminal 21, the conversation processing unit 32b of the information processing server 30 calls the salesperson terminal 12 of the salesperson user P1 corresponding to the targeted first avatar A1 via the communication unit 31 (step S21). As a result, the salesperson terminal 12 is notified of the incoming call by voice or vibration. Note that the first avatar A1 and the salesperson terminal 12 may be associated with each other in advance by the information processing server 30.

[0081] When the salesperson user P1 performs an operation to respond to the call on the salesperson terminal 12 (step S22), a conversation execution process is performed in each of the customer terminal 21, the salesperson terminal 12, and the information processing server 30 (steps S23, S24, S25).

[0082] That is, the first conversation information Ic1 inputted to the salesperson terminal 12 is transmitted to the customer terminal 21 via the information processing server 30, and output based on the first conversation information Ic1 is performed at the customer terminal 21. In addition, the second conversation information Ic2 inputted to the customer terminal 21 is transmitted to the salesperson terminal 12 via the information processing server 30, and output based on the second conversation information Ic2 is performed at the salesperson terminal 12. In this way, a utterance inputted in the form of text, audio, or video at one terminal is outputted at the other terminal, and a conversation is established between the salesperson user P1 and the customer user P2.

[0083] In this way, the conversation execution process by the conversation processing unit 32b includes a process of instructing the communication unit 31 to transmit the first conversation information Ic1 received from the salesperson terminal 12 to the customer terminal 21, and to transmit the second conversation information Ic2 received from the customer terminal 21 to the salesperson terminal 12.

[0084] Before a conversation between the salesperson user P1 and the customer user P2 is established, the customer user P2 performs operations on the avatars A1 and A2, such as selecting the first avatar A1 to be the conversation target and moving the second avatar A2 to the area where the first avatar A1 is located. During the conversation between the salesperson user P1 and the customer user P2, it is preferable that a display indicating that the first avatar A1 or the second avatar A2 is speaking is displayed on the customer terminal 21. In this way, the first avatar A1 and the second avatar A2 are involved in the conversation between the salesperson user P1 and the customer user P2 with respect to operations or displays related to the conversation.

[0085] The mode of starting the conversation is not limited to the mode in which the information processing server 30 calls the salesperson terminal 12 upon receiving a request from the customer terminal 21. For example, the information processing server 30 may receive a reservation for the conversation time and order from the customer terminal 21, and the conversation execution process may be started in each of the customer terminal 21, the salesperson terminal 12, and the information processing server 30 according to the reservation.

[0086] Specifically, the storage unit 33 of the information processing server 30 stores reservation data consisting of a table including a reservation person and a reservation time, and information based on the reservation data is transmitted from the information processing server 30 to the customer terminal 21, and the reservation status of the conversation with the salesperson user P1 can be confirmed at the customer terminal 21. When the customer user P2 specifies an available time in the reservation status, a reservation request is transmitted from the customer terminal 21 to the information processing server 30, and the conversation processing unit 32b registers the reservation of the specified time in the reservation data as a reservation of a conversation with the salesperson user P1 by the customer user P2. Then, the conversation starts according to the reservation in the reservation data. In this way, if the conversation reservation is possible, when the customer user P2 wants to talk with the salesperson user P1, even if the salesperson user P1 is busy serving a customer and cannot respond immediately, the time for the conversation can be secured in advance. Therefore, convenience for the customer user P2 is improved.

[0087] Alternatively, the conversation may be started based on the information processing server 30 calling the customer terminal 21 upon receiving a request from the salesperson terminal 12. Alternatively, the conversation means may be selectable on the customer terminal 21 or the salesperson terminal 12.

[0088] 6 and 7 show an example of a conversation screen 201 displayed on the customer terminal 21 during the conversation execution process when the conversation means is a video. In addition to the virtual area 210 and the operation area 220 described above, the conversation screen 201 includes a video area 230 in which a video of the salesperson user P1 during a conversation captured by the salesperson terminal 12 is displayed. The video displayed in the video area 230 is an example of a first status display 300 that is a display showing the status of the first space RS1. In this case, the first status display 300 shows the status of the first space RS1 based on the first conversation information Ic1 of the first information If1. The first conversation information Ic1 is composed of video data.

[0089] By displaying the image of the salesperson user P1 during the conversation, the customer user P2 can feel as if he or she is having a face-to-face conversation while communicating through the virtual space VS. Therefore, the activity in the virtual space VS can be more easily connected to reality.

[0090] 6, in the conversation screen 201, the virtual area 210 and the video area 230 may be arranged so that the virtual area 210 is the main area and the video area 230 is superimposed on a part of the virtual area 210. Conversely, as shown in Fig. 7, the virtual area 210 and the video area 230 may be arranged so that the video area 230 is the main area and the virtual area 210 is superimposed on a part of the video area 230. Also, it may be possible to select which of the virtual area 210 and the video area 230 is the main area.

[0091] In either case, the virtual area 210 and the video area 230 are simultaneously displayed on one screen. That is, while the conversation execution process is being performed, the display data generating unit 32f of the information processing server 30 generates data for displaying the virtual area 210 and the video area 230 on one screen as display data for displaying the conversation screen 201, and transmits the data to the customer terminal 21 via the communication unit 31. In this case, the first conversation information Ic1 is included in the display data and transmitted to the customer terminal 21 based on an instruction from the conversation processing unit 32b.

[0092] By simultaneously displaying the virtual area 210 and the video area 230 on one screen, the customer user P2 can get the feeling of shopping in the virtual space VS and the feeling close to a conversation in the real space at the same time. Therefore, by combining these feelings, the customer user P2 can get a feeling closer to an experience in the real space as a feeling obtained by an activity in the virtual space VS. Therefore, the connection with reality becomes easier to feel.

[0093] In addition, when the conversation means is a video, the salesperson terminal 12 may display only the video of the customer user P2 captured by the customer terminal 21, or may display the video of the customer user P2 and an image of the virtual space VS.

[0094] Next, a conversation possibility determination process by the conversation processing unit 32b will be described. In the conversation function, whether or not a conversation can be held may be determined according to the distance between the first avatar A1 and the second avatar A2. In this case, upon receiving a conversation request from the customer terminal 21 by the process of step S20 in FIG. 5, the conversation processing unit 32b performs a conversation possibility determination process.

[0095] 8 shows the procedure of the conversation determination process. In the conversation determination process, the conversation processing unit 32b first calculates the distance L between the first avatar A1 and the second avatar A2 in the virtual space VS as the process of step S30.

[0096] Next, in step S31, the conversation processing unit 32b determines whether the distance L is equal to or smaller than a predetermined threshold. The predetermined threshold is set to a distance at which a conversation between two people is possible when converted into a distance within the first space RS1.

[0097] If the distance L is equal to or less than the threshold (positive determination in step S31), the conversation processing unit 32b determines to permit the conversation as the process of step S32, and ends the conversation permission determination process. If the conversation is permitted, the conversation processing unit 32b proceeds with the process of step S21 and subsequent steps in FIG. 5.

[0098] If the distance L exceeds the threshold (negative determination in step S31), the conversation processing unit 32b determines not to permit the conversation as the process of step S33, and ends the conversation permission determination process. If the conversation is not permitted, the conversation processing unit 32b notifies the customer terminal 21 via the communication unit 31 that the distance between the avatars is too far to permit the conversation, and such a notification is displayed on the customer terminal 21.

[0099] According to the above configuration, if the customer user P2 wants to talk to the salesperson user P1, the second avatar A2 needs to be moved closer to the first avatar A1. Also, if the customer user P2 wants to avoid being talked to by the salesperson user P1, the second avatar A2 can be moved farther away from the first avatar A1. In this way, the distance between the avatars affects whether or not a conversation can take place, just as the distance between a customer and a salesperson in a real store affects whether or not a conversation can take place. Therefore, the customer user P2 can get a feeling in the activities in the virtual space VS that is closer to the experience in the real space.

[0100] Next, a conversation volume adjustment process by the conversation processor 32b will be described. When the conversation means is audio or video, the conversation function may adjust the conversation volume according to the distance between the first avatar A1 and the second avatar A2. In this case, the conversation processor 32b performs a conversation volume adjustment process prior to the conversation execution process.

[0101] 9 shows a part of the process flow of the virtual space providing system 100 when a conversation volume adjustment process is performed. In the conversation volume adjustment process, the conversation processing unit 32b first calculates the distance L between the first avatar A1 and the second avatar A2 (step S40). Then, the conversation processing unit 32b sets the conversation volume according to the distance L (step S41). In detail, the conversation processing unit 32b sets the conversation volume lower as the distance L increases.

[0102] Thereafter, the conversation processor 32b proceeds with the conversation execution process at the set conversation volume. That is, when the first conversation information Ic1 input to the salesperson terminal 12 is transmitted (step S42), the conversation processor 32b transmits the first conversation information Ic1 to the customer terminal 21 via the communication unit 31 together with an instruction to output the sound at the set conversation volume (step S43). In this case, the first conversation information Ic1 is composed of voice data or includes voice data as part of the video data. As a result, in the customer terminal 21, the speech of the salesperson user P1 is output at the set conversation volume based on the first conversation information Ic1 (step S44).

[0103] According to the above configuration, the distance between the avatars affects the volume of the conversation in the same way that the distance between a customer and a salesperson affects the volume of the conversation in a real store. Therefore, the customer user P2 can get a sense of activity in the virtual space VS that is closer to the experience in the real space.

[0104] The conversation volume adjustment process is performed at a predetermined interval after the conversation execution process is started, or is performed every time the first conversation information Ic1 is transmitted to the customer terminal 21, so that when the distance L between the avatars changes during a conversation, the conversation volume changes accordingly. This allows the customer user P2 to obtain a sensation closer to the experience in the real space. The conversation volume at the salesperson terminal 12 may be changed according to the distance L between the first avatar A1 and the second avatar A2, similar to the customer terminal 21, or may be constant.

[0105] <Customer service status display function> The customer service status display function is a function that reflects the customer service status of the salesperson user P1 in the first space RS1 in the display of the first avatar A1. Since the salesperson user P1 also serves customers who actually visit the first space RS1, when the salesperson user P1 is serving customers in the first space RS1, the salesperson user P1 cannot respond to a request for conversation from the customer user P2 through the virtual space VS. The customer service status display function allows the customer user P2 to easily grasp whether the salesperson user P1 using the first avatar A1 in the virtual space VS is available to serve customers.

[0106] 10 shows a procedure of processing by the information processing server 30 in the customer service status display function. First, in the processing of step S50, the communication unit 31 of the information processing server 30 receives, from the first device 10, determination information Ij that is information capable of determining the customer service status of the salesperson user P1. Upon receiving the determination information Ij, in the processing of step S51, the customer service status determination unit 32c of the information processing server 30 determines, based on the determination information Ij, whether or not the salesperson user P1 is serving a customer in the first space RS1.

[0107] For example, if the position information collecting device 11 includes a camera, and the salesperson user P1 is identified by analyzing a captured image when the position of the salesperson user P1 is specified using the position identification information Ip, whether another person is located within a predetermined range from the salesperson user P1 is determined by analyzing the same image. In this case, the information output from the position information collecting device 11 functions as the determination information Ij. The determination information Ij is included in the first information If1. The above-mentioned predetermined range is set to a range in which the other person is assumed to be located when the salesperson user P1 and the other person are talking. The customer service status determining unit 32c determines that the salesperson user P1 is serving a customer when another person is located within a predetermined range from the salesperson user P1.

[0108] If it is determined that the salesperson user P1 is serving a customer (positive determination in step S51), in the process of step S52, the display data generating unit 32f generates display data for displaying the basic screen 200 including a serving-customer display indicating that the first avatar A1 is serving a customer. The basic screen 200 based on this display data is displayed on the customer terminal 21, whereby the serving-customer display is displayed on the customer terminal 21 together with the image of the virtual space VS.

[0109] If it is determined that the salesperson user P1 is not serving a customer (a negative determination in step S51), in the process of step S53, the display data generating unit 32f generates display data for displaying the basic screen 200 that does not include the "serving a customer" display.

[0110] Fig. 11 shows an example of the basic screen 200 including a serving customer display 212. In Fig. 11, a third avatar A3, which is different from the first avatar A1 and the second avatar A2, is placed near the first avatar A1, and a display is provided between the first avatar A1 and the third avatar A3 indicating that they are in conversation. This display indicating that the first avatar A1 is in conversation with the third avatar A3 is the serving customer display 212.

[0111] The serving display 212 is not limited to the above example, and may be, for example, a tag indicating that the first avatar A1 is serving a customer, or a color of the first avatar A1 is changed. The serving display 212 may be displayed in association with the first avatar A1. The serving display 212 has a function of indicating that the first avatar A1 is serving a customer and indicating that the salesperson user P1 is serving a customer in the first space RS1. The serving display 212 may be a component of the virtual space VS, or the display data may be configured so that the serving display 212 is displayed near the first avatar A1, rather than being a component of the virtual space VS. Data required for drawing the serving display 212 is stored in the storage unit 33 in advance.

[0112] The customer user P2 can easily understand that the salesperson user P1 corresponding to the first avatar A1 is unable to respond to a conversation request by the serving customer display 212. This allows the customer user P2 to adjust the timing of speaking to the first avatar A1, and can efficiently proceed with activities in the virtual space VS.

[0113] In addition, the customer user P2's customer service status in the first space RS1 is displayed in the virtual space VS by the customer service display 212, so that the customer user P2 can easily perceive that the first avatar A1 is not a character that serves customers only in the virtual space VS, but an alter ego of a salesperson who actually serves customers in a store in the real space. Therefore, the customer user P2 can easily feel a connection with reality in the activities in the virtual space VS.

[0114] In addition, since the image of the virtual space VS and the customer service display 212 are displayed simultaneously on one screen, the connection between the activities in the virtual space VS and reality becomes more noticeable. The serving customer display 212 is an example of the first status display 300, which is a display showing the status of the first space RS1, and is also a display showing the working status of the salesperson user P1. In this case, the first status display 300 shows the status of the first space RS1 based on the determination information Ij.

[0115] In addition, the determination of whether the salesperson user P1 is serving a customer may be made based on information output by any device included in the first device 10, not limited to information output by the position information collection device 11. In other words, the determination information Ij does not have to be information output by the position information collection device 11 as long as it is information output by the first device 10.

[0116] For example, when the salesperson user P1 starts serving a customer in the first space RS1, the salesperson user P1 performs a predetermined operation on the salesperson terminal 12. As a result, information indicating that the salesperson user P1 is serving a customer is transmitted as determination information Ij from the salesperson terminal 12 to the information processing server 30. Based on receiving the information, the customer service status determination unit 32c determines that the salesperson user P1 is serving a customer.

[0117] Furthermore, not only when the salesperson user P1 is serving a customer who has visited the first space RS1, but also when the salesperson user P1 is on the phone, for example, the customer service status determination unit 32c may determine that the salesperson user P1 is serving a customer and display the serving display 212. For example, when the salesperson user P1 answers the phone, the salesperson user P1 performs a predetermined operation on the salesperson terminal 12. As a result, determination information Ij is transmitted from the salesperson terminal 12 to the information processing server 30, and the customer service status determination unit 32c determines that the salesperson user P1 is serving a customer.

[0118] In addition, not only when the salesperson user P1 is serving a customer, but also when the salesperson user P1 is unable to respond to a request for conversation through the virtual space VS due to work in the first space RS1, a display indicating that the salesperson user P1 is in a state where he / she is unable to respond to the request for conversation may be displayed on the customer terminal 21 as the first status display 300. Such a display is also included in the display indicating the work status of the salesperson user P1.

[0119] <Indoor shooting function> The indoor photography function is a function for taking an image in the first space RS1, such as an image of a product, and displaying it on the customer terminal 21. The indoor photography function is used, for example, when the customer user P2 wants to check the actual color or shape of the product.

[0120] 12, when the customer user P2 performs a predetermined operation on the customer terminal 21 to request shooting within the first space RS1, the request for shooting is transmitted from the customer terminal 21 to the information processing server 30 (step S60). The predetermined operation is, for example, an operation of selecting an area displayed on the basic screen 200 for which shooting is to be instructed.

[0121] Upon receiving a request from the customer terminal 21, the photography instruction unit 32d of the information processing server 30 outputs a photography instruction to the photography device 13. The photography instruction is sent from the communication unit 31 to the photography device 13 (step S61). Upon receiving the photography instruction, the photography device 13 performs photography processing (step S62). The photography processing includes a process of generating photography information Iv by photographing within the first space RS1 and transmitting the photography information Iv to the information processing server 30.

[0122] When the photographing device 13 can be remotely operated, operation information Io is input to the customer terminal 21, and the operation information Io is transmitted from the customer terminal 21 to the information processing server 30. In this case, the photographing instruction unit 32d outputs a photographing instruction including an instruction for a movement according to the operation information Io. The photographing process of the photographing device 13 includes changing the position and orientation according to the instruction from the information processing server 30.

[0123] For example, an image of the virtual space VS displayed on the customer terminal 21 includes a display showing the position of the camera device 13, and information indicating the direction and amount of movement of the camera device 13 is input as operation information Io to the customer terminal 21 by an operation such as dragging on this display. The position of the camera device 13 may be determined by analysis of a similar image, for example, when the position of the salesperson user P1 is determined by analysis of an image taken by the position information collecting device 11. Alternatively, the camera device 13 may have a function of acquiring its own position information and transmitting it to the information processing server 30, and the position of the camera device 13 may be determined based on the position information from the camera device 13 and reflected in the display on the customer terminal 21.

[0124] When the information processing server 30 receives the photographing information Iv from the photographing device 13, the display data generating unit 32f of the information processing server 30 generates display data for displaying the observation screen 202 including the image photographed by the photographing device 13. The display data is transmitted from the communication unit 31 to the customer terminal 21 (step S63). Upon receiving the display data, the customer terminal 21 displays an image based on the display data on the display unit, whereby the observation screen 202 is displayed on the customer terminal 21 (step S64).

[0125] 13 shows an example of the observation screen 202. In addition to the virtual area 210 and the operation area 220, the observation screen 202 includes a shooting area 240 in which an image captured by the image capturing device 13 is displayed. The image displayed in the shooting area 240 is an example of a first status display 300 that is a display showing the status of the first space RS1. In this case, the first status display 300 shows the status of the first space RS1 based on the shooting information Iv of the first information If1.

[0126] In the observation screen 202, as shown in FIG. 13, the virtual area 210 and the photographing area 240 may be arranged so that the virtual area 210 is mainly arranged and the photographing area 240 is overlapped on a part of the virtual area 210. Alternatively, the virtual area 210 and the photographing area 240 may be arranged so that the photographing area 240 is mainly arranged and the virtual area 210 is overlapped on a part of the photographing area 240. Also, it may be possible to select which of the virtual area 210 and the photographing area 240 is mainly arranged. In either case, the virtual area 210 and the photographing area 240 are displayed simultaneously on one screen. That is, the display data for displaying the observation screen 202 is data for displaying the virtual area 210 and the photographing area 240 on one screen.

[0127] The image captured by the photographing device 13 is displayed on the customer terminal 21, allowing the customer user P2 to check the color and shape of the product. Therefore, the customer user P2 can select the product to purchase while referring to the appearance of the product. This allows the customer user P2 to select an appropriate product and obtain a feeling similar to that of viewing and selecting a product in real space. Therefore, the customer user P2 can easily feel a connection with reality in the activities in the virtual space VS.

[0128] Furthermore, if the photographing device 13 can be remotely controlled, the customer user P2's intention is more strongly reflected in the image displayed in the photographing area 240. Therefore, it becomes easier to select products according to the customer user P2's intention, and the customer user P2 can get a feeling closer to selecting products in real space.

[0129] In addition, by simultaneously displaying the virtual area 210 and the photographing area 240 on one screen, the customer user P2 can get the feeling of shopping in the virtual space VS and the feeling of selecting a product in the real space at the same time. Therefore, by combining these sensations, the customer user P2 can get a sensation closer to the experience in the real space as the sensation obtained by the activity in the virtual space VS. Therefore, the connection with reality becomes easier to feel.

[0130] In addition, when the photographing device 13 can be remotely operated, the use of the photographing device 13 may be reserved. This increases convenience for the customer user P2. Specifically, the storage unit 33 of the information processing server 30 stores reservation data consisting of a table including a reservation person and a reservation time, and the customer terminal 21 can check the reservation status of the use of the photographing device 13 based on information based on the reservation data transmitted from the information processing server 30 to the customer terminal 21. When the customer user P2 specifies an available time in the reservation status, a reservation request is transmitted from the customer terminal 21 to the information processing server 30, and the photographing instruction unit 32d registers the reservation of the specified time in the reservation data as a reservation for the use of the photographing device 13 by the customer user P2. Then, the use of the photographing device 13 is started according to the reservation in the reservation data.

[0131] <Trial function> The trial function is a function for virtually testing a product. 14, when the customer user P2 performs a predetermined operation on the customer terminal 21 to request a trial of a product, the trial request is transmitted from the customer terminal 21 to the information processing server 30 (step S70). The predetermined operation is, for example, an operation of selecting a product displayed on the basic screen 200 and an area for instructing the trial.

[0132] When receiving a request from the customer terminal 21, the trial execution unit 32e of the information processing server 30 performs trial processing (step S71). For example, if the product is clothing or an accessory, the trial processing is processing for generating data in which the second avatar A2 corresponding to the customer user P2 wears the product, and if the product is a vehicle, the trial processing is processing for generating data in which the second avatar A2 is riding on the product. Alternatively, the trial processing may be processing for generating data in which the second avatar A2 holds the product, or in short, it may be processing for generating data in which the second avatar A2 tries on the selected product.

[0133] Next, the display data generation unit 32f of the information processing server 30 uses the data generated by the trial execution unit 32e to generate display data for displaying the trial screen 203 including an image of the second avatar A2 trying out the product (step S72).

[0134] Upon receiving the display data, the customer terminal 21 displays an image based on the display data on the display unit, whereby the trial screen 203 is displayed on the customer terminal 21 (step S73). 15 shows an example of the trial screen 203. The trial screen 203 includes an operation area 220 and a trial area 250 in which a second avatar A2 trying out a product Gd is displayed.

[0135] The background of the trial area 250 may be an image of the virtual space VS, or may be an image different from the virtual space VS. In addition, if the customer terminal 21 has a photographing function, the background of the trial area 250 may be an image of the second space RS2 photographed by the customer terminal 21. In other words, the trial function may utilize augmented reality (AR).

[0136] By displaying an image of the second avatar A2 trying out the product Gd, the customer user P2 can easily imagine how the product would look when used by the customer user P2, or how well balanced it would look when multiple products are used in combination. Even if it is difficult to try out a product in a real-world store, such as a vehicle, the customer user P2 can easily imagine how the product would look when used by the second avatar A2 by having the second avatar A2 try out the product. When AR is used, it is easy to imagine how the product Gd would look when used in the second space RS2. Therefore, an accurate decision can be made regarding the selection of a product to purchase. When AR is used, the second avatar A2 may not be displayed, and only the product Gd may be displayed.

[0137] When the customer user P2 decides on the product to purchase, a payment process is performed. The payment process may be performed by the information processing server 30, or may be performed by a server of an EC site operated by the store in the first space RS1 in cooperation with the virtual space providing system 100.

[0138] As described above, according to this embodiment, the following effects can be obtained. (1) An image of the virtual space VS and a first status display 300 showing the status of the first space RS1 are displayed on the customer terminal 21. Therefore, compared to a case where only an image of the virtual space VS is displayed and the first status display 300 is not displayed, the customer user P2 is more likely to feel a connection with reality in the activities in the virtual space VS. As a result, even if it is difficult for the customer user P2 to go to the first space RS1, the activities in the virtual space VS can give the customer user P2 a feeling similar to the activities in the first space RS1. Therefore, when the virtual space providing system 100 is used to sell products, it is possible to increase the purchasing motivation of the customer user P2.

[0139] (2) The first conversation information Ic1 is composed of video data, and the first situation display 300 includes a display of an image of the salesperson user P1 engaged in a conversation based on the first conversation information Ic1. This allows the customer user P2 to feel a sense of being close to a face-to-face conversation in the conversation with the salesperson user P1 through the virtual space VS. Therefore, the customer user P2 can easily feel a connection with reality in the activities in the virtual space VS.

[0140] (3) The greater the distance between the first avatar A1 and the second avatar A2, the smaller the volume of the sound output from the customer terminal 21 based on the first conversation information Ic1 is set. This allows the distance between the avatars to affect the volume of the conversation in the same way that the distance between a customer and a salesperson affects the volume of the conversation in a real store. Therefore, the customer user P2 can get a feeling in the activity in the virtual space VS that is closer to the experience in the real space.

[0141] (4) Whether or not a conversation can take place is determined according to the distance between the first avatar A1 and the second avatar A2, and a process of establishing a conversation is performed when the distance is equal to or less than a predetermined value. In this way, the distance between the avatars affects whether or not a conversation can take place, in the same way that the distance between a customer and a salesperson in a real store affects whether or not a conversation can take place. Therefore, the customer user P2 can get a feeling in the activities in the virtual space VS that is closer to the experience in the real space.

[0142] (5) The first status display 300 includes a serving display 212 indicating that the salesperson user P1 is serving customers in the first space RS1. This allows the customer user P2 to easily grasp whether the salesperson user P1 is in a situation where he or she can respond to a request for conversation, and therefore allows the customer user P2 to adjust the timing of speaking to the first avatar A1, and thus allows the customer user P2 to efficiently proceed with activities in the virtual space VS. In addition, the customer user P2 can easily sense that the first avatar A1 is not a character that serves customers only in the virtual space VS, but an alter-ego of a salesperson who actually serves customers in a store in the real space. Therefore, the customer user P2 can easily feel a connection to reality in activities in the virtual space VS.

[0143] (6) The first status display 300 includes an image in the first space RS1 based on the photographed information Iv. This allows the customer user P2 to check the color and shape of the product and select the product to purchase. This allows the customer user P2 to select the appropriate product and to get a feeling similar to that of looking at and selecting a product in the real space. This makes it easier to feel a connection with reality in the activities in the virtual space VS.

[0144] (7) The photographing device 13 is configured to be movable within the first space RS1, and instructions for movement according to operation information Io from the customer terminal 21 are transmitted from the information processing server 30 to the photographing device 13. This allows the customer user P2 to remotely control the photographing device 13, so that the customer user P2's intention is more strongly reflected in the image of the first space RS1 displayed on the customer terminal 21. This makes it easier for the customer user P2 to select products in line with his or her intention, and the customer user P2 can obtain a feeling closer to selecting products in real space.

[0145] (8) In the customer terminal 21, an image of the virtual space VS and the first status display 300 are displayed on one screen. This allows the customer user P2 to get the feeling of being active in the virtual space VS and a feeling close to an experience in real space at the same time. Therefore, by combining these sensations, the sensation obtained from the activity in the virtual space VS can be closer to an experience in real space. Therefore, the connection with reality is more easily felt in the activity in the virtual space VS.

[0146] [Variations] The above embodiment can be modified and implemented as follows. The image of the virtual space VS and the first status display 300 do not have to be displayed on a single screen in the customer terminal 21. For example, the virtual area 210 and the video area 230 in which the video of the salesperson user P1 is displayed and the photographing area 240 in which the image photographed by the photographing device 13 is displayed, which are the first status display 300, may be displayed in a switching manner. Even with this configuration, the customer user P2 can more easily feel a connection with reality, compared to a configuration in which only the image of the virtual space VS is displayed and the first status display 300 is not displayed.

[0147] The virtual space providing system 100 does not need to have all of the functions described in the above embodiment. The virtual space providing system 100 may be a system that enables communication between a salesperson user P1 and a customer user P2 through conversation mediated by an avatar, and that displays an image of the virtual space VS and at least one first status display 300 on the customer terminal 21.

[0148] The virtual space generating unit 32a of the information processing server 30 may place avatars corresponding to customers who are actually visiting the first space RS1 in the virtual space VS. The positions of the customers are identified, for example, based on the analysis of images captured by the position information collecting device 11, and reflected in the positions of the avatars in the virtual space VS. With this configuration, the customer user P2 can know how busy the store in the first space RS1 is, popular products, etc., based on the number and positions of the avatars corresponding to the customers in the first space RS1 in the virtual space VS.

[0149] The virtual space generation unit 32a of the information processing server 30 may control the number of avatars in the virtual space VS within a predetermined range. For example, if the number of avatars corresponding to customers is too small, the customer user P2 will not feel lively, whereas if the number of avatars corresponding to customers is too large, the virtual space VS will be crowded, making it difficult for the customer user P2 to move the second avatar A2 or select a product. If the number of avatars in the virtual space VS is controlled to a certain degree, the occurrence of these problems can be suppressed. For example, the virtual space generation unit 32a may keep the number of avatars in the virtual space VS within a predetermined range by placing avatars corresponding to a portion of the customers in the first space RS1 in the virtual space VS. Alternatively, the virtual space generation unit 32a may increase the number of avatars in the virtual space VS to within a predetermined range by placing avatars of customers who do not exist in the first space RS1 in the virtual space VS.

[0150] After the basic screen 200 is displayed, when the first avatar A1 and the second avatar A2 move within the virtual space VS, only the position information of the avatars A1 and A2 is exchanged between the information processing server 30 and the customer terminal 21, and the process of generating an image of the virtual space VS that reflects the change in the positions of the avatars A1 and A2 may be performed by the customer terminal 21. In other words, the information processing server 30 manages the changes in the position information of the avatars A1 and A2, and the movement of the avatars A1 and A2 is performed by the customer terminal 21.

[0151] In this case, the first avatar A1 moves based on information indicating the new position of the first avatar A1 transmitted from the information processing server 30 to the customer terminal 21 based on the position identification information Ip, and the second avatar A2 moves based on instruction information Is input to the customer terminal 21. In this embodiment, the customer terminal 21 functions as a virtual space generation unit that moves the avatars A1 and A2 within the virtual space VS. In this case, the customer terminal 21 may also assume part of the function of generating display data. That is, the control unit 32 of the information processing server 30 and the customer terminal 21 may function as a display data generation unit.

[0152] The use of the virtual space providing system 100 is not limited to the sale of products. In other words, the first space RS1 does not have to be a space within a store, the first user does not have to be a salesperson, and the second user does not have to be a customer. It is sufficient that the second user's avatar can carry out the same type of activity as that carried out in the first space RS1 in the virtual space VS together with the first user's avatar that actually exists in the first space RS1. For example, the first space RS1 may be an office or a tourist spot.

[0153] In particular, the virtual space providing system 100 is preferably used to provide a service using exhibits. The exhibits are not particularly limited as long as they are placed in the first space RS1 and used to provide a service, such as products to be bought and sold, product samples, and exhibits that are not the subject of buying and selling. Services using exhibits include, for example, selling products and introducing exhibits. The first space RS1 is, for example, a store, a showroom, an exhibition venue, or a venue for various events. The first user is a customer service staff member who serves visitors to the first space RS1, and the second user is a person who receives the service through the virtual space VS, in other words, a person who is served.

[0154] The provision and enjoyment of services using exhibits are activities that have traditionally been carried out in real space, but when these are carried out in a virtual space, it is important to provide a sensation similar to that of activities in real space in order to increase the satisfaction of the service recipient. Therefore, if the virtual space providing system 100 is used to provide services using exhibits, a sensation similar to that of activities in real space can be obtained, making it easier to feel a connection with reality, and therefore the satisfaction of the service recipient can be suitably increased.

[0155] A plurality of virtual spaces VS may be generated for one first space RS1. Each virtual space VS has an arrangement of structures that mimics the first space RS1. For example, a virtual space VS including an avatar corresponding to the second user of each group may be generated for each group to which the second user belongs, such as family or friends who go shopping together. This allows each group to leisurely enjoy activities in the virtual space VS. An avatar of the same first user may be placed in each of the plurality of virtual spaces VS, or, if there are a plurality of first users, an avatar of a different first user may be placed in each virtual space VS. It is not necessary that all of the customers present in the first space RS1 are reflected as first users in the avatars of the virtual space VS. [Explanation of symbols]

[0156] A1…First Avatar A2…Second Avatar Gd…Product Ic1…First conversation information Ic2: Second conversation information If1…First information If2…Second information Ij…judgment information Io…operation information Ip…location information Is…Instruction information Iv...Shooting information P1…Salesperson User P2: Customer user RS1…1st space RS2…Second space VS…Virtual space 10…First device 11...Location information collection device 12...Salesperson terminal 13...Photographic equipment 20…Second device 21...Customer terminal 30…Information processing server 31…Communications Department 32...Control section 32a…Virtual space generation section 32b…conversation processing section 32c…Service situation assessment section 32d…Shooting instruction section 32e…Trial Execution Department 32f…Display data generation section 33...Storage section 33a…Virtual space data 100...Virtual space provision system 200…Basic screen 201...Conversation screen 202...Observation screen 203…Trial screen 210…Virtual area 211…Product display 212…Display while serving customers 220…operation area 230…Image area 240…Shooting area 250…Trial area 300…First status display

Claims

1. a first receiving unit that receives first information output from a device located in a first space, the first information including at least position identification information that is information capable of identifying a position of a first user in the first space and first conversation information that indicates a statement of the first user; a second receiving unit that receives second information output from a display terminal operated by a second user in a second space, the second information including at least instruction information indicating an instruction of the second user and second conversation information indicating a statement of the second user; and a virtual space generating unit that moves a first avatar, which is a first object, in response to movement of the first user in the first space based on the position identification information in a virtual space having an arrangement of structures simulating the first space, and moves a second avatar, which is a second object, in response to an instruction of the second user based on the instruction information; a conversation processing unit that performs processing for establishing a conversation between the first user and the second user via the first avatar and the second avatar, using the first conversation information and the second conversation information; a display data generating unit that generates display data for displaying an image of the virtual space and a display showing a situation of the first space based on the first information; a transmission unit that transmits the display data to the display terminal, The virtual space generation unit places a third avatar, which is a third object corresponding to a visitor visiting the first space, in the virtual space, and controls the number of avatars in the virtual space within a predetermined range. Information processing server.

2. The first space is a space in which a service using an exhibit is provided, The first user is a customer service representative for the service, The second user is a person who receives the service through the virtual space. The information processing server according to claim 1 .

3. The first conversation information is composed of video data, The display showing the situation of the first space includes an image of the first user based on the first conversation information.

3. The information processing server according to claim 1 or 2.

4. The display showing the status of the first space includes a display showing a work status of the first user in the first space. The information processing server according to any one of claims 1 to 3.

5. The first information includes determination information that is information capable of determining a service status of the first user in the first space, the display indicating the status of the first space includes a serving display indicating that the first user is serving a customer in the first space, the serving display being displayed in association with the first avatar; The display data generating unit generates the display data for displaying an image including the display of the first user serving a customer when the first user is determined to be serving a customer based on the determination information. The information processing server according to claim 2 .

6. The first information includes imaging information consisting of imaging data within the first space, The display showing the situation of the first space includes an image of the first space based on the shooting information. The information processing server according to any one of claims 1 to 5.

7. The device located in the first space includes a photographing device that generates the photographing information and is configured to be movable within the first space, the second information includes operation information that is information indicating an instruction for a movement of the photographing device, The transmission unit transmits to the image capture device an instruction for a movement of the image capture device in accordance with the operation information. The information processing server according to claim 6.

8. The display data is data for displaying an image of the virtual space and a display showing the situation of the first space on one screen. The information processing server according to any one of claims 1 to 7.

9. each of the first conversation information and the second conversation information includes voice data; the conversation processing unit sets a volume of the sound output based on the first conversation information to be smaller as the distance between the first avatar and the second avatar increases; The transmission unit transmits to the display terminal an instruction to output a sound based on the first conversation information at a volume according to a setting of the conversation processing unit. The information processing server according to any one of claims 1 to 8.

10. The conversation processing unit determines whether or not a conversation can be held depending on a distance between the first avatar and the second avatar, and performs processing to establish the conversation when the distance is equal to or smaller than a predetermined value. The information processing server according to any one of claims 1 to 9.

11. a first acquisition unit that acquires first information in a first space, the first acquisition unit acquiring the first information including at least position identification information that is information capable of identifying a position of a first user in the first space and first conversation information that indicates a statement of the first user; a second acquisition unit that acquires second information in a second space, the second acquisition unit acquiring the second information including at least instruction information indicating an instruction based on an operation of a second user on a display terminal in the second space and second conversation information indicating a statement of the second user; a virtual space generating unit that moves a first avatar, which is a first object, in response to movement of the first user in the first space based on the position identification information in a virtual space having an arrangement of structures simulating the first space, and moves a second avatar, which is a second object, in response to an instruction of the second user based on the instruction information; a conversation processing unit that performs processing for establishing a conversation between the first user and the second user via the first avatar and the second avatar, using the first conversation information and the second conversation information; A virtual space providing system including: a display data generating unit that generates display data for displaying an image of the virtual space and a display showing a situation of the first space based on the first information on the display terminal, The virtual space generation unit places a third avatar, which is a third object corresponding to a visitor visiting the first space, in the virtual space, and controls the number of avatars in the virtual space within a predetermined range. Virtual space provision system.

Images