Information processing server and virtual space provision system

Abstract

To provide an information processing server and a virtual space provision system that make it easier to feel a connection with the reality in activities in a virtual space.SOLUTION: An information processing server 30 moves a first avatar according to the movement of a salesperson user P1 in a first space RS1, in a virtual space having the arrangement of structures imitating the first space RS1, and moves a second avatar according to an instruction from a customer user P2 in a second space RS2. Furthermore, the information processing server 30 performs processing for establishing a conversation between the salesperson user P1 and the customer user P2 with the first avatar and the second avatar intervening and transmits, to a customer terminal 21, display data for displaying both an image of the virtual space and the situation of the first space RS1.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing server used for communication using virtual reality, and a virtual space providing system. [Background technology]

[0002] In recent years, development of communication systems using virtual reality has been progressing. The applications of these systems are expanding beyond games to new applications such as the provision of services. One example of the provision of services is the sale of products. For example, Patent Documents 1 and 2 describe systems that enable communication between salespeople and customers using avatars in a virtual space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-205661 [Patent Document 2] Japanese Patent Application Laid-Open No. 2012-8638 Summary of the Invention [Problem to be solved by the invention]

[0004] The new uses of systems that provide virtual spaces are different from those of games and other applications that assume progression within a virtual space; they are originally intended to replace activities that take place in real space. Replacing real-world activities with activities in virtual space would be highly convenient for users who find it difficult to travel to real-world activity locations due to transportation and time constraints, or restrictions on going out. However, because activities in virtual space make it difficult to feel a connection with reality, there are still many shortcomings as a substitute for real-world activities. For example, the senses obtained through sight and hearing in real-world activities, such as those obtained through face-to-face conversations or observing real objects such as products, are lost in activities in virtual space, making it difficult to feel a connection with reality. [Means for solving the problem]

[0005] The information processing server for solving the above problem includes a first receiving unit that receives first information output from a device located in a first space, the first information including at least position specifying information that is information capable of specifying the position of a first user in the first space and first conversation information that indicates a statement by the first user; a second receiving unit that receives second information output from a display terminal operated by a second user in a second space, the second information including at least instruction information that indicates an instruction from the second user and second conversation information that indicates a statement by the second user; and a second receiving unit that receives second information output from a display terminal operated by a second user in a second space, the second information including at least instruction information that indicates an instruction from the second user and second conversation information that indicates a statement by the second user, and a virtual space having an arrangement of structures that resembles the first space, the first information including at least instruction information that indicates an instruction from the second user and second conversation information that indicates a statement by the second user. a virtual space generation unit that moves a first avatar, which is a first object, in accordance with the movement of the first user within the virtual space, and moves a second avatar, which is a second object, in accordance with instructions from the second user based on the instruction information; a conversation processing unit that uses the first conversation information and the second conversation information to perform processing to establish a conversation between the first user and the second user mediated by the first avatar and the second avatar; a display data generation unit that generates display data for displaying an image of the virtual space and a display showing the situation of the first space based on the first information; and a transmission unit that transmits the display data to the display terminal.

[0006] The virtual space providing system for solving the above problem includes a first acquisition unit that acquires first information in a first space, the first acquisition unit acquiring the first information including at least position identification information that is information that can identify the position of a first user in the first space and first conversation information that indicates a statement made by the first user; a second acquisition unit that acquires second information in a second space, the second acquisition unit acquiring the second information including at least instruction information that indicates an instruction based on an operation made by a second user on a display terminal in the second space and second conversation information that indicates a statement made by the second user; and a virtual space providing system that acquires the position identification information in a virtual space having an arrangement of structures that resembles the first space. a virtual space generation unit that moves a first avatar, which is a first object, in accordance with the movement of the first user within the first space based on constant information, and moves a second avatar, which is a second object, in accordance with instructions from the second user based on the instruction information; a conversation processing unit that uses the first conversation information and the second conversation information to perform processing to establish a conversation between the first user and the second user mediated by the first avatar and the second avatar; and a display data generation unit that generates display data for displaying on the display terminal an image of the virtual space and a display showing the situation of the first space based on the first information.

[0007] According to the above configuration, an image of the virtual space and a display showing the situation of the first space are displayed on the display terminal, which makes it easier for the second user to feel a connection with reality in their activities in the virtual space compared to when only an image of the virtual space is displayed.

[0008] In the above configuration, the first space may be a space where a service using an exhibit is provided, the first user may be a customer service representative for the service, and the second user may be a person who receives the service through the virtual space.

[0009] The provision and enjoyment of services using exhibits are activities that have traditionally been carried out in real space, but when these are carried out in virtual space, it is important to provide a sensation similar to that of activities in real space in order to increase the satisfaction of the recipient of the service. By using the above-mentioned virtual space provision system to provide services using exhibits, the second user can experience a sensation similar to that of activities in real space, making it easier to feel a connection with reality, thereby favorably increasing the satisfaction of the second user who is the recipient of the service.

[0010] In the aforementioned configuration, the first conversation information may be made up of video data, and the display showing the situation in the first space may include a video of the first user based on the first conversation information. According to the above configuration, the second user can have a conversation with the first user through the avatar that feels similar to a face-to-face conversation, which makes it easier for the second user to feel connected to reality during activities in the virtual space.

[0011] In the aforementioned configuration, the display showing the status of the first space may include a display showing a work status of the first user in the first space. According to the above configuration, the second user can grasp the situation of the first user in the first space, and can adjust the timing of conversation, etc., and can efficiently proceed with activities in the virtual space. In addition, the second user can easily sense that the first avatar is an alter ego of a person who is actually active in the first space. Therefore, the second user can easily feel a connection with reality in activities in the virtual space.

[0012] In the above configuration, the first information includes determination information that is information that can determine the customer service status of the first user in the first space, and the display indicating the status of the first space is a customer service display that indicates that the first user is serving customers in the first space, and includes the customer service display that is displayed in association with the first avatar, and the display data generation unit may generate the display data for displaying an image including the customer service display when it is determined that the first user is serving customers based on the determination information.

[0013] According to the above configuration, the second user can easily understand whether the first user is in a situation where he or she can respond to conversation requests, and can adjust the timing of the conversation, etc., thereby efficiently progressing activities in the virtual space. Furthermore, the second user can easily sense that the first avatar is not a character that only serves customers in the virtual space, but an alter ego of a person who actually serves customers in a store in the real space. Therefore, the second user can easily feel a connection with reality in activities in the virtual space.

[0014] In the above configuration, the first information may include shooting information consisting of shooting data within the first space, and the display showing the situation of the first space may include an image of the first space based on the shooting information.

[0015] According to the above configuration, the second user can check the appearance of the items in the first space. Therefore, the second user can get a feeling similar to that of actually visiting the first space. Therefore, the second user can easily feel a connection with reality in the virtual space.

[0016] In the above configuration, the device located in the first space may be a photographing device that generates the photographing information and is configured to be movable within the first space, the second information may include operation information that is information indicating instructions for movement of the photographing device, and the transmission unit may transmit instructions for movement of the photographing device in accordance with the operation information to the photographing device.

[0017] According to the above configuration, since the second user can remotely control the photographing device, the second user's intention is more strongly reflected in the image of the first space displayed on the display terminal. Therefore, it becomes easier for the second user to proceed with checking the appearance of the items in the first space in accordance with his / her intention, and the second user can get a feeling that is closer to actually visiting the first space.

[0018] In the aforementioned configuration, the display data may be data for displaying an image of the virtual space and a display showing a situation in the first space on one screen. According to the above configuration, the second user can get both the sensation of being active in a virtual space and a sensation similar to an experience in a real space. Therefore, by combining these sensations, the sensation obtained from the activity in the virtual space can be closer to an experience in a real space. Therefore, the second user can feel a stronger connection with reality when engaging in the activity in the virtual space.

[0019] In the above configuration, each of the first conversation information and the second conversation information includes audio data, and the conversation processing unit may set the volume of the audio output based on the first conversation information to be lower the greater the distance between the first avatar and the second avatar, and the transmission unit may send an instruction to the display terminal to output the audio based on the first conversation information at a volume in accordance with the setting of the conversation processing unit.

[0020] According to the above configuration, the distance between avatars affects the volume of conversation in the same way that the distance between people affects the volume of conversation in real space, so that the second user can experience a sensation in the virtual space that is closer to the experience in real space.

[0021] In the above configuration, the conversation processing unit may determine whether or not a conversation can take place depending on the distance between the first avatar and the second avatar, and may perform processing to establish the conversation if the distance is equal to or less than a predetermined value.

[0022] According to the above configuration, the distance between avatars affects whether or not they can converse, just as the distance between people in real space affects whether or not they can converse. Therefore, the second user can get a sense of activity in the virtual space that is closer to the experience in real space. [Effects of the Invention]

[0023] According to the present invention, it is possible to make it easier for users to feel a connection with reality when engaging in activities in a virtual space. [Brief explanation of the drawings]

[0024] [Figure 1] 1 is a block diagram showing the overall configuration of a virtual space providing system according to an embodiment; [Figure 2] FIG. 1 is a diagram illustrating an example of a virtual space generated by a virtual space providing system according to an embodiment. [Figure 3] FIG. 2 is a sequence diagram showing a processing flow in the basic function of the virtual space providing system according to an embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a screen of a display terminal in the virtual space providing system according to an embodiment. [Figure 5] FIG. 10 is a sequence diagram showing a processing flow in a conversation function of the virtual space providing system according to an embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of a screen of a display terminal in the virtual space providing system according to an embodiment. [Figure 7] FIG. 2 is a diagram illustrating an example of a screen of a display terminal in the virtual space providing system according to an embodiment. [Figure 8] 10 is a flowchart showing the flow of a conversation availability determination process in the virtual space providing system of an embodiment. [Figure 9] FIG. 10 is a sequence diagram showing a process flow of a conversation volume adjustment process in the virtual space providing system according to an embodiment. [Figure 10] 10 is a flowchart showing the processing flow of a customer service status display function of the virtual space providing system according to an embodiment. [Figure 11] FIG. 2 is a diagram illustrating an example of a screen of a display terminal in the virtual space providing system according to an embodiment. [Figure 12] FIG. 10 is a sequence diagram showing a processing flow in an indoor photography function of the virtual space providing system according to an embodiment. [Figure 13] FIG. 2 is a diagram illustrating an example of a screen of a display terminal in the virtual space providing system according to an embodiment. [Figure 14]FIG. 10 is a sequence diagram showing a processing flow in a trial function of the virtual space providing system according to an embodiment. [Figure 15] FIG. 2 is a diagram illustrating an example of a screen of a display terminal in the virtual space providing system according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0025] An embodiment of an information processing server and a virtual space providing system will be described with reference to FIGS. [Overall configuration of the virtual space provision system] The overall configuration of the virtual space providing system 100 will be described with reference to Fig. 1. In this embodiment, as an example, a case will be described in which the virtual space providing system 100 is used for selling products.

[0026] The first space RS1 and the second space RS2 are real spaces that are separate from each other. The first space RS1 is a space within a store that sells products displayed in front of the store, and the first user, a salesperson user P1, is located in the first space RS1. The salesperson user P1 is a salesperson for the products and sells the products to customers who actually visit the first space RS1.

[0027] The second space RS2 is occupied by a second user, customer user P2. Customer user P2 is a person who plans to purchase a product through the virtual space provided by the virtual space providing system 100. The second space RS2 may be any space, such as a space within the home of customer user P2.

[0028] In the virtual space providing system 100, an avatar corresponding to a salesperson user P1 and an avatar corresponding to a customer user P2 are placed in a virtual store, which is a virtual space simulating the first space RS1. These avatars are used to communicate between the salesperson user P1 and the customer user P2 regarding the buying and selling of goods.

[0029] 1, the virtual space providing system 100 includes an information processing server 30, a first device 10 located in a first space RS1, and a second device 20 located in a second space RS2. The first device 10 includes a location information collecting device 11, a salesperson terminal 12, and a photographing device 13. The second device 20 includes a customer terminal 21.

[0030] The first device 10, the second device 20, and the information processing server 30 transmit and receive data to and from each other via a network NW. The network NW used for communication between the information processing server 30 and each device included in the first device 10 and the second device 20 may be a general-purpose communication line such as the Internet, or may be a dedicated communication line for communication between each device. The network NW may include multiple independent networks, or may be a single common network.

[0031] The position information collection device 11 acquires position identification information Ip, which is information that can identify the position of the salesperson user P1 in the first space RS1. The position information collection device 11 transmits the position identification information Ip to the information processing server 30.

[0032] The position identified based on the position identification information Ip may be a relative position with respect to a reference position in the first space RS1, or may be an absolute position using latitude and longitude. The position information collection device 11 includes devices capable of detecting the position of the salesperson user P1 by a desired method. Depending on the position detection method, each device constituting the position information collection device 11 may be placed at a predetermined position in the first space RS1 or may be carried by the salesperson user P1.

[0033] For example, the location information collection device 11 may include a camera, and the location of the salesperson user P1 may be determined by analyzing an image captured by the camera. The salesperson user P1 may be identified by identifying the face of the salesperson user P1 or by identifying a marker attached to the salesperson user P1 in advance.

[0034] For example, the location information collection device 11 may include a transmitter and a receiver that are compatible with short-range wireless communication such as Bluetooth (registered trademark), and the location of the salesperson user P1 may be determined from the reception conditions when the receiver receives radio waves from the transmitter carried by the salesperson user P1.

[0035] The position identification information Ip may be information that can identify not only the position of the salesperson user P1 but also the orientation of the salesperson user P1. In this case, the position information collection device 11 may include a motion sensor or devices that constitute a head tracking or face tracking system.

[0036] The location of the salesperson user P1 based on the information collected by the location information collecting device 11 may be determined by the location information collecting device 11 or by the information processing server 30. In other words, the location identification information Ip may be information indicating the result of determining the location of the salesperson user P1, or may be information that enables the location of the salesperson user P1 to be determined by calculation using the location identification information Ip.

[0037] The salesperson terminal 12 is a device used by the salesperson user P1 to converse with the customer user P2. The conversation between the salesperson user P1 and the customer user P2 is carried out using text, audio, or video. The salesperson terminal 12 may include a device appropriate for the means of conversation. In other words, the salesperson terminal 12 may be a device capable of at least one of inputting and displaying text, inputting and outputting audio, and capturing and displaying video. For example, the salesperson terminal 12 may be a headset, a smartphone, a tablet device, a wearable device, a device for video calls, or the like.

[0038] First conversation information Ic1, which is information indicating what the salesperson user P1 said, is input to the salesperson terminal 12. The salesperson terminal 12 transmits the first conversation information Ic1 to the information processing server 30. The first conversation information Ic1 is composed of text, audio, or video data depending on the conversation medium.

[0039] The camera device 13 captures images within the first space RS1. It is preferable that the camera device 13 is capable of capturing video. The camera device 13 includes, for example, a camera fixed at a predetermined position within the first space RS1. The camera is disposed, for example, at a position where it can capture an image of a product. Alternatively, the camera device 13 may be movable within the first space RS1, and the movement of the camera device 13 may be remotely controlled. An example of a remotely controlled camera device 13 is a telepresence robot.

[0040] The photographing device 13 generates photographing information Iv consisting of photographing data within the first space RS1 and transmits the photographing information Iv to the information processing server 30. Furthermore, if the photographing device 13 can be remotely controlled, the photographing device 13 receives instructions from the information processing server 30 and changes the photographing position and photographing direction.

[0041] The information output by first device 10, in other words, the information output by each of location information collection device 11, salesperson terminal 12, and photographing device 13, is first information If1, which is information indicating the situation in first space RS1. That is, first information If1 includes location identification information Ip, first conversation information Ic1, and photographing information Iv. In virtual space provision system 100, first device 10 functions as a first acquisition unit that acquires first information If1 in first space RS1. One device may function as two or more of the location information collection device 11, the salesperson terminal 12, and the photographing device 13.

[0042] The customer terminal 21 is a display terminal equipped with a display unit that displays images. The customer terminal 21 is operated by the customer user P2. The customer terminal 21 is, for example, a smartphone, a tablet terminal, a personal computer, etc. The customer terminal 21 displays images based on display data received from the information processing server 30. The display content of the customer terminal 21 includes an image of the virtual space and a first status display that shows the status of the first space RS1.

[0043] In addition, instruction information Is, which is information indicating an instruction from customer user P2 with respect to the virtual space, is input to the customer terminal 21. The instruction information Is includes information instructing movement of an avatar corresponding to customer user P2. The instruction information Is is transmitted from the customer terminal 21 to the information processing server 30.

[0044] Furthermore, second conversation information Ic2, which is information indicating the statements of customer user P2, is input to the customer terminal 21. The second conversation information Ic2 is composed of text, audio, or video data depending on the means of conversation between the salesperson user P1 and customer user P2. The customer terminal 21 has the functions of inputting and displaying text, inputting and outputting audio, and capturing and displaying video depending on the means of conversation. The second conversation information Ic2 is transmitted from the customer terminal 21 to the information processing server 30.

[0045] Furthermore, in response to an operation of the customer user P2 on the customer terminal 21, a request for an image of the first space RS1 and a request for a product trial are sent from the customer terminal 21 to the information processing server 30. If the image capturing device 13 can be remotely controlled, operation information Io, which is information indicating instructions for the movement of the image capturing device 13, is input to the customer terminal 21 upon requesting an image of the first space RS1, and the operation information Io is sent from the customer terminal 21 to the information processing server 30.

[0046] The functions of the customer terminal 21 in the virtual space providing system 100 are realized, for example, by application software installed on the customer terminal 21. A specific example of such application software is a shopping app for a virtual store.

[0047] The information output by the second device 20, in other words, the information output by the customer terminal 21, is second information If2. That is, the second information If2 includes instruction information Is, second conversation information Ic2, and operation information Io. In the virtual space providing system 100, the second device 20 functions as a second acquisition unit that acquires the second information If2 in the second space RS2.

[0048] The information processing server 30 includes a communication unit 31 , a control unit 32 , and a storage unit 33 . The communication unit 31 executes connection processing between the information processing server 30 and each device including the first device 10 and the second device 20 via the network NW, and transmits and receives data between the connected devices. The communication unit 31 functions as a first receiving unit that receives first information If1 from the first device 10, and a second receiving unit that receives second information If2 from the second device 20. The communication unit 31 also functions as a transmitting unit that transmits display data to the customer terminal 21 and transmits movement instructions to the imaging device 13.

[0049] The control unit 32 has a configuration including a CPU and volatile memory such as RAM. Based on the programs and data stored in the storage unit 33, the control unit 32 controls the processing by the communication unit 31, the reading and writing of information in the storage unit 33, various calculation processes, and other units included in the information processing server 30. In the virtual space providing system 100, the control unit 32 functions as a virtual space generation unit 32a, a conversation processing unit 32b, a customer service situation determination unit 32c, a photography instruction unit 32d, a trial execution unit 32e, and a display data generation unit 32f.

[0050] The virtual space generation unit 32a sets the positions of objects including a first avatar A1 and a second avatar A2 within a single virtual space having an arrangement of structures that mimics the first space RS1. The first avatar A1 is an avatar corresponding to a salesperson user P1, and the second avatar A2 is an avatar corresponding to a customer user P2. This generates a virtual space VS whose components include the first avatar A1 and the second avatar A2. Figure 2 shows an example of the virtual space VS. The components of the virtual space VS also include an object representing a product Gd.

[0051] The virtual space generation unit 32a changes the position of the first avatar A1 based on the position identification information Ip included in the first information If1. The virtual space generation unit 32a also changes the position of the second avatar A2 based on the instruction information Is included in the second information If2. That is, the virtual space generation unit 32a moves the first avatar A1 based on the position identification information Ip and moves the second avatar A2 based on the instruction information Is.

[0052] The conversation processing unit 32b performs a conversation execution process, which is a process of establishing a conversation between the salesperson user P1 and the customer user P2, using the first conversation information Ic1 contained in the first information If1 and the second conversation information Ic2 contained in the second information If2.

[0053] The conversation processor 32b also performs a conversation availability determination process that determines whether or not a conversation can occur depending on the distance between the first avatar A1 and the second avatar A2. Furthermore, when the conversation medium is audio or video, the conversation processor 32b also performs a conversation volume adjustment process that adjusts the volume of the conversation depending on the distance between the first avatar A1 and the second avatar A2.

[0054] The customer service status determination unit 32c uses the first information If1 to determine whether the salesperson user P1 is currently serving a customer who is actually visiting the first space RS1. If it is determined that the salesperson user P1 is currently serving a customer, the customer service status determination unit 32c causes the display content of the display data on the customer terminal 21 to include a display indicating that the first avatar A1 is currently serving a customer.

[0055] The photographing instruction unit 32d outputs instructions to the photographing device 13 in response to a request from the customer terminal 21. The instructions to the photographing device 13 include an instruction to transmit the photographing information Iv generated by the photographing device 13. Furthermore, if the photographing device 13 can be remotely controlled, the instructions to the photographing device 13 include an instruction to move the photographing device 13 based on the operation information Io included in the second information If2.

[0056] The trial execution unit 32e performs a process of having the second avatar A2 try out a product in response to a request from the customer terminal 21. Trial-trying a product includes, for example, trying on a product such as clothing or an accessory, or test-driving a product such as a vehicle.

[0057] The display data generating unit 32f generates display data that defines the display content on the customer terminal 21. The display data is data for displaying an image of the virtual space VS and a first status display, which is a display showing the status of the first space RS1, on the customer terminal 21. The first status display is a display showing the status of the first space RS1 at that time, and includes images in the first space RS1, such as images of the salesperson user P1 and products, and a display showing the work status, such as the customer service status of the salesperson user P1.

[0058] The storage unit 33 has a configuration including a nonvolatile memory, and stores programs and data necessary for the processing executed by the control unit 32. Specifically, the storage unit 33 stores virtual space data 33a, which is data used to generate the virtual space VS.

[0059] The virtual space data 33a includes data of a basic space having an arrangement of structures that imitates the first space RS1, and data of objects that move within the virtual space VS. The basic space is a virtual space that includes exhibits such as merchandise, as well as fixed objects such as display stands and shelves for the exhibits, pillars, and walls. The basic space only needs to mimic the first space RS1 so that the movement paths of people in the first space RS1 can be reproduced, and the arrangement of structures in the first space RS1 and the basic space does not need to be completely identical. For example, the basic space only needs to have a floor plan that matches the first space RS1, i.e., a corridor arrangement that matches the first space RS1, and the arrangement of exhibits in the basic space does not need to be completely identical to the first space RS1.

[0060] The data of the base space includes, for example, information on a three-dimensional Cartesian coordinate system set for the base space, position information of the fixed objects described above, data correlating positions in the base space with positions in the first space RS1, and data for drawing the base space. The data of the objects includes data for drawing the first avatar A1 and the second avatar A2.

[0061] The functions of each part of the control unit 32 may be realized separately by various hardware components such as multiple CPUs and memories such as RAM, and software that makes these components function, or may be realized by software that gives multiple functions to a single piece of common hardware. Such software is stored in the storage unit 33 as a virtual space providing program.

[0062] [Virtual space provision system operation] The operation of the virtual space providing system 100 will be described with reference to Figures 3 to 15. The functions of the virtual space providing system 100 include a basic function, a conversation function, a customer service status display function, an indoor photography function, and a trial function. The operation of the virtual space providing system 100 for each function will be described below in order.

[0063] <Basic functions> The basic functions are the placement and movement of avatars A1 and A2 in the virtual space VS, and the display of this virtual space VS on the customer terminal 21.

[0064] 3, the position information collecting device 11 acquires position identification information Ip and transmits it to the information processing server 30 (step S10). Upon receiving the position identification information Ip, the virtual space generating unit 32a of the information processing server 30 uses the virtual space data 33a to set the position of the first avatar A1 to a position in the virtual space VS that corresponds to the position of the first space RS1 identified based on the position identification information Ip (step S11).

[0065] As a result, the position of the first avatar A1 is set so that the positional relationship of the salesperson user P1 to the structures in the first space RS1 corresponds to the positional relationship of the first avatar A1 to the structures in the virtual space VS. By repeating the processes of steps S10 and S11 at predetermined intervals, the position of the first avatar A1 in the virtual space VS changes according to the movement of the salesperson user P1 in the first space RS1.

[0066] On the other hand, when the customer user P2 performs a predetermined operation on the customer terminal 21 to request the display of the virtual store, a request to display the virtual space VS is transmitted from the customer terminal 21 to the information processing server 30 (step S12). The predetermined operation is, for example, an operation to select a predetermined area on a screen displayed by starting a shopping app for the virtual store on the customer terminal 21.

[0067] Upon receiving the request from the customer terminal 21, the virtual space generation unit 32a of the information processing server 30 uses the virtual space data 33a to set the position of the second avatar A2 at a predetermined position within the virtual space VS (step S13). The predetermined position is, for example, a position corresponding to the entrance of the virtual store.

[0068] The display data generating unit 32f of the information processing server 30 generates display data using the virtual space data 33a and the position information of the avatars A1 and A2 set by the virtual space generating unit 32a. The display data is transmitted from the communication unit 31 to the customer terminal 21 (step S14).

[0069] Upon receiving the display data, the customer terminal 21 displays an image based on the display data on the display unit. As a result, the basic screen 200 is displayed on the customer terminal 21 (step S15). That is, the display data generated by the processing of step S14 using the basic function is data for displaying the basic screen 200. FIG. 4 shows an example of the basic screen 200. The basic screen 200 is a screen on which the customer user P2 can look around at products in the virtual space VS by moving the second avatar A2.

[0070] When the customer user P2 performs various operations on the basic screen 200, instruction information Is is input to the customer terminal 21, and the instruction information Is is transmitted from the customer terminal 21 to the information processing server 30 (step S16). Specifically, for example, by dragging on the basic screen 200, information instructing the movement direction and movement amount of the second avatar A2 is input to the customer terminal 21 as instruction information Is.

[0071] Upon receiving the instruction information Is, the virtual space generation unit 32a of the information processing server 30 changes the configuration of the virtual space VS in accordance with the instruction information Is (step S17). Specifically, the virtual space generation unit 32a changes the position of the second avatar A2 in accordance with the instruction information Is.

[0072] The display data generating unit 32f generates display data using the information changed by the virtual space generating unit 32a, and the display data is transmitted from the communication unit 31 to the customer terminal 21 (step S18).

[0073] The customer terminal 21 displays an image based on the display data on the display unit, and the change according to the instruction information Is is reflected on the basic screen 200 (step S19). Specifically, the position of the second avatar A2 moves.

[0074] The basic screen 200 will be described in detail with reference to FIG. 4. The basic screen 200 includes a virtual area 210 in which an image of the virtual space VS is displayed, and an operation area 220 in which operations for changing various settings and using functions are accepted. The image in the virtual area 210 may be an image of the virtual space VS viewed from a viewpoint set around the second avatar A2, such as behind the second avatar A2, or may be an image of the virtual space VS viewed from the viewpoint of the second avatar A2. Furthermore, these viewpoints may be switchable.

[0075] A product display 211 showing information about the product is located at the location of the product Gd in the virtual area 210. The information about the product is, for example, a description of the product or reviews from purchasers of the product. The product display 211 may be displayed when the location of the product Gd is selected. The product display 211 may be a component of the virtual space VS. Alternatively, the product display 211 does not have to be a component of the virtual space VS, and the display data may be configured so that the product display 211 is displayed at a specific location within the image of the virtual space VS. The data required to draw the product display 211 is stored in advance in the storage unit 33.

[0076] Furthermore, by selecting any location within the virtual area 210, it may be possible to enlarge the display of that location. By displaying a wide range of the virtual space VS, performing an operation to move the second avatar A2, and then performing an operation to select the product Gd in the enlarged display, each operation can be performed efficiently. Such display switching may be performed by the customer terminal 21 without exchanging information with the information processing server 30, by the customer terminal 21 generating data from the display data. Alternatively, information instructing the display switching may be included in instruction information Is and sent from the customer terminal 21 to the information processing server 30, and the display may be switched based on the customer terminal 21 receiving, from the information processing server 30, display data reflecting changes made in accordance with the instruction information Is.

[0077] If the salesperson terminal 12 has an image display function, the image of the virtual space VS may also be displayed on the salesperson terminal 12. In other words, in response to a request from the salesperson terminal 12, the information processing server 30 may transmit data for displaying the image of the virtual space VS to the salesperson terminal 12.

[0078] <Conversation function> The conversation function is a function that enables a conversation between a salesperson user P1 and a customer user P2. For example, the conversation function is used when the customer user P2 wants to ask the salesperson user P1 a question about a product. First, the basic operation of the virtual space providing system 100 in the conversation function will be described.

[0079] 5, when the customer user P2 performs a predetermined operation on the customer terminal 21 to request a conversation with the first avatar A1, a conversation request for the selected first avatar A1 is transmitted from the customer terminal 21 to the information processing server 30 (step S20). The predetermined operation is, for example, an operation to select the first avatar A1 displayed on the basic screen 200 and an area for instructing the start of a conversation. By selecting the first avatar A1, an introduction to the salesperson user P1 corresponding to the first avatar A1 may be displayed on the basic screen 200.

[0080] Upon receiving a request from the customer terminal 21, the conversation processing unit 32b of the information processing server 30 calls the salesperson terminal 12 of the salesperson user P1 corresponding to the target first avatar A1 via the communication unit 31 (step S21). As a result, the salesperson terminal 12 notifies the user of the incoming call by sound or vibration. Note that the first avatar A1 and the salesperson terminal 12 may be associated with each other in advance by the information processing server 30.

[0081] When the salesperson user P1 performs an operation to respond to the call on the salesperson terminal 12 (step S22), a conversation execution process is performed in each of the customer terminal 21, the salesperson terminal 12, and the information processing server 30 (steps S23, S24, S25).

[0082] That is, the first conversation information Ic1 input to the salesperson terminal 12 is transmitted to the customer terminal 21 via the information processing server 30, and output based on the first conversation information Ic1 is performed at the customer terminal 21. In addition, the second conversation information Ic2 input to the customer terminal 21 is transmitted to the salesperson terminal 12 via the information processing server 30, and output based on the second conversation information Ic2 is performed at the salesperson terminal 12. In this way, a utterance input in the form of text, audio, or video at one terminal is output at the other terminal, and a conversation is established between the salesperson user P1 and the customer user P2.

[0083] In this way, the conversation execution process by the conversation processing unit 32b includes a process of instructing the communication unit 31 to transmit the first conversation information Ic1 received from the salesperson terminal 12 to the customer terminal 21, and to transmit the second conversation information Ic2 received from the customer terminal 21 to the salesperson terminal 12.

[0084] Before a conversation between salesperson user P1 and customer user P2 is established, customer user P2 performs operations on avatars A1 and A2, such as selecting a first avatar A1 as a conversation target and moving second avatar A2 to the area where first avatar A1 is located. During the conversation between salesperson user P1 and customer user P2, it is preferable that a display indicating that the first avatar A1 or second avatar A2 is speaking is displayed on the customer terminal 21. In this way, the first avatar A1 and the second avatar A2 are involved in operations or displays related to the conversation between salesperson user P1 and customer user P2.

[0085] The mode of starting a conversation is not limited to the mode in which the information processing server 30 calls the salesperson terminal 12 upon receiving a request from the customer terminal 21. For example, the information processing server 30 may receive a reservation for the time and order of conversation from the customer terminal 21, and the conversation execution process may be started in each of the customer terminal 21, the salesperson terminal 12, and the information processing server 30 in accordance with the reservation.

[0086] Specifically, the storage unit 33 of the information processing server 30 stores reservation data consisting of tables including reservation holders and reservation times. Information based on the reservation data is transmitted from the information processing server 30 to the customer terminal 21, allowing the customer terminal 21 to check the reservation status for a conversation with salesperson user P1. When customer user P2 specifies an available time in the reservation status, a reservation request is transmitted from the customer terminal 21 to the information processing server 30. The conversation processing unit 32b registers the specified time in the reservation data as a reservation for a conversation between customer user P2 and salesperson user P1. The conversation then begins according to the reservation in the reservation data. In this way, if conversation reservations are possible, when customer user P2 wants to talk to salesperson user P1, even if salesperson user P1 is busy serving a customer and cannot immediately respond, time for the conversation can be secured in advance. This improves convenience for customer user P2.

[0087] Alternatively, the conversation may be started by the information processing server 30 calling the customer terminal 21 upon receiving a request from the salesperson terminal 12. The conversation means may be selectable on the customer terminal 21 or the salesperson terminal 12.

[0088] 6 and 7 show an example of a conversation screen 201 displayed on the customer terminal 21 during the conversation execution process when the conversation medium is video. In addition to the virtual area 210 and operation area 220 described above, the conversation screen 201 includes a video area 230 in which video of the salesperson user P1 engaged in conversation captured by the salesperson terminal 12 is displayed. The video displayed in the video area 230 is an example of a first status display 300 that displays the status of the first space RS1. In this case, the first status display 300 displays the status of the first space RS1 based on the first conversation information Ic1 in the first information If1. The first conversation information Ic1 is composed of video data.

[0089] By displaying the image of the salesperson user P1 during the conversation, the customer user P2 can feel as if they are having a face-to-face conversation while communicating through the virtual space VS. This makes it easier for the customer user P2 to feel connected to reality during activities in the virtual space VS.

[0090] As shown in Fig. 6, on conversation screen 201, virtual area 210 and video area 230 may be arranged so that virtual area 210 is the main area and video area 230 is superimposed on a portion of virtual area 210. Conversely, as shown in Fig. 7, virtual area 210 and video area 230 may be arranged so that video area 230 is the main area and virtual area 210 is superimposed on a portion of video area 230. Also, it may be possible to select which of virtual area 210 and video area 230 is the main area.

[0091] In either case, the virtual area 210 and the video area 230 are simultaneously displayed on one screen. That is, while the conversation execution process is being performed, the display data generation unit 32f of the information processing server 30 generates data for displaying the virtual area 210 and the video area 230 on one screen as display data for displaying the conversation screen 201, and transmits the data to the customer terminal 21 via the communication unit 31. In this case, the first conversation information Ic1 is included in the display data and transmitted to the customer terminal 21 based on an instruction from the conversation processing unit 32b.

[0092] By simultaneously displaying the virtual area 210 and the video area 230 on one screen, the customer user P2 can get the feeling of shopping in the virtual space VS while also getting a feeling similar to a conversation in the real space. Therefore, by combining these sensations, the customer user P2 can get a feeling that is closer to an experience in the real space as a sensation obtained by an activity in the virtual space VS. Therefore, the customer user P2 can feel more connected to reality.

[0093] In addition, if the conversation means is video, the salesperson terminal 12 may display only the video of customer user P2 captured by the customer terminal 21, or may display the video of customer user P2 and an image of the virtual space VS.

[0094] Next, a conversation possibility determination process performed by the conversation processing unit 32b will be described. In the conversation function, whether or not a conversation can be held may be determined based on the distance between the first avatar A1 and the second avatar A2. In this case, upon receiving a conversation request from the customer terminal 21 in the process of step S20 in FIG. 5, the conversation processing unit 32b performs a conversation possibility determination process.

[0095] 8 shows the procedure of the conversation determination process. In the conversation determination process, the conversation processing unit 32b first calculates the distance L between the first avatar A1 and the second avatar A2 in the virtual space VS in step S30.

[0096] Next, in step S31, the conversation processing unit 32b determines whether the distance L is equal to or less than a predetermined threshold value. The predetermined threshold value is set to a distance that allows two people to have a conversation when converted into a distance within the first space RS1.

[0097] If the distance L is equal to or less than the threshold (positive determination in step S31), the conversation processing unit 32b determines to permit the conversation in the process of step S32, and ends the conversation permission determination process. If the conversation is permitted, the conversation processing unit 32b proceeds with the process from step S21 onwards in FIG.

[0098] If the distance L exceeds the threshold (negative determination in step S31), the conversation processing unit 32b determines not to permit the conversation in the process of step S33, and ends the conversation permission determination process. If the conversation is not permitted, the conversation processing unit 32b notifies the customer terminal 21 via the communication unit 31 that the distance between the avatars is too far and conversation is not possible, and such a notification is displayed on the customer terminal 21.

[0099] According to the above configuration, if customer user P2 wants to talk to salesperson user P1, he or she needs to move the second avatar A2 closer to the first avatar A1. Also, if customer user P2 wants to avoid being talked to by salesperson user P1, he or she can simply move the second avatar A2 farther away from the first avatar A1. In this way, just as the distance between a customer and a salesperson in a real store affects whether or not they can converse, the distance between the avatars also affects whether or not they can converse. Therefore, customer user P2 can get a sense of activity in the virtual space VS that is closer to an experience in real space.

[0100] Next, a conversation volume adjustment process by the conversation processor 32b will be described. When the conversation means is audio or video, the conversation function may adjust the conversation volume according to the distance between the first avatar A1 and the second avatar A2. In this case, the conversation processor 32b performs the conversation volume adjustment process prior to the conversation execution process.

[0101] 9 shows part of the processing flow of the virtual space providing system 100 when a conversation volume adjustment process is performed. In the conversation volume adjustment process, the conversation processing unit 32b first calculates the distance L between the first avatar A1 and the second avatar A2 (step S40). Then, the conversation processing unit 32b sets the conversation volume according to the distance L (step S41). In detail, the conversation processing unit 32b sets the conversation volume lower as the distance L increases.

[0102] Thereafter, the conversation processing unit 32b proceeds with the conversation execution process at the set conversation volume. That is, when the first conversation information Ic1 input to the salesperson terminal 12 is transmitted (step S42), the conversation processing unit 32b transmits the first conversation information Ic1 to the customer terminal 21 via the communication unit 31 together with an instruction to output audio at the set conversation volume (step S43). In this case, the first conversation information Ic1 is composed of audio data or includes audio data as part of video data. As a result, the customer terminal 21 outputs the utterances of the salesperson user P1 at the set conversation volume based on the first conversation information Ic1 (step S44).

[0103] According to the above configuration, the distance between avatars affects the volume of conversation, just as the distance between a customer and a salesperson affects the volume of conversation in a real store. Therefore, customer user P2 can experience a sensation in the virtual space VS that is closer to the experience in the real space.

[0104] The conversation volume adjustment process is performed at predetermined intervals after the conversation execution process is started, or performed each time the first conversation information Ic1 is sent to the customer terminal 21, so that when the distance L between the avatars changes during the conversation, the conversation volume changes accordingly. This allows the customer user P2 to experience a sensation closer to that experienced in real space. The conversation volume at the salesperson terminal 12 may be changed according to the distance L between the first avatar A1 and the second avatar A2, as with the customer terminal 21, or may be constant.

[0105] <Customer service status display function> The customer service status display function is a function that reflects the customer service status of salesperson user P1 in the first space RS1 in the display of first avatar A1. Because salesperson user P1 also serves customers who actually visit first space RS1, when salesperson user P1 is serving customers in first space RS1, salesperson user P1 cannot respond to a conversation request from customer user P2 through virtual space VS. The customer service status display function allows customer user P2 to easily understand whether salesperson user P1 is available to serve customers using first avatar A1 in virtual space VS.

[0106] 10 shows the processing procedure of the information processing server 30 in the customer service status display function. First, in the processing of step S50, the communication unit 31 of the information processing server 30 receives determination information Ij, which is information that can determine the customer service status of the salesperson user P1, from the first device 10. Upon receiving the determination information Ij, in the processing of step S51, the customer service status determination unit 32c of the information processing server 30 determines whether the salesperson user P1 is serving a customer in the first space RS1 based on the determination information Ij.

[0107] For example, if the location information collection device 11 includes a camera and the salesperson user P1 is identified by analyzing a captured image when the location of the salesperson user P1 is specified using the location identification information Ip, the same image analysis is used to determine whether another person is located within a predetermined range from the salesperson user P1. In this case, the information output from the location information collection device 11 functions as determination information Ij. The determination information Ij is included in the first information If1. The predetermined range is set to a range in which the other person is expected to be located when the salesperson user P1 and the other person are conversing. The customer service status determination unit 32c determines that the salesperson user P1 is serving a customer when the other person is located within a predetermined range from the salesperson user P1.

[0108] If it is determined that the salesperson user P1 is serving a customer (positive determination in step S51), in the process of step S52, the display data generation unit 32f generates display data for displaying the basic screen 200 including a serving-customer display indicating that the first avatar A1 is serving a customer. The basic screen 200 based on this display data is displayed on the customer terminal 21, whereby the serving-customer display is displayed on the customer terminal 21 together with the image of the virtual space VS.

[0109] If it is determined that the salesperson user P1 is not serving a customer (negative determination in step S51), in the process of step S53, the display data generating unit 32f generates display data for displaying the basic screen 200 that does not include the "serving a customer" display.

[0110] Fig. 11 shows an example of the basic screen 200 including a customer-serving display 212. In Fig. 11, a third avatar A3, which is different from the first avatar A1 and the second avatar A2, is placed near the first avatar A1, and a display indicating that the first avatar A1 and the third avatar A3 are engaged in a conversation is provided between them. This display indicating that the first avatar A1 is engaged in a conversation with the third avatar A3 is the customer-serving display 212.

[0111] The serving-customer display 212 is not limited to the above example, and may instead be a tag attached to the first avatar A1 indicating that the first avatar A1 is serving a customer, a change in the color of the first avatar A1, or the like. The serving-customer display 212 may be displayed in association with the first avatar A1. The serving-customer display 212 has a function of indicating that the first avatar A1 is serving a customer and also indicating that the salesperson user P1 is serving a customer in the first space RS1. The serving-customer display 212 may be a component of the virtual space VS, or the display data for the serving-customer display 212 may be configured so that the serving-customer display 212 is displayed near the first avatar A1 rather than being a component of the virtual space VS. Data required for rendering the serving-customer display 212 is stored in advance in the storage unit 33.

[0112] The customer user P2 can easily understand that the salesperson user P1 corresponding to the first avatar A1 is unable to respond to conversation requests by using the serving customer display 212. This allows the customer user P2 to adjust the timing of conversation with the first avatar A1, thereby efficiently promoting activities in the virtual space VS.

[0113] Furthermore, the customer service display 212 shows the customer service status of the customer user P2 in the first space RS1 in the virtual space VS, which makes it easier for the customer user P2 to understand that the first avatar A1 is not a character that serves customers only in the virtual space VS, but an alter ego of the salesperson who actually serves customers in the store in the real space. Therefore, the customer user P2 can easily feel a connection with reality in the activities in the virtual space VS.

[0114] Furthermore, since the image of the virtual space VS and the customer service display 212 are displayed simultaneously on one screen, the connection between the activities in the virtual space VS and reality becomes more apparent. The serving customer display 212 is an example of the first status display 300, which is a display showing the status of the first space RS1, and is also a display showing the work status of the salesperson user P1. In this case, the first status display 300 shows the status of the first space RS1 based on the determination information Ij.

[0115] The determination of whether the salesperson user P1 is serving a customer may be made based on information output by any of the devices included in the first device 10, not limited to information output by the location information collection device 11. In other words, the determination information Ij does not have to be information output by the location information collection device 11, as long as it is information output by the first device 10.

[0116] For example, when the salesperson user P1 starts serving customers in the first space RS1, the salesperson user P1 performs a predetermined operation on the salesperson terminal 12. As a result, information indicating that the salesperson user P1 is serving customers is transmitted as determination information Ij from the salesperson terminal 12 to the information processing server 30. Based on receiving this information, the customer service status determination unit 32c determines that the salesperson user P1 is serving customers.

[0117] Furthermore, not only when the salesperson user P1 is serving a customer who has visited the first space RS1, but also when the salesperson user P1 is on the phone, for example, the customer service status determination unit 32c may determine that the salesperson user P1 is serving a customer and display the serving-customer display 212. For example, when the salesperson user P1 answers the phone, the salesperson user P1 performs a predetermined operation on the salesperson terminal 12. As a result, determination information Ij is transmitted from the salesperson terminal 12 to the information processing server 30, and the customer service status determination unit 32c determines that the salesperson user P1 is serving a customer.

[0118] Furthermore, not only when the salesperson user P1 is serving customers, but also when the salesperson user P1 is unable to respond to a request for conversation through the virtual space VS due to work in the first space RS1, a display indicating that the salesperson user P1 is in a state where he or she is unable to respond to the request for conversation may be displayed on the customer terminal 21 as the first status display 300. Such a display is also included in the display indicating the work status of the salesperson user P1.

[0119] <Indoor shooting function> The indoor photography function is a function for taking an image of the first space RS1, such as an image of a product, and displaying it on the customer terminal 21. The indoor photography function is used, for example, when the customer user P2 wants to check the actual color or shape of the product.

[0120] 12, when the customer user P2 performs a predetermined operation on the customer terminal 21 to request photography of the first space RS1, the photography request is transmitted from the customer terminal 21 to the information processing server 30 (step S60). The predetermined operation is, for example, an operation to select an area displayed on the basic screen 200 for which photography is to be instructed.

[0121] Upon receiving a request from the customer terminal 21, the photography instruction unit 32d of the information processing server 30 outputs a photography instruction to the photography device 13. The photography instruction is sent from the communication unit 31 to the photography device 13 (step S61). Upon receiving the photography instruction, the photography device 13 performs photography processing (step S62). The photography processing includes processing of generating photography information Iv by photographing within the first space RS1 and transmitting the photography information Iv to the information processing server 30.

[0122] When the image capturing device 13 can be remotely controlled, operation information Io is input to the customer terminal 21, and the operation information Io is transmitted from the customer terminal 21 to the information processing server 30. In this case, the image capturing instruction unit 32d outputs an image capturing instruction including an instruction for movement in accordance with the operation information Io. The image capturing process of the image capturing device 13 includes changing the position and orientation in accordance with the instruction from the information processing server 30.

[0123] For example, an image of the virtual space VS displayed on the customer terminal 21 may include a display indicating the position of the camera device 13, and by performing an operation such as dragging on this display, information indicating the direction and amount of movement of the camera device 13 is input to the customer terminal 21 as operation information Io. For example, if the position of the salesperson user P1 is identified by analyzing an image captured by the location information collection device 11, the position of the camera device 13 may be identified by analyzing a similar image. Alternatively, the camera device 13 may have a function to acquire its own location information and transmit it to the information processing server 30, and the location of the camera device 13 may be identified based on the location information from the camera device 13 and reflected in the display on the customer terminal 21.

[0124] When the information processing server 30 receives the photographing information Iv from the photographing device 13, the display data generating unit 32f of the information processing server 30 generates display data for displaying the observation screen 202 including the image photographed by the photographing device 13. The display data is transmitted from the communication unit 31 to the customer terminal 21 (step S63). Upon receiving the display data, the customer terminal 21 displays an image based on the display data on the display unit, whereby the observation screen 202 is displayed on the customer terminal 21 (step S64).

[0125] 13 shows an example of the observation screen 202. In addition to the virtual area 210 and the operation area 220, the observation screen 202 includes a shooting area 240 in which an image captured by the image capturing device 13 is displayed. The image displayed in the shooting area 240 is an example of a first status display 300 that displays the status of the first space RS1. In this case, the first status display 300 displays the status of the first space RS1 based on the shooting information Iv of the first information If1.

[0126] 13, on the observation screen 202, the virtual area 210 and the photographing area 240 may be arranged such that the virtual area 210 is the main area and the photographing area 240 is overlapped on a part of the virtual area 210. Alternatively, the virtual area 210 and the photographing area 240 may be arranged such that the photographing area 240 is the main area and the virtual area 210 is overlapped on a part of the photographing area 240. Also, it may be possible to select which of the virtual area 210 and the photographing area 240 is to be the main area. In either case, the virtual area 210 and the photographing area 240 are simultaneously displayed on one screen. In other words, the display data for displaying the observation screen 202 is data for displaying the virtual area 210 and the photographing area 240 on one screen.

[0127] The images captured by the camera 13 are displayed on the customer terminal 21, allowing the customer user P2 to check the color and shape of the product. This allows the customer user P2 to select the product to purchase while referring to the product's appearance. This allows for an appropriate product selection, and also provides a feeling similar to viewing and selecting products in real space. This makes it easier for the customer user P2 to feel a connection with reality when engaging in activities in the virtual space VS.

[0128] Furthermore, if the photographing device 13 can be remotely controlled, the intention of the customer user P2 is more strongly reflected in the image displayed in the photographing area 240. Therefore, it becomes easier to proceed with product selection in accordance with the intention of the customer user P2, and the customer user P2 can get a feeling closer to product selection in real space.

[0129] Furthermore, by simultaneously displaying the virtual area 210 and the photographing area 240 on one screen, the customer user P2 can get the feeling of shopping in the virtual space VS and the feeling of selecting a product in the real space at the same time. Therefore, by combining these sensations, the customer user P2 can get a sensation that is closer to the experience in the real space as the sensation obtained by the activity in the virtual space VS. Therefore, the connection with reality becomes easier to feel.

[0130] If the photographing device 13 can be remotely controlled, it may be possible to reserve use of the photographing device 13. This increases convenience for the customer user P2. Specifically, the storage unit 33 of the information processing server 30 stores reservation data consisting of a table including the person making the reservation and the reservation time. Information based on the reservation data is transmitted from the information processing server 30 to the customer terminal 21, and the customer terminal 21 can check the reservation status for use of the photographing device 13. When the customer user P2 specifies an available time in the reservation status, a reservation request is transmitted from the customer terminal 21 to the information processing server 30, and the photographing instruction unit 32d registers the reservation for the specified time in the reservation data as a reservation for use of the photographing device 13 by the customer user P2. Then, use of the photographing device 13 begins in accordance with the reservation in the reservation data.

[0131] <Trial function> The trial function is a function for virtually testing a product. 14, when the customer user P2 performs a predetermined operation on the customer terminal 21 to request a trial of a product, the trial request is transmitted from the customer terminal 21 to the information processing server 30 (step S70). The predetermined operation is, for example, an operation to select the product displayed on the basic screen 200 and an area instructing the trial.

[0132] Upon receiving a request from the customer terminal 21, the trial execution unit 32e of the information processing server 30 performs trial processing (step S71). For example, if the product is clothing or an accessory, the trial processing is processing to generate data in which the second avatar A2 corresponding to the customer user P2 wears the product, and if the product is a vehicle, the trial processing is processing to generate data in which the second avatar A2 is riding on the product. Alternatively, the trial processing may be processing to generate data in which the second avatar A2 holds the product, or in short, it may be processing to generate data in which the second avatar A2 tries on the selected product.

[0133] Next, the display data generation unit 32f of the information processing server 30 uses the data generated by the trial execution unit 32e to generate display data for displaying a trial screen 203 including an image of the second avatar A2 trying out the product (step S72).

[0134] Upon receiving the display data, the customer terminal 21 displays an image based on the display data on the display unit, whereby the trial screen 203 is displayed on the customer terminal 21 (step S73). 15 shows an example of the trial screen 203. The trial screen 203 includes an operation area 220 and a trial area 250 in which a second avatar A2 trying out a product Gd is displayed.

[0135] The background of the trial area 250 may be an image of the virtual space VS, or may be an image different from the virtual space VS. Furthermore, if the customer terminal 21 has a photographing function, the background of the trial area 250 may be an image of the second space RS2 photographed by the customer terminal 21. In other words, the trial function may utilize augmented reality (AR).

[0136] By displaying an image of the second avatar A2 trying out the product Gd, the customer user P2 can easily imagine what it would look like if he or she were to use the product himself or herself, or the balance of multiple products when used together. Even for products that are difficult to try out in a real-world store, such as vehicles, the customer user P2 can easily imagine how the product would look when used by having the second avatar A2 try them out. Furthermore, when AR is used, it is easy to imagine what it would look like to use the product Gd in the second space RS2. Therefore, an accurate decision can be made regarding the selection of a product to purchase. When AR is used, the second avatar A2 may not be displayed, and only the product Gd may be displayed.

[0137] Once the customer user P2 has decided on the product to purchase, a payment process is performed. The payment process may be performed by the information processing server 30, or may be performed by a server of an e-commerce site operated by the store in the first space RS1 in cooperation with the virtual space providing system 100.

[0138] As described above, according to this embodiment, the following effects can be obtained. (1) An image of the virtual space VS and a first status display 300 showing the status of the first space RS1 are displayed on the customer terminal 21. Therefore, compared to when only an image of the virtual space VS is displayed and the first status display 300 is not displayed, the customer user P2 is more likely to feel a connection with reality when engaging in activities in the virtual space VS. As a result, even if it is difficult for the customer user P2 to visit the first space RS1, the customer user P2 can get a sense of activity in the virtual space VS that is similar to that of the first space RS1. Therefore, when the virtual space provision system 100 is used to sell products, it is possible to increase the purchasing motivation of the customer user P2.

[0139] (2) The first conversation information Ic1 is composed of video data, and the first status display 300 includes a display of video of the salesperson user P1 engaged in a conversation based on the first conversation information Ic1. This allows the customer user P2 to feel as if they are having a face-to-face conversation with the salesperson user P1 through the virtual space VS. Therefore, the customer user P2 can easily feel a connection to reality during activities in the virtual space VS.

[0140] (3) The greater the distance between the first avatar A1 and the second avatar A2, the lower the volume of the sound output from the customer terminal 21 based on the first conversation information Ic1. This allows the customer user P2 to experience a feeling in the virtual space VS that is closer to the experience in the real space, just as the distance between a customer and a salesperson affects the volume of the conversation in a real store.

[0141] (4) Whether or not a conversation can take place is determined depending on the distance between the first avatar A1 and the second avatar A2, and a process is performed to allow a conversation to take place if the distance is equal to or less than a predetermined value. This allows the customer user P2 to experience a sense of conversation that is closer to the experience in the real world when engaging in activities in the virtual space VS.

[0142] (5) The first status display 300 includes a serving display 212 indicating that the salesperson user P1 is serving customers in the first space RS1. This allows the customer user P2 to easily understand whether the salesperson user P1 is available to respond to conversation requests, making it possible to adjust the timing of speaking to the first avatar A1, and to efficiently carry out activities in the virtual space VS. Furthermore, the customer user P2 can easily sense that the first avatar A1 is not a character that serves customers only in the virtual space VS, but is an alter ego of a salesperson who actually serves customers in a store in the real space. Therefore, the customer user P2 can easily feel a connection to reality in activities in the virtual space VS.

[0143] (6) The first status display 300 includes an image of the first space RS1 based on the photographic information Iv. This allows the customer user P2 to check the color and shape of the products and select the products to purchase. This allows for an appropriate product selection and a feeling similar to viewing and selecting products in real space. This makes it easier to feel a connection with reality when engaging in activities in the virtual space VS.

[0144] (7) The camera device 13 is configured to be movable within the first space RS1, and movement instructions according to operation information Io from the customer terminal 21 are transmitted from the information processing server 30 to the camera device 13. This allows the customer user P2 to remotely control the camera device 13, so that the customer user P2's intentions are more strongly reflected in the image of the first space RS1 displayed on the customer terminal 21. This makes it easier for the customer user P2 to select products in line with his or her intentions, and the customer user P2 can get a feeling that is closer to selecting products in real space.

[0145] (8) On the customer terminal 21, an image of the virtual space VS and the first status display 300 are displayed on a single screen. This allows the customer user P2 to get both the feeling of being active in the virtual space VS and a feeling similar to an experience in real space. Therefore, by combining these sensations, the sensation obtained from the activity in the virtual space VS can be closer to an experience in real space. Therefore, the connection with reality is more easily felt when the activity in the virtual space VS is performed.

[0146] [Variations] The above embodiment can be modified as follows. The image of the virtual space VS and the first status display 300 do not have to be displayed on a single screen on the customer terminal 21. For example, the virtual area 210 and the first status display 300, which includes the video area 230 displaying the video of the salesperson user P1 and the photographing area 240 displaying the image captured by the photographing device 13, may be displayed alternately. Even with this configuration, the customer user P2 is more likely to feel a connection with reality than when only the image of the virtual space VS is displayed and the first status display 300 is not displayed.

[0147] The virtual space providing system 100 does not need to have all of the functions described in the above embodiment. The virtual space providing system 100 may be a system that enables communication between a salesperson user P1 and a customer user P2 through conversation mediated by an avatar, and that displays an image of the virtual space VS and at least one first status display 300 on the customer terminal 21.

[0148] The virtual space generation unit 32a of the information processing server 30 may place avatars corresponding to customers actually visiting the first space RS1 in the virtual space VS. The customer's location is determined, for example, based on an analysis of an image captured by the location information collection device 11, and reflected in the location of the avatar in the virtual space VS. With this configuration, the customer user P2 can know the level of activity of the store in the first space RS1, popular products, etc., based on the number and locations of avatars corresponding to customers in the first space RS1 in the virtual space VS.

[0149] The virtual space generation unit 32a of the information processing server 30 may control the number of avatars in the virtual space VS within a predetermined range. For example, if the number of avatars corresponding to customers is too small, the customer user P2 may feel less lively. On the other hand, if the number of avatars corresponding to customers is too large, the virtual space VS may become congested, making it difficult for the customer user P2 to move the second avatar A2 or select products. Controlling the number of avatars in the virtual space VS to a certain extent can prevent these problems from occurring. For example, the virtual space generation unit 32a may keep the number of avatars in the virtual space VS within a predetermined range by placing avatars corresponding to a portion of the customers in the first space RS1 in the virtual space VS. Alternatively, the virtual space generation unit 32a may increase the number of avatars in the virtual space VS to within the predetermined range by placing avatars of customers who do not exist in the first space RS1 in the virtual space VS.

[0150] After the basic screen 200 is displayed, when the first avatar A1 and the second avatar A2 move within the virtual space VS, only the position information of the avatars A1 and A2 is exchanged between the information processing server 30 and the customer terminal 21, and the process of generating an image of the virtual space VS that reflects the changes in the positions of the avatars A1 and A2 may be performed by the customer terminal 21. In other words, the information processing server 30 manages changes in the position information of the avatars A1 and A2, and the movement of the avatars A1 and A2 is performed by the customer terminal 21.

[0151] In this case, the first avatar A1 moves based on information indicating the new position of the first avatar A1, which is transmitted from the information processing server 30 to the customer terminal 21 based on the position identification information Ip, and the second avatar A2 moves based on instruction information Is input to the customer terminal 21. In this configuration, the customer terminal 21 functions as a virtual space generator that moves the avatars A1 and A2 within the virtual space VS. In this case, the customer terminal 21 may also perform part of the function of generating display data. That is, the control unit 32 of the information processing server 30 and the customer terminal 21 may function as a display data generator.

[0152] The use of the virtual space providing system 100 is not limited to the sale of products. That is, the first space RS1 does not have to be a space within a store, the first user does not have to be a salesperson, and the second user does not have to be a customer. It is sufficient that the second user's avatar can perform the same type of activity as that performed in the first space RS1 in the virtual space VS, together with the first user's avatar that actually exists in the first space RS1. For example, the first space RS1 may be an office or a tourist spot.

[0153] In particular, the virtual space provision system 100 is preferably used to provide services using exhibits. Exhibits are not particularly limited to items that are placed in the first space RS1 and used to provide services, such as products to be bought and sold, product samples, and exhibits that are not subject to sale and purchase. Services using exhibits include, for example, selling products and introducing exhibits. The first space RS1 is, for example, a store, a showroom, an exhibition venue, or a venue for various events. The first user is a customer service representative who serves visitors to the first space RS1, and the second user is a person who receives services through the virtual space VS, in other words, a person who is served.

[0154] The provision and enjoyment of services using exhibits are activities that have traditionally been carried out in real space, but when these are carried out in virtual space, it is important to provide a feeling similar to that of activities in real space in order to increase the satisfaction of the service recipient. Therefore, if the virtual space provision system 100 is used to provide services using exhibits, a feeling similar to that of activities in real space can be provided, making it easier to feel a connection with reality, thereby favorably increasing the satisfaction of the service recipient.

[0155] Multiple virtual spaces VS may be generated for one first space RS1. Each virtual space VS has a structural arrangement that mimics the first space RS1. For example, for each group to which second users belong, such as family or friends shopping together, a virtual space VS may be generated that includes avatars corresponding to the second users of the group. This allows each group to leisurely enjoy activities within the virtual space VS. An avatar of the same first user may be placed in each of the multiple virtual spaces VS, or, if there are multiple first users, an avatar of a different first user may be placed in each virtual space VS. Note that it is not necessary for all customer service representatives present in the first space RS1 to be reflected as first users in the avatars of the virtual spaces VS. [Explanation of symbols]

[0156] A1...First avatar A2...Second Avatar Gd…Product Ic1...1st conversation information Ic2...Second conversation information If1...First information If2...Second information Ij…judgment information Io…operation information Ip…location information Is…Instruction information IV...Shooting information P1...Salesperson user P2: Customer user RS1…1st space RS2…Second space VS…Virtual Space 10…First device 11...Location information collection device 12...Salesperson terminal 13...Photographic equipment 20…Second device 21...Customer terminal 30...Information processing server 31…Communications Department 32...Control unit 32a...Virtual space generation unit 32b...conversation processing section 32c… Customer service situation assessment section 32d...Shooting instruction section 32e...Trial Execution Department 32f...Display data generation section 33...Storage section 33a...Virtual space data 100...Virtual space provision system 200…Basic screen 201...Conversation screen 202...Observation screen 203…Trial screen 210...Virtual Area 211…Product display 212…Display while serving customers 220…operation area 230...Video area 240...Shooting area 250…Trial area 300...First status display

Claims

1. a first receiving unit that receives first information output from a device located in a first space, the first information including at least position identification information that is information that can identify the position of a first user in the first space and first conversation information that indicates a statement made by the first user; a second receiving unit that receives second information output from a display terminal operated by a second user in a second space, the second information including at least instruction information indicating an instruction of the second user and second conversation information indicating a statement of the second user; a virtual space generation unit that moves a first avatar, which is a first object, in a virtual space having an arrangement of structures simulating the first space, in accordance with movement of the first user in the first space based on the position identification information, and moves a second avatar, which is a second object, in accordance with an instruction of the second user based on the instruction information; a conversation processing unit that performs processing to establish a conversation between the first user and the second user via the first avatar and the second avatar, using the first conversation information and the second conversation information; a display data generating unit that generates display data for displaying an image of the virtual space and a display showing a situation of the first space based on the first information; a transmission unit that transmits the display data to the display terminal, The conversation processing unit When a request for a conversation with the first avatar is received from the display terminal, determining whether or not to have a conversation depending on the distance between the first avatar and the second avatar, and establishing the conversation when the distance is equal to or less than a predetermined value; Accepting a reservation for a conversation for the first avatar from the display terminal, and starting a process of establishing a conversation between the first user and the second user in accordance with the reservation. Information processing server.

2. the first space is a space where a service using an exhibit is provided, the first user is a customer service representative for the service, The second user is a person who receives the service through the virtual space. The information processing server according to claim 1 .

3. the first conversation information is composed of video data, The display showing the situation of the first space includes an image of the first user based on the first conversation information.

3. The information processing server according to claim 1.

4. The display showing the status of the first space includes a display showing the work status of the first user in the first space. The information processing server according to any one of claims 1 to 3.

5. the first information includes determination information that is information that can determine the service status of the first user in the first space, the display indicating the status of the first space includes a serving-customer display indicating that the first user is serving a customer in the first space, the serving-customer display being displayed in association with the first avatar; The display data generation unit generates the display data for displaying an image including the display of the first user serving a customer when it is determined that the first user is serving a customer based on the determination information. The information processing server according to claim 2 .

6. the first information includes imaging information consisting of imaging data within the first space, The display showing the situation of the first space includes an image of the first space based on the photographing information. The information processing server according to any one of claims 1 to 5.

7. the device located in the first space includes an imaging device that generates the imaging information and is configured to be movable within the first space; the second information includes operation information that is information indicating an instruction for a movement of the photographing device, The transmission unit transmits to the photographing device an instruction for a movement of the photographing device in accordance with the operation information. The information processing server according to claim 6.

8. The display data is data for displaying an image of the virtual space and a display showing the situation of the first space on one screen. The information processing server according to any one of claims 1 to 7.

9. each of the first conversation information and the second conversation information includes voice data; the conversation processing unit sets a volume of the sound to be output based on the first conversation information to be smaller as the distance between the first avatar and the second avatar increases; The transmission unit transmits to the display terminal an instruction to output a sound based on the first conversation information at a volume according to a setting of the conversation processing unit. The information processing server according to any one of claims 1 to 8.

10. a first acquisition unit that acquires first information in a first space, the first acquisition unit acquiring the first information including at least position identification information that is information that can identify a position of a first user in the first space and first conversation information that indicates a statement made by the first user; a second acquisition unit that acquires second information in a second space, the second acquisition unit acquiring the second information including at least instruction information indicating an instruction based on an operation on a display terminal of a second user in the second space and second conversation information indicating a statement of the second user; a virtual space generation unit that moves a first avatar, which is a first object, in a virtual space having an arrangement of structures simulating the first space, in accordance with movement of the first user in the first space based on the position identification information, and moves a second avatar, which is a second object, in accordance with an instruction of the second user based on the instruction information; a conversation processing unit that performs processing to establish a conversation between the first user and the second user via the first avatar and the second avatar, using the first conversation information and the second conversation information; a display data generation unit that generates display data for displaying, on the display terminal, an image of the virtual space and a display showing a situation of the first space based on the first information, The conversation processing unit When a request for a conversation with the first avatar is received from the second user via the display terminal, determining whether or not to have a conversation depending on the distance between the first avatar and the second avatar, and establishing the conversation when the distance is equal to or less than a predetermined value; accepting a reservation for a conversation with the first avatar from the second user through the display terminal, and starting a process of establishing a conversation between the first user and the second user in accordance with the reservation. Virtual space provision system.

Images