Virtual space generation device, virtual space generation program and virtual space generation method
Patent Information
- Application Number
- JP2023215088
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-20
- Publication Date
- 2025-08-15
AI Technical Summary
In virtual spaces, communication between users is often hindered by the reliance on text and voice chats, as images and product displays are static and do not facilitate smooth interaction.
A virtual space generation device and method that allows users to enter a shared virtual space as avatars, with a sharing range setting unit to determine which users can share display content, and a communication unit to transmit data for synchronized display across terminals, enabling real-time or near-real-time updates of shared content.
This configuration enhances communication by allowing users to refer to synchronized display content, facilitating smoother interactions and more effective service provision, such as customer support, by ensuring accurate inclusion of participants and reducing data processing load.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a virtual space generating device, a virtual space generating program, and a virtual space generating method. [Background technology]
[0002] In recent years, various services using virtual space have been proposed. In one type of system for providing such services, an attempt is made to realize services in virtual space that are similar to services provided in real space. For example, in the system of Patent Document 1, in a store in a virtual space, a user who is a store clerk serves a user who is trying to purchase a product by using an avatar. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent Publication No. 2022-36690 Summary of the Invention [Problem to be solved by the invention]
[0004] In virtual spaces, text and voice chat are widely used for communication between users. On the other hand, images of the virtual space and products handled by the service are displayed on the terminal operated by the user, and the user's activities in the virtual space are carried out based on information obtained from these images. Therefore, in order to realize smoother communication, it is desirable to be able to supplement communication with images. [Means for solving the problem]
[0005] Aspects of a virtual space generating device, a virtual space generating program, and a virtual space generating method for solving the above problems will be described below. [Aspect 1] A virtual space generating device comprising: a virtual space generating unit that allows a first user who will be a user of a service in a virtual space, and a second user who will be the first user's contact in the virtual space, to enter the virtual space as avatars based on a request from a terminal operated by each user; a shared range setting unit that sets a shared range consisting of a plurality of users including the first user and the second user; and a communication unit that transmits data for displaying the shared target to terminals operated by other users other than the target user who are included in the shared range, where one of the users is a target user, and at least a portion of the display content of the terminal operated by the target user is the shared target.
[0006] According to the above configuration, since the display contents can be shared on the terminals of users included in the sharing range, the users can communicate with each other while referring to the display contents of the terminals. In this way, the communication between the users is supported by the display images of the terminals, which enables smoother communication.
[0007] [Aspect 2] The shared range is a group consisting of a portion of the multiple users who are present in the virtual space, and the shared range setting unit, upon receiving a request from a terminal operated by a representative user who is the first user or the second user, sets the group to include the representative user and a user designated by the representative user, and sets the group as the shared range.A virtual space generating device as described in [Aspect 1]. According to the above configuration, users with whom display contents need to be shared can be accurately included in the sharing range.
[0008] [Aspect 3] A virtual space generating device as described in [Aspect 1], wherein the shared range setting unit sets a group consisting of multiple first users upon receiving a request from a terminal operated by the first user, and the virtual space generation unit generates a virtual space for each group to which the first users included in the group are allowed to enter, and the shared range setting unit further sets, for each virtual space, the shared range consisting of all users entering the virtual space.
[0009] According to the above configuration, since a virtual space to be entered is generated for each group of first users, it is easier to grasp the positions of the avatars of the members of the group and to communicate through the avatars, compared to a case in which the group enters one virtual space together with an unspecified number of users. Furthermore, since a shared range consisting of all users entering the virtual space is set, the first users who are going to work together in the virtual space can be accurately included in the shared range. This makes it easier for the group to carry out activities in the virtual space.
[0010] [Aspect 4] A virtual space generating device according to any one of [Aspect 1] to [Aspect 3], wherein the virtual space includes a facility and the service is provided at the facility. According to the above configuration, it is possible to provide a variety of services similar to those provided in the real space.
[0011] [Aspect 5] A virtual space generating device described in any one of [Aspect 1] to [Aspect 4], wherein the communication unit transmits the data so that changes in the state of the shared object on the terminal operated by the target user are immediately reflected on the terminal operated by the other user. According to the above configuration, changes in the state of the object to be shared are shared in detail, enabling smoother communication.
[0012] [Aspect 6] A virtual space generating device described in any one of [Aspect 1] to [Aspect 4], wherein the communication unit transmits the data so that the state of the shared object at the time specified by the target user on the terminal operated by the target user is reflected on the terminal operated by the other user. According to the above configuration, it is possible to reduce the amount of data communication and the processing load of the virtual space generating device while enabling sharing of display contents.
[0013] [Aspect 7] A virtual space generating device described in any one of [Aspect 1] to [Aspect 6], wherein the shared object is part of the display content and includes at least one of a 3D object, a 2D image, and a video. According to the above configuration, information that helps the second user respond can be shared accurately.
[0014] [Aspect 8] A virtual space generating device according to any one of [Aspect 1] to [Aspect 7], wherein the target user is the second user. According to the above configuration, the second user can accurately select and share a sharing target suitable for the first user's response, so that a smooth service can be provided.
[0015] [Aspect 9] A virtual space generating device described in any one of [Aspect 1] to [Aspect 8], wherein the authority to change the state of the shared object is operation authority, and the device is equipped with a sharing control unit that, upon receiving a request from a terminal operated by a user included in the sharing range, changes the user to which the operation authority has been set from the target user to the other user, and accepts an instruction to change the state of the shared object from a terminal operated by the user to which the operation authority has been set.
[0016] According to the above configuration, each user included in the sharing range can explain his / her own opinion, question, etc. while manipulating the display content himself / herself, thereby enabling smoother communication.
[0017] [Aspect 10] A virtual space generation program that causes one or more computers to execute the following: allowing a first user who will be a user of a service in a virtual space, and a second user who will be the first user's contact in the virtual space, to enter the virtual space as avatars based on a request from a terminal operated by each user; setting a shared range consisting of multiple users including the first user and the second user; one of the users included in the shared range is a target user, at least a portion of the display content of the terminal operated by the target user is the shared target, and transmitting data for displaying the shared target to terminals operated by other users included in the shared range who are users other than the target user.
[0018] According to the above configuration, since the display contents can be shared on the terminals of users included in the sharing range, the users can communicate with each other while referring to the display contents of the terminals. In this way, the communication between the users is supported by the display images of the terminals, which enables smoother communication.
[0019] [Aspect 11] A virtual space generating method in which one or more computers allow a first user who will be a user of a service in a virtual space, and a second user who will be the first user's contact in the virtual space, to enter the virtual space as avatars based on a request from a terminal operated by each user, set a shared range consisting of multiple users including the first user and the second user, and one of the users included in the shared range is a target user, at least a portion of the display content of the terminal operated by the target user is the shared target, and transmit data for displaying the shared target to terminals operated by other users included in the shared range who are users other than the target user.
[0020] According to the above method, since the display contents can be shared on the terminals of users included in the sharing range, the users can communicate with each other while referring to the display contents of the terminals. In this way, the communication between the users is supported by the display images of the terminals, which allows for smoother communication. Effect of the Invention
[0021] According to the present invention, communication between users can be made smoother. [Brief description of the drawings]
[0022] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a virtual space providing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing the functional configuration of a virtual space generation server according to an embodiment. [Diagram 3] FIG. 2 is a diagram showing the functional configuration of a visitor terminal according to an embodiment. [Figure 4] FIG. 4 is a diagram showing a functional configuration of a staff terminal according to an embodiment. [Diagram 5] FIG. 2 is a diagram showing a processing procedure of the virtual space providing system for a first mode of sharing of display contents in the virtual space providing system according to an embodiment. [Figure 6] FIG. 13 is a diagram showing an example of a screen displayed on a staff terminal in a first form of sharing of display contents in the virtual space providing system of the embodiment. [Figure 7] FIG. 2 is a diagram showing an example of a screen displayed on a visitor terminal in a first form of sharing of display contents in the virtual space providing system of one embodiment. [Figure 8] FIG. 13 is a diagram showing an example of a screen displayed on a staff terminal in a second form of sharing of display contents in the virtual space providing system of the embodiment. [Figure 9] FIG. 13 is a diagram showing an example of a screen displayed on a visitor terminal in a second form of sharing of display contents in the virtual space providing system of one embodiment. [Figure 10]FIG. 11 is a diagram showing a processing procedure of the virtual space providing system in a second form of sharing of display contents in the virtual space providing system according to an embodiment. [Figure 11] FIG. 13 is a diagram showing an example of a screen displayed on a staff terminal in a second form of sharing of display contents in the virtual space providing system of the embodiment. [Figure 12] FIG. 13 is a diagram showing an example of a screen displayed on a visitor terminal in a second form of sharing of display contents in the virtual space providing system of one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0023] An embodiment of a virtual space generating device, a virtual space generating program, and a virtual space generating method will be described with reference to the drawings. [Overall configuration of the virtual space provision system] The overall configuration of a virtual space providing system 100 will be described with reference to Fig. 1. In this embodiment, as an example, a case will be described in which the virtual space providing system 100 is used for customer service in a store that handles various products.
[0024] 1, the virtual space providing system 100 includes a virtual space generation server 10, which is an example of a virtual space generating device, one or more visitor terminals 20, and one or more staff terminals 30. The virtual space generation server 10, the visitor terminals 20, and the staff terminals 30 are each connected via a network NW such as the Internet.
[0025] The virtual space generation server 10 generates a virtual space VS including a store. The visitor terminal 20 is a terminal operated by a visitor user Pg, who is a user visiting a store in the virtual space VS. The visitor user Pg is, in other words, a user of the above-mentioned customer service. The visitor user Pg uses an avatar to use the store in the virtual space VS by operating the visitor terminal 20. The visitor user Pg is an example of a first user, and the visitor terminal 20 is an example of a first terminal.
[0026] The staff terminal 30 is a terminal operated by a staff user Ps who is a user who works as a clerk in a store in the virtual space VS. The staff user Ps is, in other words, a customer service representative in the store in the virtual space VS. The staff user Ps serves customers in the store in the virtual space VS using an avatar by operating the staff terminal 30. The staff user Ps is an example of a second user, and the staff terminal 30 is an example of a second terminal. An avatar is a character that acts as the user's alter ego in the virtual space VS.
[0027] In this embodiment, at least a part of the display contents of the terminals 20 and 30, in other words, at least a part of the screens of the terminals 20 and 30, are shared between a plurality of users including one or more staff users Ps and one or more visitor users Pg. The object to be shared, that is, at least a part of the display contents, is the shared object.
[0028] [Virtual space provision system configuration] The configuration of each device constituting the virtual space providing system 100 will be described with reference to FIGS.
[0029] The functional configuration of the virtual space generation server 10 will be described with reference to Fig. 2. The virtual space generation server 10 includes a communication unit 11, a control unit 12, and a storage unit 13. The communication unit 11 performs communication processing between the virtual space generation server 10 and each of the visitor terminals 20 and staff terminals 30, such as connecting to a network and sending and receiving data.
[0030] The control unit 12 executes a virtual space generating program stored in the storage unit 13, and thereby functions as a virtual space generating unit 12a, a shared range setting unit 12b, and a shared control unit 12c.
[0031] The virtual space generation unit 12a generates a virtual space VS and manages the positions of the avatars of visitor users Pg and staff users Ps in the virtual space VS. The shared range setting unit 12b sets a shared range, which is a group of users with whom the display content is shared. The shared range includes one or more staff users Ps and one or more visitor users Pg.
[0032] The sharing control unit 12c controls the sharing of display contents by controlling the exchange of information with the terminals 20 and 30 of users included in the sharing range. The sharing control unit 12c generates shared data, which is data for displaying the shared object on the terminals 20 and 30 of users included in the sharing range. The sharing control unit 12c also sets operation authority for users included in the sharing range. The operation authority is the authority to change the state of the shared object by operating the terminals 20 and 30.
[0033] The virtual space generating unit 12a, the shared range setting unit 12b, and the shared control unit 12c cooperate to generate data for displaying various screens for using the virtual space providing system 100 on the visitor terminal 20 and the staff terminal 30, and this data is transmitted to each terminal 20, 30 by the communication unit 11. The data transmitted by the communication unit 11 includes the shared data.
[0034] In addition, part of the data for displaying the above screen may be stored in each terminal 20, 30, and the data transmitted from the virtual space generation server 10 need only include information that specifies at least part of the display content of the above screen, such as avatar position information.
[0035] The storage unit 13 stores various programs and data necessary for the control unit 12 to execute processes. The storage unit 13 stores a virtual space generation program as an example of such a program. The storage unit 13 also stores virtual space data 13a and user management data 13b as examples of such data.
[0036] The virtual space data 13a includes data necessary for generating the virtual space VS, such as information on a three-dimensional orthogonal coordinate system set for the space, position information of objects to be placed in the space, and information for drawing them. The virtual space data 13a also includes information for drawing the avatars of the visitor users Pg and the staff users Ps.
[0037] The user management data 13b includes information about visitor users Pg and staff users Ps. Such information includes, as information about the shared range, information indicating users included in the shared range and information indicating users who have operation authority among the users included in the shared range. Such information about users may be managed in association with the user identification information.
[0038] The physical configuration, i.e., the hardware configuration, of the virtual space generation server 10 having the above functions will be described. The virtual space generation server 10 includes electronic circuits, which are arithmetic devices such as a CPU, MPU, and GPU, memories such as ROM, RAM, registered memory, and unbuffered memory, and storage devices such as SSD and HDD. The arithmetic devices load an operating system and various programs from the storage into the memory, and execute commands retrieved from the memory. The virtual space generation server 10 may include integrated circuits such as ASIC and FPGA.
[0039] The virtual space generation server 10 also includes a communication interface for transmitting and receiving data to and from a connected device via a network. The communication interface is implemented as hardware, software, or a combination of these.
[0040] Each process executed by the virtual space generation server 10 may be executed by software included in the virtual space generation server 10, or may be realized by a combination of an integrated circuit included in the virtual space generation server 10 and software.
[0041] The functional configuration of the visitor terminal 20 will be described with reference to Fig. 3. The visitor terminal 20 comprises a communication unit 21, a control unit 22, a storage unit 23, an input unit 24, and an output unit 25. The communication unit 21 performs communication processing between the visitor terminal 20 and the virtual space generation server 10, such as connecting to a network and sending and receiving data. The input unit 24 accepts operation and voice input to the visitor terminal 20 and sends data and signals corresponding to the input to the control unit 22. The output unit 25 receives data and signals from the control unit 22 and outputs images and sounds.
[0042] The storage unit 23 stores various programs and data necessary for the execution of processes by the control unit 22. The storage unit 23 stores a visitor management program as an example of such a program.
[0043] The control unit 22 functions as a visitor screen management unit 22a by executing a visitor management program stored in the memory unit 23. The visitor screen management unit 22a displays various screens for use of the virtual space provision system 100 on a display unit included in the output unit 25. In addition, the visitor screen management unit 22a transmits information according to user operations on the displayed screen to the virtual space generation server 10 via the communication unit 21.
[0044] The functions of the visitor terminal 20 in the virtual space providing system 100 are embodied by application software for using the virtual space providing system 100. The visitor management program is included in the application software.
[0045] The functional configuration of the staff terminal 30 will be described with reference to Fig. 4. The staff terminal 30 includes a communication unit 31, a control unit 32, a storage unit 33, an input unit , and an output unit . The communication unit 31 performs communication processing between the staff terminal 30 and the virtual space generation server 10, such as connecting to a network and sending and receiving data. The input unit 34 accepts operation and voice input to the staff terminal 30, and sends data and signals corresponding to the input to the control unit 32. The output unit 35 receives data and signals from the control unit 32, and outputs images and sounds.
[0046] The storage unit 33 stores various programs and data necessary for the execution of processes by the control unit 32. The storage unit 33 stores a staff management program as an example of such a program.
[0047] The control unit 32 functions as a staff screen management unit 32a by executing a staff management program stored in the memory unit 33. The staff screen management unit 32a displays various screens for use of the virtual space providing system 100 on a display unit included in the output unit 35. In addition, the staff screen management unit 32a transmits information corresponding to user operations on the displayed screen to the virtual space generating server 10 via the communication unit 31.
[0048] The functions of the staff terminal 30 in the virtual space providing system 100 are embodied by application software for using the virtual space providing system 100. The above-mentioned staff management program is included in the application software.
[0049] We will now explain the physical configuration, i.e., the hardware configuration, of the visitor terminal 20 and the staff terminal 30. Each of the visitor terminal 20 and the staff terminal 30 is a smartphone, tablet device, personal computer, wearable computer, or an information processing device other than these devices that can display images.
[0050] Each of the visitor terminal 20 and staff terminal 30 is configured such that a computing device, which is a circuit such as a CPU, loads an operating system and various programs from storage into memory and executes commands retrieved from the memory, and communicates with the virtual space generation server 10 via a communication interface. Each of the visitor terminal 20 and staff terminal 30 also has input devices such as a touch panel, operation buttons, a keyboard, a mouse, a controller, a camera, a microphone, and output devices including a display panel and a speaker.
[0051] [Shared range settings] The users included in the shared range may be all users who are in the store in the virtual space VS, or may be a portion of the users.
[0052] In a first example, after a user enters the virtual space VS, a user group that is a group including a plurality of users is set, and this user group is set as the shared range. For example, a list of users who have entered a store in the virtual space VS is displayed on the staff terminal 30, and the staff user Ps designates one or more visitor users Pg to be invited to the user group. As a result, a request for setting a user group is sent from the staff terminal 30 to the virtual space generation server 10, and the virtual space generation server 10 transmits an invitation to the user group to the visitor terminal 20 of the designated visitor user Pg. When the visitor user Pg accepts the invitation on the visitor terminal 20, the virtual space generation server 10 sets a user group including the staff user Ps who instructed the invitation and the visitor user Pg who accepted the invitation. Then, the virtual space generation server 10 sets the user group as the shared range. Note that the user who instructed the invitation is a representative user, and the representative user may be the visitor user Pg.
[0053] In the second example, before a user enters the virtual space VS, a group including multiple visitor users Pg is set, and a separate virtual space VS is generated for each group. Then, for each virtual space VS, a shared range consisting of all users who have entered the virtual space VS is set.
[0054] For example, a representative user, who is an arbitrary visitor user Pg, designates one or more other visitor users Pg to be invited to the group on the visitor terminal 20. As a result, a request for setting up a group is sent from the visitor terminal 20 of the representative user to the virtual space generation server 10, and the virtual space generation server 10 transmits a notification of an invitation to the group to the visitor terminal 20 of the designated visitor user Pg. When the visitor user Pg accepts the invitation on the visitor terminal 20, the virtual space generation server 10 sets up a group including the representative user and the visitor user Pg who received the invitation. Then, the virtual space generation server 10 generates a virtual space VS in which the visitor users Pg of the group are specified as the entry targets. In other words, a virtual space VS set as the entry destination of the group is generated. When the visitor user Pg performs a predetermined operation on the visitor terminal 20, the virtual space generation server 10 allows the visitor user Pg to enter the virtual space VS set as the entry destination of the group including the visitor user Pg.
[0055] In this way, visitor users Pg entering one virtual space VS are limited to visitor users Pg of one group. Staff users Ps are permitted to enter the virtual space VS of each group without restriction or with the consent of visitor users Pg in the group. The virtual space generation server 10 sets a group of visitor users Pg and staff users Ps entering one virtual space VS as one shared range.
[0056] In a third example, for a virtual space VS for which no entry target is specified, that is, a virtual space VS that anyone can enter, a shared range that includes all users who have entered the virtual space VS is set.
[0057] The shared range may be set at a predetermined timing such as the setting of a user group or the entry of a user into the virtual space VS for each group, or may be set based on an instruction to set the shared range at the staff terminal 30. The shared range may also be changed in response to the entry and exit of a user into the virtual space VS. The set shared range is recorded as included in the user management data 13b. The setting of the group and the shared range is a process performed by the shared range setting unit 12b, and the generation of the virtual space VS for each group and the entry of a user into the virtual space VS are processes performed by the virtual space generation unit 12a.
[0058] In this embodiment, the source of sharing of the display contents is the staff terminal 30, that is, the leader of sharing is the staff user Ps. Within the sharing range, the operation authority of the shared object is set to one staff user Ps who is the leader of sharing.
[0059] The visitor user Pg enters a store in the virtual space VS as an avatar by starting up application software for using the virtual space provision system 100 on the visitor terminal 20 and performing predetermined operations such as logging in and selecting the store to enter. That is, when the above-mentioned predetermined operations are performed on the visitor terminal 20, the virtual space generation server 10 sets the position of the visitor user Pg's avatar in the virtual space VS and transmits data indicating the display content of the screen displaying the inside of the virtual space VS to the visitor terminal 20.
[0060] By moving the avatar through operations on the visitor terminal 20, the avatar moves within the store in the virtual space VS, and the range of the store displayed on the visitor terminal 20 also moves accordingly. This allows the visitor user Pg to engage in activities in the virtual space VS, such as viewing exhibits such as merchandise displayed within the store.
[0061] Similarly, the staff user Ps enters the store in the virtual space VS as an avatar by performing a predetermined operation on the staff terminal 30. That is, when the predetermined operation is performed on the staff terminal 30, the virtual space generation server 10 sets the position of the avatar of the staff user Ps in the virtual space VS, and transmits data indicating the display contents of the screen displaying the inside of the virtual space VS to the staff terminal 30. The staff user Ps also uses the movement of the avatar based on the operation on the staff terminal 30 to proceed with activities in the virtual space VS.
[0062] [Share what you see] The virtual space providing system 100 shares display contents in either a first form or a second form. The first form is a form in which the entire screen is shared, and the second form is a form in which a part of the screen is shared. In the virtual space providing system 100, either the first form or the second form may be set in advance as the form of sharing of display contents, or the user may be able to select either the first form or the second form. For example, at the start of sharing, the staff user Ps may select either the first form or the second form at the staff terminal 30.
[0063] The first and second embodiments will be described in detail below. <First form> In the first form, the entire screen displayed on the staff terminal 30 of the staff user Ps who is the initiator of sharing is shared with the visitor terminal 20 of the visitor user Pg who is included in the sharing range. That is, in the first form, the entire screen is the subject to be shared. Note that the "entire screen" to be shared may be the portion of the display contents of the terminals 20, 30 excluding the portion that functions as a user interface.
[0064] The flow of processing performed by the virtual space providing system 100 for sharing display contents in the first mode will be described with reference to FIGS. As shown in Figure 5, when a staff user Ps operates the staff terminal 30 to instruct the start of sharing, screen information, which is information about the screen displayed on the staff terminal 30, is sent from the staff terminal 30 to the virtual space generation server 10 (step S10).
[0065] In detail, when the sharing range is set, a sharing instruction area R1, which is an area for instructing sharing, is displayed on the staff terminal 30, and the staff user Ps selects the sharing instruction area R1 to instruct the start of sharing. Fig. 6 shows an example of a screen of the staff terminal 30 on which the sharing instruction area R1 is displayed. Fig. 6 shows, as an example, a screen Ia on which an avatar As of a staff user Ps, who is the operator of the staff terminal 30, is placed in a store in the virtual space VS.
[0066] After the sharing instruction area R1 is selected, the staff terminal 30 may confirm whether sharing should be started, and then transmit the screen information to the virtual space generating server 10. The staff user Ps who instructed the start of sharing is the initiator of sharing, and the operation authority for the shared object is set to this staff user Ps.
[0067] Continuing to show in FIG. 5, upon receiving the screen information, the virtual space generation server 10 transmits shared data to the visitor terminal 20 of the visitor user Pg included in the shared range, targeting the shared range including the staff user Ps who instructed the start of sharing (step S11).
[0068] The shared data may be configured so that the screen displayed on the staff terminal 30 can be reproduced on the visitor terminal 20, and may include, for example, video data showing the display content of the screen. The screen information may be information required for the virtual space generation server 10 to generate such shared data. The generation of the shared data is a process performed by the shared control unit 12c.
[0069] The visitor terminal 20 that has received the shared data displays a screen based on the shared data (step S12). As a result, a screen including display content that matches the screen of the staff terminal 30 is displayed on the visitor terminal 20. Figure 7 shows the screen Ib of the visitor terminal 20 whose screen is shared with the staff terminal 30 shown in Figure 6.
[0070] The virtual space generation server 10 continuously receives screen information from the staff terminal 30 and transmits shared data to the visitor terminal 20 in a sequential manner so that changes in the display content on the staff terminal 30 are immediately reflected on the visitor terminal 20. This allows changes in the display content on the staff terminal 30 based on the operation of the staff user Ps to be reflected on the display content on the visitor terminal 20 in real time or close to real time.
[0071] When a screen is being shared, an end instruction area, which is an area for instructing the end of sharing, is displayed on the staff terminal 30 of the staff user Ps, who is the initiator of the sharing, and when the end instruction area is selected, the transmission of the shared data is stopped and the sharing of the screen is ended.
[0072] 6 and 7 show an example in which a screen showing the inside of a store in the virtual space VS is shared, but the display contents of the shared screen are not limited. The shared screen may include, for example, 3D objects or 2D images showing products, videos for introducing products, materials such as PDF files or PowerPoint files, etc. In short, the shared screen may be any screen displayed on the staff terminal 30 while the virtual space providing system 100 is being used.
[0073] Also, it is sufficient if chatting by text or voice is possible within the shared range. That is, the virtual space generation server 10 transmits character or voice information input to a terminal of a user included in the shared range to the terminal of another user included in the shared range. This allows users to have a conversation within the shared range. If the user's remarks are made public only within the shared range, conversations including information that should not be leaked, such as personal information, are also possible between staff users Ps and visitor users Pg. The exchange of information to realize such chatting is also processed by the sharing control unit 12c.
[0074] As described above, since the screen is shared within the shared range, the staff user Ps can provide customer service to the visitor user Pg, such as guiding the visitor user Pg around the store and explaining products, while referring to the display contents of the terminals 20 and 30. That is, communication between the staff user Ps and the visitor user Pg is assisted by the display images of the terminals 20 and 30. Therefore, smoother communication is possible.
[0075] <Second form> In the second form, a part of the screen displayed on the staff terminal 30 of the staff user Ps who is the initiator of sharing is shared with the visitor terminal 20 of the visitor user Pg who is included in the sharing range. The part of the screen is the subject to be shared, and specific examples of the subject to be shared include 3D objects and 2D images showing products, videos introducing products, and materials such as PDF files and PowerPoint files.
[0076] First, as one aspect of the second embodiment, a mode in which a change in the state of a shared object is reflected immediately, in other words, a mode in which sharing continues in real time or at a speed close to real time, will be described. In the above embodiment, when a staff user Ps operates the staff terminal 30 to specify a shared object and to start sharing, the shared object information, which is information about the displayed shared object, is transmitted from the staff terminal 30 to the virtual space generation server 10. Thereafter, as in the first embodiment, the shared data is transmitted from the virtual space generation server 10 to the visitor terminal 20 of the visitor user Pg in the sharing range, and display is performed on the visitor terminal 20 based on the shared data. As a result, the shared object that matches the display content of the staff terminal 30 is displayed on the visitor terminal 20.
[0077] The shared data may be configured so that the shared object displayed on the staff terminal 30 can be reproduced on the visitor terminal 20, and may include information according to the configuration of the shared object, such as a still image or video of the shared object, information indicating the size and orientation of the shared object, and information indicating the playback position and page position of the shared object. The shared object information may be information required for the virtual space generation server 10 to generate such shared data. The generation of the shared data is a process performed by the sharing control unit 12c.
[0078] FIG. 8 shows an example of a screen of a staff terminal 30 sharing display content in the second form, and FIG. 9 shows a screen of a visitor terminal 20 sharing display content with the staff terminal 30 shown in FIG.
[0079] 8 shows an example in which an object Ob, which is a 3D object, is displayed on the staff terminal 30. For example, by selecting a product exhibited in a store in the virtual space VS, an object Ob representing the selected product is displayed on the staff terminal 30. By designating the object Ob as a sharing target and selecting the sharing instruction area R1, which is an area for instructing sharing, the object Ob is displayed on the visitor terminal 20, as shown in FIG.
[0080] It is sufficient that the display contents other than the object Ob on the screen Ic of the staff terminal 30 are different from the display contents other than the object Ob on the screen Id of the visitor terminal 20. For example, in Fig. 8 and Fig. 9, in the area other than the object Ob, the staff terminal 30 displays the vicinity of the avatar As of the staff user Ps in the store in the virtual space VS, and the visitor terminal 20 displays the vicinity of the avatar Ag of the visitor user Pg in the store in the virtual space VS.
[0081] The virtual space generation server 10 continuously receives the information to be shared from the staff terminal 30 and transmits the shared data to the visitor terminal 20 in a sequential manner so that any changes in the state of the shared object on the staff terminal 30 are immediately reflected on the visitor terminal 20. This allows any changes in the state of the shared object based on the operation of the staff user Ps on the staff terminal 30 to be immediately reflected on the display content of the visitor terminal 20.
[0082] For example, a change in size or orientation of an object Ob on the staff terminal 30 is reflected in the display content of the visitor terminal 20 in real time or at a speed close to real time. Furthermore, if the object to be shared is a video, the playback position is synchronized on the terminals 20, 30 within the sharing range, and the playback state of the video, such as start, end, pause, rewind, and fast forward, is also synchronized. Furthermore, if the object to be shared is a document, the page and the position within the page displayed on the terminals 20, 30 within the sharing range are synchronized.
[0083] When a shared object is being shared, an end instruction area, which is an area for instructing the end of sharing, is displayed on the staff terminal 30 of the staff user Ps who is the initiator of sharing, and when the end instruction area is selected, the transmission of the shared data is stopped and the sharing of the screen is ended.
[0084] In the above configuration, as in the first embodiment, communication between staff users Ps and visitor users Pg is assisted by the display images of the terminals 20, 30. Therefore, smoother communication is possible.
[0085] Next, as one aspect of the second embodiment, a mode in which only the state of the sharing target at the time designated by the staff user Ps is shared will be described with reference to Figs. 10 to 12. As shown in FIG. 10, the sharing object is changed to the staff user Ps's desired state on the staff terminal 30 by the staff user Ps's operation (step S20). For example, if the sharing object is a 3D object, the orientation and size of the 3D object are operated. Also, for example, if the sharing object is a 2D image, the size of the 2D image is operated. FIG. 11 shows an example in which the sharing object is a 3D object, object Ob, and the size of object Ob is changed on the screen Ie of the staff terminal 30. In this way, the staff user Ps operates the sharing object to a state suitable for explanations to the visitor user Pg, etc.
[0086] After the object to be shared has been brought to the desired state, the staff user Ps operates the sharing instruction area R1, which is the area for instructing sharing, to select it; in other words, sharing is instructed on the staff terminal 30, and object state information, which is information indicating the object to be shared at the time sharing is instructed, is transmitted from the staff terminal 30 to the virtual space generation server 10 (step S21).
[0087] When receiving the target state information, the virtual space generation server 10 transmits the shared data to the visitor terminal 20 of the visitor user Pg included in the shared range, targeting the shared range including the staff user Ps who instructed the sharing (step S22).
[0088] The shared data only needs to be configured so that the shared object displayed on the staff terminal 30 at the time the sharing is instructed can be reproduced on the visitor terminal 20, and it only needs to include information according to the configuration of the shared object, such as a still image of the shared object, information indicating the size and orientation of the shared object, and information indicating the playback position and page position of the shared object.The object status information only needs to be information required for the virtual space generation server 10 to generate such shared data.The generation of the shared data is a process performed by the sharing control unit 12c.
[0089] The visitor terminal 20 that has received the shared data displays the shared object based on the shared data (step S23). As a result, the state of the shared object displayed on the staff terminal 30 at the time the sharing was instructed is reflected in the display content of the visitor terminal 20. Figure 12 shows the screen If of the visitor terminal 20 in which the display of the shared object is shared with the staff terminal 30 shown in Figure 11. The visitor terminal 20 displays an object Ob in a state that is identical to the object Ob displayed on the staff terminal 30 at the time the sharing was instructed.
[0090] Even if the shared target is operated on the staff terminal 30 to change its status after the instruction to share is given, the change in the status of the shared target is not immediately reflected in the display content of the visitor terminal 20. The display content of the visitor terminal 20 is updated by repeating the processing of steps S20 to S23 shown in Fig. 10. In other words, by instructing sharing again on the staff terminal 30 after changing the status of the shared target, the status of the shared target at the time this instruction to share was given is reflected in the display content of the visitor terminal 20.
[0091] In this way, the shared object is shared at any timing designated by the staff user Ps, so the staff user Ps can display the shared object in a state suitable for customer service on the terminal 20, 30 and serve the visitor user Pg while referring to the displayed content. This also allows for smoother communication between the staff user Ps and the visitor user Pg, as the communication is assisted by the display image on the terminal 20, 30. Furthermore, the amount of data communication and the processing load on the virtual space generating server 10 can be reduced compared to a form in which changes in the state of the shared object are reflected immediately.
[0092] Depending on the contents of the shared object, it may be possible to predict the state suitable for customer service. In such a case, the state of the shared object to be shared may be predetermined. For example, if the shared object is a 3D object of a cup having a characteristic shape of the handle, it is predicted that the explanation will be given while looking at the handle when serving customers. Therefore, it can be said that a 3D object oriented so that the handle is clearly visible is a shared object in a state suitable for customer service. Then, the 3D object in the above orientation is predetermined as the display content to be shared. In this case, the staff user Ps gives an instruction by a predetermined operation, such as selecting the handle of a cup displayed on the staff terminal 30, and the predetermined display content is displayed on each terminal 20, 30 within the sharing range.
[0093] With the above configuration, the staff user Ps can serve the visitor user Pg while sharing the display contents between the staff terminal 30 and the visitor terminal 20. Furthermore, since the display contents to be shared are predetermined, the processing load of the virtual space generation server 10 can be further reduced, and the operational load of the staff user Ps can also be reduced.
[0094] In the above configuration, data for displaying predetermined display contents is the shared data. In short, in either the first or second form, the display contents may be shared on the terminals of users within the sharing range based on the shared data being sent to terminals of users other than the initiator of sharing within the sharing range, or to terminals of all users within the sharing range, including the initiator of sharing.
[0095] In the second form, chatting by text or voice is also possible within the sharing range. In both the first and second forms, the sharing range may include staff users Ps other than the staff user Ps who instructed the sharing, and in this case, the shared data is also transmitted to the staff terminal 30 of the other staff user Ps, and the display content is shared.
[0096] [Modifications of sharing display content] The above-described manner of sharing the display contents may be modified as follows. The initiator of sharing may be the visitor user Pg, that is, the source of sharing of the display contents may be the visitor terminal 20. The initiator of sharing is the target user, and the operation authority is set for the target user. Also, the sharing range may include only the visitor user Pg, or may include only the staff user Ps.
[0097] Also, it may be possible to change the user with operation authority. For example, the user with operation authority may be changed from a staff user Ps who is the initiator of sharing to a visitor user Pg within the sharing range. Specifically, based on a predetermined operation being performed on the staff terminal 30 or the visitor terminal 20, a request for change of operation authority is sent from the terminal to the virtual space generation server 10, and the virtual space generation server 10 changes the user with operation authority.
[0098] The virtual space generation server 10 receives an instruction to change the state of a shared object from a terminal operated by a user who has operation authority, and transmits data to each terminal within the sharing range so that the change in state according to the instruction is reflected in the above-mentioned first or second form. The process of transferring operation authority and the reception of instructions from a user who has operation authority are processes performed by the sharing control unit 12c.
[0099] The ability to transfer operating authority allows each user included in the shared range to explain their own opinions, questions, etc. while operating the displayed content themselves, making communication smoother.
[0100] The operation authority may be freely transferred according to the user's instruction, or may be forcibly transferred by the virtual space generating server 10. For example, in a case where the shared range consists only of visitor users Pg, when a staff user Ps is added to this shared range, the operation authority may be forcibly transferred to the staff user Ps. Also, the operation authority may be set for multiple users.
[0101] The transmission of the shared data to the terminals 20 and 30 of the users within the sharing range may be executed when a predetermined condition such as the entry of the user into the virtual space VS is satisfied, instead of at the instruction of the initiator of sharing. In this case, the shared object is, for example, a video, etc., and is determined in advance. The shared object may also be a screen within the virtual space VS, such as a screen projected on a wall surface within the virtual space VS or a screen displayed on a monitor arranged within the virtual space VS. That is, as a result of transmitting data to the terminals 20 and 30 of each user within the sharing range to display the shared object, the same shared object may be displayed on the terminal of one user and the terminal of another user within the sharing range. In this case, the initiator of sharing, who is the source of the sharing of the display contents, may not be present within the sharing range. In short, when one user within the sharing range is set as the target user, it is sufficient that the shared object, which is at least a part of the display contents of the terminal of the target user, is also displayed on the terminals of users other than the target user included in the sharing range. The shared object may also be a whiteboard on which users having operating authority can freely write. As described above, according to the above embodiment, the following effects can be obtained.
[0102] (1) Display content can be shared on the devices of users within the sharing range, so users can communicate with each other while referring to the display content of the devices. In this way, users' communication is assisted by the display image of the device, making communication smoother.
[0103] (2) In customer service, staff users Ps often have the opportunity to guide and explain things to visitor users Pg. By having staff users Ps take the lead in sharing, they can accurately select and share display content appropriate for customer service, making it possible to provide smooth service.
[0104] (3) If the shared range is a group consisting of a portion of the multiple users who have entered the virtual space VS, users who need to share the display content can be accurately included in the shared range. In addition, in the virtual space VS, multiple shared ranges are set based on the formation of multiple groups, and the display content can be shared separately for each shared range, so the display content sharing function can be used with a high degree of freedom.
[0105] (4) If a virtual space VS is generated for each group of visitor users Pg, it is easier to grasp the positions of the avatars Ag of the group members and to communicate through the avatars Ag, compared to when the group enters one virtual space VS with an unspecified number of visitor users Pg. Furthermore, by setting a shared range consisting of all users who have entered the virtual space VS for each virtual space VS, the group of visitor users Pg who are planning to participate in activities together in the virtual space VS can be accurately included in the shared range. This makes it easier to advance group activities in the virtual space VS.
[0106] (5) If changes in the status of a shared object on the device of a user with operating authority are instantly reflected on the devices of other users within the sharing range, changes in the status of the shared object can be shared in detail, enabling smoother communication.
[0107] (6) If the state of the shared object at the time when the user with operating authority specifies it on his / her terminal is reflected on the terminals of other users within the sharing range, it is possible to reduce the amount of data communication and the processing load on the virtual space generation server 10 while enabling sharing of the display content.
[0108] (7) If the content to be shared is a part of the display content of the terminal, only the necessary information can be shared. If the content to be shared includes at least one of 3D objects, 2D images, and videos, information that is helpful in serving customers can be shared appropriately.
[0109] (8) The ability to transfer operating authority allows each user included in the shared range to explain their own opinions, questions, etc. while operating the displayed content themselves, allowing for smoother communication.
[0110] [Variations] The above embodiment can be modified and implemented as follows. The use of the virtual space providing system 100 is not limited to customer service in a store that handles products. For example, when the virtual space providing system 100 is used for customer service, the facilities included in the virtual space VS are not limited to stores, but may be event venues such as exhibitions, or model rooms. Customer service includes, for example, sales and explanations of products, explanations of exhibits and facilities, tourist information, and the like. Furthermore, products are not limited to physical objects, but also include financial products, and the like.
[0111] The virtual space providing system 100 may also be used for medical services such as counseling, educational services, administrative services, etc. In short, a first user who is a user of a service in the virtual space VS and a second user who is a person who interacts with the first user in the virtual space VS may enter the virtual space VS as avatars. In other words, the second user is a provider of the service.
[0112] The facilities included in the virtual space VS may be structures or buildings established for a specific purpose, such as commercial facilities, financial facilities, public facilities, medical facilities, welfare facilities, tourist facilities, factories, etc. Furthermore, in cases where the virtual space providing system 100 is used for tourist guidance, etc., the virtual space VS may not include facilities, but may be a space in which natural objects such as trees and rocks are arranged.
[0113] The virtual space providing system 100 may perform multilingual translation or simultaneous interpretation of text and voice input / output to the visitor terminal 20 and the staff terminal 30. With this configuration, global support is possible for visitor users Pg, staff users Ps, products handled, etc.
[0114] The functions of the virtual space generation server 10 may be realized by a plurality of information processing devices. One information processing device is a single computer device. In other words, the virtual space generation device may be configured from one or a plurality of information processing devices. [Explanation of symbols]
[0115] Pg…Visitor user Ps…Staff user VS…Virtual space 10…Virtual space generation server 20… Visitor terminal 30…Staff terminal 100...Virtual space provision system
Claims
1. a virtual space generation unit that allows a first user who will be a user of a service in a virtual space and a second user who will be a contact for the first user in the virtual space to enter the virtual space as avatars based on requests from terminals operated by each user, and manages the movement of the avatars of each user in the virtual space based on operations of the terminals by each user; a sharing range setting unit that sets a sharing range consisting of a plurality of users including the first user and the second user; a communication unit that transmits data for displaying the shared content to a terminal operated by another user other than the target user and that is included in the sharing range, the data being a target user, and a part of the display content of a terminal operated by the target user being a shared content; The communication unit transmits display data to each terminal so that the shared object is displayed on the terminal operated by the target user with the vicinity of the target user's avatar as a background, and the shared object is displayed on the terminal operated by the other user with the vicinity of the other user's avatar as a background. Virtual space generation device.
2. a virtual space generation unit that allows a first user who will be a user of a service in a virtual space and a second user who will be a contact for the first user in the virtual space to enter the virtual space as avatars based on requests from terminals operated by each user; a sharing range setting unit that sets a sharing range consisting of a plurality of users including the first user and the second user; a communication unit that transmits data for displaying the shared content to a terminal operated by another user other than the target user and that is included in the sharing range, the data being a target user, and at least a part of the display content of a terminal operated by the target user being a shared content; a sharing control unit that receives an instruction to change the state of the shared object from a terminal operated by a user who has been granted operation authority, which is the authority to change the state of the shared object; The processing of the sharing control unit includes changing the user to whom the operation authority is set, without receiving a request to change the user who has the operation authority from a terminal operated by a user included in the sharing range. Virtual space generation device.
3. A sharing control unit that receives an instruction to change the state of the shared object from a terminal operated by a user who has been granted operation authority to change the state of the shared object, The sharing control unit sets the operation authority for a plurality of users included in the sharing range. The virtual space generating device according to claim 1 .
4. The sharing control unit sets the operation authority for a plurality of users included in the sharing range. The virtual space generating device according to claim 2 .
5. The shared object includes a screen located within the virtual space. The virtual space generating device according to claim 1 or 2.
6. The shared range is a group consisting of a portion of a plurality of users who have entered the virtual space, The sharing range setting unit, upon receiving a request from a terminal operated by a representative user who is the first user or the second user, sets the group including the representative user and a user designated by the representative user, and sets the group as the sharing range. The virtual space generating device according to claim 1 or 2.
7. the sharing range setting unit sets a group consisting of a plurality of the first users in response to a request from a terminal operated by the first user; the virtual space generation unit generates, for each group, the virtual space into which the first users included in the group are allowed to enter; The shared range setting unit further sets, for each virtual space, the shared range consisting of all users entering the virtual space. The virtual space generating device according to claim 1 or 2.
8. The virtual space includes a facility, and the service is provided in the facility. The virtual space generating device according to claim 1 or 2.
9. The communication unit transmits the data so that a change in the state of the shared object on the terminal operated by the target user is immediately reflected on the terminal operated by the other user. The virtual space generating device according to claim 1 or 2.
10. The communication unit transmits the data so that a state of the shared object at a time when the target user designates the shared object on the terminal operated by the target user is reflected on the terminal operated by the other user. The virtual space generating device according to claim 1 or 2.
11. The sharing target is a part of the display content and includes at least one of a 3D object, a 2D image, and a video. The virtual space generating device according to claim 1 or 2.
12. The target user is the second user. The virtual space generating device according to claim 1 or 2.
13. The authority to change the state of the shared object is an operation authority, a sharing control unit that receives a request from a terminal operated by a user included in the sharing range, changes the user to whom the operation authority has been set from the target user to the other user, and receives an instruction to change the state of the shared object from the terminal operated by the user to whom the operation authority has been set. The virtual space generating device according to claim 1 .
14. On one or more computers, Allowing a first user who will be a user of a service in a virtual space and a second user who will be a contact for the first user in the virtual space to enter the virtual space as avatars based on requests from terminals operated by each user, and managing the movement of each user's avatar in the virtual space based on operations of the terminals by each user; setting a shared range consisting of a plurality of users including the first user and the second user; a program that executes the process of transmitting data for displaying the shared content to a terminal operated by another user who is a user other than the target user and is included in the sharing range, the program comprising: a user who is a target user and is included in the sharing range; a target user; a terminal operated by the target user and is included in the sharing range and is operated by another user; The device transmits display data to each terminal so that the shared object is displayed in the vicinity of the avatar of the target user in the terminal operated by the target user, and the shared object is displayed in the vicinity of the avatar of the other user in the terminal operated by the other user in the background. Virtual space generation program.
15. On one or more computers, allowing a first user who will be a user of a service in a virtual space and a second user who will be a contact for the first user in the virtual space to enter the virtual space as avatars based on requests from terminals operated by each user; setting a shared range consisting of a plurality of users including the first user and the second user; One of the users included in the sharing range is a target user, and at least a part of the display content of a terminal operated by the target user is a sharing target, and data for displaying the sharing target is transmitted to a terminal operated by another user who is a user other than the target user included in the sharing range; receiving an instruction to change the state of the shared object from a terminal operated by a user who has been granted operation authority, which is the authority to change the state of the shared object; changing the user to whom the operation authority has been set, without receiving a request to change the user to whom the operation authority has been set from a terminal operated by a user included in the sharing range. Virtual space generation program.
16. One or more computers Allowing a first user who will be a user of a service in a virtual space and a second user who will be a contact for the first user in the virtual space to enter the virtual space as avatars based on requests from terminals operated by each user, and managing the movement of each user's avatar in the virtual space based on operations of the terminals by each user; setting a shared range consisting of a plurality of users including the first user and the second user; a method for executing the method, wherein one of the users included in the sharing range is a target user, a part of display content of a terminal operated by the target user is a sharing target, and data for displaying the sharing target is transmitted to a terminal operated by another user who is a user other than the target user included in the sharing range, Transmitting display data to each terminal so that the shared object is displayed in the vicinity of the avatar of the target user in the terminal operated by the target user and the shared object is displayed in the vicinity of the avatar of the other user in the terminal operated by the other user in the background. A method for generating virtual space.
17. One or more computers allowing a first user who will be a user of a service in a virtual space and a second user who will be a contact for the first user in the virtual space to enter the virtual space as avatars based on requests from terminals operated by each user; setting a shared range consisting of a plurality of users including the first user and the second user; One of the users included in the sharing range is a target user, and at least a part of the display content of a terminal operated by the target user is a sharing target, and data for displaying the sharing target is transmitted to a terminal operated by another user who is a user other than the target user included in the sharing range; receiving an instruction to change the state of the shared object from a terminal operated by a user who has been granted operation authority, which is the authority to change the state of the shared object; changing the user to whom the operation authority has been set without receiving a request to change the user to whom the operation authority has been set from a terminal operated by a user included in the sharing range. A method for generating virtual space.