Virtual space management device
The virtual space management device allows multiple users to interact within a shared virtual environment by detecting and managing avatars for each user, addressing the limitation of single-user assumptions in existing services.
Patent Information
- Application Number
- JP2023077240
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-09
- Publication Date
- 2024-11-21
AI Technical Summary
Existing virtual space services assume a single user per terminal device, preventing multiple users from enjoying the service together.
A virtual space management device that includes a detection unit to identify additional users, a placement unit to create avatars for them, and update units to manage the actions of both the primary and secondary avatars based on user inputs, allowing multiple users to interact within the virtual space.
Enables multiple users to enjoy virtual space services simultaneously by creating and managing avatars for each user, enhancing collaborative experiences.
Smart Images

Figure 2024162061000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a management device that manages a virtual space. [Background technology]
[0002] Patent Document 1 discloses a technology related to online conferences. In the technology disclosed in Patent Document 1, a terminal device such as a personal computer is assigned to each user. Also, in the technology disclosed in Patent Document 1, a device for participating in an online conference, such as a microphone, is shared by multiple users. In the technology disclosed in Patent Document 1, when a user other than the user logged in to the online conference speaks, the fact that the other user is speaking is expressed in the online conference by displaying the avatar of the other user. An avatar is a character or the like used as an alter ego of a user. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent Publication No. 2022-109048 Summary of the Invention [Problem to be solved by the invention]
[0004] In recent years, virtual space services that enable the use of various virtual spaces such as virtual stores, virtual offices, virtual parks, and virtual homes are becoming more and more popular. A user who enters a virtual space can perform various activities in the virtual space using an avatar that is an alter-ego of the user. Existing virtual space services are based on the premise that one user operates one terminal device. For this reason, even if multiple users are in front of a terminal device, the multiple users cannot enjoy the virtual space service together. [Means for solving the problem]
[0005] A management device according to a preferred embodiment of the present disclosure is a management device for a virtual space, and includes a detection unit, a placement unit, a first update unit, and a second update unit. The detection unit detects that a second user, in addition to the first user, is in front of a terminal device used by a first user who operates the first avatar in the virtual space in which the first avatar is placed. When the detection unit detects the second user, the placement unit places a second avatar representing the second user in the virtual space. When the first update unit receives first instruction data instructing an operation of the first avatar from the terminal device, the first update unit updates the virtual space by moving the first avatar according to the first instruction data. When the second update unit receives second instruction data instructing an operation of the second avatar from the terminal device, the second update unit updates the virtual space by moving the second avatar according to the second instruction data. Effect of the Invention
[0006] According to the present disclosure, multiple users in front of their terminal devices can enjoy virtual space services together. [Brief description of the drawings]
[0007] [Figure 1] 1 is a block diagram showing an example of the configuration of a communication system 1 including a virtual space server 20 according to an embodiment of a management device of the present disclosure. [Diagram 2] 1 is a block diagram showing an example of the configuration of a user device 10. FIG. [Diagram 3] FIG. 1 shows an example of an image G1 captured by imaging device 170 in a situation where only user U(1) is present in front of user device 10(1). [Figure 4] 1 shows an example of an image G2 captured by imaging device 170 in a situation where user U(1) and another user SU are in front of user device 10(1). [Diagram 5] 2 is a block diagram showing an example of the configuration of a virtual space server 20. FIG. [Figure 6]1 is a diagram showing an example of the contents of a user table TBL1 stored in a storage device 220 of a virtual space server 20. FIG. [Figure 7] FIG. 2 is a diagram for explaining the function of a placement unit 230b that is realized by the processing device 230 of the virtual space server 20 in accordance with a program PR1. [Figure 8] 13 is a diagram for explaining the functions of a first update unit 230c and a limiting unit 230e that are realized by the processing device 230 of the virtual space server 20 in accordance with a program PR1. [Figure 9] 13 is a flowchart showing a process flow in a management method executed by the processor 230 according to the program PR1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0008] (A: Embodiment) FIG. 1 is a block diagram showing a configuration example of a communication system 1 including a virtual space server 20 according to an embodiment of a management device of the present disclosure. In the communication system 1, the virtual space server 20 is connected to a communication network NW by wire or wirelessly. The communication network NW is, for example, an electric communication line such as the Internet. As shown in FIG. 1, in addition to the virtual space server 20, each of user devices 10(1), 10(2)... 10(j) is connected to the communication network NW so as to be able to communicate with the virtual space server 20. j is an arbitrary integer of 2 or more. In the following, when it is not necessary to distinguish between the user devices 10(1), 10(2)... 10(j), the user devices 10(1), 10(2)... 10(j) are written as user devices 10. The communication system 1 of this embodiment includes multiple user devices 10, but the number of user devices 10 included in the communication system 1 may be one.
[0009] User device 10(k) is used by user U(k). k is any integer from 1 to j. User U(k) is a user who has registered to use a virtual space service. The virtual space service refers to placing an avatar corresponding to a user in a virtual space and enabling various activities to be performed in the virtual space through the movements of this avatar. Hereinafter, a user who has registered to use the virtual space service is referred to as a main user. User U(k) in this embodiment is the main user.
[0010] The virtual space server 20 is an information processing device that provides a virtual space service. The virtual space server 20 generates virtual space data in response to a request from a user device 10, and transmits the generated virtual space data to the user device 10. The virtual space data is data for displaying an image of a virtual space on the user device 10. The virtual space data includes information indicating the position, shape, and size of virtual objects placed in the virtual space. The virtual objects include the avatar of the main user who has entered the virtual space.
[0011] The user device 10 is an information processing device having a function of displaying an image. In the present embodiment, the user device 10 is a personal computer, but may be a tablet terminal, a mobile device such as a smartphone, or the like. The user device 10 displays an image showing a part of a two-dimensional virtual space according to the virtual space data received from the virtual space server 20.
[0012] Fig. 2 is a block diagram showing a configuration example of the user device 10. As shown in Fig. 2, the user device 10 includes a communication device 110, a storage device 120, a processing device 130, a bus 140, a display device 150, an input device 160, and an imaging device 170. Each of the communication device 110, the storage device 120, the display device 150, the input device 160, and the imaging device 170, and the processing device 130 are connected to each other by a bus 140 that mediates data exchange. The bus 140 may be configured using a single bus, or may be configured using different buses between each element.
[0013] The communication device 110 is hardware (transmitting / receiving device) for communicating with other devices. The communication device 110 is connected to a communication network NW by wire or wirelessly. The communication device 110 communicates with other devices connected to the communication network NW by wire or wirelessly via the communication network NW. An example of such other devices is the virtual space server 20. The communication device 110 receives virtual space data transmitted from the virtual space server 20 via the communication network NW. The communication device 110 provides the received virtual space data to the processing device 130. The communication device 110 also transmits data provided by the processing device 130 to the communication network NW.
[0014] The display device 150 is hardware that displays information to the outside. Specific examples of the display device 150 include a liquid crystal display panel and an organic EL display panel. The input device 160 is input hardware that accepts input from the outside. In this embodiment, the input device 160 is a keyboard having a plurality of operators corresponding to each letter of the alphabet and each number from 0 to 9, but may also be a mouse, a switch, or a button. In this embodiment, the user of the user device 10 can instruct entry into a virtual space, the movement of an avatar, and exit from the virtual space by inputting to the input device 160.
[0015] The imaging device 170 is a camera that captures an image of the surroundings of the user device 10 having the imaging device 170 under the control of the processing device 130. The imaging device 170 outputs image data representing a captured image (hereinafter, imaging data) to the processing device 130. In this embodiment, the imaging device 170 is disposed around the display device 150 so as to capture an image of a user using the user device 10, i.e., a user facing the display device 150.
[0016] As shown in FIG. 3, when the user U(1) is using the user device 10(1) alone, the image capture device 170 of the user device 10(1) captures an image G1 showing the user U(1). In contrast, as shown in FIG. 4, when the user U(1) and another user SU are standing side by side in front of the user device 10(1) and using the user device 10(1), the image capture device 170 of the user device 10(1) captures an image G2 showing the user U(1) and the user SU. In this embodiment, the user SU is a family member or friend of the user U(1) and is a user who has not registered to use the virtual space service, that is, a user who is not a main user. In the following, a user who is not a main user is referred to as a sub-user. The user device 10(1) in the example shown in FIG. 4 is an example of a terminal device in the present disclosure. The user U(1) in the example shown in FIG. 4 is an example of a first user in the present disclosure, and the user SU is an example of a second user in the present disclosure.
[0017] The storage device 120 is a recording medium readable by the processing device 130. The storage device 120 may be configured with at least one of, for example, a read only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), and a random access memory (RAM). A program PR1 is pre-stored in the storage device 220. The program PR1 is a program for allowing the user of the user device 10 to use a virtual space service.
[0018] The processing device 130 includes one or more central processing units (CPUs). The processing device 130 reads the program PR1 from the storage device 120 when an instruction to execute the program PR1 is given by an input to the input device 160. The processing device 130 executes the read program PR1. The processing device 130 executes the program PR1 to function as the imaging control unit 130a, the display control unit 130b, and the operation instruction unit 130c shown in FIG. 2 by executing the program PR1. That is, the imaging control unit 130a, the display control unit 130b, and the operation instruction unit 130c shown in FIG. 2 are software modules realized by operating a computer such as a CPU according to software such as a program. The functions of the imaging control unit 130a, the display control unit 130b, and the operation instruction unit 130c are as follows.
[0019] The imaging control unit 130a captures an image of the surroundings of the user device 10 using the imaging device 170. The imaging control unit 130a transmits imaging data representing the image captured by the imaging device 170 to the virtual space server 20 using the communication device 110. Details will be described later, but as shown in FIG. 4, when the user device 10(1) is being used by the user U(1) and the user SU, the virtual space server 20 detects that the user U(1) and the user SU are in front of the user device 10(1) based on the imaging data received from the user device 10(1).
[0020] Each time the communication device 110 receives virtual space data, the display control unit 130b displays an image of the virtual space represented by the virtual space data on the display device 150. As shown in FIG. 4, which will be described in detail later, when the virtual space server 20 detects that the user U(1) and the user SU are in front of the user device 10(1), the virtual space server 20 generates virtual space data representing a virtual space in which an avatar representing the user U(1) and an avatar representing the user SU are arranged, and transmits the virtual space data to the user device 10(1). In the following, the avatar representing the main user is referred to as the main avatar, and the avatar representing the sub-user is referred to as the sub-avatar. The main avatar is an example of a first avatar in the present disclosure. The sub-avatar is an example of a second avatar in the present disclosure.
[0021] User U(1) who has viewed an image of a virtual space in which a main avatar representing user U(1) and a sub-avatar representing user SU are arranged can instruct the main avatar to move by operating a control that is pre-associated with the main avatar on input device 160. Similarly, user SU who has viewed an image of a virtual space in which a main avatar representing user U(1) and a sub-avatar representing user SU are arranged can instruct the sub-avatar to move by operating a control that is pre-associated with the sub-avatar on input device 160.
[0022] As described above, the input device 160 in this embodiment is a keyboard, and includes 26 operators corresponding to the letters of the alphabet and 10 operators corresponding to the numbers from 0 to 9. In this embodiment, among the multiple operators of the input device 160, for example, the "W", "A", "S", and "D" keys are associated in advance with the main avatar. The "W" key is an operator for instructing to move the main avatar upward on the display image of the display device 150. The "A" key is an operator for instructing to move the main avatar leftward. The "S" key is an operator for instructing to move the main avatar downward. The "D" key is an operator for instructing to move the main avatar rightward.
[0023] Furthermore, in this embodiment, among the multiple operators possessed by the input device 160, for example, the keys "8", "4", "2", and "6" are pre-assigned to sub-avatars. The "8" key is an operator for instructing to move the sub-avatar upward on the display image of the display device 150. The "4" key is an operator for instructing to move the sub-avatar to the left. The "2" key is an operator for instructing to move the sub-avatar downward. The "6" key is an operator for instructing to move the sub-avatar to the right.
[0024] In this embodiment, the operator group for instructing the action of the main avatar and the operator group for instructing the action of the sub-avatar do not overlap each other. Since these two operator groups do not overlap, as shown in FIG. 4, when the user device 10(1) is being used by the user U(1) and the user SU, the user SU can input to the input device 160 to instruct the action of the sub-avatar even while the user U(1) is inputting to the input device 160 to instruct the action of the main avatar. The operator group for instructing the action of the avatar may be the keys "H", "J", "K" and "L", or may be cursor keys. In short, it is sufficient that the operator group for instructing the action of the main avatar and the operator group for instructing the action of the sub-avatar do not overlap each other. In addition, when an LED is provided on each operator of the input device 160 so that the operator group for instructing the action of the main avatar and the operator group for instructing the action of the sub-avatar can be easily distinguished, the LED may be illuminated in a different color for each operator group.
[0025] Each time an input instructing a movement of the main avatar or a movement of a sub-avatar is made to the input device 160, the action instruction unit 130c transmits instruction data indicating the content instructed by the input to the virtual space server 20.
[0026] For example, when any of the keys "W", "A", "S" and "D" is pressed, the operation instruction unit 130c transmits to the virtual space server 20 instruction data instructing the main avatar to move in a direction corresponding to the pressed key. Hereinafter, the instruction data transmitted from the operation instruction unit 130c to the virtual space server 20 in response to pressing of the keys "W", "A", "S" and "D", i.e., the instruction data instructing the operation of the main avatar, is referred to as first instruction data. On the other hand, when any of the keys "8", "4", "2" and "6" is pressed, the operation instruction unit 130c transmits to the virtual space server 20 instruction data instructing the sub-avatar to move in a direction corresponding to the pressed key. Hereinafter, the instruction data transmitted from the operation instruction unit 130c to the virtual space server 20 in response to pressing of the keys "8", "2", "4" and "6", i.e., the instruction data instructing the operation of the sub-avatar, is referred to as second instruction data.
[0027] Although details will be described later, when the virtual space server 20 receives first instruction data, it updates the virtual space by moving the main avatar in response to the first instruction data, and transmits virtual space data representing the updated virtual space to the user device 10 that transmitted the first instruction data. When the virtual space server 20 receives second instruction data, it updates the virtual space by moving the sub-avatar in response to the second instruction data, and transmits virtual space data representing the updated virtual space to the user device 10 that transmitted the second instruction data. Images of the virtual space represented by these virtual space data are displayed on the display device 150 by the display control unit 130b, so that the main user and the sub-user can each visually recognize how the main avatar moves in response to the main user's operation and how the sub-avatar moves in response to the sub-user's operation. The configuration of the user device 10 has been described above.
[0028] Fig. 5 is a block diagram showing a configuration example of virtual space server 20. As shown in Fig. 5, virtual space server 20 includes a communication device 210, a storage device 220, a processing device 230, and a bus 240. Each of communication device 210 and storage device 220 and processing device 230 are connected to each other by bus 240 that mediates data exchange. Bus 240 may be configured using a single bus, or may be configured using different buses between each element.
[0029] Although detailed illustration is omitted in FIG. 5, the virtual space server 20 may include an input device and a display device. The input device is hardware that accepts input from the outside, similar to the input device 160. The input device of the virtual space server 20 accepts input from an operator who operates and maintains the virtual space server 20. The display device is hardware that displays information to the outside, similar to the display device 150. The display device of the virtual space server 20 displays various images under the control of the processing device 230. An example of an image displayed by the display device of the virtual space server 20 under the control of the processing device 230 is an image of an input screen that accepts various inputs for the operation and maintenance of the virtual space server 20.
[0030] The communication device 210, like the communication device 110, is hardware (transmission / reception device) for communicating with other devices. The communication device 210 is connected to the communication network NW by wire or wirelessly. The communication device 210 communicates with other devices connected to the communication network NW by wire or wirelessly via the communication network NW. An example of this other device is the user device 10. The communication device 210 receives data transmitted from the user device 10 via the communication network NW. The communication device 210 provides the data received via the communication network NW to the processing device 230. The communication device 210 also transmits the data provided from the processing device 230 to the communication network NW.
[0031] The storage device 220 is a recording medium readable by the processing device 230. The storage device 220 may be configured, for example, by at least one of a ROM, an EPROM, an EEPROM, and a RAM, similar to the storage device 120. A program PR2 and a user table TBL1 are stored in advance in the storage device 220.
[0032] FIG. 6 is a diagram showing an example of the contents stored in the user table TBL1. As shown in FIG. 6, the user table TBL1 stores avatar data and a feature set in association with user identification information uniquely identifying each of the users U(1) to U(j). The user identification information is a serial number assigned to each of the users U(1) to U(j) when registering for use of the virtual space service. The avatar data represents an avatar used in the virtual space by a user identified by the user identification information associated with the avatar data. The feature set is a set of features representing the external features of the user identified by the user identification information associated with the feature set, more specifically, the facial features of the user. The avatar data and the feature set are stored in the user table TBL1 when registering for use of the virtual space service. An example of the feature set is a set of features for person recognition based on a captured image obtained by capturing an image of the user. These features are extracted from a face photo or the like attached when applying for registration for use of the virtual space service. In addition, existing technologies may be used as appropriate for the algorithm for person recognition based on a captured image and for extracting feature amounts used in the algorithm.
[0033] The processing device 230 includes one or more CPUs, similar to the processing device 130. The processing device 230 reads the program PR2 from the storage device 220 when an instruction to execute the program PR2 is given by an input to the input device of the virtual space server 20. The processing device 230 executes the read program PR2. The processing device 230 executes the program PR2, thereby functioning as the detection unit 230a, the arrangement unit 230b, the first update unit 230c, the second update unit 230d, and the restriction unit 230e shown in FIG. 5. That is, the detection unit 230a, the arrangement unit 230b, the first update unit 230c, the second update unit 230d, and the restriction unit 230e shown in FIG. 5 are software modules, similar to the imaging control unit 130a, the display control unit 130b, and the operation instruction unit 130c. The functions of the detection unit 230a, the arrangement unit 230b, the first update unit 230c, the second update unit 230d, and the restriction unit 230e are as follows.
[0034] Upon receiving imaging data from user device 10(k), detection unit 230a detects, based on the imaging data, that a user other than user U(k) is present in front of user device 10(k). Note that existing technology may be appropriately employed to detect users based on imaging data obtained by capturing images of the users.
[0035] For example, suppose that the virtual space server 20 receives imaging data representing an image G1 in Fig. 3 from the user device 10(1). In this case, the detection unit 230a detects one person by performing person recognition on the image G1 represented by the imaging data, and extracts a group of features representing the appearance characteristics of the person. In this embodiment, a group of features that matches this group of features is stored in the user table TBL1 in association with user identification information indicating the user U(1), so the detection unit 230a detects that only the user U(1) is in front of the user device 10(1), i.e., that only the main user is present.
[0036] In response to this, it is assumed that the virtual space server 20 receives imaging data representing the image G2 in FIG. 4 from the user device 10(1). In this case, the detection unit 230a detects two people by performing person recognition on the image G2 represented by the imaging data, and extracts a feature set for each person. Since one of the feature sets for these two people is stored in the user table TBL1 in association with user identification information indicating the user U(1), the detection unit 230a detects that the user U(1) is in front of the user device 10(1). Furthermore, since the other of the feature sets for the two people does not match any of the feature sets stored in the user table TBL1, the detection unit 230a detects that another user different from any of the users U(1) to U(j), i.e., a sub-user, is in front of the user device 10(1).
[0037] When the detection unit 230a detects a main user, the arrangement unit 230b arranges an avatar representing the main user, i.e., a main avatar, in the virtual space. When the detection unit 230a detects a sub-user, the arrangement unit 230b further arranges an avatar representing the sub-user, i.e., a sub-avatar, in the virtual space. In this embodiment, the arrangement unit 230b generates a sub-avatar that reflects the appearance characteristics of the other user based on a group of features extracted by the detection unit 230a for the other user. For generating an avatar that reflects the appearance characteristics of the user, an existing technology may be appropriately adopted. Then, the arrangement unit 230b generates virtual space data representing a virtual space in which the main avatar representing the main user detected by the detection unit 230a and the sub-avatars representing the other users detected by the detection unit 230a are arranged, and transmits the generated virtual space data to the user device 10 that is the source of the captured image data.
[0038] FIG. 7 is a diagram for explaining the function of the placement unit 230b. For example, assume that a user U(1) who shares a user device 10(1) with a user SU enters a virtual space VS in which a user U(2) is present. In this case, the detection unit 230a detects that a user SU is in front of the user device 10(1) in addition to the user U(1). The placement unit 230b places an avatar MA1 corresponding to the user U(1) in the virtual space VS in response to the detection result by the detection unit 230a, and places an avatar SA corresponding to the user SU within a predetermined range R centered on the placement position of the avatar MA1. An example of the above-mentioned predetermined range R is an inner region of a sphere of a predetermined radius centered on the placement position of the avatar MA1, or an inner region of a cylinder whose central axis is located at the placement position of the avatar MA1 and has a predetermined radius and a predetermined height.
[0039] Then, the placement unit 230b transmits to the user device 10(1) virtual space data representing a virtual space in which the avatar MA2, avatar MA1, and avatar SA representing the user U(2) are placed, and transmits the virtual space data to the user device 10(2). An image of the virtual space VS represented by this virtual space data is displayed on the display device 150 of the user device 10(2), so that the user U(2) can visually grasp that the user U(1) and the other user represented by the avatar SA are in front of the user device 10(1). In addition, by displaying the image of the virtual space VS on the display device 150 of the user device 10(1), each of the user U(1) and the user SU can visually confirm the state of the avatar corresponding to them and input instructions for the operation of the avatar to the input device of the user device 10(1).
[0040] When first update unit 230c receives first instruction data via communication device 210, it updates the virtual space by moving the main avatar according to the first instruction data. First update unit 230c transmits virtual space data representing the updated virtual space to user device 10 that transmitted the first instruction data. When second update unit 230d receives second instruction data from a user device, it updates the virtual space by moving the sub-avatar according to the second instruction data within a range restricted by restriction unit 230e (described later). Second update unit 230d transmits virtual space data representing the updated virtual space to user device 10 that transmitted the second instruction data.
[0041] The limiting unit 230e limits the range in which the sub-avatar can move in the virtual space to a range R corresponding to the position of the main avatar in the virtual space. In this embodiment, the surface that defines the range R is transparent, and the surface is invisible to the user U(1), the user U(2), and the user SU. In this way, since the range in which the sub-avatar can move in the virtual space is limited, for example, even if the user SU who has visually recognized the image corresponding to the virtual space VS shown in FIG. 7 continues to operate the input device 160 of the user device 10(1) to move the avatar SA to the right, the avatar SA will not move to the right beyond the range R. The reason for limiting the range in which the sub-avatar can move to the range R corresponding to the position of the main avatar is to ensure that the sub-avatar and the main avatar are displayed simultaneously on the user device 10. Note that the limiting unit 230e may display the range R in the virtual space by displaying a line that defines the boundary of the range R (a dashed line in the example shown in FIG. 7) so that the sub-user can visually grasp the range in which the sub-avatar can move.
[0042] In addition, since the range in which the sub-avatar can move is determined according to the position of the main avatar, if the main avatar moves in the virtual space, the position of the range in the virtual space also changes. FIG. 8 is a diagram for explaining the operation of the first update unit 230c and the limiting unit 230e when the first instruction data instructing the movement of the avatar MA1 is received. FIG. 8 illustrates a case in which the user U(1) performs an operation to move the avatar MA1 to the left so as to approach the avatar MA2 in the time period from time t1 to time t3. As shown in FIG. 8, when the avatar MA1 moves to the left, the range R also moves to the left. Then, when the range R reaches the position of the avatar SA at time t2, the first update unit 230c moves the avatar SA to the left as if it is pushed by the spherical or cylindrical surface that divides the range R so that the avatar SA does not go outside the range R. In FIG. 8, the avatar SA before moving with the movement of the range R is drawn by a dotted line. In this embodiment, since it is possible to operate avatar SA in parallel with the operation of avatar MA1, if the user SU operates the avatar SA so that it moves together with avatar MA1, the avatar SA will not move as if being pushed by the spherical or cylindrical surface that defines the range R.
[0043] Moreover, the processing device 230 operating according to the program PR2 executes a management method specific to the present disclosure. Fig. 9 is a flowchart showing the flow of processing in the management method of the present disclosure. As shown in Fig. 9, the management method of the present disclosure includes a detection process S110, an arrangement process S120, a first determination process S130, a second determination process S140, a first update process S150, a second update process S160, and a third determination process S170. The processing contents of each process shown in Fig. 9 are as follows.
[0044] In the detection process S110, the processing device 230 functions as a detection unit 230a. In the detection process S110, upon receiving imaging data from the user device 10(k), the processing device 230 detects that a user other than the user U(k) is present in front of the user device 10(k) based on the imaging data.
[0045] In the placement process S120, the processing device 230 functions as a placement unit 230b. In the placement process S120, when a sub-user is detected in addition to the main user in the detection process S110, the processing device 230 places the main avatar and the sub-avatar in the virtual space. Then, the processing device 230 transmits virtual space data representing the virtual space to the user device 10(k) that transmitted the imaging data. Note that, when only the main user is detected in the detection process S110, the processing device 230 places only the main avatar in the virtual space, and transmits virtual space data representing the virtual space to the user device 10(k) that transmitted the imaging data.
[0046] In the first determination process S130, the processing device 230 waits for data reception by the communication device 210, and determines whether the data received by the communication device 210 from the user device 10(k) is the first instruction data or the second instruction data. If the data received by the communication device 210 from the user device 10(k) is the first instruction data or the second instruction data, the determination result of the first determination process S130 is "Yes". If the data received by the communication device 210 from the user device 10(k) is neither the first instruction data nor the second instruction data, the determination result of the first determination process S130 is "No". If the determination result of the first determination process S130 is "Yes", the processing device 230 executes the second determination process S140. If the determination result of the first determination process S130 is "No", the processing device 230 executes the third determination process S170.
[0047] In the second determination process S140, the processing device 230 determines whether the data received by the communication device 210 from the user device 10(k) is the first instruction data. If the data received by the communication device 210 from the user device 10(k) is the first instruction data, the determination result of the second determination process S140 is "Yes". If the data received by the communication device 210 from the user device 10(k) is the second instruction data, the determination result of the second determination process S140 is "No". If the determination result of the second determination process S140 is "Yes", the processing device 230 executes the first update process S150 and then executes the first determination process S130 again. If the determination result of the second determination process S140 is "No", the processing device 230 executes the second update process S160 and then executes the first determination process S130 again.
[0048] In the first update process S150, the processing device 230 functions as a first update unit 230c and a limiting unit 230e. In the first update process S150, the processing device 230 updates the virtual space by moving the main avatar according to the first instruction data received by the communication device 210, and transmits virtual space data representing the updated virtual space to the user device 10(k) that transmitted the first instruction data. Note that in the first update process S150, when the main avatar moves within the virtual space by moving the main avatar according to the first instruction data, the processing device 230 moves the range R in accordance with the movement of the main avatar, and moves the sub-avatar in accordance with the movement of the range R, if necessary.
[0049] In the second update process S160, the processing device 230 functions as a second update unit 230d and a limiting unit 230e. In the second update process S160, the processing device 230 updates the virtual space by moving the sub-avatar within range R determined according to the position of the main avatar according to the second instruction data received by the communication device 210, and transmits virtual space data representing the updated virtual space to the user device 10(k) that transmitted the second instruction data.
[0050] In the third determination process S170, the processing device 230 determines whether the data received by the communication device 210 is data instructing the user to exit from the virtual space. If the data received by the communication device 210 is data instructing the user to exit from the virtual space, the determination result of the third determination process S170 is "Yes". If the data received by the communication device 210 is not data instructing the user to exit from the virtual space, the determination result of the third determination process S170 is "No". If the determination result of the third determination process S170 is "No", the processing device 230 executes the first determination process S130 again and waits for the communication device 210 to receive data. If the determination result of the third determination process S170 is "Yes", the processing device 230 ends the execution of this management method.
[0051] As described above, according to the virtual space server 20 of this embodiment, when the user U(k) and other users are in front of the user device 10(k), a main avatar representing the user U(k) and sub-avatars representing the other users are placed in the virtual space. Then, each of the user U(k) and the other users can move the avatar corresponding to them in the virtual space by performing an operation on the input device 160 of the user device 10(k) to instruct the movement of the avatar corresponding to them. Therefore, according to this embodiment, multiple users in front of the user device 10(k) can enjoy the virtual space service together.
[0052] (B: Transformation) The present disclosure is not limited to the above-described exemplary embodiments. Specific modified aspects are as follows. Two or more aspects selected from the following examples may be combined. (B-1: Variation 1) In the above embodiment, the placement unit 230b places an avatar that reflects the appearance characteristics of the sub-user as a sub-avatar in the virtual space. However, it is not essential to reflect the appearance characteristics of the sub-user in the sub-avatar, and the placement unit 230b may place a predetermined avatar as the sub-avatar in the virtual space. In addition, the restriction unit 230e is not essential and may be omitted.
[0053] (B-2: Variation 2) The detection unit 230a in the above embodiment detects, based on imaging data received using the communication device 210, that a user other than the user U(k) is present in front of the user device 10(k) that is the sender of the imaging data. However, the user device 10(k) may be provided with a sound collection device that collects ambient sounds and a function of transmitting sound data representing the sounds collected by the sound collection device to the virtual space server 20. In this case, the detection unit 230a may detect, based on the sound data received from the user device 10(k), that a user other than the user U(k) is present in front of the user device 10(k). In this case, a set of features representing voice features may be used as the feature group.
[0054] (B-3: Variation 3) In the above embodiment, the program PR2 is stored in the storage device 220 of the virtual space server 20, but the program PR2 may be manufactured or sold separately. When selling the program PR2, the program PR2 may be provided to a purchaser by writing the program PR2 to a computer-readable recording medium such as a flash ROM and distributing it, or by downloading it via a telecommunications line.
[0055] (B-4: Variation 4) In the above embodiment, the detection unit 230a, the arrangement unit 230b, the first update unit 230c, the second update unit 230d, and the restriction unit 230e are all software modules. However, any one, any two, any three, any four, or all of the detection unit 230a, the arrangement unit 230b, the first update unit 230c, the second update unit 230d, and the restriction unit 230e may be hardware modules. Specific examples of hardware modules include DSPs (Digital Signal Processors), ASICs (Application Specific Integrated Circuits), PLDs (Programmable Logic Devices), and FPGAs (Field Programmable Gate Arrays). The same effects as those of the above embodiment can be achieved even if any one, any two, any three, any four, or all of the detection unit 230a, the placement unit 230b, the first update unit 230c, the second update unit 230d, and the restriction unit 230e are hardware modules.
[0056] (C:Other) (1) In the above-described embodiment, ROM, RAM, etc. are given as examples of storage device 220, but storage device 220 may also be a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disc), a smart card, a flash memory device (e.g., a card, a stick, a key drive), a CD-ROM (Compact Disc-ROM), a register, a removable disk, a hard disk, a floppy (registered trademark) disk, a magnetic strip, a database, a server, or any other suitable storage medium.
[0057] (2) In the above-described embodiments, the described information, signals, etc. may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.
[0058] (3) In the above-described embodiment, the input / output information, etc. may be stored in a specific location (e.g., memory) or may be managed using a management table. The input / output information, etc. may be overwritten, updated, or added. The output information, etc. may be deleted. The input information, etc. may be transmitted to another device.
[0059] (4) In the above-described embodiments, the determination may be made based on a value represented by 1 bit (0 or 1), a Boolean (true or false) value, or a numerical comparison (e.g., comparison with a predetermined value).
[0060] (5) The order of the process steps, sequences, flow charts, etc. illustrated in the above-described embodiments may be changed without causing any inconsistency. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.
[0061] (6) Each function illustrated in Fig. 5 is realized by any combination of at least one of hardware and software. Furthermore, the method of realizing each functional block is not particularly limited. That is, each functional block may be realized by using one device that is physically or logically combined, or may be realized by using two or more devices that are physically or logically separated and directly or indirectly connected (for example, by using wires, wirelessly, etc.). The functional block may be realized by combining the one device or the multiple devices with software.
[0062] (7) The programs exemplified in the above-described embodiments should be broadly interpreted to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., regardless of whether they are called software, firmware, middleware, microcode, hardware description language, or by other names.
[0063] Additionally, software, instructions, information, etc. may be transmitted or received over a transmission medium. For example, if the software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave, etc.), then these wired and / or wireless technologies are included within the definition of transmission media.
[0064] (8) In each of the above embodiments, the terms “system” and “network” are used interchangeably.
[0065] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values from a predetermined value, or corresponding other information.
[0066] (10) In the above-described embodiments, the portable device may be a mobile station (MS). A mobile station may also be referred to by those skilled in the art as a subscriber station, a mobile unit, a subscriber unit, a wireless unit, a remote unit, a mobile device, a wireless device, a wireless communication device, a remote device, a mobile subscriber station, an access terminal, a mobile terminal, a wireless terminal, a remote terminal, a handset, a user agent, a mobile client, a client, or some other suitable terminology. In this disclosure, the terms "mobile station", "user terminal", "user equipment (UE)", "terminal", etc. may be used interchangeably.
[0067] (11) In the above-mentioned embodiments, the terms "connected" and "coupled" or any variation thereof refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "accessed." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and light (both visible and invisible) range, as some non-limiting and non-exhaustive examples.
[0068] (12) In the above embodiments, the phrase "based on" does not mean "based only on," unless otherwise specified. In other words, the phrase "based on" means both "based only on" and "based at least on."
[0069] (13) As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, search, inquiry (e.g., searching in a table, database, or other data structure), ascertaining, and the like. Also, "determining" and "determining" may include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in a memory), and the like. In addition, "judgment" and "decision" can include considering resolving, selecting, choosing, establishing, comparing, etc., to be a "judgment" or "decision." In other words, "judgment" and "decision" can include considering some action to be a "judgment" or "decision." In addition, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.
[0070] (14) In the above embodiments, when "include," "including," and variations thereof are used, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, the term "or" used in this disclosure is not intended to be an exclusive or.
[0071] (15) In this disclosure, where articles have been added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural.
[0072] (16) In this disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "combined" may also be interpreted in the same way as "different."
[0073] (17) Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched according to execution. In addition, notification of specific information (e.g., notification that "X is the case") is not limited to being done explicitly, but may be done implicitly (e.g., not notifying the specific information).
[0074] (D: Aspects understood from the above-mentioned forms or modifications) Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented as modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure. The following aspects can be understood from at least one of the above-mentioned embodiments or modifications.
[0075] A management device according to a first aspect of the present disclosure is a management device for a virtual space, and includes a detection unit, a placement unit, a first update unit, and a second update unit. The detection unit detects that a second user, other than the first user, is present in front of a terminal device used by a first user who operates the first avatar in a virtual space in which the first avatar is placed. When the detection unit detects the second user, the placement unit places a second avatar representing the second user in the virtual space. When the first update unit receives first instruction data instructing an operation of the first avatar from the terminal device, the first update unit updates the virtual space by making the first avatar operate according to the first instruction data. When the second update unit receives second instruction data instructing an operation of the second avatar from the terminal device, the second update unit updates the virtual space by making the second avatar operate according to the second instruction data. According to the management device of the first aspect, a first user and a second user who are present in front of a terminal device can enjoy a virtual space service together.
[0076] The detection unit in the management device according to a second aspect (an example of the first aspect) of the present disclosure may detect that a second user is in front of the terminal device in addition to the first user, based on imaging data obtained by imaging the surroundings of the terminal device. The placement unit in this second aspect may generate the second avatar reflecting the appearance characteristics of the second user extracted from the imaging data. According to the management device of the second aspect, the appearance characteristics of the second user can be reflected in the avatar representing the second user.
[0077] The management device according to a third aspect (an example of the second aspect) of the present disclosure may further include a limiting unit that limits a range in which the second avatar can move in the virtual space according to a position of the first avatar in the virtual space. According to the management device of the third aspect, the range in which the second avatar can move can be limited according to the position of the first avatar in the virtual space.
[0078] The limiting unit in the fourth aspect (example of the third aspect) of the present disclosure may display a range in which the second avatar can move in the virtual space. According to the management device of the fourth aspect, the range in which the second avatar can move is displayed, so that the second user can visually grasp the range. [Explanation of symbols]
[0079] 1...communication system, 10...user device, 20...virtual space server, 110, 210...communication device, 120, 220...storage device, 130, 230...processing device, 130a...imaging control unit, 130b...display control unit, 130c...operation instruction unit, 230a...detection unit, 230b...placement unit, 230c...first update unit, 230d...second update unit, 230e...restriction unit, 140, 240...bus, 150...display device, 160...input device, 170...imaging device, PR1, PR2...program, TBL1...user table.
Claims
1. a detection unit that detects that a second user, other than the first user, is present in front of a terminal device used by a first user who operates the first avatar in a virtual space in which the first avatar is placed; an arrangement unit that arranges a second avatar representing the second user in the virtual space when the second user is detected by the detection unit; a first update unit that, when first instruction data instructing an action of the first avatar is received from the terminal device, updates the virtual space by moving the first avatar in accordance with the first instruction data; a second update unit that, when second instruction data instructing an action of the second avatar is received from the terminal device, updates the virtual space by moving the second avatar in accordance with the second instruction data; A virtual space management device having the above configuration.
2. The detection unit detects that a second user, in addition to the first user, is present in front of the terminal device based on imaging data obtained by imaging the surroundings of the terminal device, The placement unit places the second avatar in the virtual space, the second avatar reflecting the appearance characteristics of the second user extracted from the imaging data. The virtual space management device according to claim 1 .
3. The virtual space management device according to claim 1 , further comprising a limiting unit that limits a range in which the second avatar can move in the virtual space depending on a position of the first avatar in the virtual space.
4. The virtual space management device according to claim 3 , wherein the limiting unit displays a range in which the second avatar can move in the virtual space.
Citation Information
Patent Citations
Information processing device and program
JP2022109048A
