Information processing apparatus, control method of information processing apparatus, and program
The information processing device addresses the issue of uncomfortable avatars in XR environments by identifying and managing specific avatars through user information acquisition and processing units, enhancing user experience in virtual spaces.
Patent Information
- Application Number
- JP2023178206
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-10-16
- Publication Date
- 2025-04-28
AI Technical Summary
Existing XR technologies, such as those used in HMDs for the metaverse, lack effective mechanisms to manage avatars that may be perceived as harassing, leading to discomfort for users.
An information processing device equipped with a user information acquisition unit, an avatar information acquisition unit, a judgment unit, and a processing unit that determines if a second avatar is specific to a user and performs actions such as moving or notifying the presence of the avatar when necessary.
Enables the mitigation of uncomfortable situations in virtual spaces by allowing users to manage avatars that cause distress, improving the overall user experience in XR environments.
Smart Images
Figure 2025068359000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device, a control method for an information processing device, and a program. [Background technology]
[0002] There is a technology that allows a user to perceive a sensation different from reality by performing image processing on an image (captured image) of a subject existing in real space. XR (Extended Reality) is known as this technology. A representative device for displaying an image to which XR technology is applied is an HMD (Head Mount Display) that is worn on a person's head. The HMD allows a user to experience the metaverse. In the metaverse, each user can set an avatar that is his / her alter ego and act. In addition, users from all over the world can participate in the metaverse. Therefore, as the number of users participating in the metaverse increases, the number of avatars in the metaverse also increases. In this case, the number of situations in which an avatar of one user harasses an avatar of another user also increases, which may result in the comfortable activities of other users in the metaverse being hindered. Non-Patent Document 1 discloses a technology in which a boundary line of a certain radius of an area centered on an avatar of a certain user is set as a personal boundary line, and when an avatar of another user tries to enter the personal boundary line, the avatar of the other user cannot move forward. [Prior art documents] [Non-patent literature]
[0003] [Non-Patent Document 1] Introducing a Personal Boundary for Horizon Worlds and Horizon Venues, [online], [Retrieved September 21, 2023], February 4, 2022, Meta Quest Blog, Internet〈https: / / www.Oculus.com / blog / introducing-a-personal-boundary-for-horizon-worlds-and-venues / ?Locale=ja〉 Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the technology described in Non-Patent Document 1, if a user finds another user's avatar unpleasant, the other user's avatar can continue to be near the user's avatar even if the other user's avatar does not enter the personal boundary line. In this case, there is a risk that the unpleasant state will continue for the user.
[0005] The present invention has been made in consideration of the above problems. It is an object of the present invention to provide an information processing device that can perform processing such as moving away a specific avatar or notifying the user of the avatar's presence when the specific avatar is an avatar that is unpleasant to the user of the information processing device. It is also an object of the present invention to provide a control method and a program for the information processing device that can perform similar processing. [Means for solving the problem]
[0006] In order to achieve the above-mentioned object, the information processing device of the present invention is an information processing device that processes information in a virtual space, and is characterized in that it comprises: a user information acquisition means for acquiring user information regarding a first user who uses the information processing device; an avatar information acquisition means for acquiring first avatar information regarding a first avatar representing the first user in the virtual space and second avatar information regarding a second avatar representing a second user other than the first user in the virtual space; a judgment means for determining whether the second avatar is a specific avatar based on at least the user information; and a processing means for performing processing on the specific avatar when it is determined that the second avatar is the specific avatar as a result of the judgment by the judgment means. Effect of the Invention
[0007] According to the present invention, for example, when a specific avatar is an avatar that is unpleasant to a user using an information processing device, processing can be performed such as moving the avatar away or notifying the user of the presence of the avatar. [Brief description of the drawings]
[0008] [Figure 1] 1 is a block diagram showing an example of a hardware configuration of an information processing device according to a first embodiment. [Figure 2A] FIG. 2 is a block diagram showing an example of a software configuration of the image processing apparatus. [Figure 2B] 11 is a flowchart illustrating an example of a process in which a user information acquisition unit of the image processing apparatus stores user information in a user information storage unit. [Figure 2C] 11 is a flowchart illustrating an example of a process in which a different avatar information acquisition unit of the image processing device stores different avatar information in a different avatar information storage unit; [Figure 2D] 11 is a flowchart illustrating an example of a process in which an avatar information acquisition unit of the image processing device stores avatar information in an avatar information storage unit. [Diagram 3] 1 is a diagram showing an example of a virtual space displayed on an output unit of an image processing device; [Figure 4] 10 is a flowchart illustrating an example of a process executed by the image processing device. [Diagram 5] 13 is a flowchart showing an example of a process executed by an entry-prohibited avatar countermeasure unit of the image processing device. [Figure 6] 10 is a diagram illustrating an example of a table of user information stored in a user information storage unit of the image processing apparatus. FIG. [Figure 7] 13 is a flowchart showing an example of processing executed by an entry prohibited avatar determining unit of the image processing device according to the second embodiment. [Figure 8] 10 is a flowchart illustrating an example of a process executed by the image processing device. [Figure 9] 13 is a diagram showing an example of a table of other avatar information stored in an other avatar information storage unit; FIG. [Figure 10] 13 is a diagram showing an example of a table of entry-prohibited avatar information stored in an entry-prohibited avatar information storage unit. FIG. [Figure 11] 13 is a flowchart showing an example of processing executed by the image processing device according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Each embodiment of the present invention will be described in detail below with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited by the configurations described in the embodiments. For example, each part constituting the present invention can be replaced with any configuration that can exert a similar function. In addition, any configuration may be added. In addition, any two or more configurations (features) of each embodiment can be combined.
[0010] First Embodiment Hereinafter, the first embodiment will be described with reference to FIG. 1 to FIG. 6. FIG. 1 is a block diagram showing an example of a hardware configuration of an image processing device (information processing device) according to the first embodiment. The image processing device 101 shown in FIG. 1 is a device that processes information in a virtual space, and is applied to an HMD (Head Mounted Display) in this embodiment. Note that devices to which the image processing device 101 can be applied are not limited to HMDs, and may be, for example, desktop or notebook personal computers, tablet terminals, smartphones, etc. The image processing device 101 has a CPU (Central Processing Unit) 102, a ROM (Read Only Memory) 103, and a RAM (Random access memory) 104. The image processing device 101 also has a communication unit 105, a sensing unit (user information acquisition means) 106, an output unit 107, and a secondary storage unit (storage means) 109. These hardware devices of the image processing device 101 are connected to each other via a bus 108 so as to be able to communicate with each other.
[0011] The CPU 102 is a control unit (computer) that controls the operation of each of the ROM 103, the RAM 104, the communication unit 105, the sensing unit 106, and the output unit 107. The ROM 103 stores various programs and operating conditions for each of the operations. The programs include programs for causing the CPU 102 to execute each unit and each means (method of controlling an information processing device) of the image processing device 101. The RAM 104 is also used as a work memory that stores temporary data of the processing executed by the CPU 102. The communication unit 105 is, for example, an external interface that communicates with an external device such as a server. The sensing unit 106 acquires user information about a user who uses the image processing device 101 in real space, that is, wears the image processing device 101 on his / her head (user information acquisition process). The user information is not particularly limited, and includes, for example, information about at least one of the user's vital signs, gaze, gestures, and facial expressions. The "vital signs" are, for example, heart rate, respiratory rate, blood pressure value, and the like. The output unit 107 is composed of, for example, a liquid crystal display, and functions as a display means for displaying images of the virtual space, etc. The secondary storage unit 109 can store in advance specific information for identifying a specific avatar, which will be described later. The secondary storage unit 109 is not particularly limited, and may be, for example, a hard disk drive (HDD) or a solid state drive (SSD).
[0012] The hardware configuration of the image processing device 101 is not limited to the configuration shown in FIG. 1. For example, the image processing device 101 may have a plurality of CPUs 102, or may further have a GPU (Graphics Processing Unit) or the like. The image processing device 101 has a ROM 103, a RAM 104, and a secondary storage unit 109 as storage units, and may further have a tertiary storage unit. As the tertiary storage unit, for example, an HDD or SSD can be used, similar to the secondary storage unit 109. The configuration of the bus 108 is also not particularly limited, and for example, the hardware may be connected to each other in a multi-stage configuration. In the following, a user who uses the image processing device 101 is referred to as the present user (first user), and a user who participates in the same virtual space as the first user and is different from the first user is referred to as another user (second user). An avatar representing the present user in the virtual space is referred to as the present avatar (first avatar), and an avatar representing another user in the same virtual space is referred to as another avatar (second avatar). The present user can move within the virtual space by operating the present avatar. The other users can move within the virtual space by operating the other avatars.
[0013] FIG. 2A is a block diagram showing an example of a software configuration of an image processing device. As shown in FIG. 2A, the image processing device 101 includes a user information acquisition unit 201, a user information storage unit 202, a different avatar information acquisition unit 203, a different avatar information storage unit 204, an avatar information acquisition unit 205, and an avatar information storage unit 206. The image processing device 101 also includes an entry-prohibited avatar determination unit (determination means) 207, an entry-prohibited avatar information storage unit 208, and an entry-prohibited avatar countermeasure unit (processing means) 209. The user information acquisition unit 201 stores the user information of the user acquired from the sensing unit 106 of the image processing device 101 worn by the user in the user information storage unit 202. As described above, the user information includes vital signs, gaze, gestures, facial expressions, and the like. The different avatar information acquisition unit 203 acquires different avatar information related to different avatars, and stores the different avatar information in the different avatar information storage unit 204 (avatar information acquisition step). The other avatar information is not particularly limited, and may be, for example, information on at least one of the position, appearance (appearance), and behavior of the other avatar in the virtual space. The avatar information acquisition unit 205 acquires the main avatar information on the main avatar and stores the main avatar information in the avatar information storage unit 206 (avatar information acquisition step). The main avatar information is not particularly limited, and may be, for example, information on at least one of the position of the main avatar in the virtual space and a conversation between the main avatar and the other avatar. Note that the other avatar information acquisition unit 203 and the avatar information acquisition unit 205 are configured as separate acquisition units (avatar information acquisition means) in this embodiment, but are not limited thereto, and may be configured as, for example, a single acquisition unit (avatar information acquisition means).
[0014] The entry prohibited avatar determination unit 207 determines whether the value of the vital sign has increased from normal based on the vital sign included in the present user information acquired from the user information storage unit 202. The entry prohibited avatar determination unit 207 determines whether the value of the vital sign has increased and is equal to or greater than a threshold value. If the determination result indicates that the value is equal to or greater than the threshold value, the entry prohibited avatar determination unit 207 determines that the other avatar is an entry prohibited avatar (specific avatar) (determination step). This determination is made based on the line-of-sight information of the present user acquired from the user information storage unit 202 and the position information of the other avatar acquired from the other avatar information storage unit 204. Note that, if the entry prohibited avatar determination unit 207 determines that the vital sign value is not equal to or greater than the threshold value, it determines that the other avatar is not an entry prohibited avatar. In addition, the entry prohibited avatar determination unit 207 stores information on the entry prohibited avatar in the entry prohibited avatar information storage unit 208. The entry-prohibited avatar countermeasure unit 209 sets, for example, a 3.5 m entry-prohibited area (entry-prohibited region) between the present avatar and the entry-prohibited avatar. The entry-prohibited area is an area where the entry of the entry-prohibited avatar is prohibited. The entry-prohibited avatar countermeasure unit 209 judges whether the present avatar and the entry-prohibited avatar are 3.5 m apart. This judgment is made based on the position information of the present avatar stored in the avatar information storage unit 206 and the position information of the entry-prohibited avatar (other avatar) stored in the other avatar information storage unit 204. When the entry-prohibited avatar countermeasure unit 209 judges that the present avatar and the entry-prohibited avatar are not 3.5 m apart, it changes the position of the entry-prohibited avatar in the virtual space and issues a warning to the present user and the entry-prohibited avatar (other user). This warning is made via the output unit 107. Furthermore, if the entry prohibited avatar ignores the warning and approaches the user, the entry prohibited avatar countermeasure unit 209 prohibits the entry prohibited avatar from entering the entry prohibited area.
[0015] 2B is a flowchart showing an example of a process in which a user information acquisition unit of an image processing device stores user information in a user information storage unit. This process is performed for each frame of a captured image. As shown in FIG. 2B, in step S1101, the user information acquisition unit 201 acquires user information of the present user acquired from the sensing unit 106 of the image processing device 101, and the process proceeds to step S1102. In step S1102, the user information acquisition unit 201 stores the user information acquired in step S1101 in the user information storage unit 202.
[0016] 2C is a flowchart showing an example of a process in which the other avatar information acquisition unit of the image processing device stores other avatar information in the other avatar information storage unit. This process is performed for each frame of a captured image. As shown in FIG. 2C, in step S1201, the other avatar information acquisition unit 203 acquires other avatar information related to other avatars existing in the virtual space, and the process proceeds to step S1202. In step S1202, the other avatar information acquisition unit 203 stores the other avatar information acquired in step S1201 in the other avatar information storage unit 204.
[0017] 2D is a flowchart showing an example of a process in which the avatar information acquisition unit of the image processing device stores avatar information in the avatar information storage unit. This process is performed for each frame of a captured image. As shown in FIG. 2D, in step S1301, the avatar information acquisition unit 205 acquires real avatar information related to a real avatar existing in a virtual space, and the process proceeds to step S1302. In step S1302, the avatar information acquisition unit 205 stores the avatar information acquired in step S1301 in the avatar information storage unit 206.
[0018] FIG. 3 is a diagram showing an example of a virtual space displayed on an output unit of an image processing device. The virtual space 301 shown in FIG. 3 includes the present avatar 302, another avatar 303, another avatar 304, another avatar 305, and a no-entry area 306. The other avatar 305 is a no-entry avatar, and is operated by another user who is uncomfortable with the present user who operates the present avatar 302, for example, because the present user is likely to be harassed or has been harassed in the past. The no-entry area 306 is set between the present avatar 302 and the other avatar 305, which is a no-entry avatar. This makes it possible to prevent the other avatar 305 from approaching the present avatar 302, and therefore the present user can eliminate the discomfort. The other avatar 303 and the other avatar 304 can enter the no-entry area 306.
[0019] 4 is a flowchart showing an example of processing executed by the image processing device. As shown in FIG. 4, in step S401, the entry-prohibited avatar determination unit 207 acquires user information of the user, i.e., vital signs and gaze information, from the user information storage unit 202.
[0020] In step S402, the entry-prohibited avatar determination unit 207 determines whether or not there is an avatar that is unpleasant to the user, that is, an avatar that is an entry-prohibited avatar, based on the vital signs acquired in step S401. This determination is made based on whether or not at least one of the vital signs, the heart rate, the respiratory rate, and the blood pressure value, is higher than normal and exceeds a threshold value. If it is equal to or higher than the threshold value, it is determined that an unpleasant avatar exists, and if it is not equal to or higher than the threshold value, it is determined that an unpleasant avatar does not exist. It is preferable that the threshold value can be changed as appropriate. Then, if it is determined that an unpleasant avatar exists as a result of the determination in step S402, the process proceeds to step S403. On the other hand, if it is determined that an unpleasant avatar does not exist as a result of the determination in step S402, the process ends.
[0021] In step S403, the entry prohibited avatar determination unit 207 acquires position information of the other avatar from the other avatar information storage unit 204. Then, the entry prohibited avatar determination unit 207 specifies an entry prohibited avatar based on the line of sight information acquired in step S401 and the position information of the other avatar acquired from the other avatar information storage unit 204. For example, when an unpleasant other avatar is present in the line of sight of the user in the virtual space, the other avatar is specified as an entry prohibited avatar. Furthermore, information regarding the entry prohibited avatar is stored in the entry prohibited avatar information storage unit 208.
[0022] In step S404, the entry-prohibited avatar countermeasure unit 209 sets, for the entry-prohibited avatar determined in step S403, an entry-prohibited area that prevents the avatar from approaching within 3.5 m of the avatar.
[0023] In this way, in the image processing device 101, when the other avatar is determined to be an entry prohibited avatar, a process is performed on the entry prohibited avatar (processing step). The process on the entry prohibited avatar is to set a no-entry area between the avatar and the other avatar in the virtual space, which prohibits the entry of the other avatar.
[0024] Fig. 5 is a flowchart showing an example of processing executed by the entry-prohibited avatar countermeasure unit of the image processing device. The processing shown in Fig. 5 is executed after the processing shown in Fig. 4. As shown in Fig. 5, in step S501, the entry-prohibited avatar countermeasure unit 209 acquires position information of the avatar in the virtual space from the avatar information storage unit 206.
[0025] In step S502, the entry prohibited avatar countermeasure unit 209 acquires, from the other avatar information storage unit 204, the position information of the other avatar that matches the information of the entry prohibited avatar stored in the entry prohibited avatar information storage unit 208.
[0026] In step S503, the entry prohibited avatar countermeasure unit 209 judges whether or not an entry prohibited avatar is present in the entry prohibited area, specifically, whether or not the separation distance between the main avatar and the entry prohibited avatar is 3.5 m. This judgment is made based on the position information of the main avatar in the virtual space acquired in step S501 and the position information of the other avatar (entry prohibited avatar) in the virtual space acquired in step S502. Then, if it is judged as a result of the judgment in step S503 that an entry prohibited avatar is present in the entry prohibited area, the process proceeds to step S504. On the other hand, if it is judged as a result of the judgment in step S503 that an entry prohibited avatar is not present in the entry prohibited area, the process ends.
[0027] In step S504, the entry prohibited avatar countermeasure unit 209 displays a warning to the effect that an unpleasant avatar is present, etc., on the output unit 107. This allows the user to know that an unpleasant avatar is present.
[0028] In step S505, the entry prohibited avatar countermeasure unit 209 changes the position of the entry prohibited avatar to outside the entry prohibited area.
[0029] In this way, in the image processing device 101, when the entry prohibited avatar is present in the entry prohibited area, i.e., has entered, as a process for the entry prohibited avatar, it is possible to notify the user that the entry prohibited avatar is present in the entry prohibited area. In addition to this notification, the position of the entry prohibited avatar in the virtual space can be changed to outside the entry prohibited area. In this way, when an avatar that is unpleasant to the user is present in the virtual space, it is possible to perform a process of moving the avatar away or notifying the user of the presence of the avatar, thereby eliminating the unpleasant feeling. In addition, it is preferable that the entry prohibited avatar countermeasure unit 209 prohibits the entry prohibited avatar from moving further when the entry prohibited avatar moves toward the entry prohibited area despite the position of the entry prohibited avatar in the virtual space being changed to outside the entry prohibited area. This can further eliminate the unpleasant feeling of the user.
[0030] FIG. 6 is a diagram showing an example of a table of user information stored in a user information storage unit of an image processing device. In FIG. 6, the user information of the present user "A" includes a heart rate of "100 beats / min", a respiratory rate of "15 breaths / min", a blood pressure value (maximum blood pressure value) of "135 mmHg", and gaze information "gaze facing forward". As described above, these pieces of information are used when determining an entry-prohibited avatar. Note that, in this embodiment, vital signs are used to determine an entry-prohibited avatar, but this is not limited thereto, and for example, a gesture can be used. In this case, for example, a gesture in which the present user puts his / her hand forward to control another user can be used. In addition, the facial expression of the present user can also be used. In this case, for example, a facial expression of narrowing eyes or a facial expression of frowning eyebrows can be used. In this embodiment, a process for the entry-prohibited avatar is a process of setting an entry-prohibited area between the present avatar and the entry-prohibited avatar, but this is not limited thereto. For example, processing for a prohibited avatar may be such that the greater the vital sign, the greater the distance between the avatar and the prohibited avatar.
[0031] <Second embodiment> Hereinafter, the second embodiment will be described with reference to Figs. 7 to 10, focusing on the differences from the previously described embodiment, and the description of similar matters will be omitted. This embodiment is similar to the first embodiment except for the method of determining an entry-prohibited avatar. Fig. 7 is a flowchart showing an example of processing executed by an entry-prohibited avatar determination unit of an image processing device according to the second embodiment. As shown in Fig. 7, processing from step S701 to step S703 is executed. The processing from step S701 to step S703 is the same as the processing from step S401 to step S403 in the flowchart shown in Fig. 4.
[0032] In step S704, the entry prohibited avatar determination unit 207 acquires information such as the movement and appearance of the entry prohibited avatar determined in step S703 from the other avatar information storage unit 204.
[0033] In step S705, the entry prohibited avatar determination unit 207 stores the information acquired in step S704 in the entry prohibited avatar information storage unit 208.
[0034] Fig. 8 is a flowchart showing an example of processing executed by the image processing device. This processing is performed for each frame of a captured image. The processing shown in Fig. 8 is executed after the processing shown in Fig. 7. As shown in Fig. 8, in step S801, the avatar information acquisition unit 205 acquires position information of the avatar existing in the virtual space, and stores it in the avatar information storage unit 206.
[0035] In step S802, the other avatar information acquisition unit 203 acquires information on all other avatars existing in the same virtual space as the virtual space in which the present avatar exists, and stores the information in the other avatar information storage unit 204. This other avatar information includes, for example, information on the movement, appearance, position, etc. of the other avatars.
[0036] In step S803, the entry prohibited avatar determination unit 207 acquires, from the other avatar information storage unit 204, information on other avatars (neighboring avatars) that exist within a radius of 5 m (or at any position) from the avatar as the center.
[0037] In step S804, the entry prohibited avatar determination unit 207 extracts information on one other avatar from the information on all other avatars acquired in step S803. The entry prohibited avatar determination unit 207 calculates an unpleasantness level for the extracted information on the other avatar by adding up the similarity of the other avatar's actions, the similarity of the appearance, and the fact that the other avatar is the same user. Then, the entry prohibited avatar determination unit 207 determines whether or not the calculated unpleasantness level exceeds a threshold. If it is determined that the threshold is exceeded, the entry prohibited avatar determination unit 207 determines the other avatar as an entry prohibited avatar and notifies the user of this, and the process proceeds to step S805. On the other hand, if it is determined that the threshold is not exceeded, the process proceeds to step S806.
[0038] In step S805, the entry prohibited avatar countermeasure unit 209 sets an entry prohibited area for the entry prohibited avatar determined in step S802.
[0039] In step S806, the entry prohibited avatar determination unit 207 determines whether step S804 has been executed for the information of all other avatars acquired in step S803. If it is determined that step S804 has been executed for the information of all other avatars, the process ends. If step S804 has not been executed for the information of all other avatars, the process returns to step S803, and the subsequent steps are executed in sequence.
[0040] FIG. 9 is a diagram showing an example of a table of other avatar information stored in the other avatar information storage unit. In FIG. 9, the other avatar information for the other avatar "D" includes the action "running", the appearance "male avatar", the operator information "user G", and the location information "(0, 30, 0)". The other avatar information for the other avatar "E" includes the action "walking", the appearance "female avatar", the operator information "user K", and the location information "(150, 100, 100)". The other avatar information for the other avatar "F" includes the action "approaching", the appearance "dog avatar", the operator information "user L", and the location information "(200, 130, 50)". These pieces of information are used when calculating the discomfort level.
[0041] FIG. 10 is a diagram showing an example of a table of entry-prohibited avatar information stored in the entry-prohibited avatar information storage unit. In FIG. 10, the other avatar information for the other avatar "A" includes the action "stare", the appearance "male avatar", and the operator information "user G". The other avatar information for the other avatar "B" includes the action "follow", the appearance "female avatar", and the operator information "user H". The other avatar information for the other avatar "C" includes the action "approach", the appearance "dog avatar", and the operator information "user I". These pieces of information are information on the actions, appearances, etc. of other avatars operated by other users who have been determined by the entry-prohibited avatar determination unit 207 to have been felt uncomfortable by this user in the past. These pieces of information are also used when calculating the discomfort level.
[0042] In this embodiment, the degree of discomfort based on the other avatar information stored in the other avatar information storage unit 204 is compared with the degree of discomfort based on the information (specific information) of the entry-prohibited avatar stored in the entry-prohibited avatar information storage unit 208. Specifically, the latter degree of discomfort is set as a threshold, and it is determined whether the former degree of discomfort exceeds the threshold. If it is determined that the former degree of discomfort is equal to or greater than the threshold, the other avatar is determined to be an entry-prohibited avatar. As a process for the entry-prohibited avatar, a notification is given that the entry-prohibited avatar is in the entry-prohibited area, and the position of the entry-prohibited avatar is changed in the virtual space. This can eliminate the discomfort for the user as in the first embodiment. The degree of discomfort may be calculated based on the conversation history between the avatar and the other avatar. The entry-prohibited avatar countermeasure unit 209 may be configured to be able to change the size of the entry-prohibited area according to the degree of discomfort. The entry-prohibited avatar countermeasure unit 209 can change the size of the entry-prohibited area. By changing the size of the no-entry area, for example, the greater the discomfort, the larger the no-entry area can be set, thereby ensuring a distance between the main avatar and the no-entry avatar that sufficiently relieves the user of the discomfort.
[0043] <Third embodiment> Hereinafter, the third embodiment will be described with reference to FIG. 11, focusing on the differences from the above-mentioned embodiments, and the description of similar matters will be omitted. This embodiment is similar to the first embodiment except for the processing for a specific avatar. FIG. 11 is a flowchart showing an example of processing executed by the image processing device according to the third embodiment. As shown in FIG. 11, in step S1401, the entry-prohibited avatar determination unit 207 acquires user information of the user, i.e., vital signs and gaze information, from the user information storage unit 202.
[0044] In step S1402, the entry-prohibited avatar determination unit 207 determines whether a specific avatar exists based on the vital signs acquired in step S1401. The specific avatar in this embodiment is an avatar that is familiar to the user (specific avatar), that is, an avatar that is permitted to enter the entry-prohibited area. Note that whether the entry-prohibited avatar determination unit 207 determines whether an unpleasant avatar exists as in the first embodiment, or whether a familiar avatar exists as in this embodiment, is switched in advance by a switching means (not shown). The determination of whether a familiar avatar exists is performed based on whether at least one of the vital signs, the heart rate, the respiratory rate, and the blood pressure value, is higher than normal and is equal to or higher than a threshold value. If it is equal to or higher than the threshold value, it is determined that a familiar avatar exists, and if it is not equal to or higher than the threshold value, it is determined that a familiar avatar does not exist. If it is determined that a familiar avatar exists as a result of the determination in step S1402, the process proceeds to step S1403. On the other hand, if it is determined in step S1402 that no friendly avatar exists, the process ends.
[0045] In step S1403, the entry prohibited avatar determination unit 207 acquires position information of the other avatar from the other avatar information storage unit 204. Then, the entry prohibited avatar determination unit 207 identifies a close avatar based on the line of sight information acquired in step S1401 and the position information of the other avatar acquired from the other avatar information storage unit 204. For example, when another avatar that is a close avatar is present in the line of sight of the present user in the virtual space, the other avatar is identified as an entry prohibited avatar. Furthermore, information regarding the close avatar is stored in the entry prohibited avatar information storage unit 208.
[0046] In step S1404, the prohibited avatar countermeasure unit 209 performs a process of shortening the distance between the familiar avatar determined in step S1403 and the real avatar in the virtual space. This allows the real user to communicate with the user who operates the familiar avatar through the real avatar and the familiar avatar.
[0047] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the above-mentioned embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. The present invention can also be realized by supplying a program that realizes one or more functions of the above-mentioned embodiments to a system or device via a network or storage medium, and having one or more processors of a computer in the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.
[0048] The disclosure of each embodiment includes the following configurations, methods, and programs. (Configuration 1) An information processing device for processing information in a virtual space, comprising: A user who uses the information processing device is a first user, and a user information acquisition means acquires user information relating to the first user; an avatar information acquisition means for acquiring first avatar information on a first avatar representing the first user in the virtual space and second avatar information on a second avatar representing a second user other than the first user in the virtual space; A determination means for determining whether the second avatar is a specific avatar based on at least the user information; and processing means for performing processing on the specific avatar when the second avatar is determined to be the specific avatar as a result of the judgment by the judgment means. (Configuration 2) The information processing device according to configuration 1, wherein the user information acquisition means acquires, as the user information, information regarding at least one of a vital sign, a line of sight, a gesture, and a facial expression of the first user. (Configuration 3) The information processing device described in configuration 1 or 2, characterized in that the avatar information acquisition means acquires, as the first avatar information, information regarding at least one of the position of the first avatar in the virtual space and a conversation between the first avatar and the second avatar, and acquires, as the second avatar information, information regarding at least one of the position, appearance, and behavior of the second avatar in the virtual space. (Configuration 4) The user information acquisition means acquires, as the user information, information regarding at least one of a vital sign, a line of sight, a gesture, and a facial expression of the first user; The information processing device of any one of configurations 1 to 3, wherein the avatar information acquisition means acquires, as the first avatar information, information regarding at least one of the position of the first avatar in the virtual space and a conversation between the first avatar and the second avatar, and acquires, as the second avatar information, information regarding at least one of the position, appearance, and behavior of the second avatar in the virtual space. (Configuration 5) The information processing device described in Configuration 4, wherein the judgment means judges whether the value of the vital sign of the first user is above a threshold value, and if it is determined as a result of the judgment that the value is above the threshold value, judges that the second avatar is the specific avatar based on the gaze information of the first user and the position information of the second avatar. (Configuration 6) A storage means for storing in advance specific information for identifying the specific avatar, 5. The information processing device according to configuration 4, wherein the determination means determines whether the second avatar is the specific avatar based on the second avatar information and the specific information. (Configuration 7) An information processing device described in any one of configurations 1 to 6, characterized in that, as processing for the specific avatar, the processing means sets a no-entry area between the first avatar and the second avatar in the virtual space, prohibiting the second avatar from entering. (Configuration 8) The information processing device described in Configuration 7, characterized in that when the second avatar enters the no-entry area, the processing means changes the position of the second avatar in the virtual space to outside the no-entry area as processing for the specific avatar. (Configuration 9) The information processing device described in configuration 8, wherein the processing means prohibits further movement of the second avatar when the second avatar moves toward the no-entry area despite changing the position of the second avatar in the virtual space. (Configuration 10) The information processing device described in configuration 8 or 9, characterized in that when the second avatar enters the forbidden area, the processing means notifies the user that the second avatar is entering the forbidden area as processing for the specific avatar. (Configuration 11) The information processing device according to any one of configurations 7 to 10, further comprising a change means for changing the size of the no-entry area. (Configuration 12) The information processing device according to any one of configurations 1 to 6, wherein the processing means reduces the distance between the first avatar and the second avatar in the virtual space as processing for the specific avatar. (Configuration 13) The information processing device according to any one of configurations 1 to 12, further comprising a display means for displaying an image of the virtual space. (Configuration 14) The information processing device according to configuration 13, which is a head-mounted display. (Method 1) A method for controlling an information processing device that processes information in a virtual space, comprising: a user information acquiring step of acquiring user information relating to a first user, the first user being a user who uses the information processing device; an avatar information acquiring step of acquiring first avatar information on a first avatar representing the first user in the virtual space and second avatar information on a second avatar representing a second user other than the first user in the virtual space; a determining step of determining whether the second avatar is a specific avatar based on at least the user information; A control method for an information processing device, comprising: a processing step of performing processing on the specific avatar when it is determined in the judgment step that the second avatar is the specific avatar. (Program 1) A program for causing a computer to execute each means of the information processing device according to any one of configurations 1 to 14. [Explanation of symbols]
[0049] 101 Image processing device (information processing device) 106 Sensing unit (user information acquisition means) 107 Output section 109 Secondary storage unit (storage means) 201 User information acquisition unit 203 Other Avatar Information Acquisition Unit 205 Avatar Information Acquisition Unit 207 Entry prohibited avatar judgment unit (judgment means) 209 Prohibited Avatar Countermeasures Department (Processing Means)
Claims
1. An information processing device that processes information in a virtual space, A user who uses the information processing device is a first user, and a user information acquisition means acquires user information relating to the first user; an avatar information acquisition means for acquiring first avatar information on a first avatar representing the first user in the virtual space and second avatar information on a second avatar representing a second user other than the first user in the virtual space; a determination means for determining whether the second avatar is a specific avatar based on at least the user information; and processing means for performing processing on the specific avatar when the second avatar is determined to be the specific avatar as a result of the determination by the determination means.
2. The information processing apparatus according to claim 1 , wherein the user information acquisition means acquires, as the user information, information regarding at least one of a vital sign, a line of sight, a gesture, and a facial expression of the first user.
3. The information processing device according to claim 1, characterized in that the avatar information acquisition means acquires, as the first avatar information, information regarding at least one of the position of the first avatar in the virtual space and a conversation between the first avatar and the second avatar, and acquires, as the second avatar information, information regarding at least one of the position, appearance, and behavior of the second avatar in the virtual space.
4. The user information acquisition means acquires, as the user information, information regarding at least one of a vital sign, a line of sight, a gesture, and a facial expression of the first user; The information processing device according to claim 1, characterized in that the avatar information acquisition means acquires, as the first avatar information, information regarding at least one of the position of the first avatar in the virtual space and a conversation between the first avatar and the second avatar, and acquires, as the second avatar information, information regarding at least one of the position, appearance, and behavior of the second avatar in the virtual space.
5. The information processing device according to claim 4, characterized in that the judgment means judges whether the value of the vital sign of the first user is above a threshold value, and if it is determined as a result of the judgment that the value is above the threshold value, judges that the second avatar is the specific avatar based on the gaze information of the first user and the position information of the second avatar.
6. A storage means for storing in advance specific information for identifying the specific avatar, The information processing apparatus according to claim 4 , wherein the determining means determines whether the second avatar is the specific avatar based on the second avatar information and the specific information.
7. The information processing device according to claim 1, characterized in that, as a processing for the specific avatar, the processing means sets a no-entry area between the first avatar and the second avatar in the virtual space, prohibiting the second avatar from entering.
8. The information processing device described in claim 7, characterized in that when the second avatar enters the no-entry area, the processing means changes the position of the second avatar in the virtual space to outside the no-entry area as processing for the specific avatar.
9. The information processing device according to claim 8, characterized in that if the second avatar moves toward the no-entry area despite the position of the second avatar being changed in the virtual space, the processing means prohibits further movement of the second avatar.
10. The information processing device according to claim 8, characterized in that, when the second avatar has entered the forbidden area, the processing means notifies the user that the second avatar has entered the forbidden area as processing for the specific avatar.
11. 8. The information processing apparatus according to claim 7, further comprising a change unit for changing the size of the no-entry area.
12. The information processing apparatus according to claim 1 , wherein the processing means reduces a distance between the first avatar and the second avatar in the virtual space as the processing for the specific avatar.
13. 2. The information processing apparatus according to claim 1, further comprising display means for displaying an image of the virtual space.
14. 14. The information processing device according to claim 13, which is a head-mounted display.
15. A method for controlling an information processing device that processes information in a virtual space, comprising: a user information acquiring step of acquiring user information relating to a first user, the first user being a user who uses the information processing device; an avatar information acquiring step of acquiring first avatar information on a first avatar representing the first user in the virtual space and second avatar information on a second avatar representing a second user other than the first user in the virtual space; a determining step of determining whether the second avatar is a specific avatar based on at least the user information; A control method for an information processing device, comprising: a processing step of performing processing on the specific avatar when it is determined in the judgment step that the second avatar is the specific avatar.
16. 2. A program for causing a computer to execute each of the means of the information processing apparatus according to claim 1.